RESUMO
BACKGROUND: Heart failure (HF) affects 6.2 million Americans and is a leading cause of hospitalization. The mainstay of the management of HF is adherence to pharmacotherapy. Despite the effectiveness of HF pharmacotherapy, effectiveness is closely linked to adherence. Measuring adherence to HF pharmacotherapy is difficult; most clinical measures use indirect strategies such as calculating pharmacy refill data or using self-report. While helpful in guiding treatment adjustments, indirect measures of adherence may miss the detection of suboptimal adherence and co-occurring structural barriers associated with nonadherence. Digital pill systems (DPSs), which use an ingestible radiofrequency emitter to directly measure medication ingestions in real-time, represent a strategy for measuring and responding to nonadherence in the context of HF pharmacotherapy. Previous work has demonstrated the feasibility of using DPSs to measure adherence in other chronic diseases, but this strategy has yet to be leveraged for individuals with HF. OBJECTIVE: We aim to explore through qualitative interviews the facilitators and barriers to using DPS technology to monitor pharmacotherapy adherence among patients with HF. METHODS: We conducted individual, semistructured qualitative interviews and quantitative assessments between April and August 2022. A total of 20 patients with HF who were admitted to the general medical or cardiology service at an urban quaternary care hospital participated in this study. Participants completed a qualitative interview exploring the overall acceptability of and willingness to use DPS technology for adherence monitoring and perceived barriers to DPS use. Quantitative assessments evaluated HF history, existing medication adherence strategies, and attitudes toward technology. We analyzed qualitative data using applied thematic analysis and NVivo software (QSR International). RESULTS: Most participants (12/20, 60%) in qualitative interviews reported a willingness to use the DPS to measure HF medication adherence. Overall, the DPS was viewed as useful for increasing accountability and reinforcing adherence behaviors. Perceived barriers included technological issues, a lack of need, additional costs, and privacy concerns. Most were open to sharing adherence data with providers to bolster clinical care and decision-making. Reminder messages following detected nonadherence were perceived as a key feature, and customization was desired. Suggested improvements are primarily related to the design and usability of the Reader (a wearable device). CONCLUSIONS: Overall, individuals with HF perceived the DPS to be an acceptable and useful tool for measuring medication adherence. Accurate, real-time ingestion data can guide adherence counseling to optimize adherence management and inform tailored behavioral interventions to support adherence among patients with HF.
RESUMO
For marginalized populations with ongoing HIV epidemics, alternative methods are needed for understanding the complexities of HIV risk and delivering prevention interventions. Due to lack of engagement in ambulatory care, such groups have high utilization of drop-in care. Therefore, emergency departments represent a location with those at highest risk for HIV and in highest need of novel prevention methods. Digital phenotyping via data collected from smartphones and other wearable sensors could provide the innovative vehicle for examining complex HIV risk and assist in delivering personalized prevention interventions. However, there is paucity in exploring if such methods are an option. This study aimed to fill this gap via a cross-sectional psychosocial assessment with a sample of N=85 emergency department patients with HIV risk. Findings demonstrate that although potentially feasible, acceptability of digital phenotyping is questionable. Technology-assisted HIV prevention needs to be designed with the target community and address key ethical considerations.
RESUMO
BACKGROUND: Electronic paper (E-paper) screens use electrophoretic ink to provide paper-like low-power displays with advanced networking capabilities that may potentially serve as an alternative to traditional whiteboards and television display screens in hospital settings. E-paper may be leveraged in the emergency department (ED) to facilitate communication. Providing ED patient status updates on E-paper screens could improve patient satisfaction and overall experience and provide more equitable access to their health information. OBJECTIVE: We aimed to pilot a patient-facing digital whiteboard using E-paper to display relevant orienting and clinical information in real time to ED patients. We also sought to assess patients' satisfaction after our intervention and understand our patients' overall perception of the impact of the digital whiteboards on their stay. METHODS: We deployed a 41-inch E-paper digital whiteboard in 4 rooms in an urban, tertiary care, and academic ED and enrolled 110 patients to understand and evaluate their experience. Participants completed a modified Hospital Consumer Assessment of Health Care Provider and Systems satisfaction questionnaire about their ED stay. We compared responses to a matched control group of patients triaged to ED rooms without digital whiteboards. We designed the digital whiteboard based on iterative feedback from various departmental stakeholders. After establishing IT infrastructure to support the project, we enrolled patients on a convenience basis into a control and an intervention (digital whiteboard) group. Enrollees were given a baseline survey to evaluate their comfort with technology and an exit survey to evaluate their opinions of the digital whiteboard and overall ED satisfaction. Statistical analysis was performed to compare baseline characteristics as well as satisfaction. RESULTS: After the successful prototyping and implementation of 4 digital whiteboards, we screened 471 patients for inclusion. We enrolled 110 patients, and 50 patients in each group (control and intervention) completed the study protocol. Age, gender, and racial and ethnic composition were similar between groups. We saw significant increases in satisfaction on postvisit surveys when patients were asked about communication regarding delays (P=.03) and what to do after discharge (P=.02). We found that patients in the intervention group were more likely to recommend the facility to family and friends (P=.04). Additionally, 96% (48/50) stated that they preferred a room with a digital whiteboard, and 70% (35/50) found the intervention "quite a bit" or "extremely" helpful in understanding their ED stay. CONCLUSIONS: Digital whiteboards are a feasible and acceptable method of displaying patient-facing data in the ED. Our pilot suggested that E-paper screens coupled with relevant, real-time clinical data and packaged together as a digital whiteboard may positively impact patient satisfaction and the perception of the facility during ED visits. Further study is needed to fully understand the impact on patient satisfaction and experience. TRIAL REGISTRATION: ClinicalTrials.gov NCT04497922; https://clinicaltrials.gov/ct2/show/NCT04497922.
RESUMO
BACKGROUND: Vocal biomarker-based machine learning approaches have shown promising results in the detection of various health conditions, including respiratory diseases, such as asthma. OBJECTIVE: This study aimed to determine whether a respiratory-responsive vocal biomarker (RRVB) model platform initially trained on an asthma and healthy volunteer (HV) data set can differentiate patients with active COVID-19 infection from asymptomatic HVs by assessing its sensitivity, specificity, and odds ratio (OR). METHODS: A logistic regression model using a weighted sum of voice acoustic features was previously trained and validated on a data set of approximately 1700 patients with a confirmed asthma diagnosis and a similar number of healthy controls. The same model has shown generalizability to patients with chronic obstructive pulmonary disease, interstitial lung disease, and cough. In this study, 497 participants (female: n=268, 53.9%; <65 years old: n=467, 94%; Marathi speakers: n=253, 50.9%; English speakers: n=223, 44.9%; Spanish speakers: n=25, 5%) were enrolled across 4 clinical sites in the United States and India and provided voice samples and symptom reports on their personal smartphones. The participants included patients who are symptomatic COVID-19 positive and negative as well as asymptomatic HVs. The RRVB model performance was assessed by comparing it with the clinical diagnosis of COVID-19 confirmed by reverse transcriptase-polymerase chain reaction. RESULTS: The ability of the RRVB model to differentiate patients with respiratory conditions from healthy controls was previously demonstrated on validation data in asthma, chronic obstructive pulmonary disease, interstitial lung disease, and cough, with ORs of 4.3, 9.1, 3.1, and 3.9, respectively. The same RRVB model in this study in COVID-19 performed with a sensitivity of 73.2%, specificity of 62.9%, and OR of 4.64 (P<.001). Patients who experienced respiratory symptoms were detected more frequently than those who did not experience respiratory symptoms and completely asymptomatic patients (sensitivity: 78.4% vs 67.4% vs 68%, respectively). CONCLUSIONS: The RRVB model has shown good generalizability across respiratory conditions, geographies, and languages. Results using data set of patients with COVID-19 demonstrate its meaningful potential to serve as a prescreening tool for identifying individuals at risk for COVID-19 infection in combination with temperature and symptom reports. Although not a COVID-19 test, these results suggest that the RRVB model can encourage targeted testing. Moreover, the generalizability of this model for detecting respiratory symptoms across different linguistic and geographic contexts suggests a potential path for the development and validation of voice-based tools for broader disease surveillance and monitoring applications in the future.
Assuntos
Asma , COVID-19 , Doença Pulmonar Obstrutiva Crônica , Insuficiência Respiratória , Humanos , Feminino , Idoso , COVID-19/diagnóstico , Tosse/diagnóstico , Asma/diagnóstico , Doença Pulmonar Obstrutiva Crônica/diagnósticoRESUMO
Patients have benefitted from increasingly sophisticated diagnostic and therapeutic innovations over the years. However, the design of the physical hospital environment has garnered less attention. This may negatively impact a patient's experience and health. In areas of the hospital, such as the emergency department (ED), patients may spend hours, or even days, in a windowless environment. Studies have highlighted the importance of natural light and imagery, as they are essential in providing important stimuli to regulate circadian rhythm and orientation, and to mitigate the onset of certain medical conditions. In hospital locations where standard windows may be infeasible, the use of a virtual window may simulate the benefits of an actual window. In this pilot study, we assessed patient experience and orientation with virtual windows in the ED. We demonstrated that virtual windows are an acceptable technology that may improve patient experience and orientation.
RESUMO
Background: Most older adults visit the emergency department (ED) near the end of life without advance care planning (ACP) and thus are at risk of receiving care that does not align with their wishes and values. ED GOAL is a behavioral intervention administered by ED clinicians, which is designed to engage seriously ill older adults in serious illness conversations in the ED. Seriously ill older adults found it acceptable in the ED. However, its potential to be used by nurses remains unclear. Objective: The aim of this study is to identify refinements to adapt an ED-based ACP intervention by eliciting the perspectives of nurses. Design: This is a qualitative study using semistructured interviews. Data were analyzed using axial coding methods. Setting/Subjects: We recruited a purposeful sample of ED nurses in one urban academic ED and one urban community ED in the northeastern region of the United States. Results: Twenty-five nurses were interviewed (mean age 46 years, 84% female, and mean clinical experience of 16 years). Emerging themes were identified within six domains: (1) nurses' prior experience with serious illness conversations, (2) overall impression of ED GOAL, (3) refinements to ED GOAL, (4) implementation of ED GOAL by ED nurses, (5) specially trained nursing model, and (6) use of telehealth with ED GOAL. Conclusions: ED nurses were generally supportive of using ED GOAL and provided insight into how to best adapt and implement it in their clinical practice. Empirical evidence for adapting ED GOAL to the nursing practice remains to be seen.
Assuntos
Planejamento Antecipado de Cuidados , Serviços Médicos de Emergência , Idoso , Comunicação , Serviço Hospitalar de Emergência , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Pesquisa QualitativaRESUMO
BACKGROUND: Display signage is ubiquitous and essential in hospitals to serve several clerical, operational, and clinical functions, including displaying notices, providing directions, and presenting clinical information. These functions improve efficiency and patient engagement, reduce errors, and enhance the continuity of care. Over time, signage has evolved from analog approaches such as whiteboards and handwritten notices to digital displays such as liquid crystal displays, light emitting diodes, and, now, electronic ink displays. Electronic ink displays are paper-like displays that are not backlit and show content by aligning microencapsulated color beads in response to an applied electric current. Power is only required to generate content and not to retain it. These displays are very readable, with low eye strain; minimize the emission of blue light; require minimal power; and can be driven by several data sources, ranging from virtual servers to electronic health record systems. These attributes make adapting electronic ink displays to hospitals an ideal use case. OBJECTIVE: In this paper, we aimed to outline the use of signage and displays in hospitals with a focus on electronic ink displays. We aimed to assess the advantages and limitations of using these displays in hospitals and outline the various public-facing and patient-facing applications of electronic ink displays. Finally, we aimed to discuss the technological considerations and an implementation framework that must be followed when adopting and deploying electronic ink displays. METHODS: The public-facing applications of electronic ink displays include signage and way-finders, timetables for shared workspaces, and noticeboards and bulletin boards. The clinical display applications may be smaller form factors such as door signs or bedside cards. The larger, ≥40-inch form factors may be used within patient rooms or at clinical command centers as a digital whiteboard to display general information, patient and clinician information, and care plans. In all these applications, such displays could replace analog whiteboards, noticeboards, and even other digital screens. RESULTS: We are conducting pilot research projects to delineate best use cases and practices in adopting electronic ink displays in clinical settings. This will entail liaising with key stakeholders, gathering objective logistical and feasibility data, and, ultimately, quantifying and describing the effect on clinical care and patient satisfaction. CONCLUSIONS: There are several use cases in a clinical setting that may lend themselves perfectly to electronic ink display use. The main considerations to be studied in this adoption are network connectivity, content management, privacy and security robustness, and detailed comparison with existing modalities. Electronic ink displays offer a superior opportunity to future-proof existing practices. There is a need for theoretical considerations and real-world testing to determine if the advantages outweigh the limitations of electronic ink displays.
RESUMO
Background: Nurses are well positioned to initiate advance care planning (ACP) conversations because of their unique strength in communication and central patient-facing role in the interdisciplinary team. Nurse-led ACP conversations have demonstrated promising results in settings outside of the emergency department (ED). Understanding ED nurses' perspectives regarding ACP conversations is needed before implementing similar practices in the ED. Objective: To explore ED nurses' perception of facilitating ACP conversations. Design: We conducted a cross-sectional survey to assess ED nurses' perceptions of facilitating ACP conversations in the ED. Setting: ED nurses at one academic hospital and one community hospital located within the northeastern region of the United States. Results: Seventy-seven (53.1%) out of 145 eligible ED nurses completed the survey. All participants perceived ACP conversations in the ED as at least somewhat important. Forty (51.9%) felt somewhat comfortable in facilitating these conversations. The majority of participants (77.9%) agreed that a specially trained nurse consultation model might be helpful in the ED. We found a correlation between total clinical experience and interest in facilitating ACP conversations in the ED (p = 0.045). Conclusion: ED nurses are well positioned to help patients clarify their goals-of-care and end-of-life care preferences. They perceived ACP conversations to be important and felt comfortable to facilitate them in the ED. Additional studies are needed to empirically test its implementation.
RESUMO
Wearable devices to detect changes in health status are increasingly adopted by consumers, yet hospitals remain slow to assimilate these devices into clinical practice. Despite the clear benefits of capturing clinical information in acutely ill patients, such technology remains difficult to implement in emergency medicine. To improve adoption, barriers must first be removed. In our technical feasibility and acceptability trial, we studied the deployment of a wearable wireless biosensor that collects physiological data. We enrolled 44 adult patients receiving care in an emergency department observation unit. After we consented patients for participation, we applied biosensors to their chest and collected basic demographic and clinical information. We then collected biosensor data on an isolated system and measured patient experience via an exit survey. Throughout this process we documented and studied technical challenges. Overall, the technology was feasible to deploy in the emergency department observation unit and was acceptable to participants. Such technologies have tremendous future operational and clinical implications in settings ranging from emergency to home-care.
RESUMO
OBJECTIVE: Emergency clinicians face elevated rates of burnout that result in poor outcomes for clinicians, patients, and health systems. The objective of this single-arm pilot study was to evaluate the feasibility of a Transcendental Meditation (TM) intervention for emergency clinicians during the coronavirus disease 2019 (COVID-19) pandemic and to explore the potential effectiveness in improving burnout, sleep, and psychological health. METHODS: Emergency clinicians (physicians, nurses, and physician-assistants) from 2 urban hospitals were recruited to participate in TM instruction (8 individual or group in-person and remote sessions) for 3 months. Session attendance was the primary feasibility outcome (prespecified as attending 6/8 sessions), and burnout was the primary clinical outcome. Participant-reported measures of feasibility and validated measures of burnout, depression, anxiety, sleep disturbance, and stress were collected at baseline and the 1-month and 3-month follow-ups. Descriptive statistics and linear mixed-effects models were used. RESULTS: Of the 14 physicians (46%), 7 nurses (22%), and 10 physician-assistants (32%) who participated, 61% were female (n = 19/32). TM training and at-home meditation practice was feasible for clinicians as 90.6% (n = 29/32) attended 6/8 training sessions and 80.6% self-reported meditating at least once a day on average. Participants demonstrated significant reductions in burnout (P < .05; effect sizes, Cohen's d = 0.43-0.45) and in symptoms of depression, anxiety, stress, and sleep disturbance (P values < .001; Cohen's d = 0.70-0.87). CONCLUSION: TM training was feasible for emergency clinicians during the COVID-19 pandemic and led to significant reductions in burnout and psychological symptoms. TM is a safe and effective meditation tool to improve clinicians' well-being.
RESUMO
Background: Advance care planning (ACP) conversations are an important intervention to provide care consistent with patient goals near the end of life. The emergency department (ED) could serve as an important time and location for these conversations. Objectives: To determine the feasibility of an ED-based, brief negotiated interview (BNI) to stimulate ACP conversations among seriously ill older adults. Methods: We conducted a pre/postintervention study in the ED of an urban, tertiary care, academic medical center. From November 2017 to May 2019, we prospectively enrolled adults ≥65 years of age with serious illness. Trained clinicians conducted the intervention. We measured patients' ACP engagement at baseline and follow-up (3 ± 1 weeks) and reviewed electronic medical record documentation of ACP (e.g., medical order for life-sustaining treatment [MOLST]). Results: We enrolled 51 patients (mean age = 71; SD 12), 41% were female, and 51% of patients had metastatic cancer. Median duration of the intervention was 11.8 minutes; few (6%) of the interventions were interrupted. We completed follow-up for 61% of participants. Patients' self-reported ACP engagement increased from 3.0 to 3.7 out of 5 after the intervention (p < 0.01). Electronic documentation of health care proxy forms increased (75%-94%, n = 48) as did MOLST (0%-19%, n = 48) during the six months after the ED visit. Conclusion: A novel, ED-based, BNI intervention to stimulate ACP conversations for seriously ill older adults is feasible and may improve ACP engagement and documentation.
Assuntos
Planejamento Antecipado de Cuidados , Intervenção em Crise , Idoso , Comunicação , Serviço Hospitalar de Emergência , Estudos de Viabilidade , Feminino , Humanos , MasculinoRESUMO
BACKGROUND: Emergency physicians face the challenge of relieving acute pain daily. While opioids are a potent treatment for pain, the opioid epidemic has ignited a search for nonopioid analgesic alternatives that may decrease the dose or duration of opioid exposure. While behavioral therapies and complementary medicine are effective, they are difficult to deploy in the emergency department. Music is a potential adjunctive therapy that has demonstrated effectiveness in managing pain. OBJECTIVE: Our objective was to understand the feasibility and potential for an effect of a novel music app to address acute pain and anxiety in patients admitted to an emergency department observation unit. METHODS: This prospective cohort study enrolled patients admitted to an emergency department observation unit with pain who had received orders for opioids. We gathered baseline pain and psychosocial characteristics including anxiety, sleep disturbance, and pain catastrophizing using validated questionnaires. Participants received a smartphone-based music intervention and listened to the music in either a supervised (research assistant-delivered music session 3 times during their stay) or unsupervised manner (music used ad lib by participant). The app collected premusic and postmusic pain and anxiety scores, and participants provided qualitative feedback regarding acceptability of operating the music intervention. RESULTS: We enrolled 81 participants and randomly assigned 38 to an unsupervised and 43 to a supervised group. Mean pain in both groups was 6.1 (1.8) out of a possible score of 10. A total of 43 (53%) reported previous use of music apps at home. We observed an overall modest but significant decrease in pain (mean difference -0.81, 95% CI -0.45 to -1.16) and anxiety (mean difference -0.72, 95% CI -0.33 to -1.12) after music sessions. Reduction of pain and anxiety varied substantially among participants. Individuals with higher baseline pain, catastrophizing (about pain), or anxiety reported greater relief. Changes in pain were correlated to changes in anxiety (Pearson ρ=0.3, P=.02) but did not vary between supervised and unsupervised groups. Upon conclusion of the study, 46/62 (74%) reported they liked the music intervention, 57/62 (92%) reported the app was easy to use, and 49/62 (79%) reported they would be willing to use the music intervention at home. CONCLUSIONS: A smartphone-based music intervention decreased pain and anxiety among patients in an emergency department observation unit, with no difference between supervised and unsupervised use. Individuals reporting the greatest reduction in pain after music sessions included those scoring highest on baseline assessment of catastrophic thinking, suggesting there may be specific patient populations that may benefit more from using music as an analgesic adjunct in the emergency department. Qualitative feedback suggested that this intervention was feasible and acceptable by emergency department patients.
Assuntos
Musicoterapia/métodos , Dor/psicologia , Adulto , Serviço Hospitalar de Emergência , Feminino , Humanos , Masculino , Aplicativos Móveis , Estudos Prospectivos , SmartphoneRESUMO
Pain is an unpleasant experience the neurobiology of which is influenced by psychosocial factors including negative affect. Music is a ubiquitous experience that can improve affect, potentially decreasing anxiety and catastrophizing, both of which are associated with greater pain severity. We hypothesized that a machine-learning generative music intervention in the form of a smartphone web app (Unwind) could be used to modulate the experience of pain. In this pilot study, we recruited 15 individuals with acute pain who were admitted to an observation unit in the emergency department, and were being treated with opioids. Participants used the music intervention (Unwind) during this brief hospitalization, after which we assessed their response to its use through a semi-structured qualitative interview. Overall, participants responded positively to Unwind. While some reported some technical challenges, participants were willing to continue using it at home. In particular, participants reported using Unwind to address their anxiety, and many used it to facilitate sleep in the presence of pain. This study demonstrates that individuals with acute pain will accept and use a smartphone-based music protocol.
RESUMO
BACKGROUND: Most seriously ill older adults visit the emergency department (ED) near the end of life, yet no feasible method exists to empower them to formulate their care goals in this setting. OBJECTIVE: To develop an intervention to empower seriously ill older adults to formulate their future care goals in the ED. DESIGN: Prospective intervention development study. SETTING: In a single, urban, academic ED, we refined the prototype intervention with ED clinicians and patient advisors. We tested the intervention for its acceptability in English-speaking patients ≥65 years old with serious illness or patients whose treating ED clinician answered "No" to the "surprise question" ("would not be surprised if died in the next 12 months"). We excluded patients with advance directives or whose treating ED clinician determined the patient to be inappropriate. MEASUREMENTS: Our primary outcome was perceived acceptability of our intervention. Secondary outcomes included perceived main intent and stated attitude toward future care planning. RESULTS: We refined the intervention with 16 mock clinical encounters of ED clinicians and patient advisors. Then, we administered the refined intervention to 23 patients and conducted semistructured interviews afterward. Mean age of patients was 76 years, 65% were women, and 43% of patients had metastatic cancer. Most participants (n = 17) positively assessed our intervention, identified questions for their doctors, and reflected on how they feel about their future care. CONCLUSION: An intervention to empower seriously ill older adults to understand the importance of future care planning in the ED was developed, and they found it acceptable.
Assuntos
Planejamento Antecipado de Cuidados , Serviço Hospitalar de Emergência , Objetivos , Autonomia Pessoal , Idoso , Idoso de 80 Anos ou mais , Tomada de Decisões , Feminino , Humanos , Entrevistas como Assunto , Masculino , Prognóstico , Estudos ProspectivosRESUMO
CONTEXT: Emergency department (ED) visits provide opportunities to empower patients to discuss advance care planning with their outpatient clinicians, but systematically developed, feasible interventions do not currently exist. Brief negotiated interview (BNI) interventions, which allow ED clinicians to efficiently motivate patients, have potential to meet this need. OBJECTIVES: We developed a BNI ED intervention to empower older adults with life-limiting illness to formulate and communicate medical care goals to their primary outpatient clinicians. This study assessed the fidelity and feasibility of this intervention in a high-volume ED. METHODS: We enrolled adult patients with serious illnesses (advanced cancer, congestive heart failure, chronic obstructive pulmonary disease, chronic kidney disease on dialysis, predicted survival <12 months) in an urban, tertiary care academic medical center ED. All participants received the BNI intervention. We video-recorded the encounters. Two reviewers assessed the recordings for intervention fidelity based on adherence to the BNI steps (Part I) and communication skills (Part II). RESULTS: We reviewed 46 video recordings. The mean total adherence score was 21.07/27 (SD 3.68) or 78.04%. The Part I mean adherence score was 12.07/15 (SD 2.07) or 80.47%. The Part II mean adherence score was 9.0/12 (SD 2.51) or 75%. The majority (75.6%) of recordings met the prespecified threshold for high intervention fidelity. CONCLUSION: ED clinicians can deliver a BNI intervention to increase advance care planning conversations with high fidelity. Future research is needed to study the intervention's efficacy in a wider patient population.
Assuntos
Planejamento Antecipado de Cuidados , Estado Terminal , Serviços Médicos de Emergência/métodos , Participação do Paciente/métodos , Adulto , Idoso , Idoso de 80 Anos ou mais , Assistência Ambulatorial/métodos , Estado Terminal/psicologia , Serviço Hospitalar de Emergência , Estudos de Viabilidade , Feminino , Comunicação em Saúde , Humanos , Masculino , Pessoa de Meia-Idade , Cooperação do Paciente , Participação do Paciente/psicologia , Médicos de Atenção Primária , Projetos Piloto , Atenção Primária à Saúde/métodos , Gravação em VídeoRESUMO
BACKGROUND: Implementing large-scale multi-site objective structured clinical examination (OSCEs) for national competency examination in a low resource country is challenging. AIMS: To describe the first national OSCE for national competency examination of medical doctors in Indonesia and evaluate the reliability, validity, feasibility, acceptability, and educational impact. METHODS: We collected electronically the OSCE scores from 49 out of 73 medical schools that participated to assess reliability and validity. We conducted electronic survey to examiners, examinees, SP trainers, and OSCE coordinators to assess feasibility, acceptability, and educational impact. RESULTS: The Cronbach's alpha coefficient across station was 0.79. There was strong correlation between rubric and global rating scores in each station (coefficient correlation ranges from 0.705 to 0.82). The content validity ratio was 0.97. The coefficient correlation between OSCE and MCQ was 0.335 (p = 0.00). All 49 medical schools were able to conduct OSCE simultaneously. Examiners, examinees, SP trainers, and OSCE coordinators had good perception regarding feasibility and acceptability of OSCE. Both examiners and examinees indicated good educational impact of OSCE application. The cutting score based on the borderline regression method was 61.96%. There were 67.39% of the examinees achieved similar or above the cutting score. CONCLUSION: With 12 stations 15 min each, the reliability coefficient across station is intermediate. Content validity is good. It is feasible and acceptable to implement large-scale multi-site OSCEs in Indonesia. Examiners and examinees perceive good educational impact on OSCE implementation.