Real-Time Electronic Patient Portal Use Among Emergency Department Patients.

Importance: Patients with inequitable access to patient portals frequently present to emergency departments (EDs) for care. Little is known about portal use patterns among ED patients. Objectives: To describe real-time patient portal usage trends among ED patients and compare demographic and clinical characteristics between portal users and nonusers. Design, Setting, and Participants: In this cross-sectional study of 12 teaching and 24 academic-affiliated EDs from 8 health systems in California, Connecticut, Massachusetts, Ohio, Tennessee, Texas, and Washington, patient portal access and usage data were evaluated for all ED patients 18 years or older between April 5, 2021, and April 4, 2022. Exposure: Use of the patient portal during ED visit. Main Outcomes and Measures: The primary outcomes were the weekly proportions of ED patients who logged into the portal, viewed test results, and viewed clinical notes in real time. Pooled random-effects models were used to evaluate temporal trends and demographic and clinical characteristics associated with real-time portal use. Results: The study included 1 280 924 unique patient encounters (53.5% female; 0.6% American Indian or Alaska Native, 3.7% Asian, 18.0% Black, 10.7% Hispanic, 0.4% Native Hawaiian or Pacific Islander, 66.5% White, 10.0% other race, and 4.0% with missing race or ethnicity; 91.2% English-speaking patients; mean [SD] age, 51.9 [19.2] years). During the study, 17.4% of patients logged into the portal while in the ED, whereas 14.1% viewed test results and 2.5% viewed clinical notes. The odds of accessing the portal (odds ratio [OR], 1.36; 95% CI, 1.19-1.56), viewing test results (OR, 1.63; 95% CI, 1.30-2.04), and viewing clinical notes (OR, 1.60; 95% CI, 1.19-2.15) were higher at the end of the study vs the beginning. Patients with active portal accounts at ED arrival had a higher odds of logging into the portal (OR, 17.73; 95% CI, 9.37-33.56), viewing test results (OR, 18.50; 95% CI, 9.62-35.57), and viewing clinical notes (OR, 18.40; 95% CI, 10.31-32.86). Patients who were male, Black, or without commercial insurance had lower odds of logging into the portal, viewing results, and viewing clinical notes. Conclusions and Relevance: These findings suggest that real-time patient portal use during ED encounters has increased over time, but disparities exist in portal access that mirror trends in portal usage more generally. Given emergency medicine's role in caring for medically underserved patients, there are opportunities for EDs to enroll and train patients in using patient portals to promote engagement during and after their visits.

Mobile application adjunct to the WHO basic emergency care course: a mixed methods study.

OBJECTIVES: The WHO developed a 5-day basic emergency care (BEC) course using the traditional lecture format. However, adult learning theory suggests that lecture-based courses alone may not promote long-term knowledge retention. We assessed whether a mobile application adjunct (BEC app) can have positive impact on knowledge acquisition and retention compared with the BEC course alone and evaluated perceptions, acceptability and barriers to adoption of such a tool. DESIGN: Mixed-methods prospective cohort study. PARTICIPANTS: Adult healthcare workers in six health facilities in Tanzania who enrolled in the BEC course and were divided into the control arm (BEC course) or the intervention arm (BEC course plus BEC app). MAIN OUTCOME MEASURES: Changes in knowledge assessment scores, self-efficacy and perceptions of BEC app. RESULTS: 92 enrolees, 46 (50%) in each arm, completed the BEC course. 71 (77%) returned for the 4-month follow-up. Mean test scores were not different between the two arms at any time period. Both arms had significantly improved test scores from enrolment (prior to distribution of materials) to day 1 of the BEC course and from day 1 of BEC course to immediately after BEC course completion. The drop-off in mean scores from immediately after BEC course completion to 4 months after course completion was not significant for either arm. No differences were observed between the two arms for any self-efficacy question at any time point. Focus groups revealed five major themes related to BEC app adoption: educational utility, clinical utility, user experience, barriers to access and barriers to use. CONCLUSION: The BEC app was well received, but no differences in knowledge retention and self-efficacy were observed between the two arms and only a very small number of participants reported using the app. Technologic-based, linguistic-based and content-based barriers likely limited its impact.

Signal from the noise: A mixed graphical and quantitative process mining approach to evaluate care pathways applied to emergency stroke care.

OBJECTIVE: Mapping real-world practice patterns vs. deviations from intended guidelines and protocols is necessary to identify and improve the quality of care for emergent medical conditions like acute ischemic stroke. Most status-quo process identification relies on expert opinion or direct observation, which can be biased or limited in scalability. We propose a mixed graphical and quantitative process mining approach to Electronic Health Record (EHR) event log data as a unique opportunity not only to more easily identify practice patterns, but also to compare real-world care processes and measure their conformance or variability. MATERIALS: Data was obtained from the event log of a major EHR vendor (Epic) for Stanford Health Care Hospital patients aged 18 years and older presenting to the ED from January 1, 2010 through December 31, 2018 and receiving tPA (tissue plasminogen activator) within 4.5 h of presentation. METHODS: We developed an unsupervised process-mining algorithm to create a process map from clinical event logs. The method first identifies the most common events across the cohort. Then, all possible ordered events are recorded, and a summarized vector of nodes (events) and edges (events occurring in series) are mapped by their timing and probability. The highest probability ordered pairs are used to identify the most common path. We define measures for individual pathways conformity and average conformity across all encounters. RESULTS: Automatically generated process mining graphs, and specifically it's the most common path, mimicked our institutions recommended "code stroke" clinical pathway. The average conformity score for our cohort was 0.36 (i.e. paths had an average of 36% overlap with all possible paths), with a range from high of 0.64 and low of 0.20. DISCUSSION: This method allows for unsupervised visualization of the current state of common processes as well as their most common path, which can then be used to calculate the conformity of individual pathways through this process. These results may be used to evaluate the consistency of quality care at a given institution. It may also be extended to other common processes like sepsis or myocardial infarction care or even those which currently lack standardized clinical pathways. CONCLUSION: Our mixed graphical and quantitative process mining approach represents an essential data analysis step to improve complex care processes by automatically generating qualitative and quantitative process measures from existing event log data which can then be used to target quality improvement initiatives.

Professional development during a pandemic: a live virtual conference for emergency medicine chief residents.

Limited professional development training exists for chief residents. The available training uses in-person lectures and workshops at annual national conferences. The COVID-19 pandemic prevented most in-person gatherings in 2020, including pivotal onboarding and training events for new chief residents. However, for the last five years, Academic Life in Emergency Medicine's Chief Resident Incubator conducted year-long remote training programs, creating virtual communities of practice for chief residents in emergency medicine (EM). As prior leaders and alumni from the Incubator, we sought to respond to the limitations presented by the pandemic and create an onboarding event to provide foundational knowledge for incoming chief residents. We developed a half-day virtual conference, whereupon 219 EM chief residents enrolled. An effective professional development experience is feasible and scalable using online videoconferencing technologies, especially if constructed with content expertise, psychological safety, and production design in mind.

RéSUMé: Il existe une formation de développement professionnel limitée pour les résidents en chef. La formation disponible utilise des conférences et des ateliers en personne lors de conférences nationales annuelles. La pandémie de COVID-19 a empêché la plupart des rassemblements en personne en 2020, y compris des activités d'intégration et de formation essentielles pour les nouveaux résidents en chef. Cependant, au cours des cinq dernières années, l'incubateur des résidents en chef de Academic Life in Emergency Medicine a organisé des programmes de formation à distance d'un an, créant ainsi des communautés de pratique virtuelles pour les résidents en chef en médecine d'urgence (MU). En tant qu'anciens dirigeants et anciens de l'incubateur, nous avons cherché à répondre aux limites présentées par la pandémie et à créer un événement d'intégration pour fournir des connaissances fondamentales aux nouveaux résidents en chef. Nous avons mis au point une conférence virtuelle d'une demi-journée, à laquelle 219 résidents en chef de MU se sont inscrits. Une expérience de développement professionnel efficace est réalisable et évolutive grâce aux technologies de vidéoconférence en ligne, surtout si elle est construite en tenant compte de l'expertise du contenu, de la sécurité psychologique et de la conception de la production.

Reaching further: Lessons from the implementation of the WHO Basic Emergency Care Course Companion App in Tanzania.

INTRODUCTION: The World Health Organization's (WHO's) Basic Emergency Care (BEC) course was developed to address training gaps in low- and middle-income countries (LMICs). Simultaneously, LMICs have experienced an unprecedented increase in the number of cell phone and internet users. We developed a mobile application adjunct to the BEC course (BEC app) and sought to assess the reach of the BEC app. METHODS: Forty-six BEC course participants, made up of doctors and nurses from three hospital sites in Tanzania, were given access to the BEC app with download instructions. Moderators tracked mobile access characteristics and barriers. This is a descriptive study outlining the implementation of the BEC app and associated findings from the process. RESULTS: Fewer than 10% of participants were able to independently download and use the application. The download process revealed three key barrier areas: accessibility (no smartphone, smartphone without charge, no access to data/WiFi to download app, increased cost of data), technical (outdated operating system, inconsistent access to data/WiFi to run the app, insufficient phone storage), and participant-related characteristics (variability in smartphone literary, language discordance, smartphone turnover). Of the 46 participants, 29 (63%) were able to download and use the BEC app successfully with moderator support. CONCLUSIONS: There is potential utility of mobile health in LMICs. However, barriers still exist to reaching the largest possible audience for these initiatives. The importance of app compatibility with a broad range of operating systems and limitation of the amount of data needed to download and use the app was underscored by our study. Moreover, creative solutions are needed to facilitate large-scale roll-outs of mobile health interventions, such as a distribution model that relies on super user and peer support rather than an individual moderator. Additional local perspectives on the download process and the utilisation and acceptance of the application post-implementation are needed.

ALiEM Connect: Large-Scale, Interactive, Virtual Residency Programming in Response to COVID-19.

PROBLEM: The COVID-19 pandemic restricted in-person gatherings, including residency conferences. The pressure to quickly reorganize educational conferences and convert content to a remote format overwhelmed many programs. This article describes the pilot event of a large-scale, interactive, virtual educational conference modeled, designed, and implemented by Academic Life in Emergency Medicine (ALiEM), called ALiEM Connect. APPROACH: The pilot ALiEM Connect event was conceptualized and implemented within a 2-week period in March 2020. The pilot was livestreamed via a combination of Zoom and YouTube and was archived by YouTube. Slack was used as a backchannel to allow interaction with other participants and engagement with the speakers (via moderators who posed questions from the backchannel to the speakers live during the videoconference). OUTCOMES: The RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework was used for program evaluation, showing that 64 U.S. Accreditation Council for Graduate Medical Education-accredited emergency medicine residency programs participated in the pilot event, with 1,178 unique users during the event (reach). For effectiveness, 93% (139/149) of trainees reported the pilot as enjoyable and 85% (126/149) reported it was equivalent to or better than their usual academic proceedings. Adoption for ALiEM Connect was fairly good with 64/237 (27%) of invited residency programs registering and participating in the pilot event. Implementation was demonstrated by nearly half of the livestream viewers (47%, 553/1,178) interacting in the backchannel discussion, sending a total of 4,128 messages in the first 4 hours. NEXT STEPS: The final component of the RE-AIM framework, maintenance, will take more time to evaluate. Further study is required to measure the educational impact of events like the ALiEM Connect pilot. The ALiEM Connect model could potentially be used to replace educational conferences that have been canceled or to implement and/or augment a large-scale, shared curriculum among residency programs in the future.

Context is Key: Using the Audit Log to Capture Contextual Factors Affecting Stroke Care Processes.

High quality patient care through timely, precise and efficacious management depends not only on the clinical presentation of a patient, but the context of the care environment to which they present. Understanding and improving factors that affect streamlined workflow, such as provider or department busyness or experience, are essential to improving these care processes, but have been difficult to measure with traditional approaches and clinical data sources. In this exploratory data analysis, we aim to determine whether such contextual factors can be captured for important clinical processes by taking advantage of non-traditional data sources like EHR audit logs which passively track the electronic behavior of clinical teams. Our results illustrate the potential of defining multiple measures of contextual factors and their correlation with key care processes. We illustrate this using thrombolytic (tPA) treatment for ischemic stroke as an example process, but the measurement approaches can be generalized to multiple scenarios.