Physician perceptions of documentation methods in electronic health records.

This study sought to determine physician, specialty and practice factors influencing choice of method for electronic health record (EHR) documentation: direct typing (DT), electronic transcription (ET), human transcription (HT), and scribes. A survey assessing physician documentation practices was developed and distributed online. The primary outcome was the proportion of physicians using each method. Secondary outcomes were provider-rated accuracy, efficiency, and ease of navigation on a 1-5 Likert scale. Means were compared using linear mixed models with Bonferroni adjustment. The 818 respondents were mostly outpatient (46%) adult (79%) physicians, practiced for a mean 15.8 years, and used DT for EHR documentation (72%). Emergency physicians were more likely to use scribes (p < 0.0001). DT was rated less efficient than all other methods (p < 0.0001). ET was rated less accurate than DT (p < 0.001) and HT (p < 0.001). HT was rated less easy to navigate than DT (p = 0.002) and scribe (p < 0.001), and ET less than scribe (p = 0.002). Two hundred and forty-three respondents provided free-text comments that further described opinions. DT was the most commonly used EHR method but rated least efficient. Scribes were rated easy to navigate and efficient but infrequently used outside of emergency settings. Further innovation is needed to design systems responsive to all physician EHR needs.

Expanding OSCE-related Learning Opportunities For Pre-Clerkship Students: Insights From an Assessment for Learning Curriculum.

Pre-clerkship clinical skills courses at many medical schools use objective structured clinical examinations (OSCEs) to assess students' development as it relates to the foundational clinical skills of history taking, communication, and physical examination. The authors report on a curriculum in which OSCEs also serve as a springboard for additional learning by linking them to activities that include patient write-ups, oral presentations, clinical reasoning discussions, clinical question generation, and video review with faculty. The rationale for using OSCEs as an assessment for learning tool is discussed, and some lessons learned are reported.

The Reliability of 2-Station Clerkship Objective Structured Clinical Examinations in Isolation and in Aggregate.

BACKGROUND: Most medical schools in the United States report having a 5- to 10-station objective structured clinical examination (OSCE) at the end of the core clerkship phase of the curriculum to assess clinical skills. We set out to investigate an alternative OSCE structure in which each clerkship has a 2-station OSCE. This study looked to determine the reliability of clerkship OSCEs in isolation to inform composite clerkship grading, as well as the reliability in aggregate, as a potential alternative to an end-of-third-year examination. DESIGN: Clerkship OSCE data from the 2017-2018 academic year were analyzed: the generalizability coefficient (ρ2) and index of dependability (φ) were calculated for clerkships in isolation and in aggregate using variance components analysis. RESULTS: In all, 93 students completed all examinations. The average generalizability coefficient for the individual clerkships was .47. Most often, the largest variance component was the interaction between the student and the station, indicating inconsistency in the performance of students between the 2 stations. Aggregate clerkship OSCE analysis demonstrated good reliability for consistency (ρ2 = .80). About one-third (33.8%) of the variance can be attributed to students, 8.2% can be attributed to the student by clerkship interaction, and 42.6% can be attributed to the student by block interaction, indicating that students' relative performances varied by block. CONCLUSIONS: Two-station clerkship OSCEs have poor to fair reliability, and this should inform the weighting of the composite clerkship grade. Aggregating data results in good reliability. The largest source of variance in the aggregate was student by block, suggesting testing over several blocks may have advantages compared with a single day examination.

Recording Out-of-Hospital Cardiac Arrest Treatment via a Mobile Smartphone Application: A Feasibility Simulation Study.

BACKGROUND: Given the demanding nature of out-of-hospital cardiac arrest (OHCA) resuscitations, recordings of the times of interventions in EMS patient care reports (PCRs) are often inaccurate. The American Heart Association developed Full Code Pro (FCP), a smartphone application designed to assist EMS personnel in recording the timing of interventions performed. Through OHCA simulations, this study assessed the group size necessary to use the FCP recording functions accurately and safely without compromising patient care. Program evaluation was based on participant feedback surveys, data accuracy, delays between recording and performing interventions, and delays in care attributed to using the application, stratified by group size. METHODS: Simulations of a standard OHCA scenario using the Gaumard TraumaHal mannequin and a dedicated iPhone 5 preloaded with FCP version 3.4 were run with group sizes of 2-6 participants, with group sizes determined by participant availability. Participants included Connecticut certified paramedics and paramedic students who had completed the appropriate coursework. A 7-item feedback survey using a Likert scale established participant feedback on the application. Videos of the simulations were analyzed to assess for delays. One-way analysis of variance with trend analysis was used to test whether outcomes differed by group size and whether differences tended in one direction in parallel with group size. RESULTS: There were 37 simulations, including 142 participants. The feedback survey questions achieved a Cronbach's alpha of 0.91, signifying high reliability, and demonstrated a linear trend supporting greater satisfaction with FCP as group size increases (p < 0.001). Similarly, increasing group size displayed linear trends with greater numbers of interventions recorded (p = 0.009) and fewer missed and false recordings (p = 0.002). Delays revealed significant linear trends (p = 0.018 for delays in recording and p < 0.001 for delays in care), as increasing group size corresponded with lesser delays. Greatest improvement was noted to be between groups of 3 and 4 participants. CONCLUSIONS: OHCA simulations using FCP demonstrate increased provider comfort, increased recording accuracy, and decreased delays as the group size increased. While the application may improve recordings for PCRs and future research, the data suggest a sufficient number of EMS personnel (>3) should be present to achieve reliable data without compromising patient care.

Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings.

BACKGROUND: Performance feedback is considered essential to clinical skills development. Formative objective structured clinical exams (F-OSCEs) often include immediate feedback by standardized patients. Students can also be provided access to performance metrics including scores, checklists, and video recordings after the F-OSCE to supplement this feedback. How often students choose to review this data and how review impacts future performance has not been documented. OBJECTIVE: We suspect student review of F-OSCE performance data is variable. We hypothesize that students who review this data have better performance on subsequent F-OSCEs compared to those who do not. We also suspect that frequency of data review can be improved with faculty involvement in the form of student-faculty debriefing meetings. DESIGN: Simulation recording software tracks and time stamps student review of performance data. We investigated a cohort of first- and second-year medical students from the 2015-16 academic year. Basic descriptive statistics were used to characterize frequency of data review and a linear mixed-model analysis was used to determine relationships between data review and future F-OSCE performance. RESULTS: Students reviewed scores (64%), checklists (42%), and videos (28%) in decreasing frequency. Frequency of review of all metric and modalities improved when student-faculty debriefing meetings were conducted (p<.001). Among 92 first-year students, checklist review was associated with an improved performance on subsequent F-OSCEs (p = 0.038) by 1.07 percentage points on a scale of 0-100. Among 86 second year students, no review modality was associated with improved performance on subsequent F-OSCEs. CONCLUSION: Medical students review F-OSCE checklists and video recordings less than 50% of the time when not prompted. Student-faculty debriefing meetings increased student data reviews. First-year student's review of checklists on F-OSCEs was associated with increases in performance on subsequent F-OSCEs, however this outcome was not observed among second-year students.

The Impact of Medical Student Participation in Emergency Medicine Patient Care on Departmental Press Ganey Scores.

INTRODUCTION: Press Ganey (PG) scores are used by public entities to gauge the quality of patient care from medical facilities in the United States. Academic health centers (AHCs) are charged with educating the new generation of doctors, but rely heavily on PG scores for their business operation. AHCs need to know what impact medical student involvement has on patient care and their PG scores. PURPOSE: We sought to identify the impact students have on emergency department (ED) PG scores related to overall visit and the treating physician's performance. METHODS: This was a retrospective, observational cohort study of discharged ED patients who completed PG satisfaction surveys at one academic, and one community-based ED. Outcomes were responses to questions about the overall visit assessment and doctor's care, measured on a five-point scale. We compared the distribution of responses for each question through proportions with 95% confidence intervals (CIs) stratified by medical student participation. For each question, we constructed a multivariable ordinal logistic regression model including medical student involvement and other independent variables known to affect PG scores. RESULTS: We analyzed 2,753 encounters, of which 259 (9.4%) had medical student involvement. For all questions, there were no appreciable differences in patient responses when stratifying by medical student involvement. In regression models, medical student involvement was not associated with PG score for any outcome, including overall rating of care (odds ratio [OR] 1.10, 95% CI [0.90-1.34]) or likelihood of recommending our EDs (OR 1.07, 95% CI [0.86-1.32]). Findings were similar when each ED was analyzed individually. CONCLUSION: We found that medical student involvement in patient care did not adversely impact ED PG scores in discharged patients. Neither overall scores nor physician-specific scores were impacted. Results were similar at both the academic medical center and the community teaching hospital at our institution.

Use of a secure social media platform to facilitate reflection in a residency program.

BACKGROUND: Reflective writing is used to promote learning and professional growth in medical education. Sharing reflections with peers and supervisors facilitates feedback that enhances understanding. OBJECTIVE: We explored the feasibility of using a secure social media platform to share reflections and promote reflective discussions in an emergency medicine residency program. METHODS: This was a prospective pilot investigation evaluated with a poststudy opinion survey. Reflective discussions were also described using basic quantitative and qualitative methods. RESULTS: The 2-month, voluntary, pilot study included 21 faculty and 36 residents. Faculty posted reflections and replies (n  =  146) more frequently than residents did (n  =  48). Survey data suggested both groups found the platform engaging and easy to use, valued the security of the platform, and felt the conversations were valuable to their professional development. CONCLUSIONS: Secure social media offers a feasible option for sharing reflections and facilitating reflective discussions in medical education.

A tiered mentorship program improves number of students with an identified mentor.

BACKGROUND: Mentorship is critical to professional development and academic success. Unfortunately, only about 40% of medical students can identify a mentor. While group mentorship has been evaluated - the concept of a specialty specific, tiered group mentorship program (TGMP) has not. In the latter, each member of the group represents a unique education or professional level. PURPOSE: The purpose of this study was to investigate the ability of a specialty-specific, tiered group mentorship program to improve mentorship for students interested in emergency medicine. METHODS: Groups consisted of faculty members, residents, 4th-year students pursuing a career in Emergency Medicine, and junior (MS1, MS2, and MS3) medical students (13 total groups). Students completed confidential electronic surveys before and after completion of the program. RESULTS: Of 126 students, 85 completed the Course Evaluation Survey. At program onset, 11.4% of 1st-year students, 41.7% of 2nd-year students, 50% of 3rd-year students, and 28% of the total students could identify a mentor. After completion, 68.6% of 1st years, 83.3% of 2nd years, 90% of 3rd years, and 77.6% of the total reported they could identify a mentor. Faculty were rated most important members followed by the 4th-year student. CONCLUSION: A tiered group mentorship program improved the ability of students to identify a mentor. Students identified mentoring relationships from individuals at various professional levels.

Emergency medicine residents' attitudes and opinions of in-training exam preparation.

PURPOSE: Emergency Medicine (EM) residents take the American Board of Emergency Medicine (ABEM) in-training exam, and performance on this exam has been shown to correlate to performance on the ABEM qualifying exam. Though many residencies have in-training exam preparation activities, there is little data on the effectiveness of these efforts. This study aimed to elicit resident perspectives about the exam and exam preparation in order to generate hypotheses and better inform future preparation efforts. METHODS: Second- and third-year EM residents at a single institution were interviewed using a semi-structured format. Qualitative methodology was used to analyze the data. RESULTS: Thirteen EM residents participated in the study. Eight major themes and 18 sub-themes were identified. These were further characterized as relating to the exam itself or to exam preparation. Residents generally value the in-training exam. Sixty-nine percent noted that it provided an assessment of their current knowledge and deficiencies. Thirty-eight percent noted that it improved familiarity with the qualifying exam. Regarding exam preparation, residents stated that a question format was preferred, especially when accompanying explanations were of high quality. Additionally, practical considerations, such as portability, impacted resident selection of study tools. CONCLUSION: Residents value the in-training exam as a marker of their academic progress and for their ability to gain familiarity with the qualifying exam. They prefer question-based preparation over text-based learning, as long as there is a detailed explanation of each answer. Educators creating structured in-training review may want to focus on question-based material with detailed explanations.

Medical student self-assessment narratives: perceived educational needs during fourth-year emergency medicine clerkship.

BACKGROUND: The educational needs of medical students in the 4th-year of training are not well defined in the literature. PURPOSE: The specific aim of this investigation is to characterize the perceived educational needs of 4th-year medical students during an Emergency Medicine clerkship. METHODS: This was a thematic analysis of informed self-assessment narratives. The writings were performed by medical students during an Emergency Medicine clerkship from July 2010 through May 2011. Themes and subthemes that emerged were assessed for frequency of occurrence. RESULTS: Qualitative analysis of 203 narratives revealed 13 themes and 55 subthemes. Patient care (50%), history taking (44%), and physical examination (29%) were the themes most commonly noted as strengths. Medical decision making/plan of care (44%), differential diagnosis (37%), presentation skills (32%), and knowledge base (27%) were the themes most commonly noted as weaknesses. All themes were described as strengths by some students and weaknesses by others; however, trends were apparent in the analysis. CONCLUSIONS: Fourth-year medical students rotating on an Emergency Medicine clerkship perceive an educational need to improve medical decision making/plan of care. Self-assessment narratives reveal trends in strengths and weaknesses but also highlight the importance of recognizing students as unique learners with individualized needs.

Developing and assessing initiatives designed to improve clinical teaching performance.

To improve the teaching performance of emergency physicians, it is necessary to understand the attributes of expert teachers and the optimal methods to deliver faculty development. A working group of medical educators was formed to review the literature, summarize what is known on the topic, and provide recommendations for future research. This occurred as a track of the 2012 Academic Emergency Medicine (AEM) consensus conference "Education Research in Emergency Medicine: Opportunities, Challenges, and Strategies for Success." The group concluded that the current state of research on these topics is limited. Improvement in understanding will come through research focusing on Kirkpatrick's higher levels of evaluation (behavior and results).

The use of reflection in emergency medicine education.

Reflection is a cognitive process in which new information and experiences are integrated into existing knowledge structures and mental models, resulting in meaningful learning. Reflection often occurs after an experience is over, promoting professional development and lifelong learning. However, a reflective emergency physician (EP) is also able to apply reflection in real time: self-monitoring, coping with the unexpected, and quickly thinking on his or her feet to solve complicated, unique, and challenging clinical problems. Reflection is a skill that can be taught and developed in medical education. Evidence demonstrating the value of teaching reflection is emerging that substantiates longstanding educational theories. While a few educators have started to explore the use of reflection for emergency medicine (EM) learners, the potential for broader application exists. This review summarizes the literature regarding reflection in medical education and provides a basic primer for teaching reflection.

The impact of two clinical shift allocation models on student experiences in an emergency medicine clerkship.

BACKGROUND: Medical students on Emergency Medicine (EM) clerkships are traditionally assigned work shifts in a manner that provides a mix of daytime, evening, overnight, and weekend shifts. Whether or not this shift allocation model provides the optimal educational experience remains unclear. PURPOSE: The purpose of this study was to compare the impact of two different shift allocation models on the student's clerkship experience. Specifically, we set out to compare the traditional shift allocation model to a novel model designed to maximize teacher-learner continuity. METHODS: This was a prospective, crossover, cohort study of medical students participating in an EM clerkship at one institution from January 1 through April 31, 2010. All students completed 2 weeks of shifts under the "traditional shift model" and 2 weeks of shifts under the "continuity-based shift model." In the latter, the guiding principle of student shift allocation was continuity between teacher and learner. Students completed coded surveys after each 2-week block that were later matched and analyzed using 2-way ANOVAs with 1 repeated measure. In addition, all students participated in a semistructured group interview at the completion of both blocks. The interviews were recorded, transcribed, and analyzed using qualitative methods. Themes and subthemes that emerged were assessed for frequency of occurrence. RESULTS: Eighteen medical students consented to participate. Students rated the continuity-based shift model higher on all 10 survey items. However, only the items that asked specifically about "faculty"-faculty teaching, faculty interaction, frequency and quality of faculty feedback-were rated significantly higher when students worked under the continuity-based shift model. Qualitative analysis of group interviews revealed 6 major themes and 16 subthemes. Students described feedback (N = 16/117) and the teacher-learner relationship (N = 21/117) as superior under the continuity-based shift model. CONCLUSIONS: Changes in shift allocation affects student experience in an EM clerkship. A shift allocation model that maximizes the continuity between teacher and learner is perceived by students to improve feedback and the teacher-learner relationship.

Pseudohyperkalemia without reported haemolysis in a patient with chronic lymphocytic leukaemia.

Hyperkalemia is a medical condition that requires immediate recognition and treatment to prevent the development of life-threatening arrhythmias. Pseudohyperkalemia is most commonly due to specimen haemolysis and is often recognised by laboratory scientists who subsequently report test results with cautionary warnings. The authors present a case of pseudohyperkalemia in a patient with chronic lymphocytic leukaemia that was the result of white blood cell lysis during phlebotomy. False elevations of potassium from this condition may not be reported with a warning from the laboratory. This places the patient at risk of unnecessary and potentially dangerous treatments. This phenomenon has not been published in the emergency medicine literature to date.

Medical student professionalism narratives: a thematic analysis and interdisciplinary comparative investigation.

BACKGROUND: Professionalism development is influenced by the informal and hidden curriculum. The primary objective of this study was to better understand this experiential learning in the setting of the Emergency Department (ED). Secondarily, the study aimed to explore differences in the informal curriculum between Emergency Medicine (EM) and Internal Medicine (IM) clerkships. METHODS: A thematic analysis was conducted on 377 professionalism narratives from medical students completing a required EM clerkship from July 2008 through May 2010. The narratives were analyzed using established thematic categories from prior research as well as basic descriptive characteristics. Chi-square analysis was used to compare the frequency of thematic categories to prior research in IM. Finally, emerging themes not fully appreciated in the established thematic categories were created using grounded theory. RESULTS: Observations involving interactions between attending physician and patient were most abundant. The narratives were coded as positive 198 times, negative 128 times, and hybrid 37 times. The two most abundant narrative themes involved manifesting respect (36.9%) and spending time (23.7%). Both of these themes were statistically more likely to be noted by students on EM clerkships compared to IM clerkships. Finally, one new theme regarding cynicism emerged during analysis. CONCLUSIONS: This analysis describes an informal curriculum that is diverse in themes. Student narratives suggest their clinical experiences to be influential on professionalism development. Medical students focus on different aspects of professionalism depending on clerkship specialty.

Clinical teaching site does not affect test performance in an emergency medicine clerkship.

OBJECTIVES: Increasing the size of medical school classes has resulted in the use of community hospitals for emergency medicine (EM) clerkships. While differences in clinical experience are expected, it is unclear if they are significant. The authors set out to investigate whether or not clinical site affects student performance on a standard written exam as a measure of medical knowledge. METHODS: This was a retrospective analysis of data from 2005 to 2009 for a mandatory fourth-year EM clerkship at one institution that uses academic (EM residency), hybrid (residency training site but not EM), and community (no residency programs) hospitals as clerkship sites. Multiple variable linear regression was used to examine the relationship between clerkship site and end of clerkship written exam score. Additional covariates included were the time of year the rotation was completed (by 3- or 4-month tertiles) and whether the student matched in EM. As test scores increased over the study period, a time factor was also included to account for this trend. A p-value of <0.05 was required for variable retention in the model. RESULTS: A total of 718 students completed the clerkship and had complete data for analysis. Thirty-five students matched in EM. A total of 311 rotated at academic sites, 304 at hybrid sites, and 103 at community sites. After adjusting for covariates, clinical site was not a significant predictor of exam score (F(2,691) = 0.42, p = 0.65). Factors associated with higher test score were student match in EM (beta coefficient = 3.4, 95% confidence interval [CI] = 1.0 to 5.7) and rotation in July through September (beta coefficient = 1.8, 95% CI = 0.5 to 3.0, against a reference of January through April). No significant interaction terms or confounders were identified. CONCLUSIONS: This study found no evidence that clerkship site affected final exam score. Academic EM clerkships may consider partnering with other hospitals for clinical experiences without compromising education.

Metastatic prostate cancer mimicking polymyalgia rheumatica.

A 59-year-old male presented to the emergency department with a four-month progressive history of proximal muscle pain and weakness with elevated erythrocyte sedimentation rate and C-reactive protein. He was initially diagnosed with polymyalgia rheumatica (PMR) and admitted to the hospital. During his hospitalization he was found to have metastatic prostate cancer, which was thought to be responsible for his PMR-like syndrome. By recognizing the resemblance between metastatic malignancy and rheumatologic diseases, the emergency physician can improve diagnostic accuracy.

Feedback in the emergency medicine clerkship.

OBJECTIVE: Feedback is a technique used in medical education to help develop and improve clinical skills. A comprehensive review article specifically intended for the emergency medicine (EM) educator is lacking, and it is the intent of this article to provide the reader with an in-depth, up-to-date, and evidence-based review of feedback in the context of the EM clerkship. METHODS: The review article is organized in a progressive manner, beginning with the definition of feedback, the importance of feedback in medical education, the obstacles limiting the effective delivery of feedback, and the techniques to overcome these obstacles then follows. The article concludes with practical recommendations to implement feedback in the EM clerkship. To advance the literature on feedback, the concept of receiving feedback is introduced. RESULTS: The published literature regarding feedback is limited but generally supportive of its importance and effectiveness. Obstacles in the way of feedback include time constraints, lack of direct observation, and fear of negative emotional responses from students. Feedback should be timely, expected, focused, based on first-hand data, and limited to behaviors that are remediable. Faculty development and course structure can improve feedback in the EM clerkship. Teaching students to receive feedback is a novel educational technique that can improve the feedback process. CONCLUSION: Feedback is an important educational technique necessary to improve clinical skills. Feedback can be delivered effectively in the EM clerkship.