Elucidating system-level interdependence in electronic health record data: What are the ramifications for trainee assessment?

CONTEXT: The electronic health record (EHR) has been identified as a potential site for gathering data about trainees' clinical performance, but these data are not collected or organised for this purpose. Therefore, a careful and rigorous approach is required to explore how EHR data could be meaningfully used for assessment purposes. The purpose of this study was to identify EHR performance metrics that represent both the independent and interdependent clinical performance of emergency medicine (EM) trainees and explore how they might be meaningfully used for assessment and feedback. METHODS: Using constructivist grounded theory, we conducted 21 semi-structured interviews with EM faculty members and residents. Participants were asked to identify the clinical actions of trainees that would be valuable for assessment and feedback and describe how those activities are represented in the EHR. Data collection and analysis, which consisted of three stages of coding, occurred iteratively. RESULTS: When faculty members and trainees in EM were asked to reflect on the usefulness of using EHR performance metrics for resident assessment and feedback they expressed both widespread support for the idea in principle and hesitation that aspects of clinical performance captured in the data would not be representative of residents' individual performance, but would rather reflect their interdependence with other team members and the systems in which they work. We highlight three categorisations of system-level interdependence - medical directives, technological systems and organisational systems - identified by our participants, and discuss strategies participants employed to navigate these forms of interdependence within the health care system. CONCLUSIONS: System-level interdependence shapes physicians' performances, and yet, this impact is rarely corrected for or noted within clinical performance data. Educators have a responsibility to recognise system-level interdependence when teaching and consider system-level interdependence when assessing the performance of trainees in order to most effectively and fairly utilise the EHR as a source of assessment data.

Risk Factors Associated with Urologic Intervention in Emergency Department Patients with Suspected Renal Colic.

BACKGROUND: Whereas most patients with urolithiasis pass their stones spontaneously and require only symptomatic management, a minority will require urologic intervention. OBJECTIVE: Our primary objective was to confirm previously reported risk factors and to identify additional predictors of urologic intervention within 90 days, for emergency department (ED) patients with suspected renal colic. METHODS: We conducted a prospective cohort study of adult patients presenting to one of two tertiary care EDs with suspected renal colic over a 20-month period. Multivariate logistic regression models determined predictor variables independently associated with urologic intervention. RESULTS: Of the 565 patients included in the analysis, 220 (38.9%) patients had a ureteric stone visualized on diagnostic imaging. Eighty-four patients (14.9%) had urologic intervention within 90 days of their initial ED visit. Urinary nitrites (odds ratio [OR] 4.2, 95% confidence interval [CI] 1.3-13.6), stone size ≥ 5 mm (OR 4.2, 95% CI 2.4-7.4), proximal ureteric stone (OR 3.1, 95% CI 1.5-6.4), age ≥ 50 years (OR 2.8, 95% CI 1.5-5.0), tachycardia at triage (OR 2.5, 95% CI 1.1-5.4), urinary leukocyte esterase (OR 2.3, 95% CI 1.2-4.5), abnormal serum white blood cells (OR 2.0, 95% CI 1.2-3.3), and history of renal colic (OR 1.8, 95% CI 1.1-3.1) were factors independently associated with urologic intervention within 90 days. CONCLUSIONS: Our study reports eight risk factors associated with urologic intervention within 90 days in patients presenting to the ED with renal colic. These risk factors should be considered when making management, prognostic, and disposition decisions for patients with suspected urolithiasis.

Developing and authenticating an electronic health record-based report card for assessing residents' clinical performance.

Purpose: The electronic health record (EHR) is frequently identified as a source of assessment data regarding residents' clinical performance. To better understand how to harness EHR data for education purposes, the authors developed and authenticated a prototype resident report card. This report card used EHR data exclusively and was authenticated with various stakeholders to understand individuals' reactions to and interpretations of EHR data when presented in this way. Methods: Using principles derived from participatory action research and participatory evaluation, this study brought together residents, faculty, a program director, and medical education researchers (n = 19) to develop and authenticate a prototype report card for residents. From February to September 2019, participants were invited to take part in a semistructured interview that explored their reactions to the prototype and provided insights about how they interpreted the EHR data. Results: Our results highlighted three themes: data representation, data value, and data literacy. Participants varied in terms of the best way to present the various EHR metrics and felt pertinent contextual information should be included. All participants agreed that the EHR data presented were valuable, but most had concerns about using it for assessment. Finally, participants had difficulties interpreting the data, suggesting that these data could be presented more intuitively and that residents and faculty may require additional training to fully appreciate these EHR data. Conclusions: This work demonstrated how EHR data could be used to assess residents' clinical performance, but it also identified areas that warrant further consideration, especially pertaining to data representation and subsequent interpretation. Providing residents and faculty with EHR data in a resident report card was viewed as most valuable when used to guide feedback and coaching conversations.

Facilitating Residents' Understanding of Electronic Health Record Report Card Data Using Faculty Feedback and Coaching.

PURPOSE: Feedback continues to present a challenge for competency-based medical education. Clear, consistent, and credible feedback is vital to supporting one's ongoing development, yet it can be difficult to gather clinical performance data about residents. This study sought to determine whether providing residents with electronic health record (EHR)-based report cards, as well as an opportunity to discuss these data with faculty trained using the R2C2 model, can help residents understand and interpret their clinical performance metrics. METHOD: Using action research methodology, the author team collected EHR data from July 2017 to February 2020, for all residents (n = 21) in one 5-year Emergency Medicine program and created personalized report cards for each resident. During October 6-17, 2020, 8 out of 17 eligible residents agreed to have their feedback conversations recorded and participate in a subsequent interview with a nonphysician member of the research team. Data were analyzed using thematic analysis, and the authors used inductive analysis to identify themes in the data. RESULTS: In analyzing both the feedback conversations as well as the individual interviews with faculty and residents, the authors identified 2 main themes: (1) Reactions and responses to receiving personalized EHR data and (2) The value of EHR data for assessment and feedback purposes. All participants believed that EHR data metrics are useful for prompting self-reflection, and many pointed to their utility in providing suggestions for actionable changes in their clinical practice. For faculty, having a tool through which underperforming residents can be shown "objective" data about their clinical performance helps underscore the need for improvement, particularly when residents are resistant. CONCLUSIONS: The EHR is a valuable source of educational data, and this study demonstrates one of the many thoughtful ways it can be used for assessment and feedback purposes.

"EMERGing" Electronic Health Record Data Metrics: Insights and Implications for Assessing Residents' Clinical Performance in Emergency Medicine.

OBJECTIVES: Competency-based medical education requires that residents are provided with frequent opportunities to demonstrate competence as well as receive effective feedback about their clinical performance. To meet this goal, we investigated how data collected by the electronic health record (EHR) might be used to assess emergency medicine (EM) residents' independent and interdependent clinical performance and how such information could be represented in an EM resident report card. METHODS: Following constructivist grounded theory methodology, individual semistructured interviews were conducted in 2017 with 10 EM faculty and 11 EM residents across all 5 postgraduate years. In addition to open-ended questions, participants were presented with an emerging list of EM practice metrics and asked to comment on how valuable each would be in assessing resident performance. Additionally, we asked participants the extent to which each metric captured independent or interdependent performance. Data collection and analysis were iterative; analysis employed constant comparative inductive methods. RESULTS: Participants refined and eliminated metrics as well as added new metrics specific to the assessment of EM residents (e.g., time between signup and first orders). These clinical practice metrics based on data from our EHR database were organized along a spectrum of independent/interdependent performance. We conclude with discussions about the relationship among these metrics, issues in interpretation, and implications of using EHR for assessment purposes. CONCLUSIONS: Our findings document a systematic approach for developing EM resident assessments, based on EHR data, which incorporate the perspectives of both clinical faculty and residents. Our work has important implications for capturing residents' contributions to clinical performances and distinguishing between independent and interdependent metrics in collaborative workplace-based settings.

Current State of Point-of-care Ultrasound Usage in Canadian Emergency Departments.

Background Point-of-care ultrasound (POCUS) has many applications in emergency medicine, which have been proven to improve patient outcomes. Training programs and well-established guidelines for its use are available, but Canadian adoption rates and attitudes toward this technology have not been recently assessed. Objectives This study aimed to provide a national assessment of the current use of POCUS in Canadian emergency departments (ED) including patterns of use, attitudes towards its role, descriptors of training experience, as well as barriers to increased utilization. Methods An electronic survey was sent to physician members of the Canadian Association of Emergency Physicians. The survey included questions related to demographics, attitudes towards POCUS, POCUS utilization, and barriers to POCUS use. Responses were statistically analyzed to identify significant associations. Results Responses demonstrated a strong association between POCUS training and amount of POCUS usage. Neither hospital type nor community type was associated with the degree of POCUS usage. POCUS was most widely adopted for Canadian Point of Care Ultrasound Society (CPOCUS) core applications and has increased since the last national survey. The most commonly reported barrier to increased POCUS adoption was the lack of training. Most physicians have formal POCUS training in core applications, and approximately one third have advanced training. Conclusions POCUS training and utilization appear to have increased since the last national assessment. This provides a foundation for future POCUS research.

Physical activity prescription by Canadian Emergency Medicine Physicians.

An increase in physical activity has been shown to improve outcomes in many diseases. An estimated 600 000 Canadians receive their primary health care from emergency departments (ED). This study aims to examine physical activity prescription by emergency medicine physicians (EPs) to determine factors that influence decisions to prescribe physical activity. A survey was distributed to EPs via email using the Canadian Association of Emergency Physicians (CAEP) survey distribution protocol. Responses from 20% (n = 332) of emergency physician/residents in Canada were analyzed. Of the EPs, 62.7% often/always counsel patients about preventative medicine (smoking, diet, and alcohol). Only 12.7% (42) often/always prescribe physical activity. The CCFP-trained physicians (College of Family Physicians Canada) were significantly more likely to feel comfortable than CCFP-EM-trained physicians (Family Physicians with Enhanced Skills in Emergency Medicine) prescribing physical activity (p = 0.0001). Both were significantly more likely than the FRCPC-trained EPs (Fellows of the Royal College of Physicians of Canada). Of the EPs, 73.4% (244) believe the ED environment does not allow adequate time for physical activity prescription. Family medicine-trained EPs are more likely to prescribe physical activity; the training they receive may better educate them compared with FRCPC-trained emergency medicine. Further education is required to standardize an approach to ED physical activity prescription.

When guidelines don't guide: the effect of patient context on management decisions based on clinical practice guidelines.

PURPOSE: This study examines the influence of patient social context on physicians' adherence to clinical practice guidelines (CPGs). METHOD: Expert emergency medicine (EM) physicians and novice physicians (EM residents) were surveyed using an Internet-based program between January and July of 2013. Participants were presented clinical cases and were asked to indicate if they would order or prescribe a specified test or treatment. Cases were chosen from four domains where CPGs exist, and were constructed to include or exclude a "context variable" (CV). Both expert and novice physicians' CPG adherence rate in the CV condition was compared with that in the no CV condition. The CPG adherence rates in CV and no CV conditions were also compared between expert and novice EM physicians. RESULTS: Expert EM physicians (n = 28) were less likely to adhere to CPGs in the CV condition compared with the no CV condition (56% versus 80%, respectively; odds ratio [OR] = 0.32, 95% confidence interval [CI]: 0.17-0.53, P < .001). Experts were less likely to adhere to CPGs in the CV condition when compared with novice physicians (n = 28) (56% versus 67%; OR = 0.62, 95% CI: 0.39-1.0, P = .039). Expert and novice EM physicians did not differ in their adherence to CPGs in the no CV condition. CONCLUSIONS: Participants were sensitive to both the best clinical evidence of benefit, as recommended by CPGs, and patient context when determining how care should be managed.

Normal renal sonogram identifies renal colic patients at low risk for urologic intervention: a prospective cohort study.

INTRODUCTION: Determining which patients with ureterolithiasis are likely to require urologic intervention is a common challenge in the emergency department (ED). The objective was to determine if normal renal sonogram could identify low-risk renal colic patients, who were defined as not requiring urologic intervention within 90 days of their initial ED visit and can be managed conservatively. METHODS: This was a prospective cohort study involving adult patients presenting to the EDs of a tertiary care centre with suspected renal colic over a 20-month period. Renal ultrasonography (US) was performed in the diagnostic imaging department by trained ultrasonographers, and the results were categorized into four mutually exclusive groups: normal, suggestive of ureterolithiasis, visualized ureteric stone, or findings unrelated to urolithiasis. Electronic medical records were reviewed to determine if patients received urologic intervention within 90 days of their ED visit. RESULTS: Of 610 patients enrolled, 341 (55.9%) had US for suspected renal colic. Of those, 105 (30.8%) were classified as normal; none of these patients underwent urologic intervention within 90 days of their ED visit. Ninety (26.4%) US results were classified as suggestive, and nine (10%) patients received urologic intervention. A total of 139 (40.8%) US results were classified as visualized ureteric stone, and 34 (24.5%) patients had urologic intervention. Seven (2.1%) US results were classified as findings unrelated to urolithiasis, and none of these patients required urologic intervention. The rate of urologic intervention was significantly lower in those with normal US results (p<0.001) than in those with abnormal findings. CONCLUSION: A normal renal sonogram predicts a low likelihood for urologic intervention within 90 days for adult ED patients with suspected renal colic.

Acute allergic reaction due to the administration of fibrinolytic therapy for ST-segment elevation myocardial infarction: case report and discussion.

Although a rare phenomenon, acute allergic reactions to fibrinolytic and heparin therapy have been described in the literature. We report the case of a 63-year-old woman who experienced a severe anaphylactic reaction while undergoing fibrinolytic therapy with tissue plasminogen activator for an ST-segment elevation myocardial infarction. Overall outcome was successful, but patient morbidity was increased because of the reaction and the subsequent therapy administered.

Emergency medicine training in Canada: a survey of medical students' knowledge, attitudes, and preferences.

OBJECTIVES: The objective of this study was to assess medical students' knowledge of and attitudes toward the two Canadian emergency medicine (EM) residency programs (Fellow of the Royal College of Physicians of Canada [FRCPC] and Certificant of the College of Family Physicians-Emergency Medicine [CCFP-EM]). Additionally, medical students interested in EM were asked to select factors affecting their preferred choice of residency training program and their intended future practice. METHODS: Medical students enrolled at The University of Western Ontario for the 2008-2009 academic year were invited to complete an online 47-item questionnaire pertaining to their knowledge, opinions, and attitudes toward EM residency training. RESULTS: Of the 563 students invited to participate, 406 (72.1%) completed the survey. Of the respondents, 178 (43.8%) expressed an interest in applying to an EM residency training program, with 85 (47.8%) most interested in applying to the CCFP-EM program. The majority of respondents (54.1%) interested in EM believed that there should be two streams to EM certification, whereas 18.0% disagreed. Family life and control over work schedule appeared to be common priorities seen as benefits of any career in EM. Other high-ranking factors influencing career choice differed between the groups interested in CCFP-EM and FRCPC. The majority of students interested in the CCFP-EM residency program (78%) reported that they intend to blend their EM with their family medicine practice. Only 2% of students planned to practice only EM with no family medicine. CONCLUSIONS: This is the first survey of Canadian medical students to describe disparities in factors influencing choice of EM residency stream, perceptions of postgraduate work life, and anticipated practice environment.