Beyond diversity and inclusion: Developing a research agenda for anti-racism in emergency medicine education.

Background: Addressing racism in emergency medicine education is vital for providing optimal training and assessment of physicians in the specialty, developing physicians with the skills necessary to advocate for their patients, and recruiting and retaining a diverse group of physicians. To form a prioritized research agenda, the Society of Academic Emergency Medicine (SAEM) conducted a consensus conference at the annual meeting in May 2022 on addressing racism in emergency medicine, which included a subgroup on education. Methods: The education workgroup worked on summarizing the current literature on addressing racism in emergency medicine education, identifying critical knowledge gaps, and creating a consensus-driven research agenda for addressing racism in emergency medicine education. We used a nominal group technique and modified Delphi to develop priority questions for research. We then distributed a pre-conference survey to conference registrants to rate priority areas for research. During the consensus conference, group leaders provided an overview and background describing the rationale for the preliminary research question list. Attendees were then involved in discussions to help modify and develop research questions. Results: Nineteen questions were initially selected by the education workgroup as potential areas for research. The education workgroup's next round of consensus building resulted in a consensus of ten questions to be included in the pre-conference survey. No questions in the pre-conference survey reached consensus. After robust discussion and voting by workgroup members and attendees at the consensus conference, six questions were determined to be priority research areas. Conclusions: We believe recognizing and addressing racism in emergency medicine education is imperative. Critical gaps in curriculum design, assessment, bias training, allyship, and the learning environment negatively impact training programs. These gaps must be prioritized for research as they can have adverse effects on recruitment, the ability to promote a safe learning environment, patient care, and patient outcomes.

In-person classroom instruction and risk of SARS-CoV-2 infection among undergraduates at Indiana University, Fall 2020.

Objective: To examine how in-person classroom instruction was related to risk of SARS-CoV-2 infection in undergraduate students. Participants: Indiana University undergraduate students (n = 69,606) enrolled in Fall 2020, when courses with in-person and remote instruction options were available. Methods: Students participated weekly in mandatory SARS-CoV-2 RT-PCR asymptomatic testing by random selection, supplemented with symptomatic testing as needed. We used log-binomial regression models to estimate the association between number of in-person credit hours and the risk of SARS-CoV-2 infection over the course of the semester. Results: Overall 5,786 SARS-CoV-2 cases were observed. Increased in-person credit hour exposures were not associated with increased risk of SARS-CoV-2 overall [aRR (95% CI): 0.98 (0.97,0.99)], nor within specific subgroups (Greek affiliation and class). Conclusions: In-person instruction did not appear to increase SARS-CoV-2 transmission in a university setting with rigorous protective measures in place, prior to mass vaccine rollout and prior to delta variant emergence.

Applicant Reactions to the AAMC Standardized Video Interview During the 2018 Application Cycle.

PURPOSE: This study examined applicant reactions to the Association of American Medical Colleges Standardized Video Interview (SVI) during its first year of operational use in emergency medicine (EM) residency program selection to identify strategies to improve applicants' SVI experience and attitudes. METHOD: Individuals who self-classified as EM applicants applying in the Electronic Residency Application Service 2018 cycle and who completed the SVI in summer 2017 were invited to participate in 2 surveys. Survey 1, which focused on procedural issues, was administered immediately after SVI completion. Survey 2, which focused on applicants' SVI experience, was administered in fall 2017, after SVI scores were released. RESULTS: The response rates for surveys 1 and 2 were 82.3% (2,906/3,532) and 58.7% (2,074/3,532), respectively. Applicant reactions varied by aspect of the SVI studied and their SVI total scores. Most applicants were satisfied with most procedural aspects of the SVI, but most applicants were not satisfied with the SVI overall or with their total SVI scores. About 20% to 30% of applicants had neutral opinions about most aspects of the SVI. Negative reactions to the SVI were stronger for applicants who scored lower on the SVI. CONCLUSIONS: Applicants had generally negative reactions to the SVI. Most were skeptical of its ability to assess the target competencies and its potential to add value to the selection process. Applicant acceptance and appreciation of the SVI will be critical to the SVI's acceptance by the graduate medical education community.

Innovation in Residency Selection: The AAMC Standardized Video Interview.

PURPOSE: Innovative tools are needed to shift residency selection toward a more holistic process that balances academic achievement with other competencies important for success in residency. The authors evaluated the feasibility of the AAMC Standardized Video Interview (SVI) and evidence of the validity of SVI total scores. METHOD: The SVI, developed by the Association of American Medical Colleges, consists of six questions designed to assess applicants' interpersonal and communication skills and knowledge of professionalism. Study 1 was conducted in 2016 for research purposes. Study 2 was an operational pilot administration in 2017; SVI data were available for use in residency selection by emergency medicine programs for the 2018 application cycle. Descriptive statistics, correlations, and standardized mean differences were used to examine data. RESULTS: Study 1 included 855 applicants; Study 2 included 3,532 applicants. SVI total scores were relatively normally distributed. There were small correlations between SVI total scores and United States Medical Licensing Examination Step exam scores, Alpha Omega Alpha Honor Medical Society membership, and Gold Humanism Honor Society membership. There were no-to-small group differences in SVI total scores by gender and race/ethnicity, and small-to-medium differences by applicant type. CONCLUSIONS: Findings provide initial evidence of the validity of SVI total scores and suggest that these scores provide different information than academic metrics. Use of the SVI, as part of a holistic screening process, may help program directors widen the pool of applicants invited to in-person interviews and may signal that programs value interpersonal and communication skills and professionalism.

The AAMC Standardized Video Interview: Reactions and Use by Residency Programs During the 2018 Application Cycle.

PURPOSE: To evaluate how emergency medicine residency programs perceived and used Association of American Medical Colleges (AAMC) Standardized Video Interview (SVI) total scores and videos during the Electronic Residency Application Service 2018 cycle. METHOD: Study 1 (November 2017) used a program director survey to evaluate user reactions to the SVI following the first year of operational use. Study 2 (January 2018) analyzed program usage of SVI video responses using data collected through the AAMC Program Director's Workstation. RESULTS: Results from the survey (125/175 programs; 71% response rate) and video usage analysis suggested programs viewed videos out of curiosity and to understand the range of SVI total scores. Programs were more likely to view videos for attendees of U.S. MD-granting medical schools and applicants with higher United States Medical Licensing Examination Step 1 scores, but there were no differences by gender or race/ethnicity. More than half of programs that did not use SVI total scores in their selection processes were unsure of how to incorporate them (36/58; 62%) and wanted additional research on utility (33/58; 57%). More than half of programs indicated being at least somewhat likely to use SVI total scores (55/97; 57%) and videos (52/99; 53%) in the future. CONCLUSIONS: Program reactions on the utility and ease of use of SVI total scores were mixed. Survey results indicate programs used the SVI cautiously in their selection processes, consistent with AAMC recommendations. Future user surveys will help the AAMC gauge improvements in user acceptance and familiarity with the SVI.

An assessment of residents' and fellows' personal finance literacy: an unmet medical education need.

OBJECTIVES: This study aimed to assess residents' and fellows' knowledge of finance principles that may affect their personal financial health. METHODS: A cross-sectional, anonymous, web-based survey was administered to a convenience sample of residents and fellows at two academic medical centers.  Respondents answered 20 questions on personal finance and 28 questions about their own financial planning, attitudes, and debt. Questions regarding satisfaction with one's financial condition and investment-risk tolerance used a 10-point Likert scale (1=lowest, 10=highest).  Of 2,010 trainees, 422 (21%) responded (median age 30 years; interquartile range, 28-33). RESULTS: The mean quiz score was 52.0% (SD = 19.1). Of 299 (71%) respondents with student loan debt, 144 (48%) owed over $200,000.  Many respondents had other debt, including 86 (21%) with credit card debt. Of 262 respondents with retirement savings, 142 (52%) had saved less than $25,000. Respondents' mean satisfaction with their current personal financial condition was 4.8 (SD = 2.5) and investment-risk tolerance was 5.3 (SD = 2.3). Indebted trainees reported lower satisfaction than trainees without debt (4.4 vs. 6.2, F (1,419) = 41.57, p < .001).   Knowledge was moderately correlated with investment-risk tolerance (r=0.41, p < .001), and weakly correlated with satisfaction with financial status (r=0.23, p < .001). CONCLUSIONS: Residents and fellows had low financial literacy and investment-risk tolerance, high debt, and deficits in their financial preparedness.  Adding personal financial education to the medical education curriculum would benefit trainees.  Providing education in areas such as budgeting, estate planning, investment strategies, and retirement planning early in training can offer significant long-term benefits.

Timing of Emergency Medicine Student Evaluation Does Not Affect Scoring.

BACKGROUND: Evaluation of medical students rotating through the emergency department (ED) is an important formative and summative assessment method. Intuitively, delaying evaluation should affect the reliability of this assessment method, however, the effect of evaluation timing on scoring is unknown. OBJECTIVE: A quality-improvement project evaluating the timing of end-of-shift ED evaluations at the University of Arizona was performed to determine whether delay in evaluation affected the score. METHODS: End-of-shift ED evaluations completed on behalf of fourth-year medical students from July 2012 to March 2013 were reviewed. Forty-seven students were evaluated 547 times by 46 residents and attendings. Evaluation scores were means of anchored Likert scales (1-5) for the domains of energy/interest, fund of knowledge, judgment/problem-solving ability, clinical skills, personal effectiveness, and systems-based practice. Date of shift, date of evaluation, and score were collected. Linear regression was performed to determine whether timing of the evaluation had an effect on evaluation score. RESULTS: Data were complete for 477 of 547 evaluations (87.2%). Mean evaluation score was 4.1 (range 2.3-5, standard deviation 0.62). Evaluations took a mean of 8.5 days (median 4 days, range 0-59 days, standard deviation 9.77 days) to complete. Delay in evaluation had no significant effect on score (p = 0.983). CONCLUSIONS: The evaluation score was not affected by timing of the evaluation. Variance in scores was similar for both immediate and delayed evaluations. Considerable amounts of time and energy are expended tracking down delayed evaluations. This activity does not impact a student's final grade.

Analysis of the evaluative components on the Standard Letter of Recommendation (SLOR) in Emergency Medicine.

INTRODUCTION: The standard letter of recommendation in emergency medicine (SLOR) was developed to standardize the evaluation of applicants, improve inter-rater reliability, and discourage grade inflation. The primary objective of this study was to describe the distribution of categorical variables on the SLOR in order to characterize scoring tendencies of writers. METHODS: We performed a retrospective review of all SLORs written on behalf of applicants to the three Emergency Medicine residency programs in the University of Arizona Health Network (i.e. the University Campus program, the South Campus program and the Emergency Medicine/Pediatrics combined program) in 2012. All "Qualifications for Emergency Medicine" and "Global Assessment" variables were analyzed. RESULTS: 1457 SLORs were reviewed, representing 26.7% of the total number of Electronic Residency Application Service applicants for the academic year. Letter writers were most likely to use the highest/most desirable category on "Qualifications for EM" variables (50.7%) and to use the second highest category on "Global Assessments" (43.8%). For 4-point scale variables, 91% of all responses were in one of the top two ratings. For 3-point scale variables, 94.6% were in one of the top two ratings. Overall, the lowest/least desirable ratings were used less than 2% of the time. CONCLUSIONS: SLOR letter writers do not use the full spectrum of categories for each variable proportionately. Despite the attempt to discourage grade inflation, nearly all variable responses on the SLOR are in the top two categories. Writers use the lowest categories less than 2% of the time. Program Directors should consider tendencies of SLOR writers when reviewing SLORs of potential applicants to their programs.

Does the experience of the writer affect the evaluative components on the standardized letter of recommendation in emergency medicine?

BACKGROUND: The Standardized Letter of Recommendation (SLOR) was developed in an attempt to standardize the evaluation of applicants to an emergency medicine (EM) residency. OBJECTIVE: Our aim was to determine whether the Global Assessment Score (GAS) and Likelihood of Matching Assessment (LOMA) of the SLOR for applicants applying to an EM residency are affected by the experience of the letter writer. We describe the distribution of GAS and LOMA grades and compare the GAS and LOMA scores to length of time an applicant knew the letter writer and number of EM rotations. METHODS: We conducted a retrospective review of all SLORs written for all applicants applying to three EM residency programs for the 2012 match. Median number of letters written the previous year were compared across the four GAS and LOMA scores using an equality of medians test and test for trend to see if higher scores on the GAS and LOMA were associated with less experienced letter writers. Distributions of the scores were determined and length of time a letter writer knew an applicant and number of EM rotations were compared with GAS and LOMA scores. RESULTS: There were 917 applicants representing 27.6% of the total applicant pool for the 2012 United States EM residency match and 1253 SLORs for GAS and 1246 for LOMA were analyzed. The highest scores on the GAS and LOMA were associated with the lowest median number of letters written the previous year (equality of medians test across groups, p < 0.001; test for trend, p < 0.001). Less than 3% received the lowest score for GAS and LOMA. Among letter writers that knew an applicant for more than 1 year, 45.3% gave a GAS score of "Outstanding" and 53.4% gave a LOMA of "Very Competitive" compared with 31.7% and 39.6%, respectively, if the letter writer knew them 1 year or less (p = 0.002; p = 0.005). Number of EM rotations was not associated with GAS and LOMA scores. CONCLUSIONS: SLORs written by less experienced letter writers were more likely to have a GAS of "Outstanding" (p < 0.001) and a LOMA of "Very Competitive" (p < 0.001) than more experienced letter writers. The overall distribution of GAS and LOMA was heavily weighted to the highest scores. The length of time a letter writer knew an applicant was significantly associated with GAS and LOMA scores.

Syndromic surveillance for influenza in the emergency department-A systematic review.

The science of surveillance is rapidly evolving due to changes in public health information and preparedness as national security issues, new information technologies and health reform. As the Emergency Department has become a much more utilized venue for acute care, it has also become a more attractive data source for disease surveillance. In recent years, influenza surveillance from the Emergency Department has increased in scope and breadth and has resulted in innovative and increasingly accepted methods of surveillance for influenza and influenza-like-illness (ILI). We undertook a systematic review of published Emergency Department-based influenza and ILI syndromic surveillance systems. A PubMed search using the keywords "syndromic", "surveillance", "influenza" and "emergency" was performed. Manuscripts were included in the analysis if they described (1) data from an Emergency Department (2) surveillance of influenza or ILI and (3) syndromic or clinical data. Meeting abstracts were excluded. The references of included manuscripts were examined for additional studies. A total of 38 manuscripts met the inclusion criteria, describing 24 discrete syndromic surveillance systems. Emergency Department-based influenza syndromic surveillance has been described worldwide. A wide variety of clinical data was used for surveillance, including chief complaint/presentation, preliminary or discharge diagnosis, free text analysis of the entire medical record, Google flu trends, calls to teletriage and help lines, ambulance dispatch calls, case reports of H1N1 in the media, markers of ED crowding, admission and Left Without Being Seen rates. Syndromes used to capture influenza rates were nearly always related to ILI (i.e. fever +/- a respiratory or constitutional complaint), however, other syndromes used for surveillance included fever alone, "respiratory complaint" and seizure. Two very large surveillance networks, the North American DiSTRIBuTE network and the European Triple S system have collected large-scale Emergency Department-based influenza and ILI syndromic surveillance data. Syndromic surveillance for influenza and ILI from the Emergency Department is becoming more prevalent as a measure of yearly influenza outbreaks.

Influenza vaccination in the emergency department: are our patients at risk?

BACKGROUND: Influenza is responsible for substantial morbidity and mortality annually. Vaccination strategies target high-risk patients. The percentage of Emergency Department (ED) patients at high risk is largely unknown. OBJECTIVES: The percentage of patients at high risk for influenza was determined and compared to the United States (US) population. METHODS: Medical records of a convenience sample of all patients presenting to the ED of a university-affiliated hospital in Tucson, Arizona from February 1-7, 2006 were reviewed (n = 1359). Patients were stratified as 1) at high risk for influenza or its complications, 2) health care workers (HCW), household contacts of high-risk patients, and other target populations, and (3) otherwise healthy adults. Additionally, vaccination status and prior ED utilization within that season's vaccination period was determined. RESULTS: Of all patients presenting to the ED, 41.5% were at high risk for influenza or its complications (US 30.8%, p < 0.001). Of all ED patients, 10.8% were household contacts, HCWs, or in another target group (US 42.8%, p < 0.001). Of high-risk ED patients, 43.5% had been vaccinated that season (US 47.1%, p < 0.001) and 13.7% had had at least one visit to the ED within the preceding 3 months. CONCLUSION: There is a higher percentage of patients at high risk for influenza in the ED population than the general US population. The ED may be a novel location in which to effectively identify and immunize high-risk individuals. Benefits to ED vaccination may include subsequent reductions in mortality and morbidity as well as a decrease in ED utilization and hospitalization for influenza and its complications.

Impact of the Final Rule on the rate of clinical cardiac arrest research in the United States.

BACKGROUND: The federal government placed a moratorium on human emergency resuscitation research in 1993 due to concerns related to informed consent. In 1996, the Food and Drug Administration introduced the Final Rule in order to allow clinical resuscitation research to proceed in special cases without prospective informed consent. It is unclear, however, how this change has impacted the performance of this research. OBJECTIVES: To measure the potential impact of the Final Rule by determining the number of clinical cardiac arrest studies performed in the United States (US) before and after 1993, and to compare it with the number of studies performed in the European Union (EU) during the same periods. METHODS: A MEDLINE search was performed for cardiac arrest studies that were prospective, interventional, randomized, and performed in the US or EU from 1983 through 2003. RESULTS: Of the 3,115 cardiac arrest publications identified, 66 (2%) met inclusion criteria. Of the 40 studies conducted in the US, 24 (60%) were published prior to or during 1993, whereas of the 27 studies conducted in the EU, six (22%) were published prior to or during 1993 (odds ratio = 0.5; 95% confidence interval = 0.3 to 0.8). CONCLUSIONS: There has been a significant decrease in the number of published clinical cardiac arrest trials in the US since 1993. In contrast, there has been a significant increase in the number of published EU trials since 1993. The current informed consent requirements may have reduced the number of clinical cardiac arrest studies performed in the US.