RESUMO
Introduction: Medical drones have potential for improving the response times to out-of-hospital emergencies. However, widespread adoption is hindered by unanswered questions surrounding medical dispatch and bystander safety. This study evaluated the impact of novel drone-specific dispatch instructions (DSDI) on bystanders' ability to interact effectively with a medical drone and provide prompt, safe, and high-quality treatment in a simulated emergency scenario. We hypothesized DSDI would improve bystanders' performance and facilitate safer bystander-drone interactions. Methods: Twenty-four volunteers were randomized to receive either DSDI and standard Medical Priority Dispatch (MPD) instructions or MPD alone in a simulated out-of-hospital cardiac arrest (OHCA) or pediatric anaphylaxis.,3 Participants in the DSDI group received detailed instructions on locating and interacting with the drone and its enclosed medical kit. The simulations were video recorded. Participants completed a semi-structured interview and survey. Results: The addition of DSDI did not lead to statistically significant changes to the overall time to provide care in either the anaphylaxis or OHCA simulations. However, DSDI did have an impact on bystander safety. In the MPD only group, 50% (6/12) of participants ignored the audio and visual safety cues from the drone instead of waiting for it to be declared safe compared to no DSDI participants ignoring these safety cues. Conclusions: All participants successfully provided patient care. However, this study indicates that DSDI may be useful to ensure bystander safety and should be incorporated in the continued development of emergency medical drones.
RESUMO
Introduction: Emergency medicine (EM) is one of few specialties with variable training lengths. Hiring a three-year graduate to continue fellowship training in a department that supports a four-year residency program can lead to conflicts around resident supervision. We sought to understand hiring and clinical supervision, or staffing, patterns of non-Accreditation Council for Graduate Medical Education (ACGME) fellowships hosted at institutions supporting four-year residency programs. Methods: We performed a web-based, cross-sectional survey of non-ACGME fellowship directors (FD) hosted at institutions supporting four-year EM residency programs. We calculated descriptive statistics. Our primary outcome was the proportion of programs with four-year EM residencies that hire non-ACGME fellows graduating from three-year EM residencies. Results: Of 119 eligible FDs, 88 (74%) completed the survey. Seventy FDs (80%) indicated that they hire graduates of three-year residencies. Fifty-six (80%) indicated that three-year graduates supervise residents. Most FDs (74%) indicated no additional requirements exist to supervise residents outside of being hired as faculty. The FDs cited department policy, concerns about quality and length of training, and resident complaints as reasons for not hiring three-year graduates. A majority (10/18, 56%) noted that not hiring fellows from three-year programs negatively impacts recruitment and gives them access to a smaller applicant pool. Conclusion: Most non-ACGME fellowships at institutions with four-year EM programs recruit three-year graduates and allow them to supervise residents. This survey provides programs information on how comparable fellowships recruit and staff their departments, which may inform policies that fit the needs of their learners, the fellowship, and the department.
Assuntos
Internato e Residência , Humanos , Estados Unidos , Bolsas de Estudo , Estudos Transversais , Educação de Pós-Graduação em Medicina , Inquéritos e Questionários , Recursos HumanosRESUMO
Intro: Medical drones are an emerging technology which may facilitate rapid treatment in time-sensitive emergencies. However, drones rely on lay rescuers, whose interactions with multipurpose medical drones have not been studied, and the optimal drone design remains unclear. Methods: We conducted 24 simulations of adult out-of-hospital cardiac arrest (OHCA) and pediatric anaphylaxis with a prototype drone equipped with spoken and visual cues and a multipurpose medical kit. 24 layperson volunteers encountered one of the two scenarios and were supported through administering treatment by a simulated 911 dispatcher. Bystander-drone interactions were evaluated via a convergent parallel mixed methods approach using surveys, video event review, and semi-structured interviews. Results: 83% (20/24) of participants voiced comfort interacting with the drone. 96% (23/24) were interested in future interaction. Participants appreciated the drone's spoken instructions but found visual cues confusing. Participants retrieved the medical kit from the drone in a mean of 5 seconds (range 2-14) of drone contact; 79% (19/24) found this step easy or very easy. The medical kit's layered design caused difficulty in retrieving appropriate equipment. Participants expressed a wide range of reactions to the unique drone design. Conclusions: Laypeople can effectively and comfortably interact with a medical drone with a novel design. Feedback on design elements will result in further refinements and valuable insights for other drone designers. A multipurpose medical kit created more challenges and indicates the need for further refinement to facilitate use of the equipment.
RESUMO
Objectives: Postresidency career choices are complex decisions that involve personal, professional, and financial preferences and may be influenced by training programs. It is unknown how residents navigate these decisions during emergency medicine (EM) residency. We explored EM residents' perspectives on career decision making and how residency programs can support career planning. Methods: We conducted semistructured interviews at seven accredited EM residency programs from diverse locations and training formats. We used purposive sampling to reflect the diversity of trainees with regard to gender, level of training, and career plans. Two researchers independently coded the transcripts. We used a constructivist-interpretivist paradigm to guide our thematic analysis. Results: We interviewed 11 residents and identified major themes in three categories. Residents described being exposed to career options through formalized curricula such as required rotations, career fairs, and subspeciality tracks, highlighting the importance of access to faculty with diverse areas of clinical and academic expertise. Many noted that exposure was often self-driven. We identified three major themes regarding career decisions: instrumental factors, people involved, and processes of decision making. Instrumental factors included personal interests, goals, and values as well as practice characteristics, financial considerations, timing, and opportunity costs. Mentors and family were highly involved in resident career decisions. Residents often utilized reflection and conversations with mentors and peers in their decision-making process. Participants recommended that programs provide exposure to diverse career options early in training, protect time for career education, and ensure adequate mentorship and a supportive community. Participants suggested specific curricular content and strategies to support career decisions. Conclusions: This study illuminates important factors involved in resident career decision making and how programs can support their trainees. Essential components include diverse experiences and building a reflective mentorship environment.
RESUMO
Objectives: The Master Adaptive Learner (MAL) model postulates that learners develop adaptive expertise through cycles of self-regulated learning. Despite a robust theoretical basis, the actual observable behaviors of MALs are not well characterized. We sought to define behaviors that characterize MALs within emergency medicine (EM) training. Methods: Using a constructivist grounded theory approach, we analyzed semistructured interviews with expert EM educators. These experts reflected on observable behaviors as well as factors in the clinical learning environment that may modulate these behaviors. We recruited using purposive sampling until thematic saturation. Results: We identified four overall themes, of which three described groups of learner behaviors and a fourth described modifiers of these behaviors. Learner behaviors include: (1) critical interrogation of practice, (2) intellectual risk-taking, and (3) intentional curation of a learning network. Critical interrogation of practice encompasses several observable behaviors including learner-driven feedback conversations, independent synthesis of clinical information, appropriate deviation from algorithms based on their conceptual understanding of core principles, intentional use of case variation and hypothetical questioning, and continuous refinement of decisions. MALs also engage in intellectual risk-taking for their development by communicating clinical decision-making processes even at the risk of being wrong, openly addressing errors and gaps, and intentionally seeking out uncomfortable experiences. Intentional curation of a learning network is the deliberate development of a consortium of trusted individuals who serve as mentors and sounding boards. We also identified a fourth theme related to the expression of learner behaviors: learning environment modulates behaviors. Active promotion of psychological safety is necessary for learners to express these behaviors. This safety is mediated through trusting relationships and expert supervisors who serve as colearners and role models. Conclusions: We present several behaviors that allow identification of MALs among EM trainees. These data expand our understanding of MALs and the critical influence of the learning environment. Identification of these behaviors may allow for more precise categorization of targeted curricular interventions and meaningful learning outcomes.
RESUMO
Objectives: The specialty of emergency medicine (EM) is experiencing a significant decrease in student interest. In addition, women are historically underrepresented within the specialty at all levels of training and practice. We sought to understand how clinical experiences and perceptions of EM influence specialty selection by medical students, particularly women. Methods: Using a constructivist grounded theory approach, we analyzed semistructured interviews with senior medical students who considered EM as a specialty. We used purposive sampling to recruit from diverse learning environments and represent a variety of experiences. Participants reflected on their specialty selection process and experiences in EM including their perceived acceptance in the work environment. Results: Twenty-five medical students from 11 geographically diverse schools participated. A total of 68% (17/25) identified as women. The majority (21/25, 84%) planned on applying to EM residency. We identified four major themes: (1) distressing interpersonal interactions with patients and the ED care team negatively affect students; (2) EM culture includes behaviors that are perceived as exclusionary; (3) beliefs about the attributes of an ideal EM physician and the specialty itself have a gendered nature; and (4) ease of access to mentors, representation, and early exposure to EM environment increased interest in specialty. Conclusions: Our participants express that EM causes challenges for students to accept the norms of behavior in the field, which is an essential element in joining a group and professional identity formation. In addition, we raise concern that gendered perceptions and language may send exclusionary environmental cues that may negatively impact recruitment of a diverse physician workforce.
RESUMO
BACKGROUND: Routine expertise is the efficient use of mastered skills at a high level of competency in familiar situations. PROBLEM: Novel case variation and continuous scientific advances preclude reliance on routine expertise alone. SOLUTION: Medical training programs must prepare learners to solve unfamiliar problems by cultivating adaptive expertise. Adaptive expertise is the ability to transfer existing knowledge to innovate a solution for an unfamiliar problem.
Assuntos
Conhecimento , Resolução de Problemas , HumanosRESUMO
INTRODUCTION: The Match in emergency medicine (EM) is historically competitive for applicants; however, the 2022 residency Match had a large number of unfilled positions. We sought to characterize the impact of and response to the Match on programs and determine programs' needs for successful recruitment strategies. METHODS: We conducted a web-based survey of EM residency program leadership during March-April 2022. Program characteristics were generated from publicly available data, and descriptive statistics were generated. We analyzed free-text responses thematically. RESULTS: There were 133/277 (48%) categorical EM residency programs that responded. Of those, 53.8% (70/130) reported a negative impression of their Match results; 17.7% (23/130) positive; and the remainder neutral (28.5%; 37/130). Three- and four-year programs did not differ in their risk of unfilled status. Hybrid programs had a higher likelihood of going unfilled (odds ratio [OR] 4.52, confidence interval [CI] 1.7-12.04) vs community (OR 1.62, CI 0.68-3.86) or university programs (0.16, 0.0-0.49). Unfilled programs were geographically concentrated. The quality of applicants was perceived the same as previous years and did not differ between filled and unfilled programs. Respondents worried the expansion of EM residency positions and perceptions of the EM job market were major factors influencing the Match. They expressed interest in introducing changes to the interview process, including caps on applications and interviews, as well as a need for more structural support for programs and the specialty. CONCLUSION: This survey identifies impacts of the changed match environment on a broad range of programs and identifies specific needs. Future work should be directed toward a deeper understanding of the factors contributing to changes in the specialty and the development of evidence-based interventions.
Assuntos
Medicina de Emergência , Internato e Residência , Humanos , Inquéritos e Questionários , Medicina de Emergência/educaçãoRESUMO
PURPOSE: Annual increases in the number of residency applications burden students and challenge programs. Several reforms to the application process have been proposed; however, stakeholder input is often overlooked. The authors examined key stakeholders' opinions about several proposed reforms to the residency application process and identified important factors to guide future reforms. METHOD: Using semistructured interviews, the authors asked educational administrators and trainees to consider 5 commonly proposed reforms to the residency application process: Match to obtain residency interviews, preference signaling, application limits, geographic preference disclosure, and abolishing the Match. The authors conducted a modified content analysis of interview transcripts using qualitative and quantitative analytic techniques. Frequency analysis regarding the acceptability of the 5 proposed reforms and thematic analysis of important factors to guide reform were performed. Fifteen-minute interviews were conducted between July and October 2019, with data analysis completed during a 6-month period in 2020 and 2021. RESULTS: Participants included 30 stakeholders from 9 medical specialties and 15 institutions. Most participants wanted to keep the Match process intact; however, they noted several important flaws in the system that disadvantage students and warrant change. Participants did not broadly support any of the 5 proposed reforms. Two themes were identified: principles to guide reform (fairness, transparency, equity, reducing costs to students, reducing total applications, reducing work for program directors, and avoiding unintended consequences) and unpopular reform proposals (concern that application limits threaten less competitive students and signaling adds bias to the system). CONCLUSIONS: Key stakeholders in the residency application process believe the system has important flaws that demand reform. Despite this, the most commonly proposed reforms are unacceptable to these stakeholders because they threaten fairness to students and program workload. These findings call for a larger investigation of proposed reforms with a more nationally representative stakeholder cohort.
Assuntos
Internato e Residência , Medicina , Estudantes de Medicina , Humanos , Custos e Análise de CustoRESUMO
Objectives: Scholarship is a requirement of residency training; however, the scholarly productivity of trainees is highly variable. The purpose of this study was to explore the perspectives of residents who have been highly productive in scholarship. Methods: We performed a qualitative study using a constructivist-interpretivist paradigm and conducted semistructured interviews at seven Accreditation Council for Graduate Medical Education-accredited emergency medicine residency programs in the United States. We included sites of diverse locations and training formats (PGY-1 to -4 vs. PGY-1 to -3). Program leadership identified residents with high levels of scholarly productivity at their institutions. We used purposive sampling to seek out residents with diversity in gender and PGY level. Two researchers independently performed a thematic analysis of interview transcripts. Discrepancies were resolved through in-depth discussion and negotiated consensus. Results: We invited 14 residents and all consented to be interviewed. Residents felt scholarship enhanced their knowledge and skills, grew collaborative networks, and provided personal fulfillment and external rewards. Scholarship positively impacted their careers by focusing their professional interests and informing career decisions. Participants identified individual and institutional facilitators of success including personal prior knowledge and skills, project management skills, mindset, protected time, mentorship, and leadership support. Challenges to conducting scholarship included lack of time, expertise, and resources. Participants acknowledged that participating in scholarly activities was hard work and recommended that residents seek out quality mentorship, work on projects that they are passionate, start early, and be persistent in their efforts. Participants' advice to faculty supporting resident scholarship included recommendations to allow resident autonomy of projects, provide scholarly opportunities, and be responsive to trainee needs. Conclusions: Participants in this study highlighted benefits of participating in scholarly activity as well as challenges and strategies for success. These results can inform residencies seeking to enhance the scholarly experience of trainees.
RESUMO
Adaptive expertise represents the combination of both efficient problem-solving for clinical encounters with known solutions, as well as the ability to learn and innovate when faced with a novel challenge. Fostering adaptive expertise requires careful approaches to instructional design to emphasize deeper, more effortful learning. These teaching strategies are time-intensive, effortful, and challenging to implement in health professions education curricula. The authors are educators whose missions encompass the medical education continuum, from undergraduate through to organizational learning. Each has grappled with how to promote adaptive expertise development in their context. They describe themes drawn from educational experiences at these various learner levels to illustrate strategies that may be used to cultivate adaptive expertise.At Vanderbilt University School of Medicine, a restructuring of the medical school curriculum provided multiple opportunities to use specific curricular strategies to foster adaptive expertise development. The advantage for students in terms of future learning had to be rationalized against assessments that are more short-term in nature. In a consortium of emergency medicine residency programs, a diversity of instructional approaches was deployed to foster adaptive expertise within complex clinical learning environments. Here the value of adaptive expertise approaches must be balanced with the efficiency imperative in clinical care. At Mayo Clinic, an existing continuous professional development program was used to orient the entire organization towards an adaptive expertise mindset, with each individual making a contribution to the shift.The different contexts illustrate both the flexibility of the adaptive expertise conceptualization and the need to customize the educational approach to the developmental stage of the learner. In particular, an important benefit of teaching to adaptive expertise is the opportunity to influence individual professional identity formation to ensure that clinicians of the future value deeper, more effortful learning strategies throughout their careers.
Assuntos
Educação Médica , Humanos , Currículo , Aprendizagem , Resolução de Problemas , EstudantesRESUMO
PURPOSE: Adaptive expertise (AE) has been identified as a critical trait to cultivate in future physicians. The 4-phase master adaptive learner (MAL) conceptual model describes the learning skills and behaviors necessary to develop AE. Though prior work has elucidated skills and behaviors used by MALs in the initial planning phase of learning, most resident learners are not thought to be MALs. In this study, the authors investigated how these majority "typical" learners develop AE by exploring the strategies they used in the planning phase of learning. METHOD: Participants were resident physicians at graduate medical education (GME) training programs located at 4 academic medical centers in the United States. Participants participated in semistructured individual interviews in 2021, and interview transcripts were analyzed using constant comparative analysis of grounded theory. RESULTS: Fourteen subjects representing 8 specialties were interviewed, generating 152 pages of transcripts for analysis. Three themes were identified: "Typical" learners were challenged by the transition from structured undergraduate medical education learning to less-structured GME learning, lacked necessary skills to easily navigate this transition, and relied on trial and error to develop their learning skills. CONCLUSIONS: Participants used trial and error to find learning strategies to help them manage the systemic challenges encountered when transitioning from medical school to residency. The success (or failure) of these efforts was tied to learners' efficacy with the self-regulated learning concepts of agency, metacognitive goal setting, and motivation. A conceptual model is provided to describe the impact of these factors on residents' ability to be adaptive learners, and actionable recommendations are provided to help educators' efforts to foster adaptive learning skills and behaviors. These findings also provided valuable evidence of validity of the MAL model that has thus far been lacking.
Assuntos
Internato e Residência , Médicos , Humanos , Estados Unidos , Pesquisa Qualitativa , Aprendizagem , CurrículoRESUMO
BACKGROUND: Adaptive expertise is an important physician skill, and the Master Adaptive Learner (MAL) conceptual model describes learner skills and behaviors integral to the acquisition of adaptive expertise. The learning environment is postulated to significantly impact how MALs learn, but it is unclear how these successful learners experience and interact with it. This study sought to understand the authentic experience of MALs within the learning environment and translate those experiences into practical recommendations to improve the learning environment for all trainees. METHODS: Following a constructivist paradigm, we conducted a thematic analysis of transcripts from focus groups composed of MALs to identify commonalities in experiences and practices of successful postgraduate trainees in the learning environment. Saturation was achieved after seven focus groups, consisting of thirty-eight participants representing fourteen specialties from four institutions. Researchers coded transcripts using constant comparison analysis, which served as the foundation for our thematic analysis. RESULTS: We identified eight themes and situated them within a 4-component model of the learning environment. Four themes were identified within the personal component: (1) patients drive learning; (2) learning has no endpoint; (3) management of emotions is crucial for learning; (4) successful learning requires a structured approach. Two themes were identified in the social component: (5) positive social relationships are leveraged to maximize learning; (6) teaching facilitates personal learning. Two themes were identified in the organizational component: (7) transitions challenge learners to adapt; (8) the learning environment dictates goal setting strategy. No major themes were identified in the physical/virtual component, although participants frequently used technology when learning. CONCLUSIONS: Master Adaptive Learners experience similar facilitators of, and barriers to, success in the learning environment. Overall, our data show that acquisition of many successful strategies and skills that support learning are relegated to the hidden curriculum of residency training. Educators could support a more effective learning environment for all trainees by: (1) highlighting patients as the focal point of learning, (2) building a professional 'learner' identity, (3) teaching learning skills, and (4) creating opportunities for collaborative learning.
Assuntos
Educação de Graduação em Medicina , Internato e Residência , Currículo , Humanos , Aprendizagem , Pesquisa QualitativaRESUMO
INTRODUCTION: Residency didactic conferences transitioned to a virtual format during the COVID-19 pandemic. This format creates questions about effective educational practices, which depend on learner engagement. In this study we sought to characterize the competitive demands for learner attention during virtual didactics and to pilot methodology for future studies. METHODS: This was a prospective, observational, cohort study of attendees at virtual didactics from a single emergency medicine residency, which employed a self-report strategy informed by validated classroom assessments of student engagement. We deployed an online, two-question survey polling across six conference days using random signaled sampling. Participants reported all activities during the preceding five minutes. RESULTS: There were 1303 responses over 40 survey deployments across six nonadjacent days. Respondents were residents (63.4%); faculty (27.5%); fellows (2.3%); students (2%); and others (4.8%). Across all responses, about 85% indicated engagement in the virtual conference within the last five minutes of the polls. The average number of activities engaged in was 2.0 (standard deviation = 1.1). Additional activities included education-related (34.2%), work-related (21.1%), social (18.8%), personal (14.6%), self-care (13.4%), and entertainment (4.4%). CONCLUSION: Learners engage in a variety of activities during virtual didactics. Engagement appears to fluctuate temporally, which may inform teaching strategies. This information may also provide unique instructor feedback. This pilot study demonstrates methodology for future studies of conference engagement and learning outcomes.
Assuntos
COVID-19 , Medicina de Emergência , Estudos de Coortes , Humanos , Pandemias , Projetos Piloto , Estudos Prospectivos , SARS-CoV-2RESUMO
OBJECTIVES: Women are underrepresented in emergency medicine (EM) leadership. Some evidence suggests that geographic mobility improves career advancement. We compared movement between medical school and residency by gender. Our hypothesis was that women move a shorter distance than men. METHODS: We collected National Residency Matching Program (NRMP) lists of ranked applicants from eight EM residency programs from the 2020 Main Residency Match. We added the gender expressed in interviews and left the Association of American Medical Colleges (AAMC) number as the unique identifier. Applicant data for matched osteopathic and allopathic seniors in the continental United States was included. We obtained street addresses for medical schools from an AAMC database and residency program addresses from the ACGME website. We performed geospatial analysis using ArcGIS Pro and compared results by gender. NRMP approved the data use and our institutional review board granted exempt status. RESULTS: A total of 881 of 944 unique applicants met inclusion criteria and included 48.5% (830/1,713) of matched allopaths and 37% of all matched seniors; 48% (420) were female. There was no significant difference between genders for distance moved (p = 0.31). Women moved a mean (±SD) 619 (±698) miles (median = 341 miles, range = 0-2,679 miles); and men, a mean (±SD) 641 (±717) miles (median = 315 miles, range = 0-2,671 miles). Further analysis of applicants traveling less than 50 miles (49 women, 51 men) and by census division showed no significant frequency differences. CONCLUSION: Women and men travel similar distances for EM residency with the majority staying within geographic proximity to their medical school. This suggests that professional mobility at this stage is not a constraint. Our study findings are limited because we do not know which personal and professional factors inform relocation decisions. Gender is not associated with a difference in distance moved by students for residency. This finding may have implications for resident selection and career development.
RESUMO
OBJECTIVES: The Accreditation Council for Graduate Medical Education expects specialties to teach and assess proficiency in culturally competent care. However, little guidance has emerged to achieve these goals. Clinical training within socioeconomically disparate settings may provide an experiential learning opportunity. We sought to qualitatively explore resident experiences working in the generic clinical learning environments (i.e., exposure to socioeconomically diverse patients across different training sites) and how it shapes cultural competency-related skill development. METHODS: Residents were recruited from emergency medicine (EM) programs. We used purposeful sampling across all postgraduate years and elicited experiences related to working at the different sites related to cultural identity, frustrating patient encounters, vulnerable populations, and development of health disparities/social determinants of health knowledge. Individual structured interviews were conducted via phone between May and December 2016. Interviews were audiotaped, transcribed, anonymized, and analyzed using systematic and iterative coding methods. RESULTS: Twenty-four interviews revealed three main themes. EM residents' experiences caring for patients across sites shaped their understanding of: (1) potential patient attributes that affected the clinical encounter, (2) difficulties in building rapport had adverse effect on the clinical evaluation, and (3) residency program and training experiences shaped their clinical preparedness and willingness to work in underserved areas. CONCLUSION: Assessing the impact disparate clinical setting exposures have on trainees' preparedness to care for socioeconomically diverse patients can provide valuable insight for medical educators into barriers and facilitators to delivering optimal learning and patient care. Participants provided a breadth of stories illuminating their real-world consciousness and competency with meeting the needs of diverse populations and their access to varied educational outlets to grapple with the disparities they observed. More research is needed to uncover effective strategies to help residents thrive and feel more prepared to care for diverse populations.
RESUMO
BACKGROUND: Research abstracts are submitted for presentation at scientific conferences; however, criteria for judging abstracts are variable. We sought to develop two rigorous abstract scoring rubrics for education research submissions reporting (1) quantitative data and (2) qualitative data and then to collect validity evidence to support score interpretation. METHODS: We used a modified Delphi method to achieve expert consensus for scoring rubric items to optimize content validity. Eight education research experts participated in two separate modified Delphi processes, one to generate quantitative research items and one for qualitative. Modifications were made between rounds based on item scores and expert feedback. Homogeneity of ratings in the Delphi process was calculated using Cronbach's alpha, with increasing homogeneity considered an indication of consensus. Rubrics were piloted by scoring abstracts from 22 quantitative publications from AEM Education and Training "Critical Appraisal of Emergency Medicine Education Research" (11 highlighted for excellent methodology and 11 that were not) and 10 qualitative publications (five highlighted for excellent methodology and five that were not). Intraclass correlation coefficient (ICC) estimates of reliability were calculated. RESULTS: Each rubric required three rounds of a modified Delphi process. The resulting quantitative rubric contained nine items: quality of objectives, appropriateness of methods, outcomes, data analysis, generalizability, importance to medical education, innovation, quality of writing, and strength of conclusions (Cronbach's α for the third round = 0.922, ICC for total scores during piloting = 0.893). The resulting qualitative rubric contained seven items: quality of study aims, general methods, data collection, sampling, data analysis, writing quality, and strength of conclusions (Cronbach's α for the third round = 0.913, ICC for the total scores during piloting = 0.788). CONCLUSION: We developed scoring rubrics to assess quality in quantitative and qualitative medical education research abstracts to aid in selection for presentation at scientific meetings. Our tools demonstrated high reliability.
RESUMO
BACKGROUND: The chief resident role often includes additional administrative and educational experiences beyond those of nonchief senior residents. It is unclear to what extent these experiences influence the postresidency career path of those selected as chief residents. The objective of this study was to evaluate the association of chief resident status on immediate postresidency career characteristics relative to nonchief residents in emergency medicine (EM). METHODS: We retrospectively analyzed graduate data from 2016 to 2020 at six accredited EM residency programs. Participating sites were geographically diverse and included 3- and 4-year training formats. Each site abstracted data using a standardized form including program, year of graduation, chief resident status, publications during residency, and immediate postresidency position (academic vs. nonacademic). We calculated descriptive statistics and performed logistic regression to explore differences between the chief resident cohort and other graduates. RESULTS: We gathered information on 365 total graduates (45.8% from 3-year programs and 54.2% from 4-year programs) including 93 (25.5%) chief residents. A total of 129 (35%) graduates assumed an academic position immediately following residency. Fifty-six (60%) of 93 chief residents assumed an academic position immediately following residency, compared to 74 (27%) of 272 other graduates. After program, year of graduation, and number of publications completed during residency were controlled for, chief resident status was a significant predictor of immediate postresidency academic career (odds ratio for a chief resident assuming an academic job = 5.36, 95% confidence interval = 3.10 to 9.27). CONCLUSION: The chief resident role within EM is significantly associated with pursuit of an academic position immediately following residency compared to nonchiefs.