RESUMO
Objectives: There is a concern that provide increased extraneous cognitive load when paired with residents on shift. However, this may be offset by the decrease in extraneous load they may provide to the residents they are paired with by offloading basic patient care tasks. We hypothesized that these forces may not be balanced. Methods: We conducted a retrospective observational analysis of PGY-2 emergency medicine residents and junior medical students at a single academic emergency department (ED) in the Midwest. A series of efficiency metrics (relative value unit [RVUs], patients per hour [PPH], time to note completion, and resident assignment to disposition [RATD]) as well as one quality metric (number of return ED visits; "bouncebacks") were compared for resident shifts in which a student was paired with the resident as well those in which no student was paired utilizing a regression model. Results: A total of 1844 records met the inclusion criteria (214 shifts with a paired medical student and 1630 without). After covariates were adjusted for, medical student shift status was a statistically significant predictor of increases in PPH (p < 0.0001) and RVUs (p = 0.0161) but was not significantly associated with RATD (p = 0.6941), log-time to note completion (p = 0.1604), or bounceback status (p = 0.9840). Shifts where residents were paired with medical students were predicted to see an additional 1.131 (95% confidence interval [CI] 0.660-1.602) PPH and produce an additional 1.923 RVUs (95% CI 1.130-3.273) per shift relative to shifts without medical students. Conclusions: When junior medical students were paired with a PGY-2 resident on ED shifts, there was a significant increase in the PPH and RVUs generated when compared with shifts in which no medical student was paired with them.
RESUMO
Background: Given the importance of the standardized letter of evaluation (SLOE) for application to emergency medicine (EM) residency, it is important that SLOE developers and authors understand how reviewers determine SLOE competitiveness. To inform SLOE design and authorship, the authors set out to build a novel theory to explain how faculty holistically interpret SLOE competitiveness. Methods: The authors used constructivist grounded theory to explore how EM faculty determine SLOE competitiveness. They used purposive sampling to recruit EM faculty participants with at least 1 year of experience in scoring SLOEs. One author conducted hour-long, semistructured interviews over Zoom between August 2023 and March 2024. Two authors iteratively coded the data to develop the initial codebook, organize codes into categories, and build connections to construct the resulting theory. Results: The authors interviewed 11 EM faculty from throughout the United States. Participants described a complex process to determine SLOE competitiveness. They began by contextualizing the SLOE to determine its trustworthiness and value before using various components of the SLOE to stratify and refine their understanding of competitiveness. Finally, when participants noted the inconsistency between different aspects of the SLOE, they used various methods to reconcile discordances and determine competitiveness. Conclusions: This study illuminates the framework used by EM faculty to determine applicant competitiveness based on the SLOE and highlights several factors that SLOE authors should consider to ensure the accurate and efficient transfer of information.
RESUMO
Purpose: Entrustable professional activities (EPAs) are a widely used framework for curriculum and assessment, yet the variability in emergency medicine (EM) training programs mandates the development of EPAs that meet the needs of the specialty as a whole. This requires eliciting and incorporating the perspectives of multiple stakeholders (i.e., faculty, residents, and patients) in the development of EPAs. Without a shared understanding of what a resident must be able to do upon graduation, we run the risk of advancing ill-prepared residents that may provide inconsistent care. Methods: In an effort to address these challenges, beginning in February 2020, the authors assembled an advisory board of 25 EM faculty to draft and reach consensus on a final list of EPAs that can be used across all training programs within the specialty of EM. Using modified Delphi methodology, the authors came to consensus on an initial list of 22 EPAs. The authors presented these EPAs to faculty supervisors, residents, and patients for refinement. The authors collated and analyzed feedback from focus groups of residents and patients using thematic analysis. The EPAs were subsequently refined based on this feedback. Results: Stakeholders in EM residency training endorsed a final revised list of 22 EPAs. Stakeholder focus groups highlighted two main thematic considerations that helped shape the finalized list of EM EPAs: attention to the meaningful nuances of EPA language and contextualizing the EPAs and viewing them developmentally. Conclusions: To foreground all key stakeholders within the EPA process for EM, the authors chose within the development process to draft; come to consensus; and refine EPAs for EM in collaboration with relevant faculty, patient, and resident stakeholders. Each stakeholder group contributed meaningfully to the content and intended implementation of the EPAs. This process may serve as a model for others in developing stakeholder-responsive EPAs.
RESUMO
Introduction: Millions of patients present to US emergency departments every year with OB/GYN concerns. Emergency medicine trainees must be adequately prepared to care for this population, regardless of how commonly they appear in the training environment. We used active learning and gamification principles in this curriculum to increase learner engagement and participation in the material. Methods: We chose OB/GYN topics based on review of Tintinalli's OB/GYN content and the American Board of Emergency Medicine's Model of Clinical Practice. Each session comprised a case-based lecture and review questions using the game-based Kahoot! online software. Pre- and postcurriculum surveys assessed residents' confidence in caring for emergent OB/GYN pathologies on a 5-point Likert scale. We designed survey questions assessing the first level of Kirkpatrick's levels of training evaluation; these questions were reviewed and revised by the department's Medical Education Scholarship Committee for validity. Results: A mean of 18 residents attended each session. Seventy-six percent of residents (26 of 34) completed the precurriculum survey, 67% (23 of 34) completed the postcurriculum survey, and 44% (15 of 34) completed both. For all respondents, mean reported confidence with curriculum topics increased from 3.5 to 4.0 (p < .05). For residents completing both surveys, confidence increased from 3.4 to 4.0 (p < .01). Discussion: Application of this curriculum significantly improved learner confidence in targeted OB/GYN topics. Future directions could include evaluating curricular impact at higher levels in the Kirkpatrick model, extending sessions to include more time for interaction, and adding suggested readings.
Assuntos
Ginecologia , Internato e Residência , Obstetrícia , Feminino , Gravidez , Humanos , Estados Unidos , Ginecologia/educação , Obstetrícia/educação , Inquéritos e Questionários , CurrículoRESUMO
INTRODUCTION: Belief in a just world is the cognitive bias that "one gets what they deserve." Stronger belief in a just world for others (BJW-O) has been associated with discrimination against individuals with low socioeconomic status (SES) or poor health status, as they may be perceived to have "deserved" their situation. Emergency medicine (EM) residents have been shown to "cherry pick" patients; in this study we sought to determine whether BJW-O is associated with a biased case mix seen in residency. METHODS: We assessed EM residents on their BJW-O using a scale with previous validity evidence and behavioral correlates. We identified chief complaints that residents may associate with low SES or poor health status, including psychiatric disease, substance use disorder (SUD); and patients with multidisciplinary care plans due to frequent ED visits. We then calculated the percentage of each of these patient types seen by each resident as well as correlations and a multiple linear regression. RESULTS: 38 of 48 (79%) residents completed the BJW-O, representing 98,825 total patient encounters. The median BJW-O score was 3.25 (interquartile range 2.81-3.75). There were no significant correlations observed between BJW-O and the percentage of patients with multidisciplinary care plans who were seen, or patients with psychiatric, SUD, dental or sickle cell chief complaints seen; and a multiple linear regression showed no significant association. CONCLUSION: Higher BJW-O scores in EM residents are not significantly associated with a biased case mix of patients seen in residency.
Assuntos
Medicina de Emergência , Internato e Residência , Viés , Grupos Diagnósticos Relacionados , Medicina de Emergência/educação , HumanosRESUMO
INTRODUCTION: Emergency medicine (EM) residents take the American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) every year. This examination is based on the ABEM Model of Clinical Practice (Model). The purpose of this study was to determine whether a relationship exists between the number of patient encounters a resident sees within a specific clinical domain and their ITE performance on questions that are related to that domain. METHODS: Chief complaint data for each patient encounter was taken from the electronic health record for EM residents graduating in three consecutive years between 2016-2021. We excluded patient encounters without an assigned resident or a listed chief complaint. Chief complaints were then categorized into one of 20 domains based on the 2016 Model. We calculated correlations between the total number of encounters seen by a resident for all clinical years and their ITE performance for the corresponding clinical domain from their third year of training. RESULTS: Available for analysis were a total of 232,625 patient encounters and 69 eligible residents who treated the patients. We found no statistically significant correlations following Bonferroni correction for multiple analyses. CONCLUSION: There was no correlation between the number of patient encounters a resident has within a clinical domain and their ITE performance on questions corresponding to that domain. This suggests the need for separate but parallel educational missions to achieve success in both the clinical environment and standardized testing.
Assuntos
Medicina de Emergência , Internato e Residência , Humanos , Estados Unidos , Avaliação Educacional , Competência Clínica , Medicina de Emergência/educação , EscolaridadeRESUMO
Audience: This curriculum is designed for emergency medicine residents at all levels of training. The curriculum covers basic foundations in clinical informatics for improving patient care and outcomes, utilizing data, and leading improvements in emergency medicine. Length of Curriculum: The curriculum is designed for a four-week rotation. Introduction: The American College of Graduate Medical Education (ACGME) mandated that all Emergency Medicine (EM) residents receive specific training in the use of information technology.1,2 To our knowledge, a clinical informatics curriculum for EM residents does not exist. We propose the following standardized and reproducible educational curriculum for EM residents. Educational Goals: The aim of this curriculum is to teach informatics skills to emergency physicians to improve patient care and outcomes, utilize data, and develop projects to lead change.3 These goals will be achieved by providing a foundational informatics elective for EM residents that follows the delineation of practice for Clinical Informatics outlined by the American Medical Informatics Association (AMIA) and the American Board of Preventive Medicine (ABPM).4-6. Educational Methods: The educational strategies used in this curriculum include asynchronous learning via books, papers, videos, and websites. Residents attend administrative sessions (meetings), develop a project proposal, and participate in small group discussions.The rotation emphasizes the basic concepts surrounding clinical informatics with an emphasis on improving care delivery and outcomes, information systems, data governance and analytics, as well as leadership and professionalism. The course focuses on the practical application of these concepts, including implementation, clinical decision support, workflow analysis, privacy and security, information technology across the patient care continuum, health information exchange, data analytics, and leading change through stakeholder engagement. Research Methods: An initial version of the curriculum was introduced to two separate institutions and was completed by three rotating resident physicians and one rotating resident pharmacist. A brief course evaluation as well as qualitative feedback was solicited from elective participants by the course director, via email following the completion of the course, regarding the effectiveness of the course content. Learner feedback was used to influence the development of this complete curriculum. Results: The curriculum was graded by learners on a 5-point Likert scale (1=strongly disagree, 5 = strongly agree). The mean response to, "This course was a valuable use of my elective time," was 5 (sd=0). The mean response to, "I achieved the learning objectives," and "This rotation helped me understand Clinical Informatics," were both 4.75 (sd=0.5). Discussion: Overall, participants reported that the content was effective for achieving the learning objectives. During initial implementation, we found that the preliminary asynchronous learning component worked less effectively than we anticipated due to a lower volume of content. In response to this, as well as resident feedback, we added significantly more educational content.In conclusion, this model curriculum provides a structured process for an informatics rotation for the emergency medicine resident that utilizes the core competencies established by the governing bodies of the clinical informatics specialty and ACGME. Topics: Clinical informatics key concepts, including definitions, fundamental terminology, history, policy and regulations, ethical considerations, clinical decision support, health information systems, data governance and analytics, process improvement, stakeholder engagement and change management.
RESUMO
Introduction: The number of fellowship options for emergency medicine (EM) physicians continues to expand. While guides exist to help residents explore individual fellowship pathways, we aimed to create a comprehensive guide for all residents considering fellowship. Methods: At the direction of the Society for Academic Emergency Medicine (SAEM) Board, 9 members of the Fellowship Guide Workgroup, including members of the Fellowship Approval Committee, and 2 members of SAEM Residents and Medical Students (RAMS) group collaboratively developed the guide using available evidence and expert opinion when high-quality evidence was unavailable. The guide was reviewed and approved by all members. Results: The guide offers advice to EM residents on how to conceptualize key aspects of their training with respect to preparation for fellowship, including scholarship, teaching, leadership, and electives. Additionally, it offers perspective on selecting a fellowship that matches the resident's interests and goals and successfully applying. Conclusion: This fellowship guide for EM residents considering fellowship summarizes the best currently available advice for residents considering fellowship training after residency.
RESUMO
Background: Since 2018, the Centers for Medicare & Medicaid Services (CMS) guidelines have allowed teaching physicians to bill for evaluation and management services based on medical student documentation. Limited previous data suggest that medical student documentation suffers from a high rate of downcoding relative to faculty documentation. We sought to compare the coding outcomes of documentation performed by medical students, and not edited by faculty, with documentation edited and submitted by faculty. Methods: A total of 104 randomly selected notes from real patient encounters written by senior medical students were compared to the revised notes submitted by faculty. The note pairs were then split and reviewed by blinded professional coders and assigned level of service (LoS) codes 1-5 (corresponding to E&M CPT codes 99281-99285). Results: We found that the LoS agreement between student and faculty note versions was 63%, with 23% of all student notes receiving lower LoS compared to faculty notes (downcoded). This was found to be similar to baseline variability in professional coder LoS designations. Conclusions: Notes from medical students who have completed a focused documentation curriculum have less LoS downcoding than in previous reports.
RESUMO
INTRODUCTION: COVID-19 has exposed health care workers to new stressors; emergency department providers are at risk of increased stress. It is unknown how coping strategies are utilized by this group during a pandemic. METHODS: A cross-sectional survey incorporating the Brief COPE inventory was deployed to residents, fellows, faculty, and physician assistants at a single US academic emergency department in the spring (April 2020 - May 2020) and winter (December 2020 - January 2021). Scores for 14 individual coping strategies, as well as approach (positive) and avoidant (negative) coping categories, were measured, and utilization of these coping strategies was compared with respect to the provider's role, sex, the number of people living at home, presence of pets and/or children at home, and stress level. RESULTS: The response rate was 58/103 (56.3%) and 50/109 (45.9%) for the spring and winter distributions, respectively. In the spring, 70.6% of responders reported increased stress vs 66% in the winter. Overall utilization of coping strategies increased slightly between spring and winter for approach coping (32.22 to 32.64) and avoidant coping (20.95 to 21.73). Resident physicians utilized less approach coping and more avoidant coping when compared to faculty/fellows. Substance use overall had a relatively low score, which increased slightly between spring and winter distributions (2.93 to 3.04). CONCLUSIONS: Approach coping was frequently utilized among ED providers during the COVID-19 pandemic study period. Resident physicians had higher utilization of avoidant coping strategies compared to faculty/fellows and could benefit from targeted wellness interventions during times of increased stress.
Assuntos
COVID-19 , Pandemias , Adaptação Psicológica , Criança , Estudos Transversais , Serviço Hospitalar de Emergência , Humanos , SARS-CoV-2 , Inquéritos e QuestionáriosRESUMO
INTRODUCTION: All emergency medicine (EM) residency programs must recruit new medical school graduates each year. The process is often overwhelming, with each program receiving far more applicants than available positions. We searched for evidence-based best practices to guide residency programs in screening, interviewing, and ranking applicants to ensure a high-performing and diverse residency class. METHODS: A literature search was conducted on the topic of residency recruitment, utilizing a call on social media as well as multiple databases. After identifying relevant articles, we performed a modified Delphi process in three rounds, utilizing junior educators as well as more senior faculty. RESULTS: We identified 51 relevant articles on the topic of residency recruitment. The Delphi process yielded six articles that were deemed most highly relevant over the three rounds. Transparency with selection criteria, holistic application review, standardized letters of evaluation, and blinding applicant files for interviewers were among noted best practices. CONCLUSIONS: Well-supported evidence-based practices exist for residency recruitment, and programs may benefit from understanding which common recruitment practices offer the most value. The articles discussed here provide a foundation for faculty looking to improve their program's recruiting practices.
RESUMO
BACKGROUND: Entrustable Professional Activities (EPAs) contain narrative 'entrustment roadmaps' designed to describe specific behaviors associated with different entrustment levels. However, these roadmaps were created using expert committee consensus, with little data available for guidance. Analysis of actual EPA assessment narrative comments using natural language processing may enhance our understanding of resident entrustment in actual practice. METHODS: All text comments associated with EPA microassessments at a single institution were combined. EPA-entrustment level pairs (e.g. Gallbladder Disease-Level 1) were identified as documents. Latent Dirichlet Allocation (LDA), a common machine learning algorithm, was used to identify latent topics in the documents associated with a single EPA. These topics were then reviewed for interpretability by human raters. RESULTS: Over 18 months, 1015 faculty EPA microassessments were collected from 64 faculty for 80 residents. LDA analysis identified topics that mapped 1:1 to EPA entrustment levels (Gammas >0.99). These LDA topics appeared to trend coherently with entrustment levels (words demonstrating high entrustment were consistently found in high entrustment topics, word demonstrating low entrustment were found in low entrustment topics). CONCLUSIONS: LDA is capable of identifying topics relevant to progressive surgical entrustment and autonomy in EPA comments. These topics provide insight into key behaviors that drive different level of resident autonomy and may allow for data-driven revision of EPA entrustment maps.
Assuntos
Competência Clínica/normas , Feedback Formativo , Internato e Residência/normas , Modelos Educacionais , Especialidades Cirúrgicas/educação , Competência Clínica/estatística & dados numéricos , Educação Baseada em Competências/normas , Educação Baseada em Competências/estatística & dados numéricos , Ciência de Dados/métodos , Docentes de Medicina/normas , Docentes de Medicina/estatística & dados numéricos , Estudos de Viabilidade , Humanos , Internato e Residência/métodos , Internato e Residência/estatística & dados numéricos , Aprendizado de Máquina , Processamento de Linguagem Natural , Autonomia Profissional , Especialidades Cirúrgicas/normas , Especialidades Cirúrgicas/estatística & dados numéricos , Cirurgiões/educação , Cirurgiões/normasRESUMO
INTRODUCTION: While patient throughput and emergency department (ED) length of stay (LOS) are recognized as important metrics in the delivery of efficient care, they must be balanced with the educational mission of academic centers. Prior studies examining the impact of learners on throughput and LOS when staffing directly with attending physicians have yielded mixed results. Herein we sought to examine the impact of a staffing model involving a supervisory resident "pre-attending" (PAT) on ED throughput and LOS, as this model offers a valuable educational experience for residents, but may do so at the expense of operational efficiency. METHODS: We retrospectively analyzed 26,702 unique patient encounters at a university-affiliated community ED between July 1, 2017-January 1,2019. The experimental group was comprised of patients seen primarily by midlevel providers, who staffed with a PAT, who subsequently staffed with an attending physician. The control group was comprised of patients seen by midlevel providers and staffed directly with attendings without a PAT. We used a parametric hazard model to analyze the effect of the presence of a PAT on service time, controlling for potential confounders including timing of presentation and patient demographics. RESULTS: The presence of a PAT is associated with a statistically significant increase in service time of five minutes (p = 0.006). Holding other variables equal, predicted service time in the experimental group was 173 minutes (95% confidence interval (CI), 171-176), while that for controls was 168 minutes (95% CI, 165-171). CONCLUSION: The presence of a PAT is associated with a statistically significant increase in service time, but the magnitude (five minutes) is likely operationally insignificant. The negligible increase in service time is offset by the benefit to residents' training. The results of this study may be helpful for residency programs considering the addition of a PAT shift structure.
Assuntos
Educação , Medicina de Emergência/educação , Serviço Hospitalar de Emergência/estatística & dados numéricos , Internato e Residência , Recursos Humanos/organização & administração , Adulto , Educação/métodos , Educação/organização & administração , Eficiência Organizacional , Feminino , Humanos , Internato e Residência/métodos , Internato e Residência/normas , Tempo de Internação/estatística & dados numéricos , Masculino , Médicos/organização & administração , Estudos Retrospectivos , Fatores de TempoRESUMO
INTRODUCTION: The "stable marriage" algorithm underlying the National Residency Match Program (NRMP) has been shown to create optimal outcomes when students submit true preference lists. Previous research has shown students may allow external information to affect their rank lists. The objective of this study was to determine whether medical students consistently make rank lists that reflect their true preferences. METHODS: A voluntary online survey was sent to third-year students at a single midwestern medical school. Students were given hypothetical scenarios that either should or should not affect their true residency preferences and rated the importance of six factors to their final rank list. The survey was edited by a group of education scholars and revised based on feedback from a pilot with current postgraduate year 1 residents. RESULTS: Of 175 students surveyed, 140 (80%) responded; 63% (88/140) reported that their "perceived competitiveness" would influence their rank list at least a "moderate amount. Of 135 students, 31 (23%) moved a program lower on their list if they learned they were ranked "low" by that program, while 6% (8/135) of respondents moved a program higher if they learned they were ranked "at the top of the list." Participants responded similarly (κ = 0.71) when presented with scenarios asking what they would do vs what a classmate should do. CONCLUSION: Students' hypothetical rank lists did not consistently match their true residency preferences. These results may stem from a misunderstanding of the Match algorithm. Medical schools should consider augmenting explicit education related to the NRMP Match algorithm to ensure optimal outcomes for students.
Assuntos
Comportamento de Escolha , Internato e Residência , Critérios de Admissão Escolar , Estudantes de Medicina/psicologia , Algoritmos , Estudos Transversais , Feminino , Humanos , Masculino , Faculdades de Medicina , Estudantes de Medicina/estatística & dados numéricos , Inquéritos e Questionários , Estados UnidosRESUMO
The coronavirus disease (COVID-19) pandemic has had a significant impact on undergraduate medical education with limitation of patient care activities and disruption to medical licensing examinations. In an effort to promote both safety and equity, the emergency medicine (EM) community has recommended no away rotations for EM applicants and entirely virtual interviews during this year's residency application cycle. These changes affect the components of the EM residency application most highly regarded by program directors - Standardized Letters of Evaluation from EM rotations, board scores, and interactions during the interview. The Council of Residency Directors in Emergency Medicine Application Process Improvement Committee suggests solutions not only for the upcoming year but also to address longstanding difficulties within the process, encouraging residency programs to leverage these challenges as an opportunity for disruptive innovation.
Assuntos
Betacoronavirus , Infecções por Coronavirus/prevenção & controle , Medicina de Emergência/educação , Internato e Residência/métodos , Inovação Organizacional , Pandemias/prevenção & controle , Pneumonia Viral/prevenção & controle , Critérios de Admissão Escolar/tendências , COVID-19 , Humanos , SARS-CoV-2 , Estados Unidos , Comunicação por Videoconferência/organização & administração , Comunicação por Videoconferência/tendênciasRESUMO
OBJECTIVE: Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery. DESIGN, SETTING, PARTICIPANTS: Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights. RESULTS: One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p < 0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κâ¯=â¯0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κâ¯=â¯0.58 vs 0.36). CONCLUSIONS: Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.
Assuntos
Cirurgia Geral , Internato e Residência , Competência Clínica , Cirurgia Geral/educação , Humanos , Autoavaliação (Psicologia)RESUMO
OBJECTIVE: Concerns over resident ability to practice effectively after graduation have led to the competency-based medical education movement. Entrustable professional activities (EPAs) may facilitate competency-based medical education in surgery, but implementation is challenging. This manuscript describes 1 strategy used to implement EPAs into an academic general surgery residency. DESIGN, SETTING, PARTICIPANTS: A mobile application was developed incorporating 5 EPAs developed by the American Board of Surgery; residents and faculty from the Departments of Surgery, Emergency Medicine, and Hospital Medicine at a single tertiary care center were trained in its use. Entrustment levels and free text feedback were collected. Self-assessment was paired with supervisor assessment, and faculty assessments were used to inform clinical competency committee entrustment decisions. Feedback was regularly solicited from app users and results distributed on a monthly basis. RESULTS: One thousand seven hundred and twenty microassessments were collected over the first 16 months of implementation; 898 (47.8%) were performed by faculty with 569 (66.0%) matched pairs. Engagement was skewed with small numbers of high performers in both resident and faculty groups. Continued development of resident and faculty was required to sustain engagement with the program. Nonsurgical specialties contributed significantly to resident assessments (496, 28.8%). CONCLUSIONS: EPAs are being successfully integrated into the assessment framework at our institution. EPA implementation in surgery residency is a long-term process that requires investment, but may address limitations in the current assessment framework.
Assuntos
Medicina de Emergência , Internato e Residência , Competência Clínica , Educação Baseada em Competências , Medicina de Emergência/educação , Humanos , Autoavaliação (Psicologia)RESUMO
INTRODUCTION: The Association of American Medical Colleges has introduced the Standardized Video Interview (SVI) to assess the communication and professionalism skills of residency applicants to allow a more holistic view of applicants beyond academic performance. Initial data suggests scores are not correlated with academic performance and provide a new measure of applicant attributes. It is not currently known how the SVI compares to existing metrics for assessing communication and professionalism during the interview process. METHODS: Applicants to the University of Wisconsin Emergency Medicine Residency program were invited and interviewed without use of the SVI scores or videos. All faculty interviewers were blinded to applicants' SVI information and asked to rate each applicant on their communication and professionalism on a scale from 1-25 (faculty gestalt score), analogous to the 6-30 scoring used by the SVI. We transformed SVI scores to our 1-25 system (transformed SVI score) for ease of comparison and compared them to faculty gestalt scores as well as applicants' overall score for all components of their interview day (interview score). RESULTS: We collected data for 125 residency candidates. Each applicant received a faculty gestalt score from up to four faculty interviewers. There was no significant correlation of SVI scores with faculty gestalt scores (Spearman's rank correlation coefficient [rs] (123)=0.09, p=0.30) and no correlation with the overall interview score (rs(123)=0.01, p=0.93). Faculty gestalt scores were correlated positively with interview scores (rs(123)=0.65, p<0.01). CONCLUSION: SVI scores show no significant correlation with faculty gestalt scores of communication and professionalism. This could relate to bias introduced by knowledge of an applicant's academic performance, different types of questions being asked by faculty interviewers, or lack of uniform criteria by which faculty assess these competencies. Further research is needed to determine whether SVI scores or faculty gestalt correlate with performance during residency.
Assuntos
Comunicação , Internato e Residência/normas , Seleção de Pessoal/métodos , Profissionalismo , Gravação em Vídeo , Avaliação Educacional/estatística & dados numéricos , Medicina de Emergência/educação , Docentes , Humanos , Entrevistas como Assunto , WisconsinRESUMO
INTRODUCTION: The National Residency Matching Program (NRMP) allows post-interview contact between residency applicants and residency programs. Thank-you communications represent one of the most common forms, but data on their value to applicants and program directors (PD) are limited. The objective of this study was to assess the effect of thank-you communications on applicant- and residency-program rank lists. METHODS: Two anonymous, voluntary surveys were sent after the 2018 NRMP Match, one to applicants who were offered an interview at a single academic site in the 2017-2018 Match cycle, and one to EM PDs nationwide. The surveys were designed in conjunction with a nationally-recognized survey center and piloted and revised based on feedback from residents and faculty. RESULTS: Of 196 residency applicants, 97 (49.5%) responded to the survey. Of these, 73/95 (76.8%) reported sending thank-you communications. Twenty-two of 73 (30%) stated that they sent thank-you communications to improve their spot on a program's rank list; and 16 of 73 (21.9%) reported that they changed their rank list based upon the responses they received to their thank-you communications. Of 163 PDs, 99 (60.7%) responded to the survey. Of those PDs surveyed, 22.6% reported that an applicant could be moved up their program's rank list and 10.8% reported that an applicant could move down a program's rank list based on their thank-you communications (or lack thereof). CONCLUSION: The majority of applicants to EM are sending thank-you communications. A significant minority of applicants and PDs changed their rank list due to post-interview thank-you communications.
Assuntos
Comunicação , Medicina de Emergência/educação , Internato e Residência , Humanos , Candidatura a Emprego , Critérios de Admissão Escolar , Inquéritos e Questionários , Estados UnidosRESUMO
INTRODUCTION: Emergency physicians encounter scenarios daily that many would consider "disgusting," including exposure to blood, pus, and stool. Physicians in procedural specialties such as surgery and emergency medicine (EM) have lower disgust sensitivity overall, but the role this plays in clinical practice is unclear. The objective of this study was to determine whether emergency physicians with higher disgust sensitivity see fewer "disgusting" cases during training. METHODS: All EM residents at a midsize urban EM program were eligible to complete the Disgust Scale Revised (DS-R). We preidentified cases as "disgust elicitors" based on diagnoses likely to induce disgust due to physician exposure to bodily fluids, anogenital anatomy, or gross deformity. The "disgust elicitor" case percent was determined by "disgust elicitor" cases seen as the primary resident divided by the number of cases seen thus far in residency. We calculated Pearson's r, t-tests and descriptive statistics on resident and population DS-R scores and "disgust elicitor" cases per month. RESULTS: Mean DS-R for EM residents (n = 40) was 1.20 (standard deviation [SD] 1.24), significantly less than the population mean of 1.67 (SD 0.61, p<0.05). There was no correlation (r = -0.04) between "disgust elicitor" case (n = 2191) percent and DS-R scores. There was no significant difference between DS-R scores for junior residents (31.1, 95% confidence interval [CI], 26.8-35.4) and for senior residents (29.0, 95%CI, 23.4-34.6). CONCLUSION: Higher disgust sensitivity does not appear to be correlated with a lower percentage of "disgust elicitor" cases seen during EM residency.