Virtual interviewing for graduate medical education recruitment and selection: A BEME systematic review: BEME Guide No. 80.

BACKGROUND: The COVID-19 pandemic caused graduate medical education (GME) programs to pivot to virtual interviews (VIs) for recruitment and selection. This systematic review synthesizes the rapidly expanding evidence base on VIs, providing insights into preferred formats, strengths, and weaknesses. METHODS: PubMed/MEDLINE, Scopus, ERIC, PsycINFO, MedEdPublish, and Google Scholar were searched from 1 January 2012 to 21 February 2022. Two authors independently screened titles, abstracts, full texts, performed data extraction, and assessed risk of bias using the Medical Education Research Quality Instrument. Findings were reported according to Best Evidence in Medical Education guidance. RESULTS: One hundred ten studies were included. The majority (97%) were from North America. Fourteen were conducted before COVID-19 and 96 during the pandemic. Studies involved both medical students applying to residencies (61%) and residents applying to fellowships (39%). Surgical specialties were more represented than other specialties. Applicants preferred VI days that lasted 4-6 h, with three to five individual interviews (15-20 min each), with virtual tours and opportunities to connect with current faculty and trainees. Satisfaction with VIs was high, though both applicants and programs found VIs inferior to in-person interviews for assessing 'fit.' Confidence in ranking applicants and programs was decreased. Stakeholders universally noted significant cost and time savings with VIs, as well as equity gains and reduced carbon footprint due to eliminating travel. CONCLUSIONS: The use of VIs for GME recruitment and selection has accelerated rapidly. The findings of this review offer early insights that can guide future practice, policy, and research.

An Automated System for Physician Trainee Procedure Logging via Electronic Health Records.

Importance: Procedural proficiency is a core competency for graduate medical education; however, procedural reporting often relies on manual workflows that are duplicative and generate data whose validity and accuracy are difficult to assess. Failure to accurately gather these data can impede learner progression, delay procedures, and negatively impact patient safety. Objective: To examine accuracy and procedure logging completeness of a system that extracts procedural data from an electronic health record system and uploads these data securely to an application used by many residency programs for accreditation. Design, Setting, and Participants: This quality improvement study of all emergency medicine resident physicians at University of California, San Diego Health was performed from May 23, 2023, to June 25, 2023. Exposures: Automated system for procedure data extraction and upload to a residency management software application. Main Outcomes and Measures: The number of procedures captured by the automated system when running silently compared with manually logged procedures in the same timeframe, as well as accuracy of the data upload. Results: Forty-seven residents participated in the initial silent assessment of the extraction component of the system. During a 1-year period (May 23, 2022, to May 7, 2023), 4291 procedures were manually logged by residents, compared with 7617 procedures captured by the automated system during the same period, representing a 78% increase. During assessment of the upload component of the system (May 8, 2023, to June 25, 2023), a total of 1353 procedures and patient encounters were evaluated, with the system operating with a sensitivity of 97.4%, specificity of 100%, and overall accuracy of 99.5%. Conclusions and Relevance: In this quality improvement study of emergency medicine resident physicians, an automated system demonstrated that reliance on self-reported procedure logging resulted in significant procedural underreporting compared with the use of data obtained at the point of performance. Additionally, this system afforded a degree of reliability and validity heretofore absent from the usual after-the-fact procedure logging workflows while using a novel application programming interface-based approach. To our knowledge, this system constitutes the first generalizable implementation of an automated solution to a problem that has existed in graduate medical education for decades.

Learning Outcomes in a Live Virtual versus In-Person Curriculum for Medical and Pharmacy Students.

Background: The coronavirus disease (COVID-19) pandemic has been a source of disruption, changing the face of medical education. In response to infection control measures at the University of California, San Diego, the hybrid in-person and recorded preclerkship curriculum was converted to a completely virtual format. The impact of this exclusive virtual teaching platform on the quality of trainee education is unknown. Objective: To determine the efficacy of a virtual course, relative to traditional hybrid in-person and recorded teaching, and to assess the impact of supplementary educational material on knowledge acquisition. Methods: A retrospective observational cohort study was performed to assess an introductory course, held mostly in person in 2019 versus completely virtual in 2020, for first-year medical students and second-year pharmacy students at the University of California, San Diego, School of Medicine and Skaggs School of Pharmacy and Pharmaceutical Sciences. Results: The midterm and final examination scores were similar for the hybrid and virtual courses. There was no association between the hours of recorded lectures watched and final examination scores for either course. In the 2019 in-person and recorded course, students who demonstrated consistent on-time use of practice quizzes scored statistically higher on the final examination (P = 0.0066). In the 2020 virtual course, students who downloaded quizzes regularly had statistically higher scores on the midterm examination (P < 0.0001). Conclusion: The similar examination scores for the hybrid in-person and recorded and exclusively virtual courses suggest that the short-term knowledge acquired was equivalent, independent of the modality with which the content was delivered. Consistent on-time use of practice quizzes was associated with higher examination scores. Future studies are needed to assess the difference between a completely in-person versus virtual curriculum.

Preparing MD-PhD students for clinical rotations: navigating the interface between PhD and MD training.

Many aspects of MD-PhD training are not optimally designed to prepare students for their future roles as translational clinician-scientists. The transition between PhD research efforts and clinical rotations is one hurdle that must be overcome. MD-PhD students have deficits in clinical skills compared with those of their MD-only colleagues at the time of this transition. Reimmersion programs (RPs) targeted to MD-PhD students have the potential to help them navigate this transition.The authors draw on their experience creating and implementing an RP that incorporates multiple types of activities (clinical exam review, objective structured clinical examination, and supervised practice in patient care settings) designed to enhance the participants' skills and readiness for clinical efforts. On the basis of this experience, they note that MD-PhD students' time away from the clinical environment negatively affects their clinical skills, causing them to feel underprepared for clinical rotations. The authors argue that participation in an RP can help students feel more comfortable speaking with and examining patients and decrease their anxiety regarding clinical encounters. The authors propose that RPs can have positive outcomes for improving the transition from PhD to clinical MD training in dual-degree programs. Identifying and addressing this and other transitions need to be considered to improve the educational experience of MD-PhD students.