A scoping review of artificial intelligence in medical education: BEME Guide No. 84.

BACKGROUND: Artificial Intelligence (AI) is rapidly transforming healthcare, and there is a critical need for a nuanced understanding of how AI is reshaping teaching, learning, and educational practice in medical education. This review aimed to map the literature regarding AI applications in medical education, core areas of findings, potential candidates for formal systematic review and gaps for future research. METHODS: This rapid scoping review, conducted over 16 weeks, employed Arksey and O'Malley's framework and adhered to STORIES and BEME guidelines. A systematic and comprehensive search across PubMed/MEDLINE, EMBASE, and MedEdPublish was conducted without date or language restrictions. Publications included in the review spanned undergraduate, graduate, and continuing medical education, encompassing both original studies and perspective pieces. Data were charted by multiple author pairs and synthesized into various thematic maps and charts, ensuring a broad and detailed representation of the current landscape. RESULTS: The review synthesized 278 publications, with a majority (68%) from North American and European regions. The studies covered diverse AI applications in medical education, such as AI for admissions, teaching, assessment, and clinical reasoning. The review highlighted AI's varied roles, from augmenting traditional educational methods to introducing innovative practices, and underscores the urgent need for ethical guidelines in AI's application in medical education. CONCLUSION: The current literature has been charted. The findings underscore the need for ongoing research to explore uncharted areas and address potential risks associated with AI use in medical education. This work serves as a foundational resource for educators, policymakers, and researchers in navigating AI's evolving role in medical education. A framework to support future high utility reporting is proposed, the FACETS framework.

Virtual interviewing for graduate medical education recruitment and selection: A BEME systematic review: BEME Guide No. 80.

BACKGROUND: The COVID-19 pandemic caused graduate medical education (GME) programs to pivot to virtual interviews (VIs) for recruitment and selection. This systematic review synthesizes the rapidly expanding evidence base on VIs, providing insights into preferred formats, strengths, and weaknesses. METHODS: PubMed/MEDLINE, Scopus, ERIC, PsycINFO, MedEdPublish, and Google Scholar were searched from 1 January 2012 to 21 February 2022. Two authors independently screened titles, abstracts, full texts, performed data extraction, and assessed risk of bias using the Medical Education Research Quality Instrument. Findings were reported according to Best Evidence in Medical Education guidance. RESULTS: One hundred ten studies were included. The majority (97%) were from North America. Fourteen were conducted before COVID-19 and 96 during the pandemic. Studies involved both medical students applying to residencies (61%) and residents applying to fellowships (39%). Surgical specialties were more represented than other specialties. Applicants preferred VI days that lasted 4-6 h, with three to five individual interviews (15-20 min each), with virtual tours and opportunities to connect with current faculty and trainees. Satisfaction with VIs was high, though both applicants and programs found VIs inferior to in-person interviews for assessing 'fit.' Confidence in ranking applicants and programs was decreased. Stakeholders universally noted significant cost and time savings with VIs, as well as equity gains and reduced carbon footprint due to eliminating travel. CONCLUSIONS: The use of VIs for GME recruitment and selection has accelerated rapidly. The findings of this review offer early insights that can guide future practice, policy, and research.

A multisite randomized trial of implicit versus explicit modeling in clinical teaching.

PURPOSE: Faculty modeling of desired behaviors has historically been a part of the apprenticeship model of clinical teaching, yet little is known about best practices for modeling. This study compared the educational impact of implicitly versus explicitly modeled communication skills among U.S. medical students. METHOD: Fourth-year medical students from six U.S. academic medical centers were randomly assigned one simulated clinical encounter in which faculty provided either implicit or explicit modeling of important communication skills. Outcomes were assessed by electronic surveys immediately before and after the simulations. Students were blinded to the purpose of the study. RESULTS: Students in the explicit arm were more likely to correctly cite two of the three key specific communication elements modeled by faculty: deliberate body position (53.3% vs. 18.6%, p < 0.001) and summarizing patient understanding (62.2% vs. 11.6%, p < 0.001). More students in the explicit study arm reported faculty 'demonstrated a key behavior that they wanted me to be able to perform in the future' (93.2% versus 62.8%, p = 0.002). Participating faculty stated they would modify their teaching approach in response to their experiences in the study. CONCLUSIONS: In a multi-center randomized trial, explicit faculty role-modeling led to greater uptake of communication knowledge, greater recognition of skills, and a greater sense that faculty expected these skills to be adopted by students. These results must be considered in the context, however, of a simulated environment and a short timeframe for assessing learning with students who volunteered for a simulated experience.

A BEME realist synthesis review of the effectiveness of teaching strategies used in the clinical setting on the development of clinical skills among health professionals: BEME Guide No. 61.

Background: Literature describing the effectiveness of teaching strategies in the clinical setting is limited. This realist synthesis review focuses on understanding the effectiveness of teaching strategies used in the clinical setting.Methods: We searched ten databases for English language publications between 1 January 1970 and 31 May 2017 reporting effective teaching strategies, used in a clinical setting, of non-procedural skills. After screening, we used consensus to determine inclusion and employed a standardised instrument to capture study populations, methodology, and outcomes. We summarised what strategies worked, for whom, and in what settings.Results: The initial search netted 53,642 references after de-duplication; 2037 were retained after title and abstract review. Full text review was done on 82 references, with ultimate inclusion of 25 publications. Three specific teaching strategies demonstrated impact on educational outcomes: the One Minute Preceptor (OMP), SNAPPS, and concept mapping. Most of the literature involves physician trainees in an ambulatory environment. All three have been shown to improve skills in the domains of medical knowledge and clinical reasoning.Discussion/conclusions: Apart from the OMP, SNAPPS, and concept mapping, which target the formation of clinical knowledge and reasoning skills, the literature establishing effective teaching strategies in the clinical setting is sparse.

Virtual reality videos for training and protocol dissemination during a pandemic.

This article was migrated. The article was marked as recommended. Preparations for the COVID-19 pandemic required healthcare teams to practice known skills, such as intubation, with renewed consideration for safety, as well as develop new Standard Operating Procedures (SOPs) for health care delivery. In these conditions, translational simulation based-education (SBE) is a well-known tool that supports health care teams to improve the system using design thinking methods such as walkthroughs and team-based simulation. However, the pandemic has introduced two stressors on translational SBE simultaneously. Firstly, the need for rapid upskilling of front-line staff and rapid change to SOPs. Secondly, the need for social or physical distancing at work, such that it quickly became inappropriate for large groups of individuals to practice in-situ SBE and debrief together in close proximity. An educational approach that brings the best of translational SBE while minimizing contact and maximizing experiential learning is needed. Digital learning has been rapidly adopted by much of medical education during the pandemic. Focusing on a strong alignment between learning goals with intended clinical performance change outcomes we sought to leverage a digital education format that allowed for low barriers to adoption, yet supported the experiential, dynamic reality of translational SBE. In the absence of the ability to quickly train large numbers of people due to the need for social distancing, an immersive experience that can only be provided by virtual reality (VR) videos was the next best thing. VR, using 360-degree video, supported the creation of instructional videos from SBE events in the hospital which allow the learner to immerse and explore multiple points within the scenario. We describe how the very act of recording a video assisted in the rapid development of SOPs through translational simulation. We then describe the use of VR to stay true to the spirit of simulation for experiential learning and nearly hands-on training.

The Current State of Physics Plan Review Training in Medical Physics Residency Programs in North America.

PURPOSE: This study aimed to identify the current state of residency training in physics plan reviews. METHODS AND MATERIALS: A voluntary, anonymous survey was sent to all program directors of accredited therapeutic medical physics residency programs in North America. Survey questions were developed to determine whether and how residents are trained in physics plan reviews. Survey questions were developed using expert validation and cognitive pretesting. RESULTS: Using a prospectively approved study (COMIRB 18-1073), responses were collected from 70 program directors, representing a 70% response rate. All respondents (100%) designated patient safety to be the purpose of physics plan reviews. Of the respondents, 94% indicated that physicists should first receive training in physics plan reviews while in a residency program. The vast majority of respondents (99%) provide training to residents in physics plan reviews. Although 57 programs (81% of respondents) have residents perform physics plan reviews as part of clinical practice (with varying levels of independence), 13 programs (19% of respondents) do not. The majority of respondents use the following training methods: observe staff physicists (96%), perform supervised reviews on actual patients for training or clinical practice (93%), use a checklist (80%), and read reference materials (62%). Although simulation plans with embedded errors would be implemented by 71% of respondents, they are currently used in only 19% of programs. CONCLUSIONS: The present study is the first to characterize chart-check teaching practices in medical physics residency programs. The vast majority of programs currently train residents in physics plan reviews. The most common teaching methods are observing and performing physics plan reviews, but there is variability in the level of resident involvement in clinical practice for physics plan reviews. There is room for the field to consider advancing current training methods, which is especially important given the critical roles that physics plan reviews have with regard to patient safety.

Technological Pedagogical Content Knowledge Among Medical Educators: What Is Our Readiness to Teach With Technology?

PURPOSE: This study aimed to empirically assess medical educator knowledge of pedagogy and technology to inform the direction of faculty development efforts. METHOD: The technological pedagogical content knowledge (TPACK) framework survey is a validated instrument for understanding educators' knowledge of content (CK), pedagogy (PK), and technology (TK) in teaching. A modified version of the TPACK was administered to medical educators (N = 76) at 2 public institutions: University of California, Irvine School of Medicine (UC Irvine); and University of Colorado School of Medicine (CU). RESULTS: An independent-samples t test compared TK with PK and CK within each institution. The means of TK (UC Irvine: 3.4; CU: 3.4) and both PK for didactic sessions (UC Irvine: 3.9; CU: 4.4) and PK for clinical settings (UC Irvine: 4.0; CU: 4.4) were compared using a t test and statistically different, P < .01. Similarly, the means of TK and CK (UC Irvine: 4.5; CU: 4.7) were statistically different, P < .01. A Wilcoxon rank sum test indicated that the CU PK for a didactic session (mean: 4.4) was greater than the UC Irvine PK for a didactic session (mean: 3.9), P < .01. Similarly, the CU PK for a clinical setting (mean: 4.4) was greater than the UC Irvine PK for a clinical setting (mean: 4.0), P < .01. CONCLUSIONS: There is a clear need for faculty development programs for medical educators to focus on how to teach with technology if medical schools continue to adopt technology within their curricula.

Alliance, Trust, and Loss: Experiences of Patients Cared for by Students in a Longitudinal Integrated Clerkship.

PURPOSE: The longitudinal integrated clerkship (LIC) model, which allows medical students to participate in comprehensive care of a panel of patients over time, is rapidly expanding because of recognized benefits to students and faculty. This study aimed to determine how LIC student contact affected patients' experiences and self-described health outcomes. METHOD: This qualitative case study used semistructured patient interviews to understand the impact of LIC learners at the University of Colorado School of Medicine on patients at Denver Health. Patients with at least 3 encounters with an LIC student and over age 18 were selected. Thirty patients were invited to participate in 2016-2017; 14 (47%) completed interviews before the thematic analysis reached saturation. Four researchers independently analyzed interview transcripts and reached consensus on emergent categories and themes. RESULTS: Six broad themes were identified: beginnings of a relationship, caring demonstrated by student, growing to trust student, reaching a therapeutic alliance, improvement of patient outcomes due to student involvement, and a sense of loss after students completed the LIC program. CONCLUSIONS: Patients deeply valued the therapeutic alliances built with LIC students involved in their care over time. These alliances led to improved patient experience, mitigation of perceived health system failures, and subjective improvement in health outcomes. Patients described a sense of loss at the end of the LIC when students were no longer involved in their care. Curricula that support students building longitudinal therapeutic relationships with their patients are an opportunity to improve patient experience while promoting students' professional development.

A 3-Dimensional Anatomical Education Model in Postpartum Perineal Laceration Care: A Pre-Post Intervention Study.

OBJECTIVE: The aim of this study was to investigate the effects of postpartum patients introduction to and interaction with a virtual 3-dimensional (3D) pelvic model on the self-care, knowledge, and anxiety parameters. METHODS: The model was designed from computed tomography data displaying the involvement of the levator ani in a fourth-degree perineal laceration. This 3D model was used to educate postpartum day 1 patients at the bedside. Patient data were collected using a pre and post questionnaire assessing knowledge, anxiety, and confidence in perineal wound self-care. RESULTS: Thirty-six patients were enrolled with a median age of 28.5 years (interquartile range, 31, 21.75 years) and a median parity of 1 (interquartile range, 2, 1). Patient use of the tool significantly decreased patient anxiety regarding perineal lacerations (P < 0.01) and significantly increased patient knowledge on what part of their vagina was lacerated during vaginal delivery (P < 0.01). CONCLUSIONS: Reviewing a 3D model of perineal lacerations with patients on postpartum day 1 is associated with less anxiety and increased knowledge of pelvic floor anatomy. These pilot data represent a preliminary investigation into the relations between 3D model of perineal lacerations and a range of patient outcomes.

Launchpad for Onboarding New Faculty Into Academic Life.

We developed a faculty professional development seminar series in order to facilitate the integration of our numerous new faculty into academics. The changing nature of the healthcare system, increasing clinical and administrative responsibility, and lack of access to senior mentors can hinder junior faculty productivity and possibly increase attrition. Given that no ready-made resources existed to address these issues we established a Professional Development Committee, developed a curriculum that covers relevant topics including promotion, mentorship, conflict management and feedback, and effective presentation of scientific data, and instituted changes iteratively based upon feedback. We used surveys from successive years of this seminar series to assess effectiveness, and our data demonstrate that our Professional Development Seminar Series was valued by its participants and that individual lectures improved from year to year. While it is too early to determine whether our efforts will lead to long-term changes in promotion success or faculty retention, our initial data are promising.

The Impact of an Academy of Medical Educators on the Culture of an American Health Sciences Campus.

PURPOSE: During the last two decades in the United States, academies of medical educators (AMEs) have proliferated as formal organizations within faculties of health professions education to recognize teaching excellence, support faculty development, and encourage scholarly activity. AMEs have been effective at rewarding faculty for educational excellence and providing faculty development. However, the impact of an AME on campus culture remains unclear. METHOD: A qualitative case study asked, How has an AME shaped organizational culture? The authors investigated the University of Colorado health sciences campus AME given its clear mandate to impact organizational culture. The authors interviewed a purposeful sample of 26 AME members and non-AME campus faculty and educational leaders during the 2014-2015 academic year. Two reviewers employed content analysis to code the transcripts. RESULTS: The AME has positively impacted organizational culture by being a symbol of institutional commitment to the educational mission, and by asserting education as an evidence-based practice. At the faculty member level, the AME's impact includes creating a home and community for educators to network. Individual faculty influence departments and programs across campus through teaching and interpersonal connections. However, the AME has not impacted all of campus, due to only reaching self-identified educators, and the siloed nature of departments on campus. CONCLUSIONS: Although limited to a single campus and an early established AME, this study contributes significant insight by describing how an AME as a structural unit impacts individual faculty members, who in turn impact organizational campus culture regarding the educational mission.

How to Write Well-Defined Learning Objectives.

Writing effective learning objectives is a necessary skill in academic medicine. Learning objectives are clearly written, specific statements of observable learner behavior or action that can be measured upon completion of an educational activity. They are the foundation for instructional alignment whereby the learning objectives, assessment tools, and instructional methods mutually support the desired learning outcome. This review article describes the essential components of a learning objective and provides practical tips on writing well-defined learning objectives.

Study Skills and Test Taking Strategies for Coaching Medical Learners Based on Identified Areas of Struggle.

INTRODUCTION: Learners in high-performing contexts such as medical school and residency are presumed to have appropriate study skills to be successful. However, for those learners in academic difficulty who are identified as having weak study skills and poor test taking skills, faculty need tools to use to lead these struggling learners to academic success. In coaching learners on study skills, we frequently found that the study skills that helped them get into medical school or residency were no longer sufficient to make them successful in their new program. Given that there are multiple study strategies available, faculty coaches need mechanisms to first tease out which skills are the issue and then provide targeted strategies specific to each learner. METHODS: In meeting with a faculty coach, learners are briefly interviewed, complete a self-assessment to explore all possible root weaknesses in their study skills, and then read strategic solutions and review with faculty how they may be implemented. This tool has been offered to 52 students, 76 residents, and 20 fellows and faculty between 2010 and 2015. RESULTS: One hundred forty-eight individuals participated in this innovation, with more than 91% of all individuals going on to pass the exam that they had either failed or, in the case of the in-training exam, scored below the 30th percentile on. CONCLUSION: A self-assessment tool is key to individualized insight and action plans for improving study skills. Implementation must be supported with concurrent in-person coaching.

Virtual patients--what are we talking about? A framework to classify the meanings of the term in healthcare education.

BACKGROUND: The term "virtual patients" (VPs) has been used for many years in academic publications, but its meaning varies, leading to confusion. Our aim was to investigate and categorize the use of the term "virtual patient" and then classify its use in healthcare education. METHODS: A literature review was conducted to determine all articles using the term "virtual patient" in the title or abstract. These articles were categorized into: Education, Clinical Procedures, Clinical Research and E-Health. All educational articles were further classified based on a framework published by Talbot et al. which was further developed using a deductive content analysis approach. RESULTS: 536 articles published between 1991 and December 2013 were included in the study. From these, 330 were categorized as educational. Classifying these showed that 37% articles used VPs in the form of Interactive Patient Scenarios. VPs in form of High Fidelity Software Simulations (19%) and Virtual Standardized Patients (16%) were also frequent. Less frequent were other forms, such as VP Games. Analyzing the literature across time shows an overall trend towards the use of Interactive Patient Scenarios as the predominant form of VPs in healthcare education. CONCLUSIONS: The main form of educational VPs in the literature are Interactive Patient Scenarios despite rapid technical advances that would support more complex applications. The adapted classification provides a valuable model for VP developers and researchers in healthcare education to more clearly communicate the type of VP they are addressing avoiding misunderstandings.

Evaluation of the role of training in the implementation of a depression screening and treatment protocol in 2 academic outpatient internal medicine clinics utilizing the electronic medical record.

Systematic approaches to depression identification and management are effective though not consistently implemented. The research team implemented a depression protocol, preceded by training, in 2 faculty-resident practices. Medical assistants used the Patient Health Questionnaire (PHQ)-2 for initial screening; providers performed the PHQ-9. These were documented in the electronic medical record. Logistic regression was performed to assess the association of provider type, clinic site, and training attendance with documentation of PHQ-9 after positive PHQ-2s, and with repeat PHQ-9s after positive PHQ-9s. In logistic regression analysis, training attendance was positively associated with documentation of PHQ-9 after a positive PHQ-2 (odds ratio [OR] = 2.4 [confidence interval (CI) = 1.3-4.3]) and repeated documentation of a PHQ-9 after a positive PHQ-9 (OR = 2.5 [CI = 1.1-5.3]). This study describes the successful implementation of a stepped-care approach to depression care. The positive association of training with compliance with protocol procedures indicates the importance of training in the implementation of practice change.