Looking Across the Drape: A Novel Quality Improvement Approach to Understanding Surgeon and Anesthesiologist Burnout.

OBJECTIVE: To identify well-being threats for surgeons and anesthesiologists and develop interventions using the Quality of Life Improvement (QOLI) approach. BACKGROUND: Developing feasible perioperative well-being interventions requires identifying shared and specialty-specific well-being needs. The QOLI framework integrates human-centered design, implementation science, and quality improvement to address well-being needs. METHODS: Anesthesia and surgery faculty in eight perioperative departments at an academic medical center completed cross-sectional surveys containing validated measures of well-being and workplace satisfaction, and open-ended questions about professional motivations, pain points, strategies for improvement, and well-being priorities. Using template analysis, we analyzed open-ended survey data and presented resulting themes at a joint-specialty town hall for live-voting to identify well-being priorities. RESULTS: 104 perioperative faculty completed the survey. Across specialties, higher MHC-SF scores (representative of individual global well-being) were associated with higher satisfaction with workplace control, values, decision latitude, and social support. Anesthesiologists reported lower satisfaction and control than surgeons across multiple domains. Template analysis yielded five areas for intervention: (1) Work culture, (2) Work environment/resources, (3) Sources of fulfillment, (4) Work/life harmony, (5) Financial compensation. Surgeons and anesthesiologists both prioritized high-quality patient care but differed in their other top priorities. The most frequently cited well-being threats for surgeons were OR inefficiencies/delays and excessive workload, while anesthesiologists cited understaffing and unpredictable work hours. CONCLUSIONS: Surgeons and anesthesiologists share many needs and priorities, with pain points that are often negatively synergistic. Applying the QOLI approach across specialties allows for well-being interventions that honor complexity and promote the development of feasible solutions.

Student, Staff and Faculty Experience with a Medical School Racial and Sociopolitical Trauma Protocol: A Mixed Methods Study.

Problem: Medical students experience racial and sociopolitical trauma that disrupts their learning and wellbeing. Intervention: University of California, San Francisco (UCSF) School of Medicine students advocated for a systems approach to responding to traumatic events. Students partnered with educators to introduce an innovative protocol that affords short-term flexibility in curricular expectations (e.g., defer attendance, assignments, assessments) to empower students to rest, gather, or pursue community advocacy work. This study explored students' protocol utilization and student, staff, and faculty experience with its implementation. Context: UCSF is a public medical school with a diverse student body. Students raised the need to acknowledge the effects of trauma on their learning and wellbeing. Consequently, students and educators created the UCSF Racial and Sociopolitical Trauma protocol ('protocol') to allow students time-limited flexibility around academic obligations following events anticipated to inflict trauma on a school community level. The protocol affords students space to process events and engage with affected communities while ensuring all students achieve school competencies and graduation requirements. Impact: We conducted a two-phase mixed methods study: (1) retrospective analysis of quantitative data on students' protocol use and (2) focus groups with students, staff, and faculty. We used descriptive statistics to summarize students' protocol use to adjust attendance, assignment submission, and assessments and thematic analysis of focus group data. Across eight protocol activations June 2020 - November 2021, 357 of 664 (54%) students used it for 501 curricular activities: 56% (n = 198) for attendance, 71% (n = 252) for assignments, and 14% (n = 51) for assessments. When deciding to utilize the protocol, student focus group participants considered sources of restoration; impact on their curricular/patient responsibilities; and their identities. The protocol symbolized an institutional value system that made students feel affirmed and staff and faculty proud. Staff and faculty initially faced implementation challenges with questions around how to apply the protocol to curricular components and how it would affect their roles; however, these questions became clearer with each protocol activation. Questions remain regarding how the protocol can be best adapted for the clerkship setting. Lessons Learned: High protocol usage and focus group data confirmed that students found value in the protocol, and staff and faculty felt invested in the protocol mission. This student-initiated intervention supports a cultural shift beyond diversity toward trauma-informed medical education. Partnership among learners and educators can contribute to transforming learning and healthcare environments by enacting systems and structures that enable all learners to thrive.

Students' Perspectives on Basic and Clinical Science Integration When Step 1 is Administered After the Core Clerkships.

Phenomenon: According to adult learning theories, effective cognitive integration of basic and clinical science may promote the transfer of knowledge to patient care. The placement of the U.S. Medical Licensing Examination (USMLE) Step 1 after the core clerkships is one strategy intended to facilitate cognitive integration, though learner experiences with this model are unexplored. The purpose of this study is to understand students' perspectives on basic and clinical science integration in a post-clerkship Step 1 curriculum. Approach: Focus groups were conducted between August and September 2020 with senior medical students from the University of California, San Francisco School of Medicine and University of Michigan Medical School. Data were analyzed using a constructivist approach to thematic analysis. Findings: Thirty-three students participated in six focus groups. Participants described multiple barriers to cognitive integration in the clerkship learning environment, though they also identified examples of teaching and learning that facilitated integration. Early in their clerkships, students struggled to integrate because of their tenuous basic science foundation, cognitive overload, and difficulty perceiving the relevance of basic science to patient care. They felt that educators primarily focused on clinical science, and many basic science teaching sessions during clerkships felt irrelevant to patient care. However, students also described experiences that made the connection between basic and clinical science more explicit, including modeling by educators and clerkship learning activities that more overtly encouraged the application of basic science to clinical care. In addition, the return to basic science studying during the post-clerkship dedicated Step 1 study period offered powerful integration opportunities. These facilitators of cognitive integration helped students recognize the value of integration for enduring learning. Insights: There are myriad barriers to cognitive integration of basic and clinical science during clerkships in a post-clerkship Step 1 curriculum. The relevance of basic science to patient care needs to be made more explicit to students through modeling by clinician educators to augment the potential benefits of curricular change. The post-clerkship Step 1 study period appears to offer a unique opportunity for cognitive integration later in a learner's trajectory that may be related to curricular design. When learners recognize the applicability of basic science to patient care, they may more intentionally transfer basic science knowledge to clinical practice.

The fundamentals of Artificial Intelligence in medical education research: AMEE Guide No. 156.

The use of Artificial Intelligence (AI) in medical education has the potential to facilitate complicated tasks and improve efficiency. For example, AI could help automate assessment of written responses, or provide feedback on medical image interpretations with excellent reliability. While applications of AI in learning, instruction, and assessment are growing, further exploration is still required. There exist few conceptual or methodological guides for medical educators wishing to evaluate or engage in AI research. In this guide, we aim to: 1) describe practical considerations involved in reading and conducting studies in medical education using AI, 2) define basic terminology and 3) identify which medical education problems and data are ideally-suited for using AI.

The efficacy of an anatomy and ultrasonography workshop on improving residents' confidence and knowledge in regional anesthesia.

BACKGROUND: Ultrasound Guided Regional Anesthesia (UGRA) has become the standard for regional anesthesia practice, but there is not a standardized educational approach for training residents. The objective of this study was to evaluate the efficacy of an UGRA workshop utilizing the theoretical framework of embodied cognition for anesthesiology residents. METHODS: A workshop was developed consisting of didactics, scanning training on standardized patients (SPs) and anatomy reviews on prosected cadavers that focused on the most common UGRA procedures for the upper and lower extremity. At the beginning of the workshop and at the end of the workshop residents completed pre-test and pre-confidence surveys, as well as post-test and post-confidence surveys, respectively to assess the impact of the workshop. RESULTS: 39 residents (100% of the possible residents) participated in the workshop in 2019. Residents' confidence in identifying relevant anatomy for the most common UGRA procedures significantly increased in 13 of the 14 measurements. Residents' knowledge gain was also statistically significant from the pre-test to post-test (20.13 ± 3.61 and 26.13 ± 2.34; p < .0001). The residents found the course overall to be very useful (4.90 ± 0.38) and in particular the cadaveric component was highly rated (4.74 ± 0.55). CONCLUSIONS: In this study, we developed a workshop guided by the embodied cognition framework to aid in shortening the overall learning curve of UGRA for anesthesiology residents. Based on our results this workshop should be replicated by institutions that are hoping to decrease the learning curve associated with UGRA and increase residents' confidence in identifying the relevant anatomy in UGRA nerve blocks.

Development and validation of the safe transfusion assessment tool.

BACKGROUND: Given the prevalence and risks of blood transfusion, it is essential that trainees and practicing clinicians have a thorough understanding of relevant transfusion medicine competencies. The aim of this research was to develop and gather validity evidence for an instrument to assess knowledge of core transfusion-related competencies. METHODS: We developed the safe transfusion assessment tool (STAT) using a multistep process. Initially, 20 core competencies in transfusion medicine were identified through a consensus-driven Delphi process. Learning objectives and assessment items pertinent to each competency were created. Next, a 13-item assessment tool was piloted with multidisciplinary experts and trainees. Multiple iterative revisions were made based on feedback. Finally, the 12-item STAT was administered to 100 participants of varying training level and specialty to establish validity, difficulty and item discrimination indices, and perceived utility. RESULTS: Analysis of instrument item difficulty and item discrimination indices demonstrated the ability of the STAT to assess essential knowledge in transfusion medicine relevant to trainees and clinicians in multiple programs and practice settings. Eight of twelve items discriminated between learners with varying degrees of expertise. Hundred percent of students and trainees rated the STAT as Extremely Helpful or Somewhat Helpful and the majority planned to utilize the answer guide as a study aid. CONCLUSION: The STAT is a concise, valid, and reliable knowledge assessment tool that may be used by researchers and educators to augment transfusion medicine curricula (www.safetransfusion.ucsf.edu). Scores can help inform departments on areas in which trainees require additional support and areas of potential educational interventions.

Profiles for Success: Examining the Relationship between Student Profiles and Clerkship Performance Using Latent Profile Analysis.

PHENOMENON: Learning is a complex phenomenon in which learners can vary in their learning orientation, learning approaches, and perception of the learning environment. Learners may be characterized as mastery oriented or performance oriented, and this learning orientation can influence their learning approaches, such as whether to seek feedback or ask for help. The learning environment includes institutional assessment policies and informal interactions that emphasize outcomes and differentiation among students. When learners perceive the learning environment as performance oriented, they feel competition from other learners and fear negative feedback. This complex interplay of learning orientation, its influence on feedback-seeking behavior, and the environmental influence and reinforcement of both can be captured through learner profiles. APPROACH: In this multi-institutional cross-sectional survey study of students from six U.S. medical schools, we investigated learner profiles that characterize how these domains manifest together across individual learners. We then determined how these profiles are associated with students' clerkship grades. Measures included the Patterns of Adaptive Learning for learning orientation, self-reports for learning approaches, and perceptions of the learning environment. We used latent profile analysis to cluster students who share common characteristics around orientation, behavior, and environment. The relationship between these profiles and the percentage of honors earned was examined using multiple regression analysis. FINDINGS: We found four distinct learner profiles within 666 of 974 (68%) analyzable responses: (1) performance oriented with negative perceptions of environment, (2) mastery oriented with desirable learning approaches, (3) "average" group, and (4) mastery orientation only. Profile 1 (M = 39%) and Profile 4 (M = 38%) students received fewer clerkship honors compared with other profiles. Profile 2 students earned a significantly higher percentage of honors grades (M = 54%) compared with other students. Profile 3 students (average group) earned the second highest percentage of honors (M = 46%). Effect sizes comparing the percentage of honors varied from 0.32 to 0.65, indicating medium to large differences. INSIGHTS: The highest performers, as measured by clerkship honors grades, were mastery oriented, perceived a more positive learning environment, and were comfortable asking questions and seeking feedback for their learning. The lowest performing students were performance oriented and had negative perceptions of their learning environments. Contrary to previous findings, we found that the relationship between mastery orientation and learning approaches is not unidirectional but rather seems to be mediated by perceptions of the learning environment.

The role of data science and machine learning in Health Professions Education: practical applications, theoretical contributions, and epistemic beliefs.

Data science is an inter-disciplinary field that uses computer-based algorithms and methods to gain insights from large and often complex datasets. Data science, which includes Artificial Intelligence techniques such as Machine Learning (ML), has been credited with the promise to transform Health Professions Education (HPE) by offering approaches to handle big (and often messy) data. To examine this promise, we conducted a critical review to explore: (1) published applications of data science and ML in HPE literature and (2) the potential role of data science and ML in shifting theoretical and epistemological perspectives in HPE research and practice. Existing data science studies in HPE are often not informed by theory, but rather oriented towards developing applications for specific problems, uses, and contexts. The most common areas currently being studied are procedural (e.g., computer-based tutoring or adaptive systems and assessment of technical skills). We found that epistemic beliefs informing the use of data science and ML in HPE poses a challenge for existing views on what constitutes objective knowledge and the role of human subjectivity for instruction and assessment. As a result, criticisms have emerged that the integration of data science in the field of HPE is in danger of becoming technically driven and narrowly focused in its approach to teaching, learning and assessment. Our findings suggest that researchers tend to formalize around the epistemological stance driven largely by traditions of a research paradigm. Future data science studies in HPE need to involve both education scientists and data scientists to ensure mutual advancements in the development of educational theory and practical applications. This may be one of the most important tasks in the integration of data science and ML in HPE research in the years to come.

Trainee perception of cognitive load during observed faculty staff teaching of procedural skills.

OBJECTIVES: Although teachers impact learners' cognitive load, how specific teaching activities affect intrinsic, germane and extraneous load during procedural skills training is unknown. We sought to characterise teaching activities used in the exemplar procedural setting of colonoscopy, and to explore how they were enacted and how learners perceived them as affecting intrinsic, germane and extraneous cognitive load. METHODS: We observed 10 colonoscopies performed by eight different gastroenterology fellows and supervised by 10 different attending physicians at two hospitals, and recorded the teaching activities observed, as well as details of when they were used and how they were enacted. After the colonoscopy, each fellow completed the Cognitive Load Inventory for Colonoscopy to quantify intrinsic, germane and extraneous load. We then interviewed each fellow to determine how he or she perceived teaching as affecting cognitive load. Qualitative data were subjected to content analysis. Instances of germane load-promoting activities were correlated with measured germane load. RESULTS: We observed 515 instances of teaching activities. The intensity of teaching varied substantially, ranging from 0.7 to 3.3 activities per minute, as did the pattern of teaching activities used by different attending physicians. Little teaching occurred immediately before or after a procedure. Fellows usually perceived teaching as affecting cognitive load in ways that promoted learning, particularly by reducing intrinsic load and increasing germane load. Fellows strongly perceived that the provision of autonomy promoted germane load. Conversely, fellows perceived that excessive teaching increased extraneous load. Instances of germane load-promoting teaching activities correlated moderately with measured germane load. CONCLUSIONS: Teaching in the exemplar procedural setting of colonoscopy affected learners' cognitive load in mostly beneficial ways, yet even 'good' teaching activities had detrimental effects when used excessively. Teachers of procedures should consider learner experience, task complexity and environmental factors to modulate the modality, content and intensity of teaching to promote balanced cognitive load and learning. Teaching more reservedly during the procedure and taking advantage of pre- and post-procedure opportunities may help.

Can You See Me Now? Video Supplementation for Pediatric Teledermatology Cases.

BACKGROUND/OBJECTIVES: Digital video is widely available and is used sporadically in clinical settings to evaluate patients, but whether it helps improve clinical management has not been determined. The aim of this study was to assess whether recorded video in addition to still images can improve residents' diagnostic and management accuracy and confidence with pediatric teledermatology cases. METHODS: Dermatology residents from three programs were assigned alternately to an online survey with 15 pediatric teledermatology cases presented with still images only (still) or still images plus recorded video (mixed). Participants provided free-text diagnoses and management recommendations and rated their confidence and image quality. Responses were scored using a modified script concordance grading key based on reference panelists' responses. RESULTS: Thirty-one residents participated (response rate 57%). Participants in the mixed group scored significantly higher on management accuracy (87.6 ± 12.9 vs 71.7 ± 14.2; p = 0.003). Both groups performed better on more common conditions than less common conditions. The mixed group outperformed the still group on less common conditions with respect to management recommendations. CONCLUSION: This novel study suggests that supplemental recorded video may improve the management accuracy of pediatric teledermatology consultations, particularly for complex cases. Residents may benefit from training in recording and interpreting video.

Measuring cognitive load during procedural skills training with colonoscopy as an exemplar.

OBJECTIVES: Few studies have investigated cognitive factors affecting learning of procedural skills in medical education. Cognitive load theory, which focuses on working memory, is highly relevant, but methods for measuring cognitive load during procedural training are not well understood. Using colonoscopy as an exemplar, we used cognitive load theory to develop a self-report instrument to measure three types of cognitive load (intrinsic, extraneous and germane load) and to provide evidence for instrument validity. METHODS: We developed the instrument (the Cognitive Load Inventory for Colonoscopy [CLIC]) using a multi-step process. It included 19 items measuring three types of cognitive load, three global rating items and demographics. We then conducted a cross-sectional survey that was administered electronically to 1061 gastroenterology trainees in the USA. Participants completed the CLIC following a colonoscopy. The two study phases (exploratory and confirmatory) each lasted for 10 weeks during the 2014-2015 academic year. Exploratory factor analysis determined the most parsimonious factor structure; confirmatory factor analysis assessed model fit. Composite measures of intrinsic, extraneous and germane load were compared across years of training and with global rating items. RESULTS: A total of 477 (45.0%) invitees participated (116 in the exploratory study and 361 in the confirmatory study) in 154 (95.1%) training programmes. Demographics were similar to national data from the USA. The most parsimonious factor structure included three factors reflecting the three types of cognitive load. Confirmatory factor analysis verified that a three-factor model was the best fit. Intrinsic, extraneous and germane load items had high internal consistency (Cronbach's alpha 0.90, 0.87 and 0.96, respectively) and correlated as expected with year in training and global assessment of cognitive load. CONCLUSIONS: The CLIC measures three types of cognitive load during colonoscopy training. Evidence of validity is provided. Although CLIC items relate to colonoscopy, the development process we detail can be used to adapt the instrument for use in other learning settings in medical education.

Predicting cost of care using self-reported health status data.

BACKGROUND: We examined whether self-reported employee health status data can improve the performance of administrative data-based models for predicting future high health costs, and develop a predictive model for predicting new high cost individuals. METHODS: This retrospective cohort study used data from 8,917 Safeway employees self-insured by Safeway during 2008 and 2009. We created models using step-wise multivariable logistic regression starting with health services use data, then socio-demographic data, and finally adding the self-reported health status data to the model. RESULTS: Adding self-reported health data to the baseline model that included only administrative data (health services use and demographic variables; c-statistic = 0.63) increased the model" predictive power (c-statistic = 0.70). Risk factors associated with being a new high cost individual in 2009 were: 1) had one or more ED visits in 2008 (adjusted OR: 1.87, 95 % CI: 1.52, 2.30), 2) had one or more hospitalizations in 2008 (adjusted OR: 1.95, 95 % CI: 1.38, 2.77), 3) being female (adjusted OR: 1.34, 95 % CI: 1.16, 1.55), 4) increasing age (compared with age 18-35, adjusted OR for 36-49 years: 1.28; 95 % CI: 1.03, 1.60; adjusted OR for 50-64 years: 1.92, 95 % CI: 1.55, 2.39; adjusted OR for 65+ years: 3.75, 95 % CI: 2.67, 2.23), 5) the presence of self-reported depression (adjusted OR: 1.53, 95 % CI: 1.29, 1.81), 6) chronic pain (adjusted OR: 2.22, 95 % CI: 1.81, 2.72), 7) diabetes (adjusted OR: 1.73, 95 % CI: 1.35, 2.23), 8) high blood pressure (adjusted OR: 1.42, 95 % CI: 1.21, 1.67), and 9) above average BMI (adjusted OR: 1.20, 95 % CI: 1.04, 1.38). DISCUSSION: The comparison of the models between the full sample and the sample without theprevious high cost members indicated significant differences in the predictors. This has importantimplications for models using only the health service use (administrative data) given that the past high costis significantly correlated with future high cost and often drive the predictive models. CONCLUSIONS: Self-reported health data improved the ability of our model to identify individuals at risk for being high cost beyond what was possible with administrative data alone.

Assessing 3rd year medical students' interprofessional collaborative practice behaviors during a standardized patient encounter: A multi-institutional, cross-sectional study.

BACKGROUND: To understand how third-year medical student interprofessional collaborative practice (IPCP) is affected by self-efficacy and interprofessional experiences (extracurricular experiences and formal curricula). METHODS: The authors measured learner IPCP using an objective structured clinical examination (OSCE) with a standardized nurse (SN) and standardized patient (SP) during a statewide clinical performance examination. At four California medical schools from April to August 2012, SPs and SNs rated learner IPCP (10 items, range 0-100) and patient-centered communication (10 items, range 0-100). Post-OSCE, students reported their interprofessional self-efficacy (16 items, 2 factors, range 1-10) and prior extracurricular interprofessional experiences (3 items). School representatives shared their interprofessional curricula during guided interviews. RESULTS: Four hundred sixty-four of 530 eligible medical students (88%) participated. Mean IPCP performance was 79.6 ± 14.1 and mean self-efficacy scores were 7.9 (interprofessional teamwork) and 7.1 (interprofessional feedback and evaluation). Seventy percent of students reported prior extracurricular interprofessional experiences; all schools offered formal interprofessional curricula. IPCP was associated with self-efficacy for interprofessional teamwork (ß = 1.6, 95% CI [0.1, 3.1], p = 0.04) and patient-centered communication (ß = 12.5, 95% CI [2.7, 22.3], p = 0.01). CONCLUSIONS: Medical student IPCP performance was associated with self-efficacy for interprofessional teamwork and patient-centered communication. Increasing interprofessional opportunities that influence medical students' self-efficacy may increase engagement in IPCP.

What should primary care providers know about pediatric skin conditions? A modified Delphi technique for curriculum development.

BACKGROUND: There is limited access to pediatric dermatology in the United States, resulting in inadequate education and patient care. OBJECTIVE: This Delphi study aimed to identify important objectives for a pediatric dermatology curriculum for general practitioners. METHODS: A modified, 2-round Delphi technique was used to develop consensus on objectives developed by expert pediatric dermatologists. A panel of 20 experts (pediatric dermatologists, family practitioners, and general pediatricians) rated objectives using a 5-point Likert-type scale. Items with group medians 4.0 or greater with at least 70% agreement reached consensus. RESULTS: In round 1, the expert panel rated 231 objectives from 16 categories for inclusion in an online curriculum. In round 2, experts were given group feedback and rated 235 objectives. A total of 170 items met consensus. Generally, objectives surrounding common conditions including acne, molluscum, warts, atopic dermatitis, and newborn skin met consensus whereas objectives on rare growths, birthmarks, and inherited conditions failed to meet consensus. LIMITATIONS: The Delphi panel consisted of US-based physicians, most in urban areas with a dedicated pediatric specialist at their institution. CONCLUSIONS: The accepted objectives encompass management of common conditions and referral of potentially dangerous diseases and can be used to develop a pediatric dermatology curriculum for primary care providers.

Career-long learning: relationship between cognitive and metacognitive skills.

OBJECTIVES: Physicians need metacognitive skills including reflection and goal generation for effective lifelong learning (LLL). These skills are not readily assessed and may not correlate with cognitive skills. We examined early-career physicians' metacognition and relationships between metacognitive skills, cognitive skills, and orientation toward LLL. METHODS: Pediatric fellows at UCSF document career progress in annual Individual Development Plans (IDPs). To assess metacognitive skills, we scored narratives in IDPs with a Reflective Ability Rubric (RAR) and goal setting with a SMART Goal Rubric (SMART-GR: consists of global IDP score and four IDP domain subscores). To assess cognitive skills, we collected American Board of Pediatrics scores (ABP), and to measure orientation toward LLL, fellows completed the Jefferson Scale (JeffSPLL). We used Spearman's correlation to examine relationships between scores. RESULTS: About 57/66 (86%) fellows participated. Mean scores were: RAR 2.4 ± 1.3 (scale 0-6); SMART-GR global IDP 2.8 ± 1.0, (1-5); JeffSPLL 46.3 ± 3.9 (14-56); and ABP 559.4 ± 75.7. RAR scores correlated significantly with SMART-GR scores but metacognitive measures did not correlate with ABP scores. CONCLUSIONS: Our study suggests early-career physicians may have limited metacognitive skills; cognitive and metacognitive skills do not correlate; and orientation toward LLL does not predict metacognitive skills. Thus, we need improved methods to teach and assess metacognition.

ChatGPT and Generative Artificial Intelligence for Medical Education: Potential Impact and Opportunity.

ABSTRACT: ChatGPT has ushered in a new era of artificial intelligence (AI) that already has significant consequences for many industries, including health care and education. Generative AI tools, such as ChatGPT, refer to AI that is designed to create or generate new content, such as text, images, or music, from their trained parameters. With free access online and an easy-to-use conversational interface, ChatGPT quickly accumulated more than 100 million users within the first few months of its launch. Recent headlines in the popular press have ignited concerns relevant to medical education over the possible implications of cheating and plagiarism in assessments as well as excitement over new opportunities for learning, assessment, and research. In this Scholarly Perspective, the authors offer insights and recommendations about generative AI for medical educators based on literature review, including the AI literacy framework. The authors provide a definition of generative AI, introduce an AI literacy framework and competencies, and offer considerations for potential impacts and opportunities to optimize integration of generative AI for admissions, learning, assessment, and medical education research to help medical educators navigate and start planning for this new environment. As generative AI tools continue to expand, educators need to increase their AI literacy through education and vigilance around new advances in the technology and serve as stewards of AI literacy to foster social responsibility and ethical awareness around the use of AI.

How to Use and Report on p-values.

The use of the p-value in quantitative research, particularly its threshold of "P < 0.05" for determining "statistical significance," has long been a cornerstone of statistical analysis in research. However, this standard has been increasingly scrutinized for its potential to mislead findings, especially when the practical significance, the number of comparisons, or the suitability of statistical tests are not properly considered. In response to controversy around use of p-values, the American Statistical Association published a statement in 2016 that challenged the research community to abandon the term "statistically significant". This stance has been echoed by leading scientific journals to urge a significant reduction or complete elimination in the reliance on p-values when reporting results. To provide guidance to researchers in health professions education, this paper provides a succinct overview of the ongoing debate regarding the use of p-values and the definition of p-values. It reflects on the controversy by highlighting the common pitfalls associated with p-value interpretation and usage, such as misinterpretation, overemphasis, and false dichotomization between "significant" and "non-significant" results. This paper also outlines specific recommendations for the effective use of p-values in statistical reporting including the importance of reporting effect sizes, confidence intervals, the null hypothesis, and conducting sensitivity analyses for appropriate interpretation. These considerations aim to guide researchers toward a more nuanced and informative use of p-values.

The Impact of an Interactive Unconscious Bias Training on Perioperative Learners.

Background: Providers' unconscious biases reinforce health disparities through negative direct patient care and interactions with colleagues. Objective: We created a workshop grounded in Critical Race Theory and the importance of different intersectionalities to improve medical trainees' self-assessment of their implicit biases in curated facilitated spaces. Methods: A total of 44 UCSF first-year clinical anesthesiology residents (CA-1) (95% response rate) and 23 surgery residents in their research year (77% response rate) participated in this workshop over 4 separate sessions in September 2020 and 2021. Quantitative data from a pre-/post-workshop survey was analyzed via a paired t test to evaluate our workshop's effectiveness. Feedback on efficacy was obtained by coding themes from our survey's open-ended questions. Results: The workshop was evaluated positively by a total of 65 of 67 participants in the post-workshop survey. On a 5-point Likert scale, participants self-reported they agreed that their unconscious biases affect their clinical interactions from a pre-workshop mean of 3.3 (SD ± 1.32) to a post-workshop mean of 3.9 (SD ± 0.87, P = .008). Conclusion: Our findings suggest that this workshop was effective for perioperative residents and can be extrapolated to all residents by tailoring the workshop to their respective work environments.

Engaging GME Learners in Health System-Aligned Improvement Work in the Clinical Learning Environment.

Alignment between graduate medical education (GME) and health system priorities is foundational to meaningful engagement of residents and fellows in systems improvement work within the clinical learning environment. The Residents and Fellows Leading Interprofessional Continuous Improvement Teams program at the University of California San Francisco was designed over a decade ago to address barriers to trainee participation in health system-based improvement work. The program provides structure and support for health system-aligned trainee-led improvement projects in the clinic learning environment. Project champions (residents/fellows) from GME programs attend workshops where they learn improvement methodologies and develop proposals for health system-based improvement projects for their training programs. Proposals are supported by local faculty mentors and are reviewed and approved by GME and health systems' leaders. During the academic year, teams share their progress using visual management boards and interactive leader rounds. The health system provides a modest financial incentive for successful projects. Since the program's inception, thousands of trainees from 58 residency and fellowship programs have participated either as champions or participants in the program at least once, and in total over 300 projects have been implemented. Approximately three-quarters of the specific improvement goals were met, all projects meaningfully engaged residents and fellows, and many projects continued after the learners graduated. This active partnership between GME and a health system created a symbiotic relationship; trainees received education and support to complete improvement projects, while the health system reaped additional benefits from the alignment and impact of the projects. This partnership continues to grow with steady increases in participating programs, spread to partner health systems, and scholarship for trainees and faculty.

Unprofessionalism in anesthesiology: A qualitative study on classifying unprofessional behavior in anesthesiology residency education.

STUDY OBJECTIVE: This study aims to identify the domains that constitute behaviors perceived to be unprofessional in anesthesiology residency training programs. DESIGN: Qualitative study. SETTING: Anesthesiology residency training programs. PATIENTS: Not applicable. The participants involved residents, fellows, and faculty members purposefully sampled in four US-based anesthesiology residency programs. INTERVENTIONS: Participants were asked to submit examples of unprofessional behavior they witnessed in anesthesiology residents, fellows, or faculty members via a Qualtrics link. MEASUREMENTS: Not applicable. The behavior examples were independently reviewed and categorized into themes using content analysis. MAIN RESULTS: A total of 116 vignettes were collected, resulting in a final list of 111 vignettes after excluding those that did not describe behavior exhibited by anesthesiology faculty or trainees. Fifty-eight vignettes pertained to unprofessional behaviors observed in faculty members and 53 were observed in trainees (residents and fellows). Nine unprofessionalism themes emerged in the analysis. The most common themes were VERBAL, SUPERVISION, QUALITY, ENGAGEMENT, and TIME. As to the distribution of role group (faculty versus trainee) by theme, unprofessional behaviors falling into the categories of BIAS, GOSSIP, LEWD, and VERBAL were observed more in faculty; whereas themes with unprofessional behavior primarily attributed to trainees included ENGAGEMENT, QUALITY, TIME, and SUPERVISION. CONCLUSION: By reviewing reported professionalism-related vignettes within residency training programs, we identified classification descriptors for defining unprofessional behavior specific to anesthesiology residency education. Findings from this study enrich the definition of professionalism as a multi-dimensional competency pertaining to anesthesiology graduate medical education. This framework may facilitate preventative intervention and timely remediation plans for unprofessional behavior in residents and faculty.