Public and Population Health in U.S. Medical Education: A Review of Guidance in Extraordinary Times.

ABSTRACT: Generations of medical educators have recommended including public and population health (PPH) content in the training of U.S. physicians. The COVID-19 pandemic, structural racism, epidemic gun violence, and the existential threats caused by climate change are currently unsubtle reminders of the essential nature of PPH in medical education and practice. To assess the state of PPH content in medical education, the authors reviewed relevant guidance, including policies, standards, and recommendations from national bodies that represent and oversee medical education for physicians with MD degrees.Findings confirm that guidance across the medical education continuum, from premedical education to continuing professional development, increasingly includes PPH elements that vary in specificity and breadth. Graduate medical education policies present the most comprehensive approach in both primary care and subspecialty fields. Behavioral, quantitative, social, and systems sciences are represented, although not uniformly, in guidance for every phase of training. Quantitative PPH skills are frequently presented in the context of research, but not in relation to the development of population health perspectives (e.g., evidence-based medicine, quality improvement, policy development). The interdependence between governmental public health and medical practice, environmental health, and the impact of structural racism and other systems of oppression on health are urgent concerns, yet are not consistently or explicitly included in curricular guidance. To prepare physicians to meet the health needs of patients and communities, educators should identify and address gaps and inconsistencies in PPH curricula and related guidance.Re-examinations of public health and health care systems in the wake of the COVID-19 pandemic support the importance of PPH in physician training and practice, as physicians can help to bridge clinical and public health systems. This review provides an inventory of existing guidance (presented in the appendices) to assist educators in establishing PPH as an essential foundation of physician training and practice.

Physicians' continuing medical education activities and satisfaction with their ability to stay current in medical information and practice: A cross-sectional study.

Background and Aims: Little is known about physicians' approaches to continuing medical education (CME) for continuing professional development despite the rapid evolution of CME offerings. We sought to identify the extent to which demographic, career, and experiential CME-activity variables were independently associated with physicians' satisfaction with their ability to stay current on medical information and practice. Methods: Using the 2019 Association of American Medical Colleges' National Sample Survey of Physicians data, we ran multivariable logistic regression models examining demographic, career, and experiential (participation in 11 CME activities in the past year) variables for their associations with physicians' satisfaction (satisfied vs. not satisfied/neutral) with their ability to stay current. Results: Of 5926 respondents, 90% (5341/5926) were satisfied with their ability to stay current. Significant (each two-sided p < 0.05) predictors of respondents who were satisfied included (among others) a surgery specialty (vs. primary care; adjusted odds ratio [AOR] = 1.41, 95% confidence interval [CI] = 1.06-1.88), an academic affiliation (vs. none; AOR = 1.35, 95% CI = 1.10-1.66), and participation (vs. no participation) in each of professional meetings (AOR = 1.31, 95% CI = 1.07-1.60) and journal-based CME (AOR = 1.29, 95% CI = 1.07-1.56). Respondents who self-identified as a race/ethnicity underrepresented in medicine (vs. white; AOR = 0.68, 95% CI = 0.48-0.97) and were between ages 40 and 49 years (vs. 50-59; AOR = 0.74; 95% CI = 0.58-0.94) were less likely to be satisfied. Gender, board certification status, and medical degree type did not independently predict satisfaction (each p > 0.05). Conclusion: We observed independent associations between physicians' satisfaction with their ability to stay current in medical information and practice and each specialty, academic affiliation, race/ethnicity, age, and CME activity type (for 2 of 11 examined). Findings may be relevant to organizations and institutions designing and implementing CME activities in the current context of COVID-19 pandemic-related in-person activity limitations and can inform targeted interventions addressing differences in the satisfaction we observed to better support physicians' CME.

Discontinuation of the USMLE Step 2 Clinical Skills Examination: Studying the Past to Define the Future.

The United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) was discontinued in January 2021, marking a significant milestone in assessment of clinical skills. In this commentary, the authors trace the history of the Step 2 CS exam-beginning with its early roots in the 1960s up to its discontinuation in 2021. In this new era, the medical education community is replete with opportunities for advancing methodology and content associated with clinical skills assessment. The authors propose 3 main lessons gleaned from this rich history and modern evolution, which are aimed at defining a future that includes creative collaboration toward development of comprehensive, equitable, student-focused, and patient-centered clinical performance assessment. First, as it has done throughout history, the medical education community should continue to innovate, collaborate, and improve upon methods of clinical skills assessment. Second, medical educators should continue to shift to more complex and student-driven approaches of assessment, that is, assessments that provide an unstructured environment, are realistic with respect to the natural conditions, and do not limit students to lists of options or force them to take a certain path of reasoning. Third, medical educators should continue to rethink the role of assessment and ensure that all assessments, regardless of stakes or type, provide sufficient feedback for the student to identify areas of strength and weakness.

Teaching Public and Population Health in Medical Education: An Evaluation Framework.

Curriculum models and training activities in medical education have been markedly enhanced to prepare physicians to address the health needs of diverse populations and to advance health equity. While different teaching and experiential learning activities in the public health and population health sciences have been implemented, there is no existing framework to measure the effectiveness of public and population health (PPH) education in medical education programs. In 2015, the Association of American Medical Colleges established the Expert Panel on Public and Population Health in Medical Education, which convened 20 U.S. medical faculty members whose goal was to develop an evaluation framework adapted from the New World Kirkpatrick Model. Institutional leaders can use this framework to assess the effectiveness of PPH curricula for learners, faculty, and community partners. It may also assist institutions with identifying opportunities to improve the integration of PPH content into medical education programs. In this article, the authors present outcomes metrics and practical curricular or institutional illustrations at each Kirkpatrick training evaluation level to assist institutions with the measurement of (1) reaction to the PPH education content, (2) learning accomplished, (3) application of knowledge and skills to practice, and (4) outcomes achieved as a result of PPH education and practice. A fifth level was added to measure the benefit of PPH curricula on the health system and population health. The framework may assist with developing a locally relevant evaluation to further integrate and support PPH education at U.S. medical schools and teaching hospitals.

A Mixed-methods Comparison of Participant and Observer Learner Roles in Simulation Education.

BACKGROUND: Traditional simulation-based education prioritizes participation in simulated scenarios. The educational impact of observation in simulation-based education compared with participation remains uncertain. Our objective was to compare the performances of observers and participants in a standardized simulation scenario. METHODS: We assessed learning differences between simulation-based scenario participation and observation using a convergent, parallel, quasi-experimental, mixed-methods study of 15 participants and 15 observers (N = 30). Fifteen first-year residents from six medical specialties were evaluated during a simulated scenario (cardiac arrest due to critical hyperkalemia). Evaluation included predefined critical actions and performance assessments. In the first exposure to the simulation scenario, participants and observers underwent a shared postevent debriefing with predetermined learning objectives. Three months later, a follow-up assessment using the same case scenario evaluated all 30 learners as participants. Wilcoxon signed rank and Wilcoxon rank sum tests were used to compare participants and observers at 3-month follow-up. In addition, we used case study methodology to explore the nature of learning for participants and observers. Data were triangulated using direct observations, reflective field notes, and a focus group. RESULTS: Quantitative data analysis comparing the learners' first and second exposure to the investigation scenario demonstrated participants' time to calcium administration as the only statistically significant difference between participant and observer roles (316 seconds vs. 200 seconds, p = 0.0004). Qualitative analysis revealed that both participation and observation improved learning, debriefing was an important component to learning, and debriefing closed the learning gap between observers and participants. CONCLUSIONS: Participants and observers had similar performances in simulation-based learning in an isolated scenario of cardiac arrest due to hyperkalemia. Findings support current limited literature that observation should not be underestimated as an important opportunity to enhance simulation-based education. When paired with postevent debriefing, scenario observers and participants may reap similar educational benefits.

Unifying interdisciplinary education: designing and implementing an intern simulation educational curriculum to increase confidence in critical care from PGY1 to PGY2.

BACKGROUND: A longitudinal, multidisciplinary critical care simulation curriculum was developed and implemented within a teaching hospital to address the need for consistent, safe, efficient, and unified critical care training within graduate medical education. Primary goals were to increase learner confidence in critical care topics and procedural skills across all specialties. Secondary goals included improving communication skills and obtaining a high level of learner satisfaction. All interns caring for adult patients within our hospital participated in three 4-h simulation-based sessions scheduled over the second half of their intern year. Pre- and postcurricular surveys evaluated self-confidence in critical care topics, procedures, and communication skills. The Debriefing Assessment for Simulation in Healthcare Student Version (DASH-SV) Short Form was used to evaluate facilitator debriefing. Data were compared with Wilcoxon rank sum and signed rank test. RESULTS: Pre- and postcurricular surveys were collected from 51 of 52 interns (98% response rate) in curricular year 1 and 59 of 59 interns (100% response rate) in curricular year 2 in six programs within the hospital. Resident confidence significantly improved in all areas (p < .05). DASH-SV demonstrated overall effective facilitator debriefing and > 75% of interns in both curricular years 1 and 2 expressed a desire for future educational sessions. CONCLUSIONS: The implemented curriculum increased learner confidence in select critical care topics, procedures, and communication skills and demonstrated a high level of learner satisfaction. The curriculum has expanded to learners from three other teaching hospitals within our system to unify critical care education for all interns caring for adult patients.

Effects of a novel mental skills curriculum on surgical novices' attention.

BACKGROUND: Surgery is very cognitively demanding, particularly for novices. Novices are required to direct full attention on the procedure at hand, and additional demands can lead to cognitive overload. Through extensive practice, experts develop spare attentional capacity (SAC) for simultaneous tasks. However, little effort has been made to enhance novices' SAC. Mental skills may enhance attention management and increase SAC. The purpose of this study was to determine the efficacy of a novel mental skills curriculum (MSC) to enhance novices' attention management. METHODS: Sixty novice volunteers were randomly stratified to a control or MSC group based on baseline laparoscopic skill and mental skill use (assessed with the Test of Performance Strategies version 2 [TOPS-2]). All participants received laparoscopic training, whereas the MSC group received additional mental skills training. At all sessions, participants completed a secondary task during laparoscopy, which assessed SAC. Participants also completed the D2 Test of Attention and the TOPS-2 attention control subscale, which are valid attention measures. RESULTS: Fifty-five novices completed the study. Both groups displayed significantly improved laparoscopic suturing ability (P < 0.001) and D2 performance (control: P < 0.005, MSC: P < 0.01), but there were no between-group differences in D2 or TOPS attention control scores. However, only the MSC group displayed significantly improved hit rate on the secondary task (P < 0.05). CONCLUSIONS: The novel MSC implemented in this study enhanced surgical novices' SAC compared to controls, and it is clear that this curriculum may be effective at enhancing learners' ability to attend multiple task-relevant stimuli concurrently. Additional study of the impact of this MSC on learners' attentional capacity is currently underway.

Effectiveness of a comprehensive mental skills curriculum in enhancing surgical performance: Results of a randomized controlled trial.

INTRODUCTION: We hypothesized that the implementation of a novel mental skills curriculum (MSC) during laparoscopic simulator training would improve mental skills and performance, and decrease stress. METHODS: Sixty volunteer novices were randomized into intervention and control groups. All participants received FLS training while the intervention group also participated in the MSC. Skill transfer and retention were assessed on a live porcine model after training and 2 months later, respectively. Performance was assessed using the Test of Performance Strategies-2 (TOPS-2) for mental skills, FLS metrics for laparoscopic performance, and the State Trait Anxiety Inventory (STAI-6) and heart rate (HR) for stress. RESULTS: Fifty-five participants (92%) completed training and the transfer test, and 46 (77%) the retention test. There were no significant differences between groups at baseline. Compared to controls the intervention group significantly improved their mental skill use, demonstrated higher laparoscopic skill improvement during retention, and reported less stress during the transfer test. CONCLUSIONS: The MSC implemented in this study effectively enhanced participants' mental skill use, reduced cognitive stress in the operating room with a small impact on laparoscopic performance.

Implementation results of a novel comprehensive mental skills curriculum during simulator training.

BACKGROUND: Mental skills training refers to the implementation of cognitive performance-enhancing strategies to promote optimal performance. We aimed to develop a surgery-specific mental skills curriculum (MSC) and obtain initial evidence of efficacy. METHODS: The developed MSC consisted of 8 proven performance-enhancing modules. Its efficacy was assessed during laparoscopic simulator-based practice by novices using validated instruments of mental skills, workload, and stress, in addition to a skill transfer test to a porcine model. A paired t test was used to analyze the data. RESULTS: Nine surgical novices completed the curriculum. Compared with baseline assessment, participants improved significantly their laparoscopic performance and mental skills after completion of the MSC. All participants completed the task in the porcine model without an appreciable change in their perceived stress. During the skill transfer test, 8 participants were observed using mental skills taught in the MSC. CONCLUSIONS: A surgery-specific simulator-based MSC was developed, and its efficacy in improving mental skills and surgical performance was supported during a surgical skill transfer test.

Effectiveness of a mental skills curriculum to reduce novices' stress.

BACKGROUND: Stress has been shown to negatively impact surgical performance, and surgical novices are particularly susceptible to its effects. Mental skills are psychological strategies designed to enhance performance and reduce the impact of stress to consistently facilitate the ideal mental conditions that enable performers to perform their best. Mental skills have been used routinely in other high-stress domains (e.g., with Navy SEALs, military pilots, elite athletes, and so forth) to facilitate optimal performance in challenging situations. We have developed a novel mental skills curriculum (MSC) to aid surgical trainees in optimizing their performance under stressful conditions. The purpose of this study was to determine the effectiveness of this MSC in reducing novices' stress. METHODS: The MSC was implemented with a convenience sample of surgical novices over 8 wk. Two stress tests were administered before and after completion of the MSC to assess its effectiveness in reducing trainee stress. The Trier Social Stress Test (TSST) is a validated method of measuring participants' stress responses; it was implemented by giving participants 10 min to prepare for an impromptu presentation and 5 min to present it in front of a medical education expert who would be assessing them. The O'Connor Tweezer Dexterity Test (OTDT) is a test of fine motor dexterity; participants competed against each other in small groups who would complete the test the fastest. Such competition has been shown to cause acute stress in performers. To assess stress, heart rate (HR), perceived stress (STAI-6), and perceived workload (NASA-TLX) were completed during all testing sessions. RESULTS: Nine novices (age 23 ± 7 y, 55% women) completed the MSC. HR increased significantly from resting to performance during the TSST and from early during competition (at 2 min and 30 s of elapsed time) to immediately after completing the task. However, participants perceived less stress during and immediately after the TSST and OTDT tests (P < 0.05) after completion of the MSC. In addition, they reported significantly less workload during the second OTDT administration (P < 0.05) and showed a trend toward faster completion of this test. CONCLUSIONS: The novel MSC was effective at reducing surgical novices' perceived stress and workload during two comprehensive stress tests. Although not statistically significant, participant's enhanced performance during the OTDT is encouraging. This curriculum may be valuable to help inexperienced learners reduce stress in a variety of situations related to learning and performing surgical skills. Additional research using a larger sample size is currently underway to validate the effectiveness of this curriculum.

From the coliseum to the convention centre: a reflection on the current state of medical education conferences and conference-goers.

The advancement of knowledge and development of policy in the field of medical education require critical academic discourse among the most intelligent medical educators; and critical academic discourse requires coffee. In this essay, we reflect on the state of professional development conferences in the field of medical education and the rituals that surround their success. Having begun in ancient Greece, symposia were ripe with debauchery. Today, sedated by the light brown walls of hotel conference centres, symposia are more serious endeavours, engaging men and women in the sometimes turbulent waters of epistemological debate. The abstract submission process (summed up by: 'Yay! It was accepted for presentation' [Deep breath] 'Oh no…it was accepted for presentation'), the 'juggling act' of parent attendees, the acting prowess of abstract presenters and the unapologetic approach to buffet eating are all by-products of the collision of true intellects among medical education scholars. We hold these rituals in high regard and argue that they are required to advance the field of medical education. These rituals bind the walls supporting true progressive thought and innovative research, all fuelled by the glass of wine purchased with that one coveted drink ticket.

What stress coping strategies are surgeons relying upon during surgery?

BACKGROUND: The objective of this study was to determine sources of intraoperative stress, impact on surgical outcomes, coping strategies, and surgeon interest in stress management training. METHODS: An anonymous survey was electronically distributed to surgeons at a tertiary care hospital. Respondents were asked to rate the perceived impact of 9 stressors on operative performance, identify stress coping strategies, list witnessed stress-related complications, and opine on the perceived need for stress management training. RESULTS: Seventy-two responses were received (76% relative risk). Complex or rarely performed cases and poor assistance were associated with the highest stress, while personal life distractions were associated with the least. Importantly, 40% of surgeons indicated that they had witnessed an intraoperative complication directly related to surgeon stress. Respondents (82%) believed that formal stress management training is needed. CONCLUSIONS: Several stressors affect surgical performance and contribute to complications. Surgeons use a variety of stress coping strategies. Formal stress management training is needed.

Poor resident-attending intraoperative communication may compromise patient safety.

BACKGROUND: Prior research suggests that hierarchy in medicine may impact communication and patient safety. This study examined the factors that influence surgical trainees in expressing their opinion in the operating room and the consequences this might have on patient safety. METHODS: An anonymous survey of general surgery, gynecology, and orthopedic surgery residents and attendings was conducted at a teaching institution in 2010. Separate surveys were used for attendings and for trainees consisting of 26 and 27 questions, respectively, with 17 questions in common. The surveys assessed whether the surgical hierarchy interfered with the residents voicing concerns about patient safety. Survey data was compiled, and χ2, Fisher exact tests, and the Wilcoxon rank sum test were used depending on the normality of the data. RESULTS: Thirty-eight trainees and 23 attendings participated in the survey; 74%-78% of trainees and attendings recalled an incident where the trainee spoke up and prevented an adverse event. While all attendings reported that they encourage residents to question their intraoperative decision making, only 55% of residents agreed (P<0.01). Residents indicated that they were more likely to voice their opinion with some attendings than with others based on their personality. Both groups agreed that the hierarchical structure of general surgical residency is necessary. CONCLUSION: Our findings indicate that resident attending intraoperative communication can prevent adverse patient events. Trainees often feel impaired in voicing their concerns to their attendings. Strategies that improve resident attending communication intraoperatively are needed as they are likely to enhance patient safety.

Standardized patient practices: initial report on the survey of US and Canadian medical schools.

BACKGROUND: There is currently a lack of information about the ways in which standardized patients (SPs) are used, how programs that facilitate their use are operated, the ways in which SP-based performance assessments are developed, and how assessment quality is assured. This survey research project was undertaken to describe the current practices of programs delivering SP-based instruction and/or assessment. METHOD: A structured interview of 61 individual SP programs affiliated with the Association of Standardized Patient Educators (ASPE) was conducted over a 7-month period. A web-based data entry system was used by the 11 trained interviewers. RESULTS: The two most common reported uses of SPs were learner performance assessment (88% of respondents) and small-group instruction (84% of respondents). Fifty-four percent of programs hired 51-100 SPs annually and paid an average of $15 and $16 per hour for training time and portraying a case, respectively. The average reported number of permanent program employees, excluding SPs and temporary staff, was 4.8 (sd = 3.6). The most frequently reported salary range was $30,001-$45,000. CONCLUSION: We intend for these preliminary results to inform the medical education community about the functions of SPs and the structures of programs that implement these complex educational endeavors.

Performance assessment in medical education: where we've been and where we're going.

The assessment of clinical competence is becoming increasingly complex, patient centered, and student driven. Traditionally, clinical evaluation methods consisted primarily of faculty observations, oral examinations, and multiple-choice tests. Increased faculty work load, discontent with traditional methods of clinical skill assessment, and developments in the fields of psychology and education have led to the formation of new modalities, namely performance assessments. The literature pertaining to the performance assessment with standardized patients is reviewed. Based on this literature, several areas for the future direction of performance assessment are proposed, including (a) toward evidence-based locally developed assessments, (b) toward an understanding of educational outcomes and noncognitive assessment factors, and (c) toward more student-driven assessments.

Direct observation of students during clerkship rotations: a multiyear descriptive study.

PURPOSE: To determine how often students report that they are observed while performing physical examinations and taking histories during clerkship rotations. METHOD: From 1999-2001, 397 students at the University of Virginia School of Medicine were asked at the end of their third year to report the number of times they had been observed by a resident or faculty member while taking histories and performing physical examinations on six rotations. RESULTS: Three hundred and forty-five students (87%) returned the survey instrument; of these, 322 (81%) returned instruments with complete information. On average, the majority reported that they had never been observed by a faculty member while taking a history (51%), performing a focused physical examination (54%), or a complete physical examination (81%). The majority (60%) reported that they had never been observed by a resident while performing a complete physical examination. Faculty observations occurred most frequently during the four-week family medicine rotation and least frequently during the 12-week surgery rotation. The length of the clerkship rotation was inversely related to the number of reported observations, chi(2) (5, n = 295) = 127.85, p <.000. CONCLUSIONS: Although alternative assessments of clinical skills are becoming more common in medical education, faculty ratings based on direct observation are still prominent. The data in this study reflect that these observations may actually be occurring quite infrequently, if at all. Decreasing the evaluative weight of faculty and resident ratings during the clerkship rotation may be necessary. Otherwise, efforts should be made to increase the validity of these ratings.

Medical Students' First Male Urogenital Examination: Investigating the Effects of Instruction and Gender on Anxiety.

OBJECTIVES: To investigate the effect that standardized instruction of the male urogenital examination had on the anxiety levels of students and to determine what influence, if any, the gender of the student had on this experience. METHODS: One hundred thirty six second year medical students were asked to report their level of anxiety before and after participation in a small group teaching session on the male urogenital examination. We gathered both qualitative and quantitative information to better understand students' anxiety surrounding this instruction. RESULTS: Students had significantly lower state-anxiety scores following the instruction than before (F(1, 76)=102.353, p=.000, η2=.574) and female students were more likely to have greater state-anxiety than male students (F=6.952, p=.010, η2=.084). Ninety-nine percent of students reported that the teaching associates successfully reduced their anxiety. This decrease was attributed predominantly to the personal qualities of the teaching associates and to the format of the instruction. CONCLUSIONS: This study provides both quantitative and qualitative evidence that the use of male teaching associates to provide standardized instruction on the urogenital exam is effective at reducing students' anxiety, particularly with regard to female students. Added standardized instruction may lead to increased confidence, skill, and future compliance with intimate physical exam screening practices.