Signs, Sources, Coping Strategies, and Suggested Interventions for Burnout Among Preclerkship Students at a U.S. Medical School: A Qualitative Focus Group Study.

PURPOSE: Research suggests that burnout can begin early in medical school, yet burnout among preclerkship students remains underexplored. This study aimed to characterize burnout signs, sources, coping strategies, and potential interventions among preclerkship students at one U.S. medical school. METHOD: The authors conducted a qualitative study of preclerkship students at Mayo Clinic Alix School of Medicine (MCASOM) during June 2019. Participants completed 2 Maslach Burnout Inventory (MBI) items (measuring frequency of emotional exhaustion and depersonalization) and 2 free-text questions on burnout before participating in 1 of 3 semistructured focus groups. Focus group questions were derived from a literature review on medical student burnout with input from the MCASOM Student Life and Wellness Committee. Group discussions were recorded, transcribed, coded inductively, and analyzed iteratively (along with free-text comments) using a general inductive approach from a constructivist perspective. RESULTS: Eighteen of 111 eligible students (16%) participated, with 5/18 (28%) reporting weekly emotional exhaustion and/or depersonalization on MBI items. Analysis of focus group transcripts showed that most students had experienced burnout symptoms during their first or second year, corresponding with school-related stressors and manifesting in cognitive-emotional, physical, and verbal-behavioral ways. Students identified systemic, institutional, and individual burnout drivers and discussed how these drivers interacted (e.g., high standards of excellence at the system level interacted with anxiety and maladaptive thinking at the individual level, creating pressure to always do more). Students used various coping strategies (e.g., self-care, peer support, reframing, and compartmentalization) but emphasized limitations of these strategies and recommended interventions directed toward systemic and institutional burnout drivers. CONCLUSIONS: This study offers insights into burnout signs and sources among preclerkship medical students that can inform future large-scale studies. Results suggest that burnout emerges from dynamic interactions among systemic, institutional, and individual factors and may benefit from multipronged interventions.

The Problem and Power of Professionalism: A Critical Analysis of Medical Students' and Residents' Perspectives and Experiences of Professionalism.

PURPOSE: Professionalism has historically been viewed as an honorable code to define core values and behaviors of physicians, but there are growing concerns that professionalism serves to control people who do not align with the majority culture of medicine. This study explored how learners, particularly those from historically marginalized groups, view the purpose of professionalism and how they experience professionalism as both an oppressive and valuable force. METHOD: The authors conducted a qualitative study with a critical orientation. In 2021 and 2022, they interviewed fourth-year medical students and senior residents at 3 institutions about their perceptions and experiences of professionalism. After cataloguing participants' stories, the authors combined critical theory with narrative and thematic analysis to identify mechanisms by which professionalism empowered or disempowered individuals or groups based on identities. RESULTS: Forty-nine trainees (31 medical students and 18 senior residents from multiple specialties) participated in interviews; 17 identified as a race/ethnicity underrepresented in medicine and 15 as people of color not underrepresented in medicine. Their stories, especially those of participants underrepresented in medicine, identified professionalism as an oppressive, homogenizing force that sometimes encoded racism through various mechanisms. These mechanisms included conflating differences with unprofessionalism, enforcing double standards of professionalism, and creating institutional policies that regulated appearance or hindered advocacy. Participants described deleterious consequences of professionalism on their learning and mental health. However, participants also described useful aspects of professionalism as a means of advocating for marginalized groups. Additionally, participants described how they reconceived professionalism to include their own identities and values. CONCLUSIONS: Trainees, especially those from historically marginalized groups, experience professionalism as a restrictive, assimilative force while also finding value in and constructive adaptations for professionalism. Understanding both the destructive and empowering aspects of professionalism on individual and institutional levels can help improve the framing of professionalism in medical education.

"Finding My Piece in That Puzzle": A Qualitative Study Exploring How Medical Students at Four U.S. Schools Envision Their Future Professional Identity in Relation to Health Systems.

PURPOSE: Health systems science (HSS) curricula equip future physicians to improve patient, population, and health systems outcomes (i.e., to become "systems citizens"), but the degree to which medical students internalize this conception of the physician role remains unclear. This study aimed to explore how students envision their future professional identity in relation to the system and identify experiences relevant to this aspect of identity formation. METHOD: Between December 2018 and September 2019, authors interviewed 48 students at 4 U.S. medical schools with HSS curricula. Semistructured interviews were audiorecorded, transcribed, and analyzed iteratively using inductive thematic analysis. Interview questions explored how students understood the health system, systems-related activities they envisioned as future physicians, and experiences and considerations shaping their perspectives. RESULTS: Most students anticipated enacting one or more systems-related roles as a future physician, categorized as "bottom-up" efforts enacted at a patient or community level (humanist, connector, steward) or "top-down" efforts enacted at a system or policy level (system improver, system scholar, policy advocate). Corresponding activities included attending to social determinants of health or serving medically underserved populations, connecting patients with team members to address systems-related barriers, stewarding health care resources, conducting quality improvement projects, researching/teaching systems topics, and advocating for policy change. Students attributed systems-related aspirations to experiences beyond HSS curricula (e.g., low-income background; work or volunteer experience; undergraduate studies; exposure to systems challenges affecting patients; supportive classmates, faculty, and institutional culture). Students also described future-oriented considerations promoting or undermining identification with systems-related roles (responsibility, affinity, ability, efficacy, priority, reality, consequences). CONCLUSIONS: This study illuminates systems-related roles medical students at 4 schools with HSS curricula envisioned as part of their future physician identity and highlights past/present experiences and future-oriented considerations shaping identification with such roles. These findings inform practical strategies to support professional identity formation inclusive of systems engagement.

Assessing electrodiagnostic skills among residents and fellows: Relationships between workplace-based assessments using the Electromyography Direct Observation Tool and other measures of trainee performance.

INTRODUCTION/AIMS: Graduate medical education programs must ensure residents and fellows acquire skills needed for independent practice. Workplace-based observational assessments are informative but can be time- and resource-intensive. In this study we sought to gather "relations-to-other-variables" validity evidence for scores generated by the Electromyography Direct Observation Tool (EMG-DOT) to inform its use as a measure of electrodiagnostic skill acquisition. METHODS: Scores on multiple assessments were compiled by trainees during Clinical Neurophysiology and Electromyography rotations at a large US academic medical center. Relationships between workplace-based EMG-DOT scores (n = 298) and scores on a prerequisite simulated patient exercise, patient experience surveys (n = 199), end-of-rotation evaluations (n = 301), and an American Association of Neuromuscular & Electrodiagnostic Medicine (AANEM) self-assessment examination were assessed using Pearson correlations. RESULTS: Among 23 trainees, EMG-DOT scores assigned by physician raters correlated positively with end-of-rotation evaluations (r = 0.63, P = .001), but EMG-DOT scores assigned by technician raters did not (r = 0.10, P = .663). When physician and technician ratings were combined, higher EMG-DOT scores correlated with better patient experience survey scores (r = 0.42, P = .047), but not with simulated patient or AANEM self-assessment examination scores. DISCUSSION: End-of-rotation evaluations can provide valid assessments of trainee performance when completed by individuals with ample opportunities to directly observe trainees. Inclusion of observational assessments by technicians and patients provides a more comprehensive view of trainee performance. Workplace- and classroom-based assessments provide complementary information about trainee performance, reflecting underlying differences in types of skills measured.

Reimagining Faculty Development Deployment: A Multipronged, Pragmatic Approach to Improve Engagement.

PROBLEM: Faculty at academic health centers have many competing demands on their time, leading to high work stress, burnout, and limited capacity to meaningfully improve their teaching, evaluation, feedback, and other education-related skills. Faculty development provides a useful mechanism to assist faculty in enhancing their knowledge and skills in these areas, but engaging faculty can be a challenge. APPROACH: To promote engagement, the authors developed a multipronged, pragmatic approach to faculty development. They created: (1) brief videos leveraging micro-learning strategies; (2) prepackaged workshops for use during existing faculty meetings; (3) a newsletter to raise awareness of faculty development opportunities; (4) a searchable, web-based catalog to facilitate rapid retrieval of faculty development content; and (5) an academy to acknowledge engagement of individual faculty members, provide certificates, and promote a culture that prioritizes our education mission. OUTCOMES: Since they launched the new approach in 2017, they have developed 41 microlearning videos, 15 prepackaged workshops, and 24 issues of the newsletter. Between January 2017 and May 2021, the videos generated more than 150,055 views; the workshops were downloaded 2,850 times; and the issues of the newsletter, emailed bimonthly to 3,500 members of the faculty, had an open rate that increased from 30% in 2017 to 70% in 2021. The Academy of Educational Excellence, which was launched in 2018, grew to more than 490 members. Preliminary feedback suggests faculty and education leaders are highly satisfied with the faculty development resources and approaches to engagement. NEXT STEPS: Next steps include obtaining more user satisfaction data and evaluating whether education-related knowledge and skills have improved among faculty participants.

Social Support, Social Isolation, and Burnout: Cross-Sectional Study of U.S. Residents Exploring Associations With Individual, Interpersonal, Program, and Work-Related Factors.

PURPOSE: To examine associations of social support and social isolation with burnout, program satisfaction, and organization satisfaction among a large population of U.S. residents and fellows and to identify correlates of social support and social isolation. METHOD: All residents and fellows enrolled in graduate medical education programs at Mayo Clinic sites were surveyed in February 2019. Survey items measured social support (emotional and tangible), social isolation, burnout, program satisfaction, and organization satisfaction. Factors of potential relevance to social support were collected (via the survey, institutional administrative records, and interviews with program coordinators and/or program directors) and categorized as individual, interpersonal, program, or work-related factors (duty hours, call burden, elective time, vacation days used before survey administration, required away rotations, etc.). Multivariable regression analyses were conducted to examine relationships between variables. RESULTS: Of 1,146 residents surveyed, 762 (66%) from 58 programs responded. In adjusted models, higher emotional and tangible support were associated with lower odds of burnout and higher odds of program and organization satisfaction, while higher social isolation scores were associated with higher odds of burnout and lower odds of program satisfaction and organization satisfaction. Independent predictors of social support and/or social isolation included age, gender, relationship status, parental status, postgraduate year, site, ratings of the program leadership team, ratings of faculty relationships and faculty professional behaviors, satisfaction with autonomy, and vacation days used before survey administration. CONCLUSIONS: This study demonstrates that social support and social isolation are strongly related to burnout and satisfaction among residents and fellows. Personal and professional relationships, satisfaction with autonomy, and vacation days are independently associated with social support and/or social isolation, whereas most program and work-related factors are not. Additional studies are needed to determine if social support interventions targeting these factors can improve well-being and enhance satisfaction with training.

Cultivating the physician workforce: Recruiting, training, and retaining physicians to meet the needs of the population.

In the 10 years since the Lancet Commission on Education of Health Professionals for the 21st Century suggested the changes necessary to transform medical education, the United States remains plagued by shortages of physicians and maldistribution of the physician workforce. Minoritized and rural communities usually suffer the most, with widely documented health disparities across the United States by race, ethnicity, gender identity, education, and zip code. Medical schools can respond by recruiting students more likely to practice in these settings and training them to address the community needs. In 2013, the American Medical Association launched an initiative to trigger transformation in medical education and formed a consortium of schools representing a diversity of U.S. institutions. Consortium member schools highlighted in this article share lessons learned in their efforts to strengthen social accountability and develop needed sectors of the physician workforce. Development of the physician workforce involves recruiting and widening pathways of entry for diverse groups, providing training settings and competencies aligned with community needs, and explicit programming in retention, inclusion and well-being to mitigate against workforce losses.

Primer on the In-home Teleneurologic Examination: A COVID-19 Pandemic Imperative.

It is imperative in the coronavirus disease 2019 (COVID-19) pandemic that we serve our patients by implementing teleneurology visits for those who require neurologic advice but do not need to be seen face to face. The authors propose a thorough, practical, in-home, teleneurologic examination that can be completed without the assistance of an on-the-scene medical professional and can be tailored to the clinical question. We hope to assist trainees and practicing neurologists doing patient video visits for the first time during the COVID-19 pandemic, focusing on what can, rather than what cannot, be easily examined.

Residents' Perceptions of Faculty Behaviors and Resident Burnout: a Cross-Sectional Survey Study Across a Large Health Care Organization.

BACKGROUND: Data suggests the learning environment factors influence resident well-being. The authors conducted an assessment of how residents' perceptions of faculty-resident relationships, faculty professional behaviors, and afforded autonomy related to resident burnout. METHODS: All residents at one organization were surveyed in 2019 using two items from the Maslach Burnout Inventory and the faculty relationship subscale of the Johns Hopkins Learning Environment Scale (JHLES, range 6 to 30). Residents were also asked about faculty professional behaviors (range 0 to 30), and satisfaction with autonomy across various clinical settings. RESULTS: A total of 762/1146 (66.5%) residents responded to the survey. After adjusting for age, gender, postgraduate year, and specialty, lower (less favorable) JHLES-faculty relationship subscale score (parameter estimate, - 3.08, 95% CI - 3.75, - 2.41, p < 0.0001), fewer observed faculty professional behaviors (parameter estimate, - 3.34, 95% CI - 4.02, - 2.67, p < 0.0001), and lower odds of satisfaction with autonomy in the intensive care settings (OR 0.46, 95% CI 0.30, 0.70, p = 0.001), but not other care settings, were reported by residents with burnout in comparison to those without. Similar relationships were observed when emotional exhaustion and depersonalization were analyzed separately as continuous variables. CONCLUSION: In this cohort, resident perceptions of faculty relationships, faculty professional behaviors, and satisfaction with autonomy in the intensive care unit were associated with resident burnout. Additional longitudinal studies are needed to elucidate the direction of these relationships and determine if faculty development can reduce resident burnout.

Qualitative and quantitative evaluation of an interprofessional workshop between physical therapy and medical students.

Interprofessional education (IPE) is an important component of medical education, preparing students for the collaboration necessary for high-quality patient care. This study aimed to compare IPE readiness in pre-qualification physical therapy (PT) and medical (MD) students before and after an interprofessional workshop and identify factors influencing the workshop's perceived educational value. In two consecutive years, students were surveyed with the Readiness for Interprofessional Learning Scale (RIPLS) following a four-hour, case-based workshop. During the second year, students were also surveyed before the workshop and answered open-ended questions about its educational value. PT and MD students had similar mean pre-workshop RIPLS scores (83.0, SD 5.3 vs. 80.7, SD 7.9; p = .27), but post-workshop scores were higher among PT students (86.3, SD 6.5 vs. 80.3, SD 8.8; p < .001). Qualitative thematic analysis of responses to open-ended questions revealed students valued IPE within the workshop. However, MD students in particular identified improvement opportunities in workshop delivery, timing, and content. These factors undermined the perceived educational value for MD students and may have contributed to their lower post-workshop RIPLS scores. This study suggests that a brief workshop can improve readiness for IPE among pre-professional students and highlights the importance of content, delivery, and timing to IPE success.

The Relationship Between Burnout and Help-Seeking Behaviors, Concerns, and Attitudes of Residents.

PURPOSE: To evaluate the relationship between help-seeking concerns and attitudes and burnout among residents. METHOD: In 2019, all residents across the 4 Mayo Clinic sites were surveyed. The survey included 2 items from the Maslach Burnout Inventory, an item from the National Comorbidity Survey Replication about likelihood of seeking professional help for a serious emotional problem, and items developed to explore residents' help-seeking behaviors and concerns. Multivariable logistic regression was conducted for each outcome variable and included age, gender, specialty, postgraduate year, site, and burnout. RESULTS: Of the 1,146 residents to whom surveys were sent, 762 (66.5%) responded. Nearly half (342/747, 45.8%) were concerned about negative consequence to their career if they went on medical leave, and one-third (247/753, 32.8%) were reluctant to seek professional help for a serious emotional concern. Of the 437 residents who had never attended a personal health appointment during scheduled work, 34.6% (151) thought it would be difficult to tell a supervising physician they needed to miss work due to a scheduled appointment. On multivariable analysis, burnout was independently associated with reporting it would be difficult to tell a supervising physician of a need to attend an appointment (odds ratio [OR] 2.32; 95% confidence interval [CI] 1.46, 3.67; P < .001), being concerned about negative consequence to their career if they went on medical leave (OR 2.09; 95% CI 1.49, 2.93; P < .001), and reluctance to seek professional care for a serious emotional problem (OR 1.65; 95% CI 1.17, 2.34; P = .004). CONCLUSIONS: Barriers to self-care and help-seeking are common among residents and may be worse among those with burnout. Strategies to reduce stigma and promote a culture of well-being are needed.

High-Value, Cost-Conscious Care Attitudes in the Graduate Medical Education Learning Environment: Various Stakeholder Attitudes That Residents Misjudge.

BACKGROUND: Training residents in delivering high-value, cost-conscious care (HVCCC) is crucial for a sustainable healthcare. A supportive learning environment is key. Yet, stakeholders' attitudes toward HVCCC in residents' learning environment are unknown. OBJECTIVE: We aimed to measure stakeholders' HVCCC attitudes in residents' learning environment, compare these with resident perceptions of their attitudes, and identify factors associated with attitudinal differences among each stakeholder group. DESIGN: We conducted a cross-sectional survey across the Netherlands between June 2017 and December 2018. PARTICIPANTS: Participants were 312 residents, 305 faculty members, 53 administrators, and 1049 patients from 66 (non)academic hospitals. MAIN MEASURES: Respondents completed the Maastricht HVCCC Attitude Questionnaire (MHAQ), containing three subscales: (1) high-value care, (2) cost incorporation, (3) perceived drawbacks. Additionally, resident respondents estimated the HVCCC attitudes of other stakeholders, and answered questions on job demands and resources. Univariate and multivariate analyses were used to analyze data. KEY RESULTS: Attitudes differed on all subscales: faculty and administrators reported more positive HVCCC attitudes than residents (p ≤ 0.05), while the attitudes of patients were less positive (p ≤ 0.05). Residents underestimated faculty's (p < 0.001) and overestimated patients' HVCCC attitudes (p < 0.001). Increasing age was, among residents and faculty, associated with more positive attitudes toward HVCCC (p ≤ 0.05). Lower perceived health quality was associated with less positive attitudes among patients (p < 0.001). The more autonomy residents perceived, the more positive their HVCCC attitude (p ≤ 0.05). CONCLUSIONS: Attitudes toward HVCCC vary among stakeholders in the residency learning environment, and residents misjudge the attitudes of both faculty and patients. Faculty and administrators might improve their support to residents by more explicitly sharing their thoughts and knowledge on HVCCC and granting residents autonomy in clinical practice.

Medical Student Attitudes toward USMLE Step 1 and Health Systems Science - A Multi-Institutional Survey.

Phenomenon: Because of its importance in residency selection, the United States Medical Licensing Examination Step 1 occupies a critical position in medical education, stimulating national debate about appropriate score use, equitable selection criteria, and the goals of undergraduate medical education. Yet, student perspectives on these issues and their implications for engagement with health systems science-related curricular content are relatively underexplored. Approach: We conducted an online survey of medical students at 19 American allopathic medical schools from March-July, 2019. Survey items were designed to elicit student opinions on the Step 1 examination and the impact of the examination on their engagement with new, non-test curricular content related to health systems science. Findings: A total of 2856 students participated in the survey, representing 23.5% of those invited. While 87% of students agreed that doing well on the Step 1 exam was their top priority, 56% disagreed that studying for Step 1 had a positive impact on engagement in the medical school curriculum. Eighty-two percent of students disagreed that Step 1 scores should be the top item residency programs use to offer interviews. When asked whether Step 1 results should be reported pass/fail with no numeric score, 55% of students agreed, while 33% disagreed. The majority of medical students agreed that health systems science topics were important but disagreed that studying for Step 1 helped learn this content. Students reported being more motivated to study a topic if it was on the exam, part of a course grade, prioritized by residency program directors, or if it would make them a better physician in the future. Insights: These results confirm the primacy of the United States Medical Licensing Examination Step 1 exam in preclinical medical education and demonstrate the need to balance the objectives of medical licensure and residency selection with the goals of the broader medical profession. The survey responses suggest several potential solutions to increase student engagement in health systems science curricula which may be especially important after Step 1 examination results are reported as pass/fail.

The Hiker's Guide to the RIME Supplement: Choosing Directions in Research.

In this Commentary, the authors seek to build on prior RIME commentaries by considering how researchers transition from worldviews, focal lengths, and research goals to research directions and methodological choices. The authors use the analogy of a hiker to illustrate how different researchers studying a similar phenomenon can choose among different research directions, which lead down different paths and offer different perspectives on a problem. Following the hiker analogy, the authors use the "Research Compass" to categorize the 15 research papers included in the 2020 Research in Medical Education supplement according to their research aim and corresponding methodological approach. The authors then discuss implications of the relative balance of these study types within this supplement and within health professions education research at large, emphasizing the critical importance of studying a topic from multiple vantage points to construct a richer and more nuanced understanding of health professions education challenges. The authors conclude by recognizing the challenges we face in the current era of COVID-19 and by calling health professions education researchers and practitioners to continue our collective efforts to improve learner education and patient care, as we together navigate the unfamiliar terrain of the present day.

The Relationship Between Residents' Perceptions of Residency Program Leadership Team Behaviors and Resident Burnout and Satisfaction.

PURPOSE: To explore the relationship between residents' perceptions of residency program leadership team behaviors and resident burnout and satisfaction. METHOD: In February 2019, the authors surveyed all residents across the 77 graduate medical education training programs at Mayo Clinic's multiple sites. Survey items measured residents' perceptions of program director and associate program director behaviors (using a composite residency program leadership team score), resident burnout, and resident satisfaction with the program and organization. Multivariable logistic regression was performed to evaluate relationships between these variables at the individual resident (adjusting for age, sex, postgraduate training year, program location, and specialty) and program (including only programs with at least 5 respondents) levels. RESULTS: Of the 1,146 residents surveyed, 762 (66.5%) responded. At the individual resident level, higher composite leadership team scores were associated with lower emotional exhaustion and depersonalization and higher overall satisfaction with the residency program and organization (all P < .001). In adjusted logistic regression models, each 1-point gain in composite leadership team score was associated with 9% lower odds of burnout, 20% higher odds of program satisfaction, and 19% higher odds of satisfaction with the organization (all P < .001). At the residency program level, higher mean composite leadership team scores were associated with a lower rate of burnout (r = -0.35, P = .03) and higher program and organization satisfaction (r = 0.67 and 0.74, respectively, both P < .001). CONCLUSIONS: The behaviors of residency program leadership teams influence residents' burnout and satisfaction. Additional studies are needed to determine if leadership training results in improved resident well-being and satisfaction.

Promoting Value Through Patient-Centered Communication: A Multisite Validity Study of Third-Year Medical Students.

PURPOSE: To examine validity evidence for a standardized patient scenario assessing medical students' ability to promote value using patient-centered communication (in response to a patient requesting an unnecessary test) and to explore the potential effect of various implementation and curricular factors on student scores. METHOD: Third-year medical students (N = 516) from 5 U.S. MD-granting medical schools completed the communication scenario between 2014 and 2017 as part of a larger objective structured clinical examination (OSCE). Centralized raters assessed performance using an 11-item checklist. The authors collected multiple sources of validity evidence. RESULTS: The mean checklist score was 0.85 (standard deviation 0.09). Interrater reliability for checklist scores was excellent (0.87, 95% confidence interval = 0.78-0.93). Generalizability and Phi-coefficients were, respectively, 0.65 and 0.57. Scores decreased as the number of OSCE stations increased (r = -0.15, P = .001) and increased when they were used for summative purposes (r = 0.26, P < .001). Scores were not associated with curricular time devoted to high-value care (r = 0.02, P = .67) and decreased when more clerkships were completed before the assessment (r = -0.12, P = .006). CONCLUSIONS: This multisite study provides validity evidence supporting the use of scenario scores to assess the ability of medical students to promote value in clinical encounters using patient-centered communication. Findings illuminate the potential effect of OSCE structure and purpose on student performance and suggest clerkship learning experiences may not reinforce what students are taught in the formal curriculum regarding high-value care. Devoting more time to the topic appears insufficient to counteract this erosion.

A new instrument to measure high value, cost-conscious care attitudes among healthcare stakeholders: development of the MHAQ.

BACKGROUND: Residents have to learn to provide high value, cost-conscious care (HVCCC) to counter the trend of excessive healthcare costs. Their learning is impacted by individuals from different stakeholder groups within the workplace environment. These individuals' attitudes toward HVCCC may influence how and what residents learn. This study was carried out to develop an instrument to reliably measure HVCCC attitudes among residents, staff physicians, administrators, and patients. The instrument can be used to assess the residency-training environment. METHOD: The Maastricht HVCCC Attitude Questionnaire (MHAQ) was developed in four phases. First, we conducted exploratory factor analyses using original data from a previously published survey. Next, we added nine items to strengthen subscales and tested the new questionnaire among the four stakeholder groups. We used exploratory factor analysis and Cronbach's alphas to define subscales, after which the final version of the MHAQ was constructed. Finally, we used generalizability theory to determine the number of respondents (residents or staff physicians) needed to reliably measure a specialty attitude score. RESULTS: Initial factor analysis identified three subscales. Thereafter, 301 residents, 297 staff physicians, 53 administrators and 792 patients completed the new questionnaire between June 2017 and July 2018. The best fitting subscale composition was a three-factor model. Subscales were defined as high-value care, cost incorporation, and perceived drawbacks. Cronbach's alphas were between 0.61 and 0.82 for all stakeholders on all subscales. Sufficient reliability for assessing national specialty attitude (G-coefficient > 0.6) could be achieved from 14 respondents. CONCLUSIONS: The MHAQ reliably measures individual attitudes toward HVCCC in different stakeholders in health care contexts. It addresses key dimensions of HVCCC, providing content validity evidence. The MHAQ can be used to identify frontrunners of HVCCC, pinpoint aspects of residency training that need improvement, and benchmark and compare across specialties, hospitals and regions.

Imprinting on Clinical Rotations: Multisite Survey of High- and Low-Value Medical Student Behaviors and Relationship with Healthcare Intensity.

BACKGROUND: Physician behaviors are important to high-value care, and the learning environment medical students encounter on clinical clerkships may imprint their developing practice patterns. OBJECTIVES: To explore potential imprinting on clinical rotations by (a) describing high- and low-value behaviors among medical students and (b) examining relationships with regional healthcare intensity (HCI). DESIGN: Multisite cross-sectional survey PARTICIPANTS: Third- and fourth-year students at nine US medical schools MAIN MEASURES: Survey items measured high-value (n = 10) and low-value (n = 9) student behaviors. Regional HCI was measured using Dartmouth Atlas End-of-Life Chronic Illness Care data (ratio of physician visits per decedent compared with the US average, hospital care intensity index, ratio of medical specialty to primary care physician visits per decedent). Associations between regional HCI and student behaviors were examined using unadjusted and adjusted (controlling for age, sex, and year in school) logistic regression analyses, using median item ratings to summarize reported engagement in high- and low-value behaviors. KEY RESULTS: Of 2623 students invited, 1304 (50%) responded. Many reported trying to determine healthcare costs (1085/1234, 88%), but only 45% (571/1257) reported including cost details in case presentations. Students acknowledged suggesting tests solely to anticipate what their supervisor would want (1143/1220, 94%), show off their ability to generate a broad differential diagnosis (1072/1218, 88%), satisfy curiosity (958/1217, 79%), protect the team from liability (938/1215, 77%), and build clinical experience (533/1217, 44%). Students in higher intensity regions reported significantly more low-value behaviors: each one-unit increase in the ratio of physician visits per decedent increased the odds of reporting low-value behaviors by 20% (OR 1.20, 95% CI 1.04-1.38; P = 0.01). CONCLUSIONS: Third- and fourth-year medical students report engaging in both high- and low-value behaviors, which are related to regional HCI. This underscores the importance of the clinical learning environment and suggests imprinting is already underway during medical school.