Strategies to support self-regulated learning in integrated, student-centered curricula.

PURPOSE: With undergraduate medical education shifting to an integrated, student-centered approach, self-regulated learning (SRL) skills are critical for student success. Educational research holds that learning strategy effectiveness is context dependent. Our study aims to explore what strategies medical students use to support SRL when engaged in the specific context of an integrated, student-centered curriculum. APPROACH: This study took place in two medical schools with integrated, student-centered curricula. Semi-structured interviews were conducted with first-year medical students from both schools, asking them to reflect on the learning strategies they used throughout their first year of medical school. Interview data was analyzed first deductively using the SRL framework and then inductively to understand the specific strategies being used. FINDINGS: Students engaged in strategies to support SRL in ways that were unique to the integrated, student-centered context. We found that medical students developed strategies to plan for integration and building connections across material during all three phases of self-regulated learning. INSIGHTS: By identifying specific tasks and behaviors students utilized during their first year of medical school, this study provides a roadmap that students and educators can use to help students become self-regulated learners.

Optimizing allocation of curricular content across the Undergraduate & Graduate Medical Education Continuum.

BACKGROUND: Medical educators struggle to incorporate socio-cultural topics into crowded curricula. The "continuum of learning" includes undergraduate and graduate medical education. Utilizing an exemplar socio-cultural topic, we studied the feasibility of achieving expert consensus among two groups of faculty (experts in medical education and experts in social determinants of health) on which aspects of the topic could be taught during undergraduate versus graduate medical education. METHODS: A modified Delphi method was used to generate expert consensus on which learning objectives of social determinants of health are best taught at each stage of medical education. Delphi respondents included experts in medical education or social determinants of health. A survey was created using nationally published criteria for social determinants of health learning objectives. Respondents were asked 1) which learning objectives were necessary for every physician (irrespective of specialty) to develop competence upon completion of medical training and 2) when the learning objective should be taught. Respondents were also asked an open-ended question on how they made the determination of when in the medical education continuum the learning objective should be taught. RESULTS: 26 out of 55 experts (13 social determinants of health and 13 education experts) responded to all 3 Delphi rounds. Experts evaluated a total of 49 learning objectives and were able to achieve consensus for at least one of the two research questions for 45 of 49 (92%) learning objectives. 50% more learning objectives reached consensus for inclusion in undergraduate (n = 21) versus graduate medical education (n = 14). CONCLUSIONS: A modified Delphi technique demonstrated that experts could identify key learning objectives of social determinants of health needed by all physicians and allocate content along the undergraduate and graduate medical education continuum. This approach could serve as a model for similar socio-cultural content. Future work should employ a qualitative approach to capture principles utilized by experts when making these decisions.

Trusting early learners with critical professional activities through emergency medical technician certification.

BACKGROUND: Two dominant themes face medical education: developing integrated curricula and improving the undergraduate medical education (UME) to graduate medical education (GME) transition. An innovative solution to both of these challenges at the Zucker School of Medicine has been the application of the cognitive apprenticeship framework in requiring emergency medical technician (EMT) certification during the first course in medical school as the core on which to build an integrated curriculum and provide entrustable clinical skills. METHODS: Beginning with the Class of 2011, student feedback about the short-term impact of the experience was collected annually. In addition, perceptions of near graduates and alumni were surveyed in 2017 to explore the long-term impact of the experience. Theme analysis was conducted via inductive coding. RESULTS: Both first-year and more experienced learners report the value of the EMT curriculum as an integrated component of the first course of medical school. Reported positive long-term impacts included the first-hand observation of social determinants of health and interprofessionalism. Negative comments by early learners focused on course logistics, whereas older learners recalled the variability of clinical experiences during ambulance runs. CONCLUSIONS: The integration of the EMT curriculum as a core component of the first course serves multiple purposes: 1) it provides the foundation of a spiral learning approach; 2) it contextualizes the basic sciences within clinical practice; 3) it provides opportunities for students to engage in authentic clinical activities under the guidance of mentors; 4) it introduces students to the interdisciplinary nature of medicine; and 5) it serves as the first entrustable professional activity (EPA) for our students.

The 6 degrees of curriculum integration in medical education in the United States

Despite explicit expectations and accreditation requirements for integrated curriculum, there needs to be more clarity around an accepted common definition, best practices for implementation, and criteria for successful curriculum integration. To address the lack of consensus surrounding integration, we reviewed the literature and herein propose a definition for curriculum integration for the health professions education audience. We further believe that health professions education is ready to move beyond "horizontal" (one-dimensional) and "vertical" (two-dimensional) integration and propose a model of "six degrees of curriculum integration" to expand the two-dimensional concept for future designs of health professions programs and best prepare learners to meet the needs of patients. These six degrees include: interdisciplinary, timing and sequencing, instruction and assessment, incorporation of basic and clinical sciences, knowledge and skills-based competency progression, and graduated responsibilities in patient care. We encourage medical educators to look beyond two-dimensional integration to best prepare physicians of the future.

The Association of Master Adaptive Learning With Less Burnout and More Resilience in Obstetrics and Gynecology Residents.

PURPOSE: Medical education should prepare learners for complex and evolving work, and should ideally include the Master Adaptive Learner (MAL) model-meta-learning skills for continuous self-regulated learning. This study aimed to measure obstetrics and gynecology (OB/GYN) residents' MAL attributes, assess associations with burnout and resilience, and explore learning task associations with MAL. METHOD: OB/GYN residents were surveyed electronically at an in-training examination in January 2022. The survey included demographic information, the 2-item Maslach Burnout Inventory, the 2-item Connor-Davidson Resilience Scale, 4 MAL items (e.g., "I take every opportunity to learn new things"), and questions about training and learning experiences. RESULTS: Of 5,761 residents, 3,741 respondents (65%) were included. A total of 1,478 of 3,386 (39%) demonstrated burnout (responded positive for burnout on emotional exhaustion or depersonalization items). The mean (SD) Connor-Davidson Resilience Scale score was 6.4 (1.2) of a total possible score of 8. The mean (SD) MAL score was 16.3 (2.8) of a total possible score of 20. The MAL score was inversely associated with burnout, with lower MAL scores for residents with (mean [SD] MAL score, 16.5 [2.4]) vs without (mean [SD], 16.0 [2.3]) burnout (P < .001). Higher MAL scores were associated with higher resilience (R = 0.29, P < .001). Higher MAL scores were associated with the statement, "I feel that I was well prepared for my first year of residency" (R = 0.19, P < .001) and a plan to complete subspecialty training after residency (mean [SD] of 16.6 [2.4] for "yes" and 16.2 [2.4] for "no," P < .001). CONCLUSIONS: Residents who scored higher on MAL showed more resilience and less burnout. Whether less resilient, burned-out residents did not have the agency to achieve MAL status or whether MAL behaviors filled the resiliency reservoir and protected against burnout is not clear.

Comparison of the Multiple Mini-Interview and the Traditional Interview in Medical School Admissions: Lessons Learned Using a Hybrid Model at One Institution.

PURPOSE: Medical school admissions interviews are a critical form of assessment; however, the most effective interview strategy is debated. This study compares the traditional interview (TI) and multiple mini-interview (MMI) within a hybrid TI-MMI model at one medical school to determine whether the interview approaches reveal different information about applicants and whether a hybrid model results in a more diversified applicant pool. METHOD: Admissions data from 3 application cycles at the Donald and Barbara Zucker School of Medicine at Hofstra/Northwell were used. The TI was used in 2017-2018 and the hybrid TI-MMI model in 2018-2019 and 2019-2020. Applicants were scored on a 5-point scale and referred to a voting committee for acceptance consideration if interview scores met threshold criteria. Changes in the number of students referred to the committee using the TI vs the TI-MMI score criteria were analyzed. RESULTS: In 2017-2018 (TI only), 683 applicants were interviewed; in 2018-2019 (TI-MMI), 844 applicants were interviewed; and in 2019-2020 (TI-MMI), 805 applicants were interviewed. Medium correlations were found between total MMI and TI scores in 2018-2019 ( ρ = 0.37, P < .001) and 2019-2020 ( ρ = 0.33, P < .001). No differences were found in TI scores between 2017-2018 and 2018-2019 ( P = .30), but TI scores were significantly lower in 2019-2020 vs 2017-2018 ( P < .001) and 2018-2019 ( P = .002). Overall, a 10% to 18% increase was found in the number of applicants referred to the voting committee when using hybrid criteria, with a 19% to 27% increase in underrepresented in medicine applicants. CONCLUSIONS: The TI-MMI model may allow for a more holistic interview approach and an expanded pool of applicants, particularly underrepresented in medicine applicants, considered for acceptance.

Measuring the Master Adaptive Learner: Development and Internal Structure Validity Evidence for a New Instrument.

BACKGROUND: The master adaptive learner (MAL) uses self-regulated learning skills to develop adaptive, efficient, and accurate skills in practice. Given rapid changes in healthcare, it is essential that medical students develop into MALs. There is a need for an instrument that can capture MAL behaviors and characteristics. The objective of this study was to develop an instrument for measuring the MAL process in medical students and evaluate its psychometric properties. METHODS: As part of curriculum evaluation, 818 students completed previously developed instruments with validity evidence including the Self-Regulated Learning Perception Scale, Brief Resilience Scale, Goal Orientation Scale, and Jefferson Scale of Physician Lifelong Learning. The authors performed exploratory factor analysis to examine underlying relationships between items. Items with high factor loadings were retained. Cronbach's alpha was computed. In parallel, the multi-institutional research team rated the same items to provide content validity evidence of the items to MAL model. RESULTS: The original 67 items were reduced to 28 items loading onto four factors: Planning, Learning, Resilience, and Motivation. Each subscale included the following number of items and Cronbach's alpha: Planning (10 items, alpha = 0.88), Learning (6 items, alpha = 0.81), Resilience (6 items, alpha = 0.89), and Motivation (6 items, alpha = 0.81). The findings from the factor analyses aligned with the research team ratings of linkage to the components of MAL. CONCLUSION: These findings serve as a starting point for future work measuring master adaptive learning to identify and support learners. To fully measure the MAL construct, additional items may need to be developed.

Using a Problem/Case-Based Learning Program to Increase First and Second Year Medical Students' Discussions of Health Care Cost Topics.

BACKGROUND: The rising costs of health care in the United States are unsustainable and gaps in physician knowledge of how to provide care at a lower cost remains a contributing factor. It has been suggested that learning about health care costs should be incorporated into existing, already overburdened medical school curricula. OBJECTIVE: To increase the discussion of health care costs among first and second year medical students, we added a component of health care cost education to an existing problem/case-based learning (PBL/CBL) program without adding curricular time. DESIGN: A total of 98 medical students participated in this study throughout the first 2 years of their educational program. Students were charged with researching and discussing health care cost topics as part of their weekly PBL/CBL case conferences. Faculty facilitators tracked each student's participation in discussions of health care cost topics as well as how often students initiated new conversations about health care cost topics during their case conferences. RESULTS: 100% of students engaged in conversations about health care cost topics throughout their first and second year PBL/CBL program. In addition, students increasingly initiated new conversations about health care cost topics as they progressed through their courses from the first to the second year (R 2 = 0.887, P < .01). CONCLUSIONS: Sensitizing medical students early during their educational program to incorporate health care cost topics into their PBL/CBL case conferences proved an effective means for having them engage in conversations related to health care costs. These results offer a new, time-efficient option for incorporating health care cost topics for schools with PBL/CBL programs.

Applying the Hedgehog Concept to Transform Undergraduate Medical Education.

As the U.S. health care system changes and physician responsibilities shift, medical educators must reconsider how best to prepare medical school graduates for the future practice of medicine. Thoughtful reexamination of the goals of undergraduate medical education (UME) and the roles of educators, medical students, and physicians is warranted to ensure that they align with evolving health care environments and delivery systems. In this Invited Commentary, the authors apply Jim Collins's "hedgehog concept" from Good to Great-a business-world framework designed to transform companies-to UME. The hedgehog concept is defined by the intersection of an organization's passion, area of expertise, and economic and resource engines. Focusing on this single concept can guide key decisions, reject what does not align conceptually, and drive overall organizational success. The authors use the hedgehog concept to frame the programmatic development of the Donald and Barbara Zucker School of Medicine at Hofstra/Northwell (Zucker SOM), a millennial medical school, as an organization with the passion to develop innovative UME curricula by challenging the status quo; the drive to be the best at leveraging health system resources to train graduates to excel in systems-based care; and the economic and resource engine of faculty time, financial and infrastructure support, and reputation building. The success of this approach is assessed at Zucker SOM through student and graduate outcomes data. The authors suggest that this hedgehog concept is generalizable to other UME programs whose leaders seek to transform medical education to meet 21st-century workforce and health care delivery needs.

Integration of leadership training into a problem/case-based learning program for first- and second-year medical students.

PURPOSE: The evolution of health care systems in response to societal and financial pressures has changed care delivery models, which presents new challenges for physicians. Leadership training is increasingly being recognized as an essential component of medical education training to prepare physicians to meet these needs. Unfortunately, most medical schools do not include leadership training. It has been suggested that a longitudinal and integrated approach to leadership training should be sought. We hypothesized that integration of leadership training into our hybrid problem-based learning (PBL)/case-based learning (CBL) program, Patient-Centered Explorations in Active Reasoning, Learning and Synthesis (PEARLS), would be an effective way for medical students to develop leadership skills without the addition of curricular time. METHODS: We designed a unique leadership program in PEARLS in which 98 medical students participated during each of their six courses throughout the first 2 years of school. A program director and trained faculty facilitators educated students and coached them on leadership development throughout this time. Students were assessed by their facilitator at the end of every course on development of leadership skills related to teamwork, meaningful self-assessment, process improvement, and thinking outside the box. RESULTS: Students consistently improved their performance from the first to the final course in all four leadership parameters evaluated. The skills that demonstrated the greatest change were those pertaining to thinking outside the box and process improvement. CONCLUSION: Incorporation of a longitudinal and integrated approach to leadership training into an existing PBL/CBL program is an effective way for medical students to improve their leadership skills without the addition of curricular time. These results offer a new, time-efficient option for leadership development in schools with existing PBL/CBL programs.

Assessment of medical students' leadership traits in a problem/case-based learning program.

BACKGROUND: Healthcare delivery is shifting to team-based care and physicians are increasingly relied upon to lead and participate in healthcare teams. Educational programs to foster the development of leadership qualities in medical students are needed to prepare future physicians for these roles. OBJECTIVE: Evaluate the development of leadership attributes in medical students during their first 2 years of medical school while participating in leadership training integrated into a problem/case-based learning program utilizing the Leadership Traits Questionnaire assessment tool. DESIGN: Ninety-eight students enrolled at Zucker School of Medicine participated in Patient-Centered Explorations in Active Reasoning, Learning and Synthesis (PEARLS), a hybrid problem/case-based learning program, during the first and second years of medical school. The Leadership Traits Questionnaire, designed to measure 14 distinct leadership traits, was utilized. It was administered to students, peers in students' PEARLS groups and their faculty facilitators. Participants completed questionnaires at three-time points during the study. Likert scale data obtained from the questionnaire was analyzed using a two-level Hierarchal Linear Model. RESULTS: Complete data sets were available for 84 students. Four traits, including self-assured, persistent, determined, and outgoing, significantly increased over time by measurements of both peer and facilitator-rated assessments. Six additional traits significantly increased over time by measurement of facilitator-rated assessment. By contrast, a majority of student self-rated assessments trended downward during the study. CONCLUSIONS: Medical students demonstrated development of several important leadership traits during the first 2 years of medical school. This was accomplished while participating in the PEARLS program and without the addition of curricular time. Future work will examine the impact of third year clerkships on leadership traits.

Contextualizing the relevance of basic sciences: small-group simulation with debrief for first- and second-year medical students in an integrated curriculum.

AIM: There has been a call for increased integration of basic and clinical sciences during preclinical years of undergraduate medical education. Despite the recognition that clinical simulation is an effective pedagogical tool, little has been reported on its use to demonstrate the relevance of basic science principles to the practice of clinical medicine. We hypothesized that simulation with an integrated science and clinical debrief used with early learners would illustrate the importance of basic science principles in clinical diagnosis and management of patients. METHODS: Small groups of first- and second-year medical students were engaged in a high-fidelity simulation followed by a comprehensive debrief facilitated by a basic scientist and clinician. Surveys including anchored and open-ended questions were distributed at the conclusion of each experience. RESULTS: The majority of the students agreed that simulation followed by an integrated debrief illustrated the clinical relevance of basic sciences (mean ± standard deviation: 93.8% ± 2.9% of first-year medical students; 96.7% ± 3.5% of second-year medical students) and its importance in patient care (92.8% of first-year medical students; 90.4% of second-year medical students). In a thematic analysis of open-ended responses, students felt that these experiences provided opportunities for direct application of scientific knowledge to diagnosis and treatment, improving student knowledge, simulating real-world experience, and developing clinical reasoning, all of which specifically helped them understand the clinical relevance of basic sciences. CONCLUSION: Small-group simulation followed by a debrief that integrates basic and clinical sciences is an effective means of demonstrating the relationship between scientific fundamentals and patient care for early learners. As more medical schools embrace integrated curricula and seek opportunities for integration, our model is a novel approach that can be utilized.