Unpacking Medical Students' Mixed Engagement in Health Systems Science Education.

Phenomenon: Medical education is better aligning with the needs of health systems. Health systems science competencies, such as high-value care, population health, and systems thinking, are increasingly being integrated into curricula, but not without challenges. One challenge is mixed receptivity by students, the underlying reasons of which have not been extensively explored. In this qualitative study, we explored the research question: "How do students perceive health systems science curricula across all four years, and how do such perceptions inform the reasons for mixed quality ratings?" Approach: Following large-scale health systems science curricular changes in their medical school, we used students' open-ended comments obtained from course evaluations related to 1st-, 2nd-, and 4th-year courses and performed a qualitative thematic analysis to explore students' perceptions. We identified themes, synthesized findings into a conceptual figure, and agreed upon results and quotations. Findings: Five themes were identified: (1) perceived importance and relevance of health systems science education, (2) tension between traditional and evolving health systems science-related professional identity, (3) dissatisfaction with redundancy of topics, (4) competition with basic and clinical science curricula, and, (5) preference for discrete, usable, testable facts over complexity and uncertainty. The relationship between themes is described along a continuum of competing agendas between students' traditional mindset (which focuses on basic/clinical science) and an emerging medical education approach (which focuses on basic, clinical, and health systems science). Insights: Health systems science education can be viewed by learners as peripheral to their future practice and not aligned with a professional identity that places emphasis on basic and clinical science topics. For some students, this traditional identity limits engagement in health systems science curricula. If health systems science is to achieve its full potential in medical education, further work is required to explore the adoption of new perspectives by students and create activities to accelerate the process.

The Facilitator Instrument for Team-Based Learning (FIT).

Construct: We sought to evaluate the quality of Team-Based Learning facilitation in both large and small group settings. Background: Team Based Learning (TBL) is an increasingly popular small group instructional strategy in health science education. TBL facilitation skills are unique and differ from those needed to lecture or facilitate other types of small groups. Measuring facilitation skills and providing feedback to TBL instructors is important, yet to date no valid instrument has been developed and published for this purpose. Approach: We created an 11-item instrument (ratings of each item on a 7-point scale) designed to assess TBL facilitation skills, considering major sources of validity. Twelve experts in TBL facilitation and training developed the content of the FIT. To ensure response processes were valid, we used an immediate retrospective probing technique with 4th year medical students who were not part of the study. The Facilitator Instrument for Team-Based Learning (FIT) was piloted with 2,840 medical students in 7 schools in large (year 1 and 2) and small (year 3) courses. The internal structure of the FIT was analyzed. Results: In total, 1,559 and 1,281 medical students in large and small TBL classes, respectively (response rate 88%) rated 33 TBL facilitators. The composite mean score for the FIT was 6.19 (SD = 1.10). Exploratory factor analysis and Cronbach's alpha indicated that all items loaded on 1 factor, accounting for 77% of the item variance. Cronbach's alpha for the 11 items was 0.97. Analysis of facilitator variables and course context indicated that FIT scores were statistically significantly correlated with type of class (pre-clinical or clinical) and size of class as well as the facilitator enjoyment in using TBL as a method. Gender and the amount that facilitators used TBL each year was weakly correlated, with other factors not correlated (years facilitating TBL, confidence in facilitating TBL, and age). Conclusions: Analysis of FIT scores from 2,840 medical students across multiple institutions and teaching settings suggests the utility of the FIT in determining the quality of TBL facilitation across a range of medical education settings. Future research is needed to further analyze course contexts and facilitator variables that may influence FIT scores with additional facilitators. Additionally, FIT scores should be correlated with additional measures of TBL facilitator quality, such as direct observations, especially if these data are used for summative decision-making purposes.

A practical guide for implementing and maintaining value-added clinical systems learning roles for medical students using a diffusion of innovations framework.

After emphasizing biomedical and clinical sciences for over a century, US medical schools are expanding experiential roles that allow students to learn about health care delivery while also adding value to patient care. After developing a program where all 1st-year medical students are integrated into interprofessional care teams to contribute to patient care, authors use a diffusion of innovations framework to explore and identify barriers, facilitators, and best practices for implementing value-added clinical systems learning roles. In 2016, authors conducted 32 clinical-site observations, 29 1:1 interviews with mentors, and four student focus-group interviews. Data were transcribed verbatim, and a thematic analysis was used to identify themes. Authors discussed drafts of the categorization scheme, and agreed upon results and quotations. Of 36 sites implementing the program, 17 (47%) remained, 8 (22%) significantly modified, and 11 (31%) withdrew from the program. Identified strategies for implementing value-added roles included: student education, patient characteristics, patient selection methods, activities performed, and resources. Six themes influencing program implementation and maintenance included: (1) educational benefit, (2) value added to patient care from student work, (3) mentor time and site capacity, (4) student engagement, (5) working relationship between school, site, and students, and, (6) students' continuity at the site. Health systems science is an emerging focus for medical schools, and educators are challenged to design practice-based roles that enhance education and add value to patient care. Health professions' schools implementing value-added roles will need to invest resources and strategize about best-practice strategies to guide efforts.

High-Stakes Collaborative Testing: Why Not?

Phenomenon: Studies of high-stakes collaborative testing remain sparse, especially in medical education. We explored high-stakes collaborative testing in medical education, looking specifically at the experiences of students in established and newly formed teams. APPROACH: Third-year psychiatry students at 5 medical schools across 6 sites participated, with 4 participating as established team sites and 2 as comparison team sites. For the collaborative test, we used the National Board of Medical Examiners Psychiatry subject test, administering it via a 2-stage process. Students at all sites were randomly selected to participate in a focus group, with 8-10 students per site (N = 49). We also examined quantitative data for additional triangulation. FINDINGS: Students described a range of heightened emotions around the collaborative test yet perceived it as valuable regardless if they were in established or newly formed teams. Students described learning about the subject matter, themselves, others, and interpersonal dynamics during collaborative testing. Triangulation of these results via quantitative data supported these themes. Insights: Despite student concerns, high-stakes collaborative tests may be both valuable and feasible. The data suggest that high-stakes tests (tests of learning or summative evaluation) could also become tests for learning or formative evaluation. The paucity of research into this methodology in medical education suggests more research is needed.

Educating patient-centered, systems-aware physicians: a qualitative analysis of medical student perceptions of value-added clinical systems learning roles.

BACKGROUND: Medical schools have a critical need to develop roles for students that are "value-added," defined as "…experiential roles that can positively impact health outcomes while also enhancing student knowledge, attitudes, and skills in Clinical or Health Systems Science." Following implementation of value-added clinical systems learning roles for all first-year students, authors investigated student perceptions of the educational value from these patient-centered experiences. METHODS: Between 2014 and 16, authors collected logs from students following their working with patients; authors also performed six, 1:1 student interviews, which were audio recorded and transcribed verbatim. Authors used thematic analysis to explore students' perceptions of the experience and educational benefits from these roles. Authors identified themes, and agreed upon results and quotations. RESULTS: A total of 792 logs from 363 patients and six interviews were completed and analyzed. Students reported six educational benefits of performing value-added clinical systems learning roles in the health system, including enhanced understanding of and appreciation for a patient's perspective on health care and his/her health, barriers and social determinants of health, health care systems and delivery, interprofessional collaboration and teamwork, clinical medicine, and approach to communicating with patients. CONCLUSIONS: Students' reported educational benefits from value-added clinical systems learning roles span several learning areas that align with clinical and Health Systems Science, i.e. the needs of future physicians. These roles have the potential to shift learning from the physician-centric identity to one more fully aligned with patient-centered, team-based providers, while also potentially improving health today.

Training for Leadership Roles in Academic Medicine: Opportunities for Psychologists in the AAMC LEAD Program.

Psychologists' roles within academic medicine have expanded well beyond research and scholarship. They are active as providers of patient care, medical education, and clinical supervision. Although the number of psychologists in academic health centers continues to grow, they represent a small portion of total medical school faculties. However, with the movement toward collaborative care models, emphasis on interprofessional teams, and increased emphasis on psychological science topics in medical curricula, psychologists are well-positioned to make further contributions. Another path through which psychologists can further increase their contributions and value within academic health centers is to aspire to leadership roles. This article describes the first author's reflections on her experiences in a two-year, cohort-based, educational leadership development certificate program in academic medicine. The cohort was comprised largely of physicians and basic scientists, and a small number of non-physician participants of which the first author was the only clinical psychologist. The insights gained from this experience provide recommendations for psychologists interested in leadership opportunities in academic medicine.

Facilitating the Feedback Process on a Clinical Clerkship Using a Smartphone Application.

OBJECTIVES: This pilot study evaluated the effects of a smartphone-triggered method of feedback delivery on students' perceptions of the feedback process. METHODS: An interactive electronic feedback form was made available to students through a smartphone app. Students were asked to evaluate various aspects of the feedback process. Responses from a previous year served as control. RESULTS: In the first three quarters of academic year 2014-2015 (pre-implementation), only 65% of responders reported receiving oral feedback and 40% reported receiving written feedback. During the pilot phase (transition), these increased to 80% for both forms. Following full implementation in academic year 2015-2016 (post-implementation), 97% reported receiving oral feedback, and 92% reported receiving written feedback. A statistically significant difference was noted pre- to post-implementation for both oral and written feedback (p < 0.01). A significant increase from pre-implementation to transition was noted for written feedback (p < 0.01) and from transition to post-implementation for oral feedback (p < 0.01). Ninety-one and 94% of responders reported ease of access and timeliness of the feedback, 75% perceived the quality of the feedback to be good to excellent; 64% felt receiving feedback via the app improved their performance; 69% indicated the feedback method as better compared to other methods. Students acknowledged the facilitation of conversation with supervisors and the convenience of receiving feedback, as well as the promptness with which feedback was provided. The use of a drop-down menu was thought to limit the scope of conversation. CONCLUSION: These data point to the effectiveness of this method to cue supervisors to provide feedback to students.

The developmental inter-relationships between activity, novelty preferences, and delay discounting in male and female rats.

Increased locomotion, novelty-seeking, and impulsivity are risk factors associated with substance use. In this study, the inter-relationships between activity, novelty preferences, and delay discounting, a measure of impulsivity, were examined across three stages: juvenile/early adolescence (postnatal Day [P] 15, 19, and 42 for activity, novelty, and impulsivity, respectively), adolescent/late adolescent (P28, 32, 73), and adult (P90, 94, 137) in male and female rats. Our estimates of impulsive choice, where animals were trained to criterion, revealed an age × sex interaction where early adolescent females had the lowest levels of impulsivity. The relationships of activity and novelty to impulsivity significantly changed across age within each sex. Early adolescent males with high activity, but low novelty preferences, were more impulsive; however, low activity and high novelty preferences were related to high impulsivity in adult males. Female activity gradually increased across age, but did not show a strong relationship with impulsivity. Novelty preferences are moderately related to impulsivity into adulthood in females. These data show that males and females have different developmental trajectories for these behaviors. Males show greater sensation-seeking (e.g., activity) and risky behavior (e.g., novelty preferences) earlier in life, whereas these behaviors emerge during adolescence in females.

Providing context for a medical school basic science curriculum: The importance of the humanities.

INTRODUCTION: To increase students' understanding of what it means to be a physician and engage in the everyday practice of medicine, a humanities program was implemented into the preclinical curriculum of the medical school curriculum. The purpose of our study was to determine how medical students' views of being a doctor evolved after participating in a required humanities course. METHODS: Medical students completing a 16-clock hour humanities course from 10 courses were asked to respond to an open-ended reflection question regarding changes, if any, of their views of being a doctor. The constant comparative method was used for coding; triangulation and a variety of techniques were used to provide evidence of validity of the analysis. RESULTS: A majority of first- and second-year medical students (rr = 70%) replied, resulting in 100 pages of text. A meta-theme of Contextualizing the Purpose of Medicine and three subthemes: the importance of Treating Patients Rather than a Disease, Understanding Observation Skills are Important, and Recognizing that Doctors are Fallible emerged from the data. CONCLUSIONS: Results suggest that requiring humanities as part of the required preclinical curriculum can have a positive influence on medical students and act as a bridge to contextualize the purpose of medicine.

Working together: Using a unique approach to evaluate an interactive and clinic-based longitudinal interprofessional education experience with 13 professions.

Interprofessional education (IPE) involving an interactive and longitudinal clinic experience at an inner-city charitable clinic from September to May 2013/2014 was evaluated. Pre-, mid-, and post-intervention data were collected from students in 13 different professions including medicine (medical and physician assistant), dentistry (dental and dental hygiene), nursing (undergraduate and clinical nurse specialist), public health, pharmacy, physical therapy, occupational therapy, nutritional sciences, speech and language pathology, and social work. To evaluate their interprofessional attitudes, students completed the TeamSTEPPS Teamwork Attitudes Questionnaire (T-TAQ) and Readiness for Interprofessional Learning Scale (RIPLS). They also completed a unique measure, healthcare professionals circles diagrams (HPCDs), that indicated student conceptualisation of a healthcare team caring for a complex patient, along with perception of their team's progress towards meeting patient goals. Results from the T-TAQ and RIPLS scores indicated small but significant increases from pre- to post-intervention (p = 0.005 and 0.012, respectively). Analysis of the HPCDs revealed significant increases in students' perceptions of the types of interprofessional team members, relationships, and communication between professions to provide medical care to patients (p < 0.01). Most HPCDs included pharmacists, nurses, and physicians as part of the care team at all time points. Students significantly increased their inclusion of dentistry, public health, social work, and physician assistants as members of the healthcare team from pre- to post-intervention. Implications of our data indicated the importance of IPE interventions that include not only classroom-based sessions, but actual patient care experiences within interprofessional teams. It also reinforced the importance of new and unique methods to assess IPE.

Team cohesiveness, team size and team performance in team-based learning teams.

OBJECTIVES: The purpose of this study was to explore the relationships among variables associated with teams in team-based learning (TBL) settings and team outcomes. METHODS: We administered the National Board of Medical Examiners (NBME) Psychiatry Subject Test first to individuals and then to teams of Year three students at four medical schools that used TBL in their psychiatry core clerkships. Team cohesion was analysed using the Team Performance Scale (TPS). Bivariate correlation and linear regression analysis were used to analyse the relationships among team-level variables (mean individual TPS scores for each team, mean individual NBME scores of teams, team size, rotation and gender make-up) and team NBME test scores. A hierarchical linear model was used to test the effects of individual TPS and individual NBME test scores within each team, as well as the effects of the team-level variables of team size, team rotation and gender on team NBME test scores. Individual NBME test and TPS scores were nested within teams and treated as subsampling units. RESULTS: Individual NBME test scores and individual TPS scores were positively and statistically significantly (p < 0.01) associated with team NBME test scores, when team rotation, team size and gender make-up were controlled for. Higher team NBME test scores were associated with teams rotating later in the year and larger teams (p < 0.01). Gender make-up was not significantly associated. CONCLUSIONS: The results of an NBME Psychiatry Subject Test administered to TBL teams at four medical schools suggest that larger teams on later rotations score higher on a team NBME test. Individual NBME test scores and team cohesion were positively and significantly associated with team NBME test scores. These results suggest the need for additional studies focusing on team outcomes, team cohesion, team size, rotation and other factors as they relate to the effective and efficient performance of TBL teams in health science education.

Team Emotional Intelligence, Team Interactions, and Gender in Medical Students During a Psychiatry Clerkship.

OBJECTIVE: This study examined the relationship between team emotional intelligence, quality of team interactions, and gender. METHODS: Psychiatry clerkship students participating in Team-Based Learning (TBL, n = 484) or no TBL (control, n = 265) completed the Workgroup Emotional Intelligence Profile (WEIP-S) and the Team Performance Scale (TPS). RESULTS: Significant correlations (p < 0.01) existed between quality of team interactions (i.e., TPS) and team emotional intelligence (i.e., WEIP-S) subscales, but not gender. Control and TBL groups experienced significant increases in WEIP-S subscales pre to post (p < 0.01, η (2) = .08), with the TBL group experiencing significantly higher gains in three of four subscales. Control group scored higher on TPS. CONCLUSIONS: A significant relationship exists between team emotional intelligence and quality of team interactions. Gender was unrelated to TPS or WEIP-S subscales. TBL group experienced higher gains in WEIP-S subscales while the control group experienced slightly higher TPS scores. Results suggest implications for medical educators who use TBL.

Non-physician and physician preceptors in Landscapes of Practice: a mixed-methods study exploring learning for 1st-year medical students in clinical experiences.

Medical education has traditionally relied on physician educators. With expanding Health Systems Science competencies, non-physician healthcare providers are required. To investigate preceptor-role types, communication frequency, and importance of preceptors in value-added patient navigator roles (PN) and clinical preceptorships (CP). Using a mixed-methods approach, medical students participating in PN and CP during the first year of medical school (n=191) identified individuals with whom they communicated and communication frequency (1=never, 7=frequently), and importance of preceptors to work/education (1=not important, 7=extremely important; open-ended responses). Quantitative data were analyzed via repeated measures using a mixed-effects model and McNemar's test; effect size was calculated via Cohen's d or Cohen's h; qualitative data was analyzed using thematic analysis. Comparing ratings for non-physicians to physician healthcare professionals in PN, communication frequency (5.54 vs 3.65; p<0.001, d=1.18), importance to work (5.77 vs 4.28, p<0.001, d=0.89) and education (5.02 vs 4.12, p<0.001; d=0.49) were higher for non-physician educators. Comparing ratings for non-physicians to physician healthcare professionals in CP, communication frequency (4.93 vs. 6.48, p<0.001, d=1.33), importance to work (5.12 vs 6.61 vs, p<0.001, d=1.29) and education (4.32 vs 6.55, p<0.001, d=1.89) were higher for physician educators. Qualitative analysis indicated that non-physician healthcare providers in PN focused on Health Systems Science concepts, including social determinants of health and healthcare delivery. In PN, students observed collaboration from the perspective of multiple providers. In CP, healthcare providers, mainly physicians, focused on physician-centric clinical skills and interprofessional collaboration from the physician's perspective. Educational benefits of non-physician healthcare professionals related to Health Systems Science in work-based clinical settings - or Landscapes of Practice - can help students understand systems-based concepts such as social determinants of health, healthcare delivery systems, and interprofessional collaboration. Differences in the educational value of non-physician healthcare educators perceived by students should be further explored.

Implementation and Evaluation of an Interprofessional Health Systems Science Professional Development Program.

PROBLEM: Few interprofessional development programs focused on learning knowledge and skills in health systems science (HSS) have been described. The authors implemented a professional development program (the HSS Academy) for interprofessional clinicians and trainees. The authors describe the HSS Academy, report preliminary outcomes, and describe strategies for use in other programs. APPROACH: The HSS Academy (an 8-month active learning classroom and project-based curriculum) was implemented at Penn State College of Medicine in 2015. To create an interprofessional environment, participants were selected from various professions and phases of training. The curriculum was anchored in HSS competencies (e.g., high-value care, quality improvement, social determinants of health, health system strategy and delivery) and included 2 distinct threads focused on systems thinking competencies and academic skill development. It featured course speakers and faculty from diverse roles and disciplines both inside and outside the health system, application of HSS competencies in local system contexts, and networking with interprofessional colleagues. OUTCOMES: From 2015 to 2021, 121 of 128 participants, including physicians, medical students, and nurses, completed the HSS Academy (95% completion rate). Over 90 individuals, including faculty and system leaders, contributed to the HSS Academy as educators. Comparisons of pre-post evaluations demonstrated statistically significant self-perceived improvements in HSS knowledge and skills, systems thinking, and HSS teaching knowledge and skills. Projects (n = 110) most commonly focused on health care delivery, quality improvement, or patient safety. Teaching strategies to meet each objective, several barriers encountered, and strategies to address those barriers are described. NEXT STEPS: Next steps will be to address financial support for creating and sustaining the HSS Academy, ensure a mutually shared understanding of the HSS Academy's goals among all stakeholders, facilitate meaningful change from scholars' work, and provide networking and opportunities for scholars to continue work in HSS after completion of the HSS Academy.

Depressive-like behavior in adolescents after maternal separation: sex differences, controllability, and GABA.

Exposure to adversity during development is an identified risk factor for depression later in life. In humans, early adversity accelerates the onset of depressive symptoms, which manifest during adolescence. Animal studies have used maternal separation as a model of early adversity to produce adult depressive-like behaviors, but have yet to examine these behaviors during adolescence. Moreover, the nature of depressive-like behaviors has not been well characterized in this model. Here, we used the triadic model of learned helplessness to understand controllability, helplessness, and motivational factors following maternal separation in male and female adolescent rats. We found sex-dependent changes in the effects of separation, with males demonstrating loss of controllability in an escapable shock condition, whereas females demonstrated motivational impairment in a no-shock condition. The effect, however, did not endure as adult females were no longer helpless. Reductions in parvalbumin, a GABAergic marker, in the prefrontal cortex of separated subjects relative to age-matched controls were evident and paralleled depressive-like behavior. Understanding the risk factors for depression, the nature of depressive-like behaviors, and their unique sex dependency may ultimately provide insight into improved treatments.

Meeting the family: promoting humanism in gross anatomy.

BACKGROUND: Human dissection commonly occurs early in the undergraduate medical school curriculum, thus presenting an immediate opportunity for educators to teach and encourage humanistic qualities of respect, empathy, and compassion. PURPOSE: The purpose of this study was to measure the impact of the Donor Luncheon, a unique program in which medical students meet the families of the anatomical donor prior to dissection in the anatomy course at the University of Oklahoma College of Medicine. METHODS: Students were randomized into groups of 8 to attend the luncheon and either met with family of the donor or attended the luncheon with no donor family present. A questionnaire measured students' attitudes at 2 weeks, 6 weeks, and at the conclusion of the anatomy course. RESULTS: Factor analysis revealed 5 scales. Analysis revealed statistically significant differences across time for Donor as Person, Dissection Process, and Donor as Patient and statistically significant differences between groups for Donor as Person and Donor as Patient. CONCLUSIONS: These results suggest that this program can provide students with the opportunity to maintain more humanistic attitudes at the beginning of their medical education career.

Accelerated 3-Year MD Pathway Programs: Graduates' Perspectives on Education Quality, the Learning Environment, Residency Readiness, Debt, Burnout, and Career Plans.

PURPOSE: To compare perception of accelerated and traditional medical students, with respect to satisfaction with education quality, and the learning environment, residency readiness, burnout, debt, and career plans. METHOD: Customized 2017 and 2018 Medical School Graduation Questionnaires (GQs) were analyzed using independent samples t tests for means and chi-square tests for percentages, comparing responses of accelerated MD program graduates (accelerated pathway [AP] students) from 9 schools with those of non-AP graduates from the same 9 schools and non-AP graduates from all surveyed schools. RESULTS: GQ completion rates for the 90 AP students, 2,573 non-AP students from AP schools, and 38,116 non-AP students from all schools in 2017 and 2018 were 74.4%, 82.3%, and 83.3%, respectively. AP students were as satisfied with the quality of their education and felt as prepared for residency as non-AP students. AP students reported a more positive learning climate than non-AP students from AP schools and from all schools as measured by the student-faculty interaction (15.9 vs 14.4 and 14.3, respectively; P < .001 for both pairwise comparisons) and emotional climate (10.7 vs 9.6 and 9.6, respectively; P = .004 and .003, respectively) scales. AP students had less debt than non-AP students (P < .001), and more planned to care for underserved populations and practice family medicine than non-AP students from AP schools (55.7% vs 33.9% and 37.7% vs 9.4%; P = .002 and < .001, respectively). Family expectations were a more common influence on career plans for AP students than for non-AP students from AP schools and from all schools (26.2% vs 11.3% and 11.7%, respectively; P < .001 for both pairwise comparisons). CONCLUSIONS: These findings support accelerated programs as a potentially important intervention to address workforce shortages and rising student debt without negative impacts on student perception of burnout, education quality, or residency preparedness.