Script Concordance Tests for Formative Clinical Reasoning and Problem-Solving Assessment in General Pediatrics.

Introduction: Script Concordance Tests (SCTs) are short clinical vignettes with proposed diagnoses, diagnostic studies, treatments, and management options for patient care scenarios. The SCTs included in this resource were incorporated into a required pediatric clerkship to facilitate formative student feedback and additional opportunities for precepting faculty to provide midclerkship feedback. Pediatric cases were specifically selected due to the scarcity of medical student experience with common pediatric clinical presentations. Methods: We developed eight themed SCTs comprising 72 individual test items focused on common topics in general pediatrics. Items were administered to a convenience sample of third-year medical students during their required pediatric clerkship between fall 2016 and spring 2020. To evaluate the SCTs, we conducted item analyses, as well as comparing student performance to summative assessments. Results: The mean aggregate percentage score across all SCTs was .84 (SD = .08). Student SCT performance was related to USMLE Step 2 Clinical Knowledge scores, clerkship grades, and NBME Pediatrics Shelf Exam scores. Discussion: These SCTs facilitated feedback to medical students in the clinical learning environment. Their current form provides a means of exploring student clinical reasoning and problem-solving and can be used at a single point or to measure longitudinally. When paired with structured subject- and competency-specific midclerkship student evaluation, SCTs helped facilitate timely feedback to students via immediate explanations of each question. SCTs can assist students in recognizing and reflecting on potential knowledge gaps.

Training methods that improve MD-PhD student self-efficacy for clinical research skills.

INTRODUCTION: MD-PhD training programs train physician-scientists to pursue careers involving both clinical care and research, but decreasing numbers of physician-scientists stay engaged in clinical research. We sought to identify current clinical research training methods utilized by MD-PhD programs and to assess how effective they are in promoting self-efficacy for clinical research. METHODS: The US MD-PhD students were surveyed in April-May 2018. Students identified the clinical research training methods they participated in, and self-efficacy in clinical research was determined using a modified 12-item Clinical Research Appraisal Inventory. RESULTS: Responses were received from 61 of 108 MD-PhD institutions. Responses were obtained from 647 MD-PhD students in all years of training. The primary methods of clinical research training included no clinical research training, and various combinations of didactics, mentored clinical research, and a clinical research practicum. Students with didactics plus mentored clinical research had similar self-efficacy as those with didactics plus clinical research practicum. Training activities that differentiated students who did and did not have the clinical research practicum experience and were associated with higher self-efficacy included exposure to Institutional Review Boards and participation in human subject recruitment. CONCLUSIONS: A clinical research practicum was found to be an effective option for MD-PhD students conducting basic science research to gain experience in clinical research skills. Clinical research self-efficacy was correlated with the amount of clinical research training and specific clinical research tasks, which may inform curriculum development for a variety of clinical and translational research training programs, for example, MD-PhD, TL1, and KL2.

Developing a fully online course for senior medical students.

In 2002 the University of Michigan Medical School created a one-month course in advanced medical therapeutics (AMT). All senior medical students were required to complete the course. To provide some flexibility for students who were interviewing for residency positions the AMT course was created using a distance-learning model, and in the 2008-2009 academic year it was offered in a fully online format. The components of the course are weekly case-based modules, a weekly online seminar, quizzes based on modules and seminars, and a research project based on a therapeutic question. The paper discusses the development and components of the AMT course, a survey of fourth-year medical students who participated in the course between 2007 and 2010, and how the course evolved over three years.

Pass-fail grading: laying the foundation for self-regulated learning.

Traditionally, medical schools have tended to make assumptions that students will "automatically" engage in self-education effectively after graduation and subsequent training in residency and fellowships. In reality, the majority of medical graduates out in practice feel unprepared for learning on their own. Many medical schools are now adopting strategies and pedagogies to help students become self-regulating learners. Along with these changes in practices and pedagogy, many schools are eliminating a cornerstone of extrinsic motivation: discriminating grades. To study the effects of the switch from discriminating to pass-fail grading in the second year of medical school, we compared internal and external assessments and evaluations for a second-year class with a discriminating grading scale (Honors, High Pass, Pass, Fail) and for a second-year class with a pass-fail grading scale. Of the measures we compared (MCATs, GPAs, means on second-year examinations, USMLE Step 1 scores, residency placement, in which there were no statistically significant changes), the only statistically significant decreases (lower performance with pass fail) were found in two of the second-year courses. Performance in one other course also improved significantly. Pass-fail grading can meet several important intended outcomes, including "leveling the playing field" for incoming students with different academic backgrounds, reducing competition and fostering collaboration among members of a class, more time for extracurricular interests and personal activities. Pass-fail grading also reduces competition and supports collaboration, and fosters intrinsic motivation, which is key to self-regulated, lifelong learning.

A qualitative exploration of how the conflict between the formal and informal curriculum influences student values and behaviors.

PURPOSE: The third-year students at one medical school told the authors that values core to patient-centered care were impossible to practice in clerkships, in a culture where supervisors role modeled behaviors in direct conflict with patient-centered care. As they developed a new medical student curriculum, the authors designed the Family Centered Experience (FCE) to help students achieve developmental goals and understand the importance of and provide a foundation for patient-centered care. METHOD: The authors solicited members of the first cohort to complete the FCE (the class of 2007) to participate in this focus-group-based study halfway through the third year. They explored the influence of the FCE on students' experiences in the third-year clerkships, and how conflicts between the two learning experiences shaped these students' values and behaviors. RESULTS: Students reported that during clerkships they experienced strong feelings of powerlessness and conflict between what they had learned about patient-centered care in the first two years and what they saw role modeled in the third year. Based on students' comments, the authors categorized students into one of three groups: those whose patient-centered values were maintained, compromised, or transformed. CONCLUSIONS: Students revealed that their conflict was connected to feelings of powerlessness, along with exacerbating factors including limited time, concerns about expectations for their behavior, and pessimism about change. Role modeling had a significant influence on consequences related to students' patient-centered values.

Analysis of factors that predict clinical performance in medical school.

Academic achievement indices including GPAs and MCAT scores are used to predict the spectrum of medical student academic performance types. However, use of these measures ignores two changes influencing medical school admissions: student diversity and affirmative action, and an increased focus on communication skills. To determine if GPA and MCAT predict performance in medical school consistently across students, and whether either predicts clinical performance in clerkships. A path model was developed to examine relationships among indices of medical student performance during the first three years of medical school for five cohorts of medical students. A structural equation approach was used to calculate the coefficients hypothesized in the model for majority and minority students. Significant differences between majority and minority students were observed. MCAT scores, for example, did not predict performance of minority students in the first year of medical school but did predict performance of majority students. This information may be of use to medical school admissions and resident selection committees.

The impact of facilitation of small-group discussions of psychosocial topics in medicine on faculty growth and development.

PURPOSE: To use qualitative analysis of interview transcripts with clinician-educators who facilitate small-group discussions on psychosocial themes--including doctoring--to answer the question, "What impact does facilitating small-group discussions of the patient's experience with chronic illness, the doctor-patient relationship, and doctoring have on faculty instructors' attitudes regarding their roles as clinicians and teachers?" METHOD: In 2006, in-depth, face-to-face interviews using an open-ended question format were conducted with individual faculty small-group instructors teaching in the Family Centered Experience and Longitudinal Case Studies courses at the University of Michigan Medical School. Interview transcripts were analyzed using grounded theory methodology to identify emerging themes. Accuracy of interpretations and saturation of themes was confirmed by repeated contextual reading of the transcripts. RESULTS: Several major thematic codes emerged from the data. Facilitation of small-group discussions of psychosocial topics and doctoring fostered reflective approaches to patient care and teaching; enhanced interpersonal relationships between facilitators and their students, colleagues, and patients; and acted as a source of fulfillment and renewal among faculty facilitators. CONCLUSIONS: Small-group teaching of the art of doctoring may stimulate personal and professional growth among faculty facilitators and renewed interest in teaching and patient care.

A Web-based geriatrics portfolio to document medical students' learning outcomes.

OBJECTIVE: The University of Michigan Medical School is integrating into its curriculum the attitudes, knowledge, and skills that pertain to the care of older individuals using a defined set of core learning outcomes encompassing all four years. Students will demonstrate proficiency in these outcomes as a graduation requirement. We have developed an individualized, interactive, Web-based geriatrics portfolio to track the acquisition and mastery of these outcomes for students. DESCRIPTION: The required learning outcomes in geriatrics are presented to first-year students in their geriatrics portfolio Web page. The outcomes have been adapted from the recommendations published by the American Geriatrics Society's Education Committee.(1) The portfolio cross-references learning outcomes to specific activities in the curriculum. The activities include content given in lectures, multidisciplinary case discussions, standardized patient instructor (SPI) experiences involving older patients, and specific types of patient encounters during the clinical years. The portfolio allows documentation of completion dates of specific activities and the evaluations the student received. Certain activities such as the SPI experiences will include hyperlinks to their descriptions and the information that should be reviewed prior to each activity. The portfolio is integrated with existing administrative databases. Data entry occurs through links (e.g., exam scores), uploading comment forms from the SPI, and direct student input. One novel example of student input is the ability to upload information concerning encounters with older patients that students are recording in personal data assistant templates such that this information maps directly to the appropriate learning outcomes in their portfolios. The portfolio is designed to encourage students to take responsibility for their geriatrics education. Several types of evaluation data are provided, some that are specific to an activity (e.g., SPI feedback) and others that provide global assessments of learning outcomes (e.g., attitude surveys). The Web page can be displayed by the list of outcomes (categorized by attitudes, knowledge, and skills), by medical school year, and by date of completion. In this way, students can see at a glance how they are performing and whether they are up-to-date with completing the required outcomes. DISCUSSION: The geriatrics portfolio serves to identify and highlight geriatrics-related content across the four years. Its interactive features make it much more dynamic than a written transcript. Requiring proficiency in learning outcomes related to geriatrics for graduation will clearly convey to students that this information is critically important in their training to become physicians. The individualized evaluation summaries will prove useful to the student because self-directed learning opportunities can be targeted to address weak areas. Evaluation of performances will also aid program directors to appropriately modify the curriculum to address any deficiencies. This innovative Web-based approach to capture learning outcomes that are dispersed throughout a four-year curriculum may also find application in similar curricula (e.g., women's health and end-of-life care).

Implementation and evaluation of an undergraduate Sociocultural Medicine Program.

PURPOSE: To demonstrate an effective model for designing, implementing, and evaluating the Sociocultural Medicine Program (SMP), part of a comprehensive sociocultural medicine curriculum at the University of Michigan Medical School. METHOD: This study followed a cross-sectional, pre- and post-intervention survey design. A total of 167 medical students completed a measure of attitudes toward sociocultural issues in medicine prior to and following participation in the SMP. Students' attitudes were assessed in the domains of "exposure to sociocultural issues," "sociocultural factors in clinical scenarios," and "sociocultural background in patient/physician/health status issues." RESULTS: Paired t-tests of the pre- and post-intervention responses revealed significant positive changes for items in the domain of exposure to sociocultural issues in medicine: experience with sociocultural issues in a clinical setting (p <.01), understanding of relationship among sociocultural background, health, and medicine (p <.001), and importance of sociocultural background in students' future patient populations (p <.01). Significant changes were also found for the impact of sociocultural background in patient/physician/health status issues: physician-patient relationship (p <.001) and patients' health behavior (p <.001). CONCLUSIONS: The SMP had a significant educational impact on students' attitudes towards sociocultural issues in medicine. Students reported greater exposure to these issues conceptually and clinically, and greater influence of sociocultural factors in patients' behaviors and patient- physician relationships. Critical components of this SMP were faculty development, multiple teaching approaches, and pre- and post-intervention evaluation.