Core and cluster or head to toe?: a comparison of two types of curricula for teaching physical examination skills to preclinical medical students.

BACKGROUND: Despite the central importance of physical examination (PE) skills to patient evaluation, early trainees struggle with its correct application and interpretation. This struggle may reflect the instructional strategies of PE courses which have largely ignored the clinical reasoning necessary to accurately apply these skills. The "core + cluster" (C + C) is a recent approach to teaching PE to clerkship-level medical students that combines a basic 'core' exam with 'cluster' based on the student's hypothesis about their patient's clinical presentation. Our institution developed a novel C + C curriculum to teach PE to preclinical students. We aimed to assess the impact of this new curriculum on students' clinical skills and course evaluations in comparison to the traditional "head-to-toe" approach we'd used previously. METHODS: This was a retrospective study comparing two consecutive medical school cohorts exposed to the new (C + C) and prior (HTT) curricula respectively. We studied two complete cohorts of first-year medical students at our institution who matriculated in 2014 and 2015. The 2014 cohort received PE training via an HTT approach. The 2015 cohort received PE training via a C + C approach. Outcomes included performance scores on a statewide clinical performance exam (CPX) and student course evaluations. RESULTS: We found no statistically significant difference in mean CPX scores between the two cohorts. However, student course ratings were significantly higher in the C + C cohort and students rated the C + C format as highly useful in clinical encounters. CONCLUSIONS: The C + C curriculum appears to be as effective a method of teaching PE to preclinical students as the HTT approach and is better received by students. We believe that this approach more appropriately reflects the way PE is used in clinical encounters and may help students with diagnostic hypothesis generation.

Modeling the social determinants of resilience in health professions students: impact on psychological adjustment.

Stressors inherent to training and stemming from the learning environment are associated with high rates of burnout, depression, and mental health problems in health professions students (HPS). There is evidence that disadvantaged or stigmatized groups are particularly affected. These problems not only impact students after graduation but may also have detrimental effects on patient outcomes. Resilience, conceptualized as the process of adapting well in the face of adversity, has inspired an increasing number of interventions aimed at addressing those problems in HPS. These interventions have mostly targeted individual students and their psychological traits while ignoring social and structural factors that may enhance or undermine individual resilience. To address this gap in the literature, the authors reviewed the evidence for psychosocial determinants of resilience and proposed a model inspired by the social determinants of health literature and the "upstream-downstream" metaphor. In this theoretical paper, the authors propose that upstream determinants such adverse childhood experiences and socioeconomic and sociodemographic markers of disadvantage have a direct effect on psychological adjustment and an indirect effect mediated by resilience. Additionally, the authors propose that the institutional downstream drivers of learning environment, social support, and sense of belonging moderate the direct and indirect effects of the upstream determinants on psychological adjustment. Future research should test these hypotheses and gather evidence that may guide the development of interventions. The authors present their model as part of a comprehensive response to recent calls to action to address diversity, equity and inclusion in health professions education.

What knowledge is required for an informed choice related to non-invasive prenatal screening?

Non-invasive prenatal screening (NIPS) using cell-free DNA is a screening test for fetal aneuploidy offered by a variety of prenatal healthcare providers. Guidelines for genetic screening consistently recommend that providers facilitate informed choices, which have been associated with better psychological and clinical outcomes than uninformed choices. The multidimensional measure of informed choice (MMIC) is a widely used and theory-based measure that combines knowledge, values, and behavior to classify decisions as either informed or uniformed. We implemented a previously validated version of the MMIC for women offered NIPS to describe the choices made by women receiving prenatal care at the Vanderbilt University Medical Center. The survey included the Ottawa Decisional Conflict scale, an outcome measure used for validation of choice categorization. We found that most women (87%) made an informed choice about NIPS. Of the women categorized as uninformed, 67% had insufficient knowledge, and 33% had an attitude discordant with their decision. The vast majority of respondents (92.5%) underwent NIPS and had a positive attitude toward screening (94.3%). Ethnicity (p = 0.04) and education (p = 0.01) were found to be significantly associated with informed choice. Decisional conflict was extremely low among all participants, with only 5.6% of all participants demonstrating any form of decisional conflict, and all being categorized as having made an informed choice. This study suggests that pre-test counseling by a genetic counselor results in high rates of informed choice and low-decisional conflict amongst women offered NIPS by genetic counselors, though more research is required to determine if rates of informed choice remain high when NIPS is offered by other prenatal providers.

Associations of Postbaccalaureate Coursework with Underrepresented Race/Ethnicity, Academic Performance, and Primary Care Training among Matriculants at Five California Medical Schools.

Studies employing data collected over 15 years ago suggested salutary effects of postbaccalaureate (PB) premedical coursework on medical school class diversity, academic performance, and primary care training. The studies may have limited current applicability given changes in medical school admissions paradigms and population demographics. Using data from interviewees at >1 of 5 California public medical schools between 2011-2013 (N=3805), we examined associations of PB premedical coursework with underrepresented race/ethnicity; academic performance (United States Medical Licensing Examination Step 1 and Step 2 scores, clerkship Honors); and primary care residency. Adjusting for age, sex, and year, PB coursework was associated with underrepresented race/ethnicity, but not after further adjustment for self-designated disadvantage (SDA). PB coursework was not associated with academic performance or primary care residency. Holistic consideration of SDA and UIM status in admissions coupled with robust matriculant support may merit exploration as an alternative to PB coursework for increasing medical school diversity.

Exploring the Relationships Between Resilience and News Monitoring with COVID Distress in Health Profession Students.

OBJECTIVE: Alarming rates of anxiety and burnout in pre-clinical health profession trainees are now challenged by additional COVID-19 stressors. This study explored COVID-related stressors among first-year medical, physician assistant, nurse practitioner, and veterinary medical students. The authors examined associations between resilience, news monitoring, and COVID stress. METHODS: Students completed an online questionnaire that included the Brief Resilience Scale at their matriculation in August 2019. Survey results were linked to demographic information collected by all schools. A follow-up survey in May 2020 included original questions on COVID-19 stressors and news monitoring. Statistical analyses included descriptive statistics and multivariable linear regression models. RESULTS: Across schools, 74% (266/360) provided consent for the 2019 survey, and 76% (201/264) responded to COVID-19 questions in the follow-up 2020 survey. Students were "extremely" or "very" concerned about family members getting infected (n = 71, 76% School of Medicine (SOM); n = 31, 76% School of Nursing (SON); n = 50, 75% School of Veterinary Medicine (SVM)) and curriculum schedule changes (n = 72, 78%, SOM; n = 28, 68% SON; n = 52, 79% SVM). Greater frequency of COVID news monitoring was associated with greater COVID-related stress (p = 0.02). Higher resilience at matriculation was associated with lower COVID-related stress ten months later (p < 0.001). CONCLUSIONS: Amid COVID-19 uncertainty, health science schools should address the immense student stress regarding curriculum disruptions. The results of this study underscore the powerful role of resilience in protecting against stress not only during the known academic rigor of health professions training but also during unprecedented crises.

Medical Student Attitudes toward USMLE Step 1 and Health Systems Science - A Multi-Institutional Survey.

Phenomenon: Because of its importance in residency selection, the United States Medical Licensing Examination Step 1 occupies a critical position in medical education, stimulating national debate about appropriate score use, equitable selection criteria, and the goals of undergraduate medical education. Yet, student perspectives on these issues and their implications for engagement with health systems science-related curricular content are relatively underexplored. Approach: We conducted an online survey of medical students at 19 American allopathic medical schools from March-July, 2019. Survey items were designed to elicit student opinions on the Step 1 examination and the impact of the examination on their engagement with new, non-test curricular content related to health systems science. Findings: A total of 2856 students participated in the survey, representing 23.5% of those invited. While 87% of students agreed that doing well on the Step 1 exam was their top priority, 56% disagreed that studying for Step 1 had a positive impact on engagement in the medical school curriculum. Eighty-two percent of students disagreed that Step 1 scores should be the top item residency programs use to offer interviews. When asked whether Step 1 results should be reported pass/fail with no numeric score, 55% of students agreed, while 33% disagreed. The majority of medical students agreed that health systems science topics were important but disagreed that studying for Step 1 helped learn this content. Students reported being more motivated to study a topic if it was on the exam, part of a course grade, prioritized by residency program directors, or if it would make them a better physician in the future. Insights: These results confirm the primacy of the United States Medical Licensing Examination Step 1 exam in preclinical medical education and demonstrate the need to balance the objectives of medical licensure and residency selection with the goals of the broader medical profession. The survey responses suggest several potential solutions to increase student engagement in health systems science curricula which may be especially important after Step 1 examination results are reported as pass/fail.

Propranolol inhibits cavernous vascular malformations by ß1 adrenergic receptor antagonism in animal models.

Propranolol, a pleiotropic ß-adrenergic blocker, has been anecdotally reported to reduce cerebral cavernous malformations (CCMs) in humans. However, propranolol has not been rigorously evaluated in animal models, nor has its mechanism of action in CCM been defined. We report that propranolol or its S(-) enantiomer dramatically reduced embryonic venous cavernomas in ccm2 mosaic zebrafish, whereas R-(+)-propranolol, lacking ß antagonism, had no effect. Silencing of the ß1, but not ß2, adrenergic receptor mimicked the beneficial effects of propranolol in a zebrafish CCM model, as did the ß1-selective antagonist metoprolol. Thus, propranolol ameliorated cavernous malformations by ß1 adrenergic antagonism in zebrafish. Oral propranolol significantly reduced lesion burden in 2 chronic murine models of the exceptionally aggressive Pdcd10/Ccm3 form of CCM. Propranolol or other ß1-selective antagonists may be beneficial in CCM disease.

Novel Murine Models of Cerebral Cavernous Malformations.

Cerebral cavernous malformations (CCMs) are ectatic capillary-venous malformations that develop in approximately 0.5% of the population. Patients with CCMs may develop headaches, focal neurologic deficits, seizures, and hemorrhages. While symptomatic CCMs, depending upon the anatomic location, can be surgically removed, there is currently no pharmaceutical therapy to treat CCMs. Several mouse models have been developed to better understand CCM pathogenesis and test therapeutics. The most common mouse models induce a large CCM burden that is anatomically restricted to the cerebellum and contributes to lethality in the early days of life. These inducible models thus have a relatively short period for drug administration. We developed an inducible CCM3 mouse model that develops CCMs after weaning and provides a longer period for potential therapeutic intervention. Using this new model, three recently proposed CCM therapies, fasudil, tempol, vitamin D3, and a combination of the three drugs, failed to substantially reduce CCM formation when treatment was administered for 5 weeks, from postnatal day 21 (P21) to P56. We next restricted Ccm3 deletion to the brain vasculature and provided greater time (121 days) for CCMs to develop chronic hemorrhage, recapitulating the human lesions. We also developed the first model of acute CCM hemorrhage by injecting mice harboring CCMs with lipopolysaccharide. These efficient models will enable future drug studies to more precisely target clinically relevant features of CCM disease: CCM formation, chronic hemorrhage, and acute hemorrhage.

The Relationships among Self-Designated Disadvantage, Socioeconomic Disadvantage, and Academic Performance in Medical School: A Multi-Institutional Study.

As medical schools seek to address the growing disparity between the socioeconomic makeup of their students and the general population, it is important to understand the academic trajectory of disadvantaged students. We used a locally-developed multicomponent socioeconomic disadvantage (SED) measure and the self-designated disadvantaged (SDA) question ["yes" (+) or "no" (-)] from the American Medical College Application Service application to examine academic performance of students from three disadvantaged categories (high SED/SDA+, high SED/SDA-, and low SED/SDA+); with low SED/SDA-as the reference group across five California schools. Compared with reference, the DA+ subgroups scored lower on USMLE Step 1 and Step 2 Clinical Knowledge examinations and received fewer clerkship Honors. After adjustment for academic metrics and sociodemographic variables, high SED subgroups performed similarly to reference, but performance gaps for low SED/SDA+ students persisted. Medical schools must better understand the institutional and other drivers of academic success in disadvantaged students.

Distinct cellular roles for PDCD10 define a gut-brain axis in cerebral cavernous malformation.

Cerebral cavernous malformation (CCM) is a genetic, cerebrovascular disease. Familial CCM is caused by genetic mutations in KRIT1, CCM2, or PDCD10 Disease onset is earlier and more severe in individuals with PDCD10 mutations. Recent studies have shown that lesions arise from excess mitogen-activated protein kinase kinase kinase 3 (MEKK3) signaling downstream of Toll-like receptor 4 (TLR4) stimulation by lipopolysaccharide derived from the gut microbiome. These findings suggest a gut-brain CCM disease axis but fail to define it or explain the poor prognosis of patients with PDCD10 mutations. Here, we demonstrate that the gut barrier is a primary determinant of CCM disease course, independent of microbiome configuration, that explains the increased severity of CCM disease associated with PDCD10 deficiency. Chemical disruption of the gut barrier with dextran sulfate sodium augments CCM formation in a mouse model, as does genetic loss of Pdcd10, but not Krit1, in gut epithelial cells. Loss of gut epithelial Pdcd10 results in disruption of the colonic mucosal barrier. Accordingly, loss of Mucin-2 or exposure to dietary emulsifiers that reduce the mucus barrier increases CCM burden analogous to loss of Pdcd10 in the gut epithelium. Last, we show that treatment with dexamethasone potently inhibits CCM formation in mice because of the combined effect of action at both brain endothelial cells and gut epithelial cells. These studies define a gut-brain disease axis in an experimental model of CCM in which a single gene is required for two critical components: gut epithelial function and brain endothelial signaling.

Medical Student Socioeconomic Disadvantage, Self-Designated Disadvantage, and Subsequent Academic Performance.

We previously reported that medical school matriculants with higher scores on a continuous measure of socioeconomic disadvantage (SED) had worse academic performance than those with lower scores. Analyses examining performance concurrently by SED and self-designated disadvantage (SDA) are lacking, an important gap since SDA may reflect perceptions only partly shaped by SED. We examined the associations of the four possible combinations of SED and SDA categories-SED+/SDA+, SED+/SDA-, and SED-/SDA+ (versus SED-/SDA-as reference)-with U.S. Medical Licensing Examination (USMLE) Step 1 and 2 Clinical Knowledge performance and third-year clerkship Honors at one medical school. USMLE scores were lower than reference for SED+/SDA+ and SED-/SDA+ (but not SED+/SDA-) students. SED+/SDA+, SED+/SDA-, and SED-/SDA+ students all received fewer Honors than reference. The findings indicate SED and SDA each predict different features of medical school performance, suggesting avenues for enhancing disadvantaged students' success and the representativeness of the physician workforce.

Incidence of Health and Behavior Problems in Service Dog Candidates Neutered at Various Ages.

Saint Francis Service Dogs (SFSD) trains dogs to aid people with multiple sclerosis, brain injury, and many other conditions. Organizations like SFSD must carefully consider when to neuter dogs to give them the best chance at successfully completing lengthy and expensive training. The objective of this retrospective cohort study was to assess differences in the incidence of health or behavior problems leading to dismissal between dogs neutered at different ages. Data on 245 dogs-including birth date, sex, neuter date, dismissal or successful completion of training, and (where applicable) reason for dismissal-were collected from SFSD records. Age-at-neuter was grouped (<7 months; 7-11 months; > 11 months) and compared for dogs who successfully completed training and dogs who were dismissed. Dogs neutered from 7 to 11 months of age were dismissed at a significantly lower overall rate than dogs neutered at an older or younger age. There were no differences between males and females. Labrador and golden retrievers were less likely to be dismissed than other breeds. This pattern was the same for dismissals for behavioral reasons. Dogs neutered at <7 months had more than twice the risk for health-related dismissals as dogs neutered at any older age and this pattern held for orthopedic dismissals. Labradors were at higher risk for orthopedic-related dismissal than golden retrievers and all other breeds. This study suggests that there is a relationship between dogs' age at neuter and the incidence of health and behavioral problems that can lead to dismissal from service dog training.

Adverse Childhood Experiences in Medical Students: Implications for Wellness.

OBJECTIVE: The primary purpose of the study was to assess the prevalence of adverse childhood experiences (ACEs) in a cohort of third-year medical students and characterize their childhood protective factors. METHODS: The authors developed a web-based anonymous survey distributed to all third-year medical students in one school (N = 98). The survey included the 10-item ACE Study questionnaire, a list of childhood protective factors (CPF) and questions to assess students' perception of the impact of ACEs on their physical and mental health. The medical school's IRB approved the student survey as an exempt study. The authors computed descriptive and comparative statistical analyses. RESULTS: Eighty-six of 98 students responded (88% response rate). Forty-four students (51%) reported at least one ACE exposure and 10 (12%) reported ≥ 4 exposures. The latter were all female. The average difference in the ACE score between male and female medical students was - 1.1 (independent t test with unequal variances t(57.7) = - 2.82, P = .007). Students with an ACE score of ≥ 4 were significantly more likely to report a moderate or significant effect on their mental health, compared with students with scores ≤ 3 (chi-square test, P = < .0001). Most students reported high levels of CPF (median score = 13 of a maximum score = 14). ACEs and CPF were inversely associated (Pearson correlation = - 0.32, P = .003). CONCLUSIONS: A sizeable minority of medical students reported exposure to multiple ACEs. If replicated, findings suggest a significant vulnerability of these medical students to health risk behaviors and physical and mental health problems during training and future medical practice.

Do Admissions Multiple Mini-Interview and Traditional Interview Scores Predict Subsequent Academic Performance? A Study of Five California Medical Schools.

PURPOSE: To compare the predictive validities of medical school admissions multiple mini-interviews (MMIs) and traditional interviews (TIs). METHOD: This longitudinal observational study of 2011-2013 matriculants to five California public medical schools examined the associations of MMI scores (two schools) and TI scores (three schools) with subsequent academic performance. Regression models adjusted for sociodemographics and undergraduate academic metrics examined associations of standardized mean MMI and TI scores with United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge (CK) scores and, for required clerkships, with mean National Board of Medical Examiners Clinical Science subject (shelf) exam score and number of honors grades. RESULTS: Of the 1,460 medical students, 746 (51.1%) interviewed at more than one study school; 579 (39.7%) completed at least one MMI and at least one TI. Neither interview type was associated with Step 1 scores. Higher MMI scores were associated with more clerkship honors grades (adjusted incidence rate ratio [AIRR] 1.28 more [95% CI 1.18, 1.39; P < .01] per SD increase) and higher shelf exam and Step 2 CK scores (adjusted mean 0.73 points higher [95% CI 0.28, 1.18; P < .01] and 1.25 points higher [95% CI 0.09, 2.41; P = .035], respectively, per SD increase). Higher TI scores were associated only with more honors grades (AIRR 1.11 more [95% CI 1.01, 1.20; P = .03] per SD increase). CONCLUSIONS: MMI scores were more strongly associated with subsequent academic performance measures than were TI scores.

Community College Pathways to Medical School and Family Medicine Residency Training.

PURPOSE: Medical students who attend community college are more likely to express intention to train in family medicine. This study examined whether community college attendance is associated with family medicine residency training in a national sample of US medical school graduates. METHODS: We performed a cross-sectional analysis using the Association of American Medical Colleges matriculant files of residency trainees who graduated from medical school between 2010 to 2012. Residency specialty (family medicine vs other) was modeled using logistic regression analysis; the key independent variable was community college attendance, with categories of non-community college (reference); community college while in high school; community college after graduating from high school, then transfer to 4-year university; and community college after graduating from a 4-year university or as a postbaccalaureate. The logistic model adjusted for age, sex, race/ethnicity, years in medical school, parental education (a marker of socioeconomic status), and high school US region. RESULTS: Of the 43,382 medical school graduates studied, 25.9% attended community college and 8.7% trained in family medicine. In unadjusted analysis, graduates attending community college while in high school, after graduating from high school with transfer to 4-year university, or after graduating from a 4-year university or as a postbaccalaureate (12.0%, 12.7%, and 10.8%, respectively) were more likely to train in family medicine compared with their peers who did not attend community college (7.7%). Respective adjusted odds ratios were 1.47 (95% CI, 1.33-1.63; P <.001), 1.27 (95% CI, 1.06-1.52; P = .009), and 1.17 (95% CI, 1.06-2.29; P = .002). Among family medicine residents, 32.7% of those who were white, 35.2% of those Asian, 50.8% of those Latino, and 32.7% of those black or African American attended community college. CONCLUSIONS: US medical school graduates who attended community college were more likely to train in family medicine, suggesting community college is an important pathway for increasing the primary care workforce.

Do Multiple Mini-Interview and Traditional Interview Scores Differ in Their Associations With Acceptance Offers Within and Across Five California Medical Schools?

PURPOSE: In single-school studies, multiple mini-interview (MMI) and traditional interview (TI) scores are associated with acceptance offers. Unexamined is whether scores at one school are associated with acceptance at other schools; such analyses would mitigate single-school design biases and better estimate how well interviews capture desired applicant attributes. Using data from the 5 California Longitudinal Evaluation of Admissions Practices (CA-LEAP) medical schools, the authors examined associations of MMI and TI scores with acceptance offers within and across schools. METHOD: The analyses included applicants who interviewed at ≥1 CA-LEAP school during the 2011-2013 admissions cycles. Three CA-LEAP schools employed TIs and 2 employed MMIs. Interview scores were standardized (z scores: mean = 0, SD = 1), and associations with acceptance offers were examined within and across schools in analyses stratified by school, adjusting for applicant sociodemographics, academic metrics, year, and total number of interviews. RESULTS: Of 4,993 applicants interviewed, 428 (8.6%) interviewed at both MMI schools, 681 (13.6%) at ≥2 TI schools, and 1,327 (26.6%) at ≥1 MMI and ≥1 TI school. For each school, acceptance was associated with interview score at that school and also with interview scores at the other 4 schools. Cross-school associations of MMI versus TI scores with acceptance did not differ statistically. CONCLUSIONS: Interview score at a given school was associated with acceptance at the other 4 schools, with no significant differences in associations for MMIs versus TIs. The findings suggest both MMIs and TIs captured attributes valued by admissions teams across CA-LEAP schools.

Medical School Performance of Socioeconomically Disadvantaged and Underrepresented Minority Students Matriculating after a Multiple Mini-Interview.

Multiple Mini-Interviews (MMIs) are increasingly used in medical school admissions. We previously reported that while under-represented minority (URM) status was not associated with MMI scores, self-designated disadvantaged applicants had lower MMI scores, possibly affecting their matriculation prospects. No studies have examined how URM status or socioeconomic disadvantage (SED) are associated with academic performance following admission through an MMI. We examined the adjusted associations of MMI scores, SED, and URM status with U.S. Medical Licensing Examination Steps 1 and 2 performance and third-year clerkship Honors, measures affecting residency matching. While URM status was not associated with the measures, students with greater SED had lower Step 1 scores and fewer Honors. Students with higher MMI scores had more Step 1 failures, but more Honors. The findings identify areas to address in medical school admissions, student support, and evaluation processes, which is important given the need for a more representative physician workforce.

Medical School Applicant Characteristics Associated With Performance in Multiple Mini-Interviews Versus Traditional Interviews: A Multi-Institutional Study.

PURPOSE: To examine applicant characteristics associated with multiple mini-interview (MMI) or traditional interview (TI) performance at five California medical schools. METHOD: Of the five California Longitudinal Evaluation of Admission Practices consortium schools, three used TIs and two used MMIs. Schools provided retrospective data on 2011-2013 admissions cycle interviewees: age, gender, race/ethnicity (underrepresented in medicine [UIM] or not), disadvantaged (DA) status, undergraduate GPA, Medical College Admission Test (MCAT) score, and interview score (standardized as z score; mean = 0; SD = 1). Adjusted linear regression analyses, stratified by interview type, examined associations with interview performance. RESULTS: The 4,993 applicants who completed 7,516 interviews included 931 (18.6%) UIM and 962 (19.3%) DA individuals; 3,226 (64.6%) had only 1 interview. Mean age was 24.4 (SD = 2.7); mean GPA and MCAT score were 3.72 (SD = 0.22) and 33.6 (SD = 3.7), respectively. Older age, female gender, and number of prior interviews were associated with better performance on both MMIs and TIs. Higher GPA was associated with lower MMI scores (z score, per unit GPA = -0.26; 95% CI = -0.45, -0.06) but unrelated to TI scores. DA applicants had higher TI scores (z score = 0.17; 95% CI = 0.07, 0.28) but lower MMI scores (z score = -0.18; 95% CI = -0.28, -0.08) than non-DA applicants. Neither UIM status nor MCAT score was associated with interview performance. CONCLUSIONS: These findings have potentially important workforce implications, particularly regarding MMI performance of DA applicants, and illustrate the need for other multi-institutional studies.

Reliability of Multiple Mini-Interviews and traditional interviews within and between institutions: a study of five California medical schools.

BACKGROUND: Many medical schools use admissions Multiple Mini-Interviews (MMIs) rather than traditional interviews (TIs), partly because MMIs are thought to be more reliable. Yet prior studies examined single-school samples of candidates completing either an MMI or TI (not both). Using data from five California public medical schools, the authors examined the within- and between-school reliabilities of TIs and MMIs. METHODS: The analyses included applicants interviewing at ≥1 of the five schools during 2011-2013. Three schools employed TIs (TI1, TI2, TI3) and two employed MMIs (MMI1, MMI2). Mixed linear models accounting for nesting of observations within applicants examined standardized TI and MMI scores (mean = 0, SD = 1), adjusting for applicant socio-demographics, academic metrics, year, number of interviews, and interview date. RESULTS: A total of 4993 individuals (completing 7516 interviews [TI = 4137, MMI = 3379]) interviewed at ≥1 school; 428 (14.5%) interviewed at both MMI schools and 687 (20.2%) at more than one TI school. Within schools, inter-interviewer consistency was generally qualitatively lower for TI1, TI2, and TI3 (Pearson's r 0.07, 0.13, and 0.29, and Cronbach's α, 0.40, 0.44, and 0.61, respectively) than for MMI1 and MMI 2 (Cronbach's α 0.68 and 0.60, respectively). Between schools, the adjusted intraclass correlation coefficient was 0.27 (95% CI 0.20-0.35) for TIs and 0.47 (95% CI 0.41-0.54) for MMIs. CONCLUSIONS: Within and between-school reliability was qualitatively higher for MMIs than for TIs. Nonetheless, TI reliabilities were higher than anticipated from prior literature, suggesting TIs may not need to be abandoned on reliability grounds if other factors favor their use.