It's a matter of trust: exploring the basis of program directors' decisions about whether to trust a resident to care for a loved one.

There has been increased attention to and emphasis on competency-based medical education and the transformation from highly supervised medical students towards independent, entrustable physicians. We explored how program directors (PDs) justify decisions about whether they would trust finishing Post Graduate Year 1 (PGY1) residents to care for the PD or a loved one. Using an end of year survey with validity evidence, we assessed PDs' responses (Yes, No, Not Sure) and written comments about this entrustment decision for USUHS medical students from graduating classes of 2013-2015 (PGY1). We performed a qualitative inductive content analysis to identify themes in how PDs justified their decisions as well as descriptive statistics and a contingency table analysis to examine associations between trust decisions and election to membership in Alpha Omega Alpha (AOA), or conversely, referral to the Student Promotions Committee (SPC) for remediation. Qualitative analyses revealed five themes related to this trust decision about medical residents: personal, interpersonal, knowledge, competence, and developmental. Neither AOA status, nor SPC referral status was significantly associated with the trust measure, overall, but positive trust decisions were significantly higher among those elected to AOA than in those who were not. Positive trust decisions were significantly associated with AOA status but negative trust decisions were not significantly associated with referral to the SPC. This study offers insights into what attributes may underpin trust decisions by PDs. Our findings suggest that PDs' frequent use of personal and interpersonal characteristics to justify trust decisions contrasts with the use of clinical and knowledge based assessments during undergraduate medical education (UME), and emphasize the importance of critical intrinsic abilities.

Post-Carnegie II curricular reform: a north American survey of emerging trends & challenges.

BACKGROUND: In 2010, coincident with the 100th anniversary of Flexner's sentinel report, the Carnegie Foundation published an updated review of North American medical education and challenged medical schools to initiate further educational reforms. Specific recommendations pertained to a) ensuring standardized outcomes while allowing for individualized processes, b) integrating foundational knowledge with clinical experience, c) cultivating habits of inquiry and innovation and d) professional identity formation. As we approach the 10-year anniversary of this latest report, we sought to determine what type of curricular revisions have been emerging within the past decade and what types of challenges have been encountered along the way? METHODS: In 2018, an electronic survey was sent to all 166 Liaison Committee on Medical Education (LCME) accredited North American Medical Schools, using the points of contact (educational deans) that were listed in a publicly available, Association of American Medical Colleges database. Free text comments were grouped into themes using the constant-comparative technique. RESULTS: Sixty unique responses yielding a 36.14% response rate. The distribution of responses was proportionally representative of the distribution of public vs. private, old vs. new vs. established North American medical schools. Self-reported curricular changes aggregated into five main themes: Changes in curricular structure/organization, changes in curricular content, changes in curricular delivery, changes in assessment, and changes involving increased use of technology/informatics. Challenges were predominantly focused on overcoming faculty resistance, faculty development, securing adequate resourcing, change management, and competition for limited amounts of curricular time. CONCLUSIONS: Changes in curricular organization, content, delivery, assessment and the use of technology reflect reforms that are broad and deep. Empowering faculty to "let go" of familiar constructs/processes requires strong leadership, particularly when initiating particularly disruptive curricular changes, such as relocating the Step 1 examination or shifting to a competency-based curriculum. While North American medical schools are responding to the calls for action described in the second (2010) Carnegie Foundation report, the full vision has yet to be achieved.

Combination of anti-citrullinated protein antibodies and rheumatoid factor is associated with increased systemic inflammatory mediators and more rapid progression from preclinical to clinical rheumatoid arthritis.

The development of rheumatoid factor (RF) and/or anti-citrullinated protein antibodies (ACPAs) can be observed years prior to clinical diagnosis of rheumatoid arthritis (RA). Nevertheless, the interaction between these two autoantibodies and their combined effect on development of RA is unclear. We measured RF, cytokines, and ACPA subtypes in serial pre-clinical serum samples collected from 83 US veterans who all developed RA. Levels of cytokines and ACPAs were compared between the following groups: anti-cyclic citrullinated peptide (anti-CCP)-/RF- (double negative), anti-CCP+/RF-, anti-CCP-/RF+, or anti-CCP+/RF+ (double-positive). The double-positive subgroup had significantly higher levels of 20 inflammatory cytokines and 29 ACPA reactivities, and the shortest interval, 1.3 years, between the preclinical sample timepoint and diagnosis of RA. Thus, the combined presence of ACPAs and RF is associated with a more rapid progression to RA, suggesting that anti-CCP+/RF+ individuals have a more advanced preclinical disease state and that the onset of RA may be imminent.

Validity evidence for medical school OSCEs: associations with USMLE® step assessments.

BACKGROUND: Recently, there has been a surge in the use of objective structured clinical examinations (OSCEs) at medical schools around the world, and with this growth has come the concomitant need to validate such assessments. PURPOSES: The current study examined the associations between student performance on several school-level clinical skills and knowledge assessments, including two OSCEs, the National Board of Medical Examiners® (NBME) Subject Examinations, and the United States Medical Licensing Examination® (USMLE) Step 2 Clinical Skills (CS) and Step 3 assessments. METHODS: The sample consisted of 806 medical students from the Uniformed Services University of the Health Sciences. We conducted Pearson correlation analysis as well as stepwise multiple linear regression modeling to examine the strength of associations between students' performance on 2nd- and 3rd-year OSCEs and their two Step 2 CS component scores and Step 3 scores. RESULTS: Positive associations were found between the OSCE variables and the USMLE scores; in particular, student performance on both the 2nd- and 3rd-year OSCEs was more strongly associated with the two Step 2 CS component scores than with Step 3 scores. CONCLUSIONS: These findings, although preliminary, provide some predictive validity evidence for the use of OSCEs in determining readiness of medical students for clinical practice and licensure.

Application essays and future performance in medical school: are they related?

BACKGROUND: There is a paucity of research on whether application essays are a valid indicator of medical students' future performance. PURPOSE: The goal is to score medical school application essays systematically and examine the correlations between these essay scores and several indicators of student performance during medical school and internship. METHODS: A journalist created a scoring rubric based on the journalism literature and scored 2 required essays of students admitted to our university in 1 year (N = 145). We picked 7 indicators of medical school and internship performance and correlated these measures with overall essay scores: preclinical medical school grade point average (GPA), clinical medical school GPA, cumulative medical school GPA, U.S. Medical Licensing Exam (USMLE) Step 1 and 2 scores, and scores on a program director's evaluation measuring intern professionalism and expertise. We then examined the Pearson and Spearman correlations between essay scores and the outcomes. RESULTS: Essay scores did not vary widely. American Medical College Application Service essay scores ranged from 3.3 to 4.5 (M = 4.11, SD = 0.15), and Uniformed Services University of the Health Sciences essay scores ranged from 2.9 to 4.5 (M = 4.09, SD = 0.17). None of the medical school or internship performance indicators was significantly correlated with the essay scores. CONCLUSIONS: These findings raise questions about the utility of matriculation essays, a resource-intensive admission requirement.

Does self-reported clinical experience predict performance in medical school and internship?

CONTEXT: Medical school admissions committees attempt to select the most qualified applicants. In addition to traditional performance measures, committees often look favourably upon applicants who report previous clinical experience. OBJECTIVES: This study aimed to determine if self-reported clinical experience is a valid indicator of future performance in medical school and internship. METHODS: We collected data for seven year groups (1993-1999; n = 1112) and operationalised trainee performance in terms of five outcomes: cumulative medical school grade point average (GPA); US Medical Licensing Examination (USMLE) Step 1 and 2 scores, and scores on a validated programme director's evaluation measuring intern expertise and professionalism. We then conducted a series of analyses of covariance to compare outcomes in applicants who self-reported previous clinical experience with outcomes in those who did not. In these analyses, the independent variable was self-reported clinical experience (yes/no), the covariate was undergraduate GPA, and the dependent variables were the five performance outcomes. RESULTS: In four of five analyses, we found no differences in the performance of the two groups (clinical experience versus no clinical experience). However, on the cumulative medical school GPA outcome, applicants who reported previous clinical experience had statistically significantly lower cumulative GPAs upon graduation than those who did not report such experience (F(1,940) = 9.35, p = 0.002, partial η(2) = 0.01 [small effect size]). CONCLUSIONS: Our results suggest that applicants who self-report previous clinical experience may not be better candidates. In fact, on some measures of performance, these applicants may actually perform worse than those who report no clinical experience.

Alternate list matriculants: outcome data from those medical students admitted from the alternate list.

BACKGROUND: Medical schools are increasing class size to meet future health care needs for our nation. This may lead to more students being accepted from an alternate list (vs. primary acceptances). Given these trends, performance outcomes were compared for alternate list matriculants and primary acceptances. Our hypothesis was that those students accepted from an alternate list would perform equally to the primary acceptances on these outcomes. METHOD: We compared medical school performance of students who received a primary recommendation of "accept" and compared them to those who received a recommendation of "alternate" over a 10-year period. Given the small sample size of this alternate list group (N = 23), descriptive statistics are reported. RESULTS: No consistent differences between alternate and primary acceptance matriculants in terms of cumulative medical school grade point average, United States Medical Licensing Examination (USMLE) Step 1 scores and USMLE Step 2 Clinical Knowledge scores were found. Only three alternates (13.0%) were presented to student promotion committee compared to 17.2% for matriculants who were primary acceptances. Three alternates were required to repeat a year (average percentage of 8.7%) compared to 5.6% of matriculants who were primary acceptances. CONCLUSIONS: This observational study provides some reassurance that as long as the qualifications of the applicant pool remain adequate, admissions policies that provide for alternate list acceptances may not produce poorer performing students, at least by our current outcome measures.

Exploring the relationship between self-reported research experience and performance in medical school and internship.

PURPOSE: To investigate the relationship between self-reported research experience and medical students' performance in medical school and internship. METHODS: We collected data from seven year-groups (1993-1999; N = 1,112) and examined 7 performance outcomes: medical school preclinical grade point average (GPA), medical school clinical GPA, cumulative medical school GPA, U.S. Medical Licensing Examination Step 1 and 2 scores, and scores on a previously validated program director's survey of intern professionalism and expertise. We then conducted a series of multiple linear regressions to determine the relations between self-reported research experience and our seven outcomes. RESULTS: When compared to those who reported no prior research experience, students who reported research experience performed significantly better on U.S. Medical Licensing Examination Step 1 and had a higher medical school preclinical GPA. However, these same students scored significantly lower on intern professionalism and expertise ratings. Self-reported research experience did not show statistically significant correlations with the other outcome variables. CONCLUSIONS: The results from our large, multiyear, cohort study suggest that prior research experience may account for some variance in outcomes in the early stages of medical school education, but that variance explained diminishes considerably as trainees progress into the more senior phases of education. On the other hand, prior research experience may be negatively related to students' performance in internship. In all cases, however, effect sizes are small.

Identifying themes within a medical school admission committee's reviews of applicants.

BACKGROUND: Admissions committees attempt to select the most qualified applicants based on many cognitive and "noncognitive" factors. PURPOSE: Identify common themes cited in the admissions committee member summaries of medical school matriculants and determine the relative frequency and importance of these themes. METHODS: After reviewing a convenience sample of 150 reviewer comments, 14 qualitative themes were identified. Utterances (thematic word strings) from each of the three reviewer comments for each matriculant for 7 academic years (1989-1996) were then categorized and coded as being positive, negative, or neutral. Intra-rater and inter-rater reliabilities were calculated. RESULTS: Utterances (n = 9299) about 981 matriculants were categorized by theme and sorted as being positive, neutral, or negative. Intra-rater reliabilities were excellent (mean K = 0.98, range 0.90-1.00). Similarly, inter-rater reliabilities were also excellent (mean K = 0.94, range 0.55-1.00 and mean K = 0.90, range 0.08-1.00). Four themes (overall summarizing comments, academic, test scores, and motivation) accounted for more than half (56%) of the utterances. CONCLUSIONS: We were able to qualitatively identify themes and provide information about how one committee weighs both cognitive and "noncognitive" factors. Admission committees should consider reexamining their process and potentially expanding, eliminating, or modifying application components.

Relationship between admissions committee review and student performance in medical school and internship.

PURPOSE: To investigate the association between tertiary reviewer (admissions committee member) comments and medical students' performance during medical school and into internship. METHODS: We collected data from seven year-groups (1993-1999) and coded tertiary reviewer comments into 14 themes. We then conducted an exploratory factor analysis to reduce the dimensions of the themes (excluding the Overall impression theme). Subsequently, we performed Pearson correlation analyses and multiple linear regression analysis to examine the relationship between the factors and seven outcome measures: medical school preclinical grade point average (GPA), medical school clinical GPA, cumulative medical school GPA, U.S. Medical Licensing Examination Step 1 and 2 scores, and scores on a program director's evaluation measuring intern professionalism and expertise. RESULTS: We extracted seven factors from the 13 themes and found small-to-moderate, significant correlations between the factors, the Overall impression theme, and the outcome measures. In particular, positive comments on Test and Maturity were associated with higher U.S. Medical Licensing Examination Step 1 and 2 scores. Negative comments on Interview and Recommendations were associated with lower ratings of professionalism during internship. Comments on Overall impression were significantly associated with all the outcome measures. CONCLUSIONS: Tertiary reviewer comments were weakly associated with performance in medical school and internship. Compared with positive comments, negative comments had stronger associations with medical school and internship performance measures.

Development and initial validation of a survey to assess students' self-efficacy in medical school.

Self-efficacy is a personal belief in one's capability to successfully execute the behaviors necessary to attain designated types of performances. Sometimes described as task-specific self-confidence, self-efficacy is a key component in many contemporary theories of motivation and learning. The purpose of this study was to develop a survey for measuring students' medical skills self-efficacy and to collect reliability and validity evidence for the instrument. A secondary purpose was to explore differences in students' self-efficacy from year 1 of medical school to year 4. We created 19 survey items based on the 6 core competencies of the Accreditation Council for Graduate Medical Education, and we collected data from 304 medical students. Results from an exploratory factor analysis suggested three interpretable factors: patient care self-efficacy (eight items, Cronbach's alpha = 0.92), interpersonal skills self-efficacy (three items, Cronbach's alpha = 0.76), and evidence-based medicine self-efficacy (three items, Cronbach's alpha = 0.79). We then compared students' self-efficacy at different stages of training using a one-way multivariate analysis of variance. Consistent with our expectations, we found several statistically significant differences, suggesting students' self-efficacy increased considerably from year 1 of medical school to year 4, F(9, 725) = 30.58, p < 0.001, Wilks' lambda = 0.46. Using this survey, medical educators and researchers have a psychometrically sound tool for measuring students' medical skills self-efficacy during undergraduate medical education. Practical implications and future directions are discussed.

Relationship between OSCE scores and other typical medical school performance indicators: a 5-year cohort study.

BACKGROUND: Objective Structured Clinical Examinations (OSCEs) are used at the majority of U.S. medical schools. Given the high resource demands with constructing and administering OSCEs, understanding how OSCEs relate to typical performance measures in medical school could help educators more effectively design curricula and evaluation to optimize student instruction and assessment. PURPOSE: To investigate the correlation between second-year and third-year OSCE scores, as well as the associations between OSCE scores and several other typical measures of students' medical school performance. METHODS: We tracked the performance of a 5-year cohort (classes of 2007-2011). We studied the univariate correlations among OSCE scores, U.S. Medical Licensing Examination (USMLE) scores, and medical school grade point average. We also examined whether OSCE scores explained additional variance in the USMLE Step 2 Clinical Knowledge score beyond that explained by the Step 1 score. RESULTS: The second- and third-year OSCE scores were weakly correlated. Neither second- nor third-year OSCE score was strongly correlated with USMLE scores or medical school grade point average. CONCLUSION: Our findings suggest that OSCEs capture a viewpoint that is different from typical assessment measures that largely reflect multiple choice questions; these results also support tenets of situated cognition theory.

40 years of military medical education: an overview of the Long-Term Career Outcome Study (LTCOS).

In 2005, the Long-Term Career Outcome Study (LTCOS) was established by the Dean, F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences (USU). The original charge to the LTCOS team was to establish an electronic database of current and past students at USU. Since its inception, however, the LTCOS team has broadened its mission and started collecting and analyzing data on a continuous basis for the purposes of program evaluation and, in some cases, research. The purpose of this commentary is to review the history of the LTCOS, including details about USU, a brief review of prior LTCOS work, and progress made since our last essay on LTCOS efforts. This commentary also provides an introduction to the special issue, which is arranged as a series of articles that span the medical education continuum (i.e., before, during, and after medical school). The relative balance of articles in each phase of training represents the LTCOS team's efforts to address the entire continuum of medical education.

Leadership success and the Uniformed Services University: perspectives of flag officer alumni.

UNLABELLED: The Uniformed Services University of the Health Sciences (USU) houses the nation's only federal medical school, the F. Edward Hébert School of Medicine. A key aspect of the curriculum at USU is leadership education as graduates go on to serve the Department of Defense through a variety of senior positions in the military. We surveyed a specific group of USU graduates who have achieved the rank of General or Admiral ("flag officers") to enhance our understanding of successful leadership for military physicians and to gain an understanding of how USU might shape its curriculum in the future. METHODS: We sent an Internet-based survey to 13 flag officer graduates. The first section of the survey contained items from the multifactor leadership questionnaire-6S, a questionnaire with evidence of reliability and validity for evaluating leadership styles. The second section of the survey contained open-ended questions addressing key characteristics of an effective leader in the Military Health System, experiences that prepared them for leadership, USU's role in leadership positions, and advice for USU for better educating future leaders. The second section of the survey was coded using the constant comparative method. RESULTS: Eight flag officers (63%) responded to the survey. They all scored highly on transformational leadership style. Qualitative themes reached saturation for each open-ended question. The flag officers identified characteristics consistent with published literature from other fields regarding effective leadership. They endorsed USU's role in achieving their leadership positions and suggested areas for improvement. CONCLUSIONS: Characteristics of effective leadership (transformational leadership style) identified by the flag officers surveyed in this study are consistent with the literature from other fields. These finding have important implications for leadership education at USU and potentially other institutions. The results also provide additional data to support the notion that USU is meeting its societal obligation to educate future leaders in military medicine.

Where are they now? USU School of Medicine graduates after their military obligation is complete.

The Uniformed Services University's (USU) F. Edward Hébert School of Medicine was chartered in 1972, with the goal of providing high-quality physicians for the Uniformed Services. In exchange for their education, USU graduates incur an active duty service obligation, after which they may choose to stay on active duty or transition to civilian practice. The purpose of this study is to describe the practice characteristics of USU graduates after this obligation has been completed in order to determine the societal benefits during this phase of their careers. To accomplish this purpose, we performed a retrospective cohort study of the first 20 years of USU graduates (1980-1999). We used the American Medical Association Physician Masterfile to determine the graduates' current practice location and characteristics, as well as their board certification status. Of these 2,760 graduates, nearly all (91%) were involved in active clinical practice in over 100 self-declared specialties, the vast majority (89%) practiced in locations other than the immediate vicinity of the medical school (i.e., Maryland and the District of Columbia), and most still worked for the federal government (71%). Finally, USU graduates in full-time clinical practice had a board certification rate of 93%, which was better than the average of all other graduates of U.S. Medical Schools (88%) in the same time period. Thus, it seems USU is attaining its goal of producing high-quality physicians who continue to benefit the nation after their service obligation has been completed, with many still in federal service.

The Long-Term Career Outcome Study (LTCOS): what have we learned from 40 years of military medical education and where should we go?

The work of the Long-Term Career Outcome Study (LTCOS), F. Edward Hébert School of Medicine, Uniformed Services University of the Health Sciences (USU) has been a multidisciplinary effort spanning more than 5 years. Borrowing from the established program evaluation and quality assurance literature, the LTCOS team has organized its evaluation and research efforts into three phases: before medical school, during medical school, and after medical school. The purpose of this commentary is to summarize the research articles presented in this special issue and to answer two fundamental questions: (1) what has been learned from LTCOS research conducted to date, and (2) where should the LTCOS team take its evaluation and research efforts in the future? Answers to these questions are relevant to USU, and they also can inform other medical education institutions and policy makers. What is more, answers to these questions will help to ensure USU meets its societal obligation to provide the highest quality health care to military members, their families, and society at large.

Autoimmunity to peptidyl arginine deiminase type 4 precedes clinical onset of rheumatoid arthritis.

OBJECTIVE: To determine whether antibodies against peptidyl arginine deiminase type 4 (PAD-4) are present in the preclinical phase of rheumatoid arthritis (RA) and to compare the timing and extent of their appearance with those of other preclinical autoantibodies. METHODS: Prediagnosis serum samples from 83 patients with RA were evaluated for the presence of anti-PAD-4 antibody, anti-cyclic citrullinated peptide (anti-CCP) antibody, and rheumatoid factor. In addition, a control cohort (n = 83) matched by age, sex, race, number of serum samples, and duration of serum storage was tested for the presence of anti-PAD-4 antibody to determine its sensitivity and specificity for the subsequent development of RA. RESULTS: Fifteen of 83 patients with RA (18.1%) had at least 1 prediagnosis sample positive for anti-PAD-4. One of 83 control subjects (1.2%) had at least 1 positive sample, resulting in a sensitivity and specificity of 18.1% and 98.8%, respectively, of anti-PAD-4 for the future development of RA. The mean duration of anti-PAD-4 positivity prior to clinical diagnosis was 4.67 years. Anti-PAD-4 positivity was associated with anti-CCP positivity (odds ratio 5.13 [95% confidence interval 1.07-24.5]). In subjects with prediagnosis samples that were positive for both antibodies, anti-CCP positivity predated anti-PAD-4 positivity in 9 of 13 cases (69%). CONCLUSION: Autoantibodies to PAD-4 are present during the preclinical phase of RA in a subset of patients and are associated with anti-CCP positivity. Further exploration is needed regarding the timing of appearance and disease-related effects of PAD-4 autoimmunity.

The number of elevated cytokines and chemokines in preclinical seropositive rheumatoid arthritis predicts time to diagnosis in an age-dependent manner.

OBJECTIVE: To evaluate levels of biomarkers in preclinical rheumatoid arthritis (RA) and to use elevated biomarkers to develop a model for the prediction of time to future diagnosis of seropositive RA. METHODS: Stored samples obtained from 73 military cases with seropositive RA prior to RA diagnosis and from controls (mean 2.9 samples per case; samples collected a mean of 6.6 years prior to diagnosis) were tested for rheumatoid factor (RF) isotypes, anti-cyclic citrullinated peptide (anti-CCP) antibodies, 14 cytokines and chemokines (by bead-based assay), and C-reactive protein (CRP). RESULTS: Preclinical positivity for anti-CCP and/or ≥2 RF isotypes was >96% specific for future RA. In preclinical RA, levels of the following were positive in a significantly greater proportion of RA cases versus controls: interleukin-1α (IL-1α), IL-1ß, IL-6, IL-10, IL-12p40, IL-12p70, IL-15, fibroblast growth factor 2, flt-3 ligand, tumor necrosis factor α, interferon-γ-inducible 10-kd protein, granulocyte-macrophage colony-stimulating factor, and CRP. Also, increasing numbers of elevated cytokines/chemokines were present in cases nearer to the time of diagnosis. RA patients who were ≥40 years old at diagnosis had a higher proportion of samples positive for cytokines/chemokines 5-10 years prior to diagnosis than did patients who were <40 years old at diagnosis (P < 0.01). In regression modeling using only case samples positive for autoantibodies highly specific for future RA, increasing numbers of cytokines/chemokines were predictive of decreased time to diagnosis, and the predicted time to diagnosis based on cytokines/chemokines was longer in older compared with younger cases. CONCLUSION: Levels of autoantibodies, cytokines/chemokines, and CRP are elevated in the preclinical period of RA development. In preclinical autoantibody-positive cases, the number of elevated cytokines/chemokines is predictive of the time of diagnosis of future RA in an age-dependent manner.

Changes in clinical skills education resulting from the introduction of the USMLE step 2 clinical skills (CS) examination.

BACKGROUND: Step 2 Clinical Skills (CS) was recently introduced into the United States Medical Licensing Examination (USMLE) to ensure that successful candidates for licensure possess the clinical skills to provide safe and effective patient care. AIMS: To explore if medical schools had changed the objectives, content, or emphasis in their pre-clinical curriculum in response to its implementation. METHODS: In April 2005, the Clerkship Directors in Internal Medicine (CDIM) sent an electronic survey to a single member from each medical school with a CDIM member. The survey instrument included 26 pre-clinical curricular questions with nine questions specifically addressing changes in response to implementation of the Step 2 CS. RESULTS: Forty-five percent of respondents reported changes to the Introduction to Clinical Medicine (ICM) course objectives while 39% and 40% reported changes in content and emphasis. Seventy-four percent felt their students were adequately prepared for the Step 2 CS and 18% were unsure. CONCLUSIONS: Over a third of medical schools are implementing changes to the objectives, content, and/or emphasis of their curriculum, at least partially in response to the institution of Step 2 CS.

A Longitudinal Study of Commonly Used Admissions Measures and Disenrollment from Medical School and Graduate Medical Education Probation or Termination from Training.

Introduction: This is an empirical study to better understand commonly used medical school admission measures and disenrollment decisions during undergraduate medical education as well as graduate medical education (GME) probation or termination decisions. Materials and Methods: Based on the data of USUHS medical students matriculating between 1998 and 2011 (N = 2,460), we compared medical school graduates and those disenrolled from medical school on MCAT scores, undergraduate BCPM (Biology, Chemistry, Physics, Math) GPA, and undergraduate overall GPA. We also reported more specific reasons for disenrollment decisions. Next, we compared the students who were referred to the student promotion committee (SPC) with other students on these measures. Moving onto GME, we compared trainees who were put on probation or terminated from training with those who were not on MCAT and undergraduate GPA measures. In addition, we examined the association between being referred to the SPC and GME probation or termination. Results: There were 2,347 graduates and 113 disenrolled students from medical school (4.8%). For the disenrolled students, 43 (38.7%) students were disenrolled for exclusively (or primarily) non-academic reasons, and 68 (61.3%) were disenrolled for exclusively (or primarily) academic reasons. The t-tests showed statistically significant differences on the MCAT score of the first attempt (t(2,449) = 7.22, P < 0.01, Cohen's d = 0.70), average MCAT score (t(2,449) = 4.22, P < 0.01, Cohen's d = 0.41), and highest MCAT score (t(2,449) = 3.51, P < 0.01, Cohen's d = 0.34). Logistic regression model selection also revealed that the best predictor for disenrollment was the first MCAT score (exp(b) = 0.83, 95% CI = (0.78, 0.88)). No significant differences on these measures were found from the group comparisons on SPC and GME probation or termination. There was no significant association between SPC appearance and GME probation or termination. Conclusions: Academic difficulties, especially in the basic sciences, appear to be the most common factor for disenrollment from medical school. These students also had lower MCAT scores, particularly on the first attempt. The MCAT performance indicators and undergraduate GPA were consistently lower, but not statistically significant, for those who appeared before SPC or were put on probation or terminated from training during GME.