Effects of comprehensive educational reforms on academic success in a diverse student body.

CONTEXT: Calls for medical curriculum reform and increased student diversity in the USA have seen mixed success: performance outcomes following curriculum revisions have been inconsistent and national matriculation of under-represented minority (URM) students has not met aspirations. Published innovations in curricula, academic support and pipeline programmes usually describe isolated interventions that fail to affect curriculum-level outcomes. METHODS: United States Medical Licensing Examination (USMLE) Step 1 performance and graduation rates were analysed for three classes of medical students before (matriculated 1995-1997, n=517) and after (matriculated 2003-2005, n=597) implementing broad-based reforms in our education system. The changes in pipeline recruitment and preparation programmes, instructional methods, assessment systems, academic support and board preparation were based on sound educational principles and best practices. RESULTS: Post-reform classes were diverse with respect to ethnicity (25.8% URM students), gender (51.8% female), and Medical College Admissions Test (MCAT) score (range 20-40; 24.1% scored ≤ 25). Mean±standard deviation MCAT scores were minimally changed (from 27.2±4.7 to 27.8±3.6). The Step 1 failure rate decreased by 69.3% and mean score increased by 14.0 points (effect size: d=0.67) overall. Improvements were greater among women (failure rate decreased by 78.9%, mean score increased by 15.6 points; d=0.76) and URM students (failure rate decreased by 76.5%, mean score increased by 14.6 points; d=0.74), especially African-American students (failure rate decreased by 93.6%, mean score increased by 20.8 points; d=1.12). Step 1 scores increased across the entire MCAT range. Four- and 5-year graduation rates increased by 7.1% and 5.8%, respectively. CONCLUSIONS: The effect sizes in these performance improvements surpassed those previously reported for isolated interventions in curriculum and student support. This success is likely to have resulted from the broad-based, mutually reinforcing nature of reforms in multiple components of the education system. The results suggest that a narrow reductionist view of educational programme reform is less likely to result in improved educational outcomes than a system perspective that addresses the coordinated functioning of multiple aspects of the academic enterprise.

Toward Defining the Foundation of the MD Degree: Core Entrustable Professional Activities for Entering Residency.

Currently, no standard defines the clinical skills that medical students must demonstrate upon graduation. The Liaison Committee on Medical Education bases its standards on required subject matter and student experiences rather than on observable educational outcomes. The absence of such established outcomes for MD graduates contributes to the gap between program directors' expectations and new residents' performance.In response, in 2013, the Association of American Medical Colleges convened a panel of experts from undergraduate and graduate medical education to define the professional activities that every resident should be able to do without direct supervision on day one of residency, regardless of specialty. Using a conceptual framework of entrustable professional activities (EPAs), this Drafting Panel reviewed the literature and sought input from the health professions education community. The result of this process was the publication of 13 core EPAs for entering residency in 2014. Each EPA includes a description, a list of key functions, links to critical competencies and milestones, and narrative descriptions of expected behaviors and clinical vignettes for both novice learners and learners ready for entrustment.The medical education community has already begun to develop the curricula, assessment tools, faculty development resources, and pathways to entrustment for each of the 13 EPAs. Adoption of these core EPAs could significantly narrow the gap between program directors' expectations and new residents' performance, enhancing patient safety and increasing residents', educators', and patients' confidence in the care these learners provide in the first months of their residency training.

Introduction of patient video clips into computer-based testing: effects on item statistics and reliability estimates.

PURPOSE: Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. METHOD: We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. RESULTS: Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. CONCLUSIONS: The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

A university system's approach to enhancing the educational mission of health science schools and institutions: the University of Texas Academy of Health Science Education.

BACKGROUND: The academy movement developed in the United States as an important approach to enhance the educational mission and facilitate the recognition and work of educators at medical schools and health science institutions. OBJECTIVES: Academies initially formed at individual medical schools. Educators and leaders in The University of Texas System (the UT System, UTS) recognized the academy movement as a means both to address special challenges and pursue opportunities for advancing the educational mission of academic health sciences institutions. METHODS: The UTS academy process was started by the appointment of a Chancellor's Health Fellow for Education in 2004. Subsequently, the University of Texas Academy of Health Science Education (UTAHSE) was formed by bringing together esteemed faculty educators from the six UTS health science institutions. RESULTS: Currently, the UTAHSE has 132 voting members who were selected through a rigorous, system-wide peer review and who represent multiple professional backgrounds and all six campuses. With support from the UTS, the UTAHSE has developed and sustained an annual Innovations in Health Science Education conference, a small grants program and an Innovations in Health Science Education Award, among other UTS health science educational activities. The UTAHSE represents one university system's innovative approach to enhancing its educational mission through multi- and interdisciplinary as well as inter-institutional collaboration. CONCLUSIONS: The UTAHSE is presented as a model for the development of other consortia-type academies that could involve several components of a university system or coalitions of several institutions.

Comprehensive changes in the learning environment: subsequent step 1 scores of academically at-risk students.

BACKGROUND: During the past 10 years at our institution, a number of changes have been instituted in the learning environment, including instructional techniques, assessment methods, academic support, and explicit board preparation. METHOD: The authors studied the Step 1 performance of students with MCAT scores of 20 to 25 in our former and current curricula. Effect sizes were calculated for score improvement using adjusted means from ANCOVA with covariates of MCAT and age. RESULTS: The overall effect size was 0.48, with larger effects seen for underrepresented minority students overall (d = 0.64) and African American students especially (d = 0.77), representing medium to large effects. Overall failure rates decreased by two thirds. CONCLUSIONS: Comprehensive changes in the learning environment were followed by substantial improvement in Step 1 performance among academically at-risk students.

Testosterone administration to older men improves muscle function: molecular and physiological mechanisms.

We investigated the effects of 6 mo of near-physiological testosterone administration to older men on skeletal muscle function and muscle protein metabolism. Twelve older men (> or =60 yr) with serum total testosterone concentrations <17 nmol/l (480 ng/dl) were randomly assigned in double-blind manner to receive either placebo (n = 5) or testosterone enanthate (TE; n = 7) injections. Weekly intramuscular injections were given for the 1st mo to establish increased blood testosterone concentrations at 1 mo and then changed to biweekly injections until the 6-mo time point. TE doses were adjusted to maintain nadir serum testosterone concentrations between 17 and 28 nmol/l. Lean body mass (LBM), muscle volume, prostate size, and urinary flow were measured at baseline and at 6 mo. Protein expression of androgen receptor (AR) and insulin-like growth factor I, along with muscle strength and muscle protein metabolism, were measured at baseline and at 1 and 6 mo of treatment. Hematological parameters were followed monthly throughout the study. Older men receiving testosterone increased total and leg LBM, muscle volume, and leg and arm muscle strength after 6 mo. LBM accretion resulted from an increase in muscle protein net balance, due to a decrease in muscle protein breakdown. TE treatment increased expression of AR protein at 1 mo, but expression returned to pre-TE treatment levels by 6 mo. IGF-I protein expression increased at 1 mo and remained increased throughout TE administration. We conclude that physiological and near-physiological increases of testosterone in older men will increase muscle protein anabolism and muscle strength.