Temporal Trends in Childhood Household Income Among Applicants and Matriculants to Medical School and the Likelihood of Acceptance by Income, 2014-2019.

This study examines trends in childhood household income among applicants and matriculants to medical school and the likelihood of acceptance by income.

Transitioning Speech-Language Assessment to a Virtual Environment: Lessons Learned From the ELLA Study.

Purpose The COVID-19 pandemic has necessitated a quick shift to virtual speech-language services; however, only a small percentage of speech-language pathologists (SLPs) had previously engaged in telepractice. The purpose of this clinical tutorial is (a) to describe how the Early Language and Literacy Acquisition in Children with Hearing Loss study, a longitudinal study involving speech-language assessment with children with and without hearing loss, transitioned from in-person to virtual assessment and (b) to provide tips for optimizing virtual assessment procedures. Method We provide an overview of our decision making during the transition to virtual assessment. Additionally, we report on a pilot study that calculated test-retest reliability from in-person to virtual assessment for a subset of our preschool-age participants. Results Our pilot study revealed that most speech-language measures had high or adequate test-retest reliability when administered in a virtual environment. When low reliability occurred, generally the measures were timed. Conclusions Speech-language assessment can be conducted successfully in a virtual environment for preschool children with hearing loss. We provide suggestions for clinicians to consider when preparing for virtual assessment sessions. Supplemental Material https://doi.org/10.23641/asha.14787834.

Preparing for the MD: How Long, at What Cost, and With What Outcomes?

PURPOSE: To assess educational and professional outcomes of an accelerated combined bachelor of science-doctor of medicine (BS-MD) program using data collected from 1968 through 2018. METHOD: Participants of this longitudinal study included 2,235 students who entered medical school between 1968 and 2014: 1,134 in the accelerated program and 1,101 in the regular curriculum (control group)-matched by year of entrance to medical school, gender, and Medical College Admission Test (MCAT) scores. Outcome measures included performance on medical licensing examinations, academic progress, satisfaction with medical school, educational debt, first-year residency program directors' ratings on clinical competence, specialty choice, board certification, and faculty appointments. RESULTS: The authors found no practically important differences between students in the accelerated program and those in the control group on licensing examination performance, academic progress, specialty choice, board certification, and faculty appointments. Accelerated students had lower mean educational debt (P < .01, effect sizes = 0.81 and 0.45 for, respectively, their baccalaureate debt and medical school debt), lower satisfaction with their second year of medical school (P < .01, effect size = 0.21), and lower global satisfaction with their medical school education (P < .01, effect size = 0.35). Residency program directors' ratings in 6 postgraduate competency areas showed no practically important differences between the students in the accelerated program and those in the control group. The proportion of Asian students was higher among program participants (P < .01, effect size = 0.43). CONCLUSIONS: Students in the accelerated program earned BS and MD degrees at a faster pace and pursued careers that were comparable to students in a matched control who were in a regular MD program. Findings indicate that shortening the length of medical education does not compromise educational and professional outcomes.

On Step 1 Mania, USMLE Score Reporting, and Financial Conflict of Interest at the National Board of Medical Examiners.

Though intended to inform a binary decision on initial medical licensure, the United States Medical Licensing Examination (USMLE) is frequently used for screening candidates for residency positions. Some have argued that reporting results as pass/fail would honor the test's purpose while preventing inappropriate use. To date, the USMLE's sponsor organizations have declined to make such a change. In this Perspective, the authors examine the history and mission of the National Board of Medical Examiners (NBME), trace the rise of "Step 1 mania," and consider the current financial incentives for the NBME in implementing a pass/fail score-reporting policy.The NBME was founded in 1915 to address the lack of interstate reciprocity in medical licensure examination. With the creation of the USMLE in 1992, a single pathway for licensure was established, and the organization's original mission was achieved. Yet even after fulfilling its primary purpose, the NBME-classified as a nonprofit organization-has seen its revenues rise dramatically over the past 2 decades. Much of the increased revenue is derived from test products and services not required for medical licensure, with sales driven by the increasing importance of Step 1 scores in residency selection. Revenue from these products and services would likely decline if the NBME reported Step 1 results as pass/fail.A financial conflict of interest occurs when a judgment concerning a primary interest may be influenced by a secondary interest, such as financial gain. The data presented here demonstrate that the NBME has a conflict of interest in its current score-reporting policy. Possible remedies, such as disclosure, recusal, divestiture, and restructuring, are considered.

A Crisis of Trust Between U.S. Medical Education and the National Board of Medical Examiners.

This Invited Commentary is an independent opinion piece and companion to the Perspective by Carmody and Rajasekaran that appears in this issue of Academic Medicine. The National Board of Medical Examiners (NBME), a 501(c)(3) nonprofit, is a powerful gatekeeper to the medical profession in the United States. According to publicly available tax data, the NBME, which has increased its number of income-enhancing products, had revenues of $153.9 million (M) and net assets of $177.6M in 2017, earnings (revenue less expenses) of $39.7M in 2013-2017, and a highly compensated management team. Medical students are ultimately the source of nearly all the NBME's revenue, and the NBME has contributed to the growth of medical student debt. The NBME has operated as a monopoly since its agreement in the early 1990s with the Federation of State Medical Boards to cosponsor the United States Medical Licensing Examination (USMLE). Although the NBME has developed valuable products and is ostensibly governed by a capable board, the NBME has inherent financial conflicts of interest and may be benefiting from the current "Step 1 mania" undermining undergraduate medical education. Here, the author makes 4 recommendations to reestablish the trust of the U.S. medical education community in the NBME: (1) the NBME should recuse itself from current discussions and policy-making decisions related to changes in the score reporting of the USMLE Step 1 exam; (2) the NBME should disclose and be transparent about all aspects of its finances; (3) new NBME products, changes in pricing, and changes to pass thresholds should be approved by an oversight committee, independent of the NBME; and (4) the NBME (and USMLE) should not charge students or residents for retaking any of its licensing examinations.

Impact of tablet-scoring and immediate score sheet review on validity and educational impact in an internal medicine residency Objective Structured Clinical Exam (OSCE).

Introduction: The Objective Structured Clinical Examination (OSCE) is used globally for formative and summative purposes. The objective of this study was to examine the impact of tablet-scoring on sources of validity evidence for an Internal Medicine residency OSCE. Methods: We compared paper-scored OSCEs from 2014 to tablet-scored OSCEs in 2015 for missing data, amount of comments, and time to pass/fail decision. We then examined in 2016 the impact on learning of showing residents their score sheets and asking them to write an action plan immediately after an OSCE. Results: Tablet-scoring significantly reduced stations with missing data from 1.8 to 0.2%, and stations without comments from 42 to 28% with an increase in word count per comment. Time to official results reduced from 3 weeks to 12 h with tablet-scoring. Residents who wrote a learning plan after reviewing their OSCE score sheets were more likely (with medium to large effect sizes) to pursue further studying and/or change their behavior (e.g. history taking or physical examination) in the clinical environment. Conclusions: OSCE tablet-scoring improved many sources of validity evidence, especially educational impact with timeliness of feedback supporting a change in behavior, a hard to achieve goal of educational interventions.

Low-cost materials yield high resolution assessment of anatomic knowledge in surgical residents.

INTRODUCTION: Knowledge of anatomy is essential for surgeons. We sought to determine whether it is possible to effectively assess and differentiate the anatomic knowledge of general surgery residents, using pieces of fabric and yarn. METHODS: Postgraduate years 2, 3, and 4 general surgery residents were assessed during a simulation-based assessment known as the Surgical X-Games. Residents were allowed 3 minutes to assemble the anatomic structures of the right upper quadrant region and 2 minutes to create the right lower quadrant of the abdomen, using colored felt and yarn. One point (each) was given for naming and placing the structures in the correct position. A checklist was used to assess trainees with a maximum combined score of 150 points. RESULTS: A total of 34 residents (postgraduate year 2 = 16, postgraduate year 3 = 8, postgraduate year 4 = 10) participated in the 2017 fall Surgical X-Games and 31 residents (postgraduate year 2 = 13, postgraduate year 3 = 9, postgraduate year 4 = 9) participated in the spring Surgical X-Games. Total scores increased respective to the level of clinical training in both the fall Surgical X-Games (postgraduate year 2 = 77, postgraduate year 3 = 84, postgraduate year 4 = 93, P = .04) and the spring Surgical X-Games (postgraduate year 2 = 94, postgraduate year 3 = 101, postgraduate year 4 = 109). We observed significant improvement in the right upper quadrant, right lower quadrant, and total scores from the fall to the spring postgraduate year (P < .001). CONCLUSION: Surgical residents showed an increase in mean anatomical scores from postgraduate years 2 to postgraduate years 3 to postgraduate years 4, using low-fidelity models. This inexpensive, 5-minute test based on a simple checklist may offer surgical educators insight in to residents' anatomic knowledge and potential readiness for clinical rotations.

Simulation Training for Operational Medicine Providers (STOMP): Design and Implementation of a Novel Comprehensive Skills-Based Curriculum for Military General Medical Officers.

Background: Fifty percent of graduating U.S. Navy post-graduate year (PGY)-1 physicians will practice in the operational environment before returning to residency training. However, current internship structure is less rotational and focuses more on specialty-specific training. Therefore, these physicians may not be fully prepared for this primary care role. Methods: Based on the U.S. Navy privileges for General Medical Officers, a comprehensive didactic and simulation curriculum was developed. Twenty-three procedural skill competencies (SK) and five validated standardized patient (SP) scenarios were identified. During the SK portion, learners reviewed instructional videos, read reference materials, and practiced with partial task trainers before small-group sessions with subject matter experts (SME). Separate SP round-robin sessions were conducted and feedback provided by SMEs and SPs. Learners demonstrated competency or were remediated. Results: One hundred and three PGY-1 trainees participated over 2 yr. All trainees met requirements during the SK phase. During the SP phase, seven learners required remediation. All learners ultimately met requirements for privileging. Conclusion: The Simulation Training for Operational Medicine Providers curriculum for future General Medical Officers is an effective tool for primary care skill training and credentialing. Plans for export to other Graduate Medical Education sites are underway and further evaluation of skills retention is warranted.

A student-initiated objective structured clinical examination as a sustainable cost-effective learning experience.

BACKGROUND: The objective structured clinical examination (OSCE) has gained widespread use as a form of performance assessment. However, opportunities for students to participate in practice OSCEs are limited by the financial, faculty and administrative investments required. OBJECTIVES: To determine the feasibility and acceptability of a student-run mock OSCE (MOSCE) as a learning experience for medical students of all 4 years. DESIGN: We conducted a five-station MOSCE for third-year students. This involved fourth-year students as examiners and first-/second-year students as standardized patients (SPs). Each examiner scored examinees using a checklist and global rating scale while providing written and verbal feedback. MOSCE stations and checklists were designed by students and reviewed by a faculty supervisor. Following the MOSCE, participants completed surveys which elucidated their perceptions on the roles they took during the MOSCE. RESULTS: Fifty examinees participated in the MOSCE. Of these, 42 (84%) consented to participate in the study and submitted completed questionnaires. Twenty-four examiners participated in the OSCE and consented to participate in the study, with 22 (92%) submitting completed questionnaires. Fifty-three of 60 SPs (88%) agreed to take part in this study, and 51 (85%) completed questionnaires. The internal consistency of the five-station OSCE was calculated as a Cronbach's alpha of 0.443. Students commented positively on having the opportunity to network and engage in mentorship activities and reinforce clinical concepts. CONCLUSIONS: Examinees, examiners, and SPs all perceived the MOSCE to be a beneficial learning experience. We found the MOSCE to be a feasible and acceptable means of providing additional OSCE practice to students prior to higher-stakes evaluations.

Evaluating a bedside tool for neuroanatomical localization with extended-matching questions.

Neuroanatomical localization (NL) is a key skill in neurology, but learners often have difficulty with it. This study aims to evaluate a concise NL tool (NLT) developed to help teach and learn NL. To evaluate the NLT, an extended-matching questions (EMQ) test to assess NL was designed and validated. The EMQ was validated with fourth-year medical students and internal medicine and neurology residents. The NLT's usability was evaluated with third- and fourth-year students, and the effectiveness was evaluated with an experimental study of second-year students, using the EMQ as the outcome measure. Students were taught how to use both the NLT and textbook algorithms (control) to perform NL, then randomized into either group, and only allowed to use their assigned tool to complete the EMQ. Primary outcome was the difference in mean EMQ scores expressed as a percentage of total score. For EMQ validation, students (n = 56) scored lower than residents (n = 50) (76.7% ± 1.7 vs. 83.0% ± 1.6; mean ± standard error of mean, P < 0.009). The EMQ demonstrated good reliability (Cronbach's α 0.85) and generalizability (G-coefficient 0.85). Third- (n = 77) and fourth-year (n = 42) students found the NLT user-friendly and helpful in their learning of NL. In the experimental study, scores were significantly higher for NLT group (n = 94) than for controls (n = 101) (42.5 vs. 37.0%, P = 0.014); the effect size (Cohen's d) was 0.36. The EMQ is validated to reliably assess NL and is generalizable, feasible, practical, and of low cost. The concise and user-friendly NLT for NL was effective in aiding medical student performance of NL. Anat Sci Educ 11: 262-269. © 2017 American Association of Anatomists.

Analysis of testing with multiple choice versus open-ended questions: Outcome-based observations in an anatomy course.

The pedagogical approach for both didactic and laboratory teaching of anatomy has changed in the last 25 years and continues to evolve; however, assessment of student anatomical knowledge has not changed despite the awareness of Bloom's taxonomy. For economic reasons most schools rely on multiple choice questions (MCQ) that test knowledge mastered while competences such as critical thinking and skill development are not typically assessed. In contrast, open-ended question (OEQ) examinations demand knowledge construction and a higher order of thinking, but more time is required from the faculty to score the constructed responses. This study compares performances on MCQ and OEQ examinations administered to a small group of incoming first year medical students in a preparatory (enrichment) anatomy course that covered the thorax and abdomen. In the thorax module, the OEQ examination score was lower than the MCQ examination score; however, in the abdomen module, the OEQ examination score improved compared to the thorax OEQ score. Many students attributed their improved performance to a change from simple memorization (superficial learning) for cued responses to conceptual understanding (deeper learning) for constructed responses. The results support the view that assessment with OEQs, which requires in depth knowledge, would result in student better performance in the examination. Anat Sci Educ 11: 254-261. © 2017 American Association of Anatomists.

Creating an Arms Race? Examining School Costs and Motivations for Providing NAPLEX and PCOA Preparation.

Objective. To examine the extent of financial and faculty resources dedicated to preparing students for NAPLEX and PCOA examinations, and how these investments compare with NAPLEX pass rates. Methods. A 23-item survey was administered to assessment professionals in U.S. colleges and schools of pharmacy (C/SOPs). Institutions were compared by type, age, and student cohort size. Institutional differences were explored according to the costs and types of NAPLEX and PCOA preparation provided, if any, and mean NAPLEX pass rates. Results. Of 134 C/SOPs that received the survey invitation, 91 responded. Nearly 80% of these respondents reported providing some form of NAPLEX preparation. Significantly higher 2015 mean NAPLEX pass rates were found in public institutions, schools that do not provide NAPLEX prep, and schools spending less than $10,000 annually on NAPLEX prep. Only 18 schools reported providing PCOA preparation. Conclusion. Investment in NAPLEX and PCOA preparation resources vary widely across C/SOPs but may increase in the next few years, due to dropping NAPLEX pass rates and depending upon how PCOA data are used.

The Perceived Payoff of Education: Do Generational Status and Racial Discrimination Matter?

The purpose of this study was to examine the associations among racial discrimination, generational status, and perceptions of the economic value of education among Latina/o youth. Participants were 400 urban, low-income, Latina/o students from a large Midwestern U.S. city who completed surveys in both 9th and 10th grades. Results revealed that more perceived racial discrimination was associated with more perceived economic limitations of education. When analyzed by generational status, more racial discrimination in 9th grade was significantly related to lower perceived economic value of education in 10th grade for third-generation and later participants, but not for first- or second-generation participants. The results provide evidence for the diverse experiences of racial discrimination and perceived economic value of education across generational groups.