ABSTRACT
CONTEXT: Applicants to US residency training programmes are required to submit a personal statement, the content of which is flexible but often requires them to describe their career goals and aspirations. Despite their importance, no systematic research has explored common themes and gender differences inherent to these statements. OBJECTIVES: This study was conducted to analyse US applicants' Electronic Residency Application Service (ERAS) personal statements using two automated textual analysis programs, and to assess for common themes and gender-associated differences. METHODS: A retrospective cohort study of 2138 personal statements (containing 1,485,255 words) from candidates from 377 national and international medical schools applying to US internal medicine (IM) residency programmes through ERAS was conducted. A mathematical analysis of text segments using a recursive algorithm was performed; two different specifications of the text segments were used to conduct an internal validation. RESULTS: Five statistically significant thematic classes were identified through independent review by the researchers. These were best defined as referring to: the appeal of the residency programme; memorable patients; health care as public policy; research and academia, and family inspiration. Some themes were common to all applications. However, important gender-specific differences were identified. Notably, men were more likely to describe personal attributes and to self-promote, whereas women more frequently expressed the communicative and team-based aspects of doctoring. The results were externally validated using a second software program. Although these data comprise part of the national pool, they represent applicants to a single specialty at a single institution. CONCLUSIONS: By applying textual analysis to material derived from a national cohort, we identified common narrative themes in the personal statements of future US physicians, noting differences between men and women. Together, these data provide novel insight into the dominant discourse of doctoring in this generation of students applying for further training in US IM residency programmes, and depict a diverse group of applicants with multiple motivations, desires and goals. Furthermore, differences seen between men and women add to the growing understanding of bias in medical education. Training programmes may benefit by adapting curricula to foster such diverse interests.
Subject(s)
Internal Medicine/education , Internship and Residency , Motivation , School Admission Criteria , Boston , Female , Humans , Male , Personal Narratives as Topic , Retrospective Studies , School Admission Criteria/statistics & numerical data , Sex Factors , Statistics as Topic/methods , WritingABSTRACT
UNLABELLED: PHENOMENON: Changes in the medical education milieu have led away from the apprenticeship model resulting in shorter physician-student interactions. Faculty and student feedback suggests that supervisor/student interactions may now be more cursory with increasing numbers of supervisors per student, and shorter duration of interaction. This may affect both education and student assessment. APPROACH: We compared inpatient attending and resident daily schedules with those of 3rd- and 4th-year medical students rotating on medicine clerkships at Brigham and Women's Hospital during academic years 2009-11 to determine the number of days of overlap. We used evaluation forms to determine the extent of evaluator's self-reported knowledge of the student. FINDINGS: We correlated the daily schedules of 199 students and 204 resident and 187 attending physicians, which resulted in 558 resident-student pairings and 680 attending-student pairings over 2 years. During a 4-week block, students averaged 3.7 attending physicians (M = 4, range = 2-7), with 49.7% supervised by 4 or more. Attending-student overlap averaged 9 days (M = 9, range = 2-23), though 40% were 7 days or less. Students overlapped with an average 3.4 residents (M = 3, range = 1-6). Resident-student overlap averaged 12 days (M = 11, range = 3-26). There were 824 student assessment forms analyzed. Resident and attending physician supervisors describing knowledge of their student as "good/average" overlapped with students for 14 and 11 days respectively compared to resident and physician supervisors who described their knowledge as "poor" (11 days, p < .01; 6 days, p < .01). Insights: On the inpatient medicine clerkship, students have multiple supervising physicians with wide variability in the period of overlap. This leads to a disrupted apprenticeship model with fragmentation of supervision and concomitant effects on assessment, feedback, role modeling, and clerkship education.
Subject(s)
Clinical Clerkship , Education, Medical, Undergraduate/standards , Interprofessional Relations , Students, Medical , Boston , Clinical Competence , Educational Measurement , Female , Humans , Internship and Residency , Male , Patient Care Team , Time Factors , WorkloadABSTRACT
PURPOSE: Despite standardized curricula and mandated accreditation, concern exists regarding the variability and imprecision of medical student evaluation. The authors set out to perform a complete review of clerkship evaluation in U.S. medical schools. METHOD: Clerkship evaluation data were obtained from all Association of American Medical Colleges-affiliated medical schools reporting enrollment during 2009-2010. Deidentified reports were analyzed to define the grading system and the percentage of each class within each grading tier. Inter- and intraschool grading variation was assessed in part by comparing the proportion of students receiving the top grade. RESULTS: Data were analyzed from 119 of 123 accredited medical schools. Dramatic variation was detected. Specifically, the authors documented eight different grading systems using 27 unique sets of descriptive terminology. Imprecision of grading was apparent. Institutions frequently used the same wording (e.g., "honors") to imply different meanings. The percentage of students awarded the top grade in any clerkship exhibited extreme variability (range 2%-93%) from school to school, as well as from clerkship to clerkship within the same school (range 18%-81%). Ninety-seven percent of all U.S. clerkship students were awarded one of the top three grades regardless of the number of grading tiers. Nationally, less than 1% of students failed any required clerkship. CONCLUSIONS: There exists great heterogeneity of grading systems and imprecision of grade meaning throughout the U.S. medical education system. Systematic changes seeking to increase consistency, transparency, and reliability of grade meaning are needed to improve the student evaluation process at the national level.