Using Natural Language Processing and Machine Learning to Identify Internal Medicine-Pediatrics Residency Values in Applications.

PROBLEM: Although holistic review has been used successfully in some residency programs to decrease bias, such review is time-consuming and unsustainable for many programs without initial prescreening. The unstructured qualitative data in residency applications, including notable experiences, letters of recommendation, personal statement, and medical student performance evaluations, require extensive time, resources, and metrics to evaluate; therefore, previous applicant screening relied heavily on quantitative metrics, which can be socioeconomically and racially biased. APPROACH: Using residency applications to the University of Utah internal medicine-pediatrics program from 2015 to 2019, the authors extracted relevant snippets of text from the narrative sections of applications. Expert reviewers annotated these snippets into specific values (academic strength; intellectual curiosity; compassion; communication; work ethic; teamwork; leadership; self-awareness; diversity, equity, and inclusion; professionalism; and adaptability) previously identified as associated with resident success. The authors prospectively applied a machine learning model (MLM) to snippets from applications from 2023, and output was compared with a manual holistic review performed without knowledge of MLM results. OUTCOMES: Overall, the MLM had a sensitivity of 0.64, specificity of 0.97, positive predictive value of 0.62, negative predictive value of 0.97, and F1 score of 0.63. The mean (SD) total number of annotations per application was significantly correlated with invited for interview status (invited: 208.6 [59.1]; not invited: 145.2 [57.2]; P < .001). In addition, 8 of the 10 individual values were significantly predictive of an applicant's invited for interview status. NEXT STEPS: The authors created an MLM that can identify several values important for resident success in internal medicine-pediatrics programs with moderate sensitivity and high specificity. The authors will continue to refine the MLM by increasing the number of annotations, exploring parameter tuning and feature engineering options, and identifying which application sections have the highest correlation with invited for interview status.

Who will care for me next? Transitioning to adulthood with hydrocephalus.

OBJECTIVES: Hydrocephalus is a prototypical chronic condition that follows children into adulthood. The objectives of this study were to (1) review how the health care needs of young adults with hydrocephalus are not being met, (2) estimate the numbers of adults with childhood-onset hydrocephalus, (3) describe a novel program to provide care for young adults with hydrocephalus and other chronic pediatric conditions, and (4) propose national strategies to promote successful hydrocephalus transition care. RESULTS: Adults with hydrocephalus need continuous access to expert surgical and medical providers. Existing care models fail to meet this need. The number of young adults who have hydrocephalus, are aged 18 to 35 and need treatment in the United States is predicted to exceed 40000 annually within the next 2 decades. We are developing integrated teams of pediatric and adult medical and surgical specialists to provide continuous, coordinated, comprehensive care for individuals with hydrocephalus in a pediatric setting. This setting will train our future physician workforce on optimal transition care. Coordinated national efforts are also needed. CONCLUSIONS: Providers need to implement appropriate management and transition care for individuals with hydrocephalus. We must work at local and national levels to transform the care model, improve the quality of health care delivery, and improve outcomes for young adults with hydrocephalus.