Assessing readiness: the impact of an experiential learning entrustable professional activity-based residency preparatory course.

As medical schools move to integrate the Core Entrustable Professional Activities for Entering Residency (EPAs) into curricula and address the transition from student to resident, residency preparatory courses have become more prevalent. The authors developed an experiential learning EPA-based capstone course for assessment to determine impact on learner self-assessed ratings of readiness for residency and acquisition of medical knowledge. All fourth-year students from the classes of 2018-2020 completed a required course in the spring for assessment of multiple EPAs, including managing core complaints, performing basic procedures, obtaining informed consent, and providing patient handoffs. Learners selected between three specialty-based parallel tracks - adult medicine, surgery, or pediatrics. Students completed a retrospective pre-post questionnaire to provide self-assessed ratings of residency preparedness and comfort in performing EPAs. Finally, the authors studied the impact of the course on knowledge acquisition by comparing student performance in the adult medicine track on multiple choice pre- and post-tests. Four hundred and eighty-one students were eligible for the study and 452 (94%) completed the questionnaire. For all three tracks, there was a statistically significant change in learner self-assessed ratings of preparedness for residency from pre- to post-course (moderately or very prepared: adult medicine 61.4% to 88.6% [p-value < 0.001]; surgery 56.8% to 81.1% [p-value < 0.001]; pediatrics 32.6% to 83.7% [p-value 0.02]). A similar change was noted in all tracks in learner self-assessed ratings of comfort from pre- to post-course for all studied EPAs. Of the 203 students who participated in the adult medicine track from 2019-2020, 200 (99%) completed both the pre- and post-test knowledge assessments. The mean performance improved from 65.0% to 77.5% (p-value < 0.001). An experiential capstone course for the assessment of EPAs can be effective to improve learner self-assessed ratings of readiness for residency training and acquisition of medical knowledge.

Reimagining a pass/fail clinical core clerkship: a US residency program director survey and meta-analysis.

Pass/fail (P/F) grading has emerged as an alternative to tiered clerkship grading. Systematically evaluating existing literature and surveying program directors (PD) perspectives on these consequential changes can guide educators in addressing inequalities in academia and students aiming to improve their residency applications. In our survey, a total of 1578 unique PD responses (63.1%) were obtained across 29 medical specialties. With the changes to United States Medical Licensure Examination (USMLE), responses showed increased importance of core clerkships with the implementation of Step 2CK cutoffs. PDs believed core clerkship performance was a reliable representation of an applicant's preparedness for residency, particularly in Accreditation Council for Graduate Medical Education's (ACGME)Medical Knowledge and Patient Care and Procedural Skills. PDs disagreed with P/F core clerkships because it more difficult to objectively compare applicants. No statistically significant differences in responses were found in PD preferential selection when comparing applicants from tiered and P/F core clerkship grading systems. If core clerkships adopted P/F scoring, PDs would further increase emphasis on narrative assessment, sub-internship evaluation, reference letters, academic awards, professional development and medical school prestige. In the meta-analysis, of 6 studies from 2,118 participants, adjusted scaled scores with mean difference from an equal variance model from PDs showed residents from tiered clerkship grading systems overall performance, learning ability, work habits, personal evaluations, residency selection and educational evaluation were not statistically significantly different than from residents from P/F systems. Overall, our dual study suggests that while PDs do not favor P/F core clerkships, PDs do not have a selection preference and do not report a difference in performance between applicants from P/F vs. tiered grading core clerkship systems, thus providing fertile grounds for institutions to examine the feasibility of adopting P/F grading for core clerkships.

Someone Like Me: An Examination of the Importance of Race-Concordant Mentorship in Urology.

OBJECTIVE: To describe differences in urology mentorship exposure for medical students across race/ethnicity and to explore how much potential mentees valued the importance of race-concordant mentorship. METHODS: All medical students at UCLA received a cross-sectional survey. Dependent variables were perceived quality of mentorship in urology and association between race-concordant mentorship and perceived importance of race-concordant mentorship. Mentors were self-selected by medical students. Variables were compared across race/ethnicity using descriptive statistics and multivariate analyses. Subset analyses looking at race-concordance between mentor and student was performed using stratified Cochran-Mantel-Haenszel tests. This was performed to determine if there were differences, across race/ethnicity, in rating of importance of having a race-concordant mentor. RESULTS: The likelihood of having a urologist as a mentor was similar across race/ethnicity. Under-Represented in Medicine (URiM) students were more likely to report that having a mentor of the same race/ethnicity was extremely important (Asian 9%, Black 58%, Latinx 55% and White 3%, P < .001) compared to their non-URiM peers who were more likely to rate having a race-concordant mentor as not at all important (Asian 34%, Black 5%, Latinx 8%, White 79%, P < .001). URiM students with race-concordant mentors were still more likely to rate having a mentor of the same race/ethnicity as extremely/very important (73%) compared to their non-URiM peers (9%, P = .001). URiM students with race-discordant mentors also rated importance of mentors of the same race/ethnicity as extremely/very important (67%) compared to their non-URiM peers (11%, P = .006). CONCLUSION: URiM medical students regard race-concordant mentorship as extremely important. Interventions addressing mentor racial/ethnic concordance and those promoting culturally responsive mentorship may optimize recruitment of URiM students into urology.

Racial and Ethnic Differences in Medical Student Timing and Perceived Quality of Exposure to Urology.

OBJECTIVE: To contextualize the low representation of Under-Represented in Medicine (URiM) in urology, we examine differences in timing and perceived quality of urology clinical and research exposures for medical students across race/ethnicity. METHODS: A cross-sectional survey was distributed to all medical students at University of California, Los Angeles. Dependent variables were timing of urology exposure and perceived quality of urology exposure. Descriptive statistics and multivariate analyses were used to compare variables across race/ethnicity. Logistic regression was used to determine odds of early exposure to urology across race/ethnicity. RESULTS: Black and Latinx students were significantly less likely to discover urology before MS3 (P <.001). Although URiM students were more likely to recall receiving a urology interest group invitation (Asian 46%, Black 53%, Latinx 67%, White 48%, P = .03), they were less likely to attend an event (Asian 23%, Black 4%, Latinx 3% and White 15%, P <.001) despite being more likely to be interested in urology (Asian 32%, Black 38%, Latinx 50%, White 28%, P = .01). Black students were more likely to gain exposure via family/friend with a urological diagnosis. Black and Latinx students were twice as dissatisfied with timing and method of medical school exposure to urology versus their peers. There were differences across race/ethnicity for whether or not a student had engaged in urology research (Asian 10%, Black 5%, Latinx 2%, White 2%, P = .01). CONCLUSION: Racial/ethnic disparities exist in early exposure to urology, involvement in urology interest group, access to research, and satisfaction with exposure to urology. Interventions addressing the timing and quality of urology exposures may optimize recruitment of URiM students into urology.

Trends in the Racial and Ethnic Diversity in the US Urology Workforce.

OBJECTIVE: To examine the historical trends and factors underlying the current state of racial/ethnic representation within the urology workforce at each stage of the educational pipeline. METHODS: Using data from the US Census Bureau and the Association of American Medical Colleges, trends in racial/ethnic distribution for 2007-2008 to 2019-2020 were tracked in the educational pipeline for academic urologists. This pipeline was defined as progressively diminishing cohorts, starting with the US population, leading to medical school application, acceptance, and graduation, through to urology residency application, matching, and graduation, and ending with urology faculty appointment. A comparative cohort analysis was performed for academic year 2018-2019 for differences in racial/ethnic distribution across cohorts by binomial tests. RESULTS: From 2007-2008 to 2019-2020, while the proportion of Latinx/Hispanic urology applicants increased by 0.38% per year (95% CI 0.24, 0.52), their proportion in the urology resident population remained unchanged (0.07% per year, 95% CI -0.20, 0.06) from 2011-2012 to 2019-2020. There was a decrease in the proportion of Black urology applicants (-0.13% per year, 95% CI -0.24, -0.02) and no change in the resident population (-0.03% per year, 95% CI -0.11, 0.05), despite an increase in total number of residents (n = 1043 to n = 1734) from 2009-2010 to 2019-2020. In 2018-2019, there were step-wise decreases in proportion of Black and Latinx/Hispanic members represented at critical stages of the educational pipeline (P <0.0001). CONCLUSION: Attrition in URM urologists occur at key educational stages. This paper offers opportunities for the design of interventions to diversify the urology workforce.

Prospective, Randomized Trial Comparing Simulator-based versus Traditional Teaching of Direct Ophthalmoscopy for Medical Students.

OBJECTIVE: To compare results of simulator-based vs traditional training of medical students in direct ophthalmoscopy. DESIGN: Randomized controlled trial. METHODS: First-year medical student volunteers completed 1 hour of didactic instruction regarding direct ophthalmoscopes, fundus anatomy, and signs of disease. Students were randomized to an additional hour of training on a direct ophthalmoscope simulator (n = 17) or supervised practice examining classmates (traditional method, n = 16). After 1 week of independent student practice using assigned training methods, masked ophthalmologist observers assessed student ophthalmoscopy skills (technique, efficiency, and global performance) during examination of 5 patient volunteers, using 5-point Likert scales. Students recorded findings and lesion location for each patient. Two masked ophthalmologists graded answer sheets independently using 3-point scales. Students completed surveys before randomization and after assessments. Training groups were compared for grades, observer- and patient-assigned scores, and survey responses. RESULTS: The simulator group reported longer practice times than the traditional group (P = .002). Observers assigned higher technique scores to the simulator group after adjustment for practice time (P = .034). Combined grades (maximum points = 20) were higher for the simulator group (median: 5.0, range: 0.0-11.0) than for the traditional group (median: 4.0, range: 0.0-9.0), although the difference was not significant. The simulator group was less likely to mistake the location of a macular scar in 1 patient (odds ratio: 0.28, 95% confidence interval: 0.056-1.35, P = .013). CONCLUSIONS: Direct ophthalmoscopy is difficult, regardless of training technique, but simulator-based training has apparent advantages, including improved technique, the ability to localize fundus lesions, and a fostering of interest in learning ophthalmoscopy, reflected by increased practice time.

Addressing Conflicts of Interest in Health and Medicine: Current Evidence and Implications for Patient Decision Aid Development.

BACKGROUND: More stringent policies for addressing conflicts of interest have been implemented around the world in recent years. Considering the value of revisiting conflict of interest quality standards set by the International Patient Decision Aid Standards (IPDAS) Collaboration, we sought to review evidence relevant to 2 questions: 1) What are the effects of different strategies for managing conflicts of interest? and 2) What are patients' perspectives on conflicts of interest? METHODS: We conducted a narrative review of English-language articles and abstracts from 2010 to 2019 that reported relevant quantitative or qualitative research. RESULTS: Of 1743 articles and 118 abstracts identified, 41 articles and 2 abstracts were included. Most evidence on the effects of conflict of interest management strategies pertained only to subsequent compliance with the management strategy. This evidence highlighted substantial noncompliance with prevailing requirements. Evidence on patient perspectives on conflicts of interest offered several insights, including the existence of diverse views on the acceptability of conflicts of interest, the salience of conflict of interest type and monetary value to patients, and the possibility that conflict of interest disclosure could have unintended effects. We identified no published research on the effects of IPDAS Collaboration conflict of interest quality standards on patient decision making or outcomes. LIMITATIONS: Because we did not conduct a systematic review, we may have missed some evidence relevant to our review questions. In addition, our team did not include patient partners. CONCLUSIONS: The findings of this review have implications for the management of conflicts of interest not only in patient decision aid development but also in clinical practice guideline development, health and medical research reporting, and health care delivery.

Racism and Bioethics: The Myth of Color Blindness.

Like many fields, bioethics has been constrained to thinking to race in terms of colorblindness, the idea that ideal deliberation would ignore race and hence prevent bias. There are practical and ethically significant problems with colorblind approaches to ethical deliberation, and important reasons why race is ethically relevant. Future discourse needs to understand how and why race is relevant in bioethics.

High-Value Care Culture Among the Future Physician Workforce in Internal Medicine.

PURPOSE: Training in high-spending regions correlates with higher spending patterns among practicing physicians. This study aimed to evaluate whether trainees' exposure to a high-value care culture differed based on type of health system in which they trained. METHOD: In 2016, 517 internal medicine residents at 12 California graduate medical education programs (university, community, and safety-net medical centers) completed a cross-sectional survey assessing perceptions of high-value care culture within their respective training program. The authors used multilevel linear regression to assess the relationship between type of medical center and High-Value Care Culture Survey (HVCCS) scores. The correlation between mean institutional HVCCS and Centers for Medicare and Medicaid Services' Value-Based Purchasing (VBP) scores was calculated using Spearman rank coefficients. RESULTS: Of 517 residents, 306 (59.2%), 83 (16.1%), and 128 (24.8%) trained in university, community, and safety-net programs, respectively. Across all sites, the mean HVCCS score was 51.2 (standard deviation [SD] 11.8) on a 0-100 scale. Residents reported lower mean HVCCS scores if they were from safety-net-based training programs (ß = -4.4; 95% confidence interval: -8.2, -0.6) with lower performance in the leadership and health system messaging domain (P < .001). Mean institutional HVCCS scores among university and community sites positively correlated with institutional VBP scores (Spearman r = 0.71; P < .05). CONCLUSIONS: Safety-net trainees reported less exposure to aspects of high-value care culture within their training environments. Tactics to improve the training environment to foster high-value care culture include training, increasing access to data, and improving open communication about value.

Creation and evaluation of a cancer survivorship curriculum for pediatric resident physicians.

PURPOSE: There is a paucity of formal clinician education concerning cancer survivorship care, which produces care barriers and poorer outcomes for survivors of childhood cancer. To address this, we implemented a curriculum in childhood cancer survivorship care for pediatric residents at the University of California, Los Angeles (UCLA). We examined the efficacy of this curriculum following program completion. METHODS: A case-based curriculum was created and integrated within existing educational structures using Kern's model. We utilized the retrospective pre-posttest method to evaluate participating residents' knowledge, clinical skills, and attitudes towards cancer survivorship topics before and after receiving the curriculum. Pre-posttest items were compared using paired t tests and one-sided binomial tests. We analyzed free-response question items for major themes using constant comparative methods. RESULTS: Thirty-four residents completed the curriculum and its evaluation. Each assessment item significantly increased from pre- to post-curriculum; p < 0.05. Greater than 40% of residents improved in all but one assessment item post-curriculum; p < 0.05. Residents reported the curriculum enhanced their pediatric knowledge base (M = 3.24; SD = 0.65) and would recommend it to other residency programs; M = 3.24; SD = 0.69. Major themes included residents' request for additional oncofertility information, training in counseling survivors, and cancer survivorship training opportunities. CONCLUSIONS: A cancer survivorship curriculum can successfully increase trainees' knowledge, clinical skills, and comfort in discussing topics relevant to survivorship care. IMPLICATIONS FOR CANCER SURVIVORS: With increasing numbers of childhood cancer survivors living into adulthood, residents will likely treat this population regardless of intended career path. This curriculum represents one method to deliver formal cancer survivorship training.

Measuring Value in Internal Medicine Residency Training Hospitals Using Publicly Reported Measures.

Graduate medical education (GME) lacks measures of resident preparation for high-quality, cost-conscious practice. The authors used publicly reported teaching hospital value measures to compare internal medicine residency programs on high-value care training and to validate these measures against program director perceptions of value. Program-level value training scores were constructed using Centers for Medicare & Medicaid Services Value-Based Purchasing (VBP) Program hospital quality and cost-efficiency data. Correlations with Association of Program Directors in Internal Medicine Annual Survey high-value care training measures were examined using logistic regression. For every point increase in program-level VBP score, residency directors were more likely to agree that GME programs have a responsibility to contain health care costs (adjusted odds ratio [aOR] 1.18, P = .04), their faculty model high-value care (aOR 1.07, P = .03), and residents are prepared to make high-value medical decisions (aOR 1.07, P = .09). Publicly reported clinical data offer valid measures of GME value training.

Development of a high-value care culture survey: a modified Delphi process and psychometric evaluation.

BACKGROUND: Organisational culture affects physician behaviours. Patient safety culture surveys have previously been used to drive care improvements, but no comparable survey of high-value care culture currently exists. We aimed to develop a High-Value Care Culture Survey (HVCCS) for use by healthcare leaders and training programmes to target future improvements in value-based care. METHODS: We conducted a two-phase national modified Delphi process among 28 physicians and nurse experts with diverse backgrounds. We then administered a cross-sectional survey at two large academic medical centres in 2015 among 162 internal medicine residents and 91 hospitalists for psychometric evaluation. RESULTS: Twenty-six (93%) experts completed the first phase and 22 (85%) experts completed the second phase of the modified Delphi process. Thirty-eight items achieved ≥70% consensus and were included in the survey. One hundred and forty-one residents (83%) and 73 (73%) hospitalists completed the survey. From exploratory factor analyses, four factors emerged with strong reliability: (1) leadership and health system messaging (α=0.94); (2) data transparency and access (α=0.80); (3) comfort with cost conversations (α=0.70); and (4) blame-free environment (α=0.70). In confirmatory factor analysis, this four-factor model fit the data well (Bentler-Bonett Normed Fit Index 0.976 and root mean square residual 0.056). The leadership and health system messaging (r=0.56, p<0.001), data transparency and access (r=0.15, p<0.001) and blame-free environment (r=0.37, p<0.001) domains differed significantly between institutions and positively correlated with Value-Based Purchasing Scores. CONCLUSIONS: Our results provide support for the reliability and validity of the HVCCS to assess high-value care culture among front-line clinicians. HVCCS may be used by healthcare groups to identify target areas for improvements and to monitor the effects of high-value care initiatives.

Training health care professionals for 21st-century practice: a systematic review of educational interventions on chronic care.

PURPOSE: To systematically review the evidence for high-quality and effective educational strategies to train health care professionals across the education continuum on chronic disease care. METHOD: A search of English-language publications and conference proceedings was performed in November 2013 and updated in April 2014. Studies that evaluated a newly developed curriculum targeting chronic disease care with learner outcomes were included. Two primary reviewers and one adjudicating reviewer evaluated the studies and assessed their quality using the validated Medical Education Research Study Quality Instrument (MERSQI). Studies were also mapped onto elements of Wagner's chronic care model (CCM) to evaluate their use of established evidence-based models for chronic care delivery. Miller's classification of clinical competence was used to assess the quality of learner achievements for each educational intervention. RESULTS: A total of 672 articles were found for this review. Twenty-two met criteria for data extraction. The majority of studies were of moderate quality according to MERSQI scoring. Only three studies reported both learner and patient outcomes. The highest-quality studies incorporated more elements of Wagner's CCM and showed high-level learner competence according to Miller's classification. Successful interventions redesigned health care delivery systems to include team-based care, emphasized training of health care professionals on patient self-management, and included learner-based quality improvement initiatives. CONCLUSIONS: The growing number of children and adults with chronic disease necessitates improved educational interventions for health care professionals that involve evidence-based models for restructuring chronic care delivery, aim for high-level learner behavioral outcomes, and evolve through quality improvement initiatives.