Analysis of narrative assessments of internal medicine resident performance: are there differences associated with gender or race and ethnicity?

BACKGROUND: Equitable assessment is critical in competency-based medical education. This study explores differences in key characteristics of qualitative assessments (i.e., narrative comments or assessment feedback) of internal medicine postgraduate resident performance associated with gender and race and ethnicity. METHODS: Analysis of narrative comments included in faculty assessments of resident performance from six internal medicine residency programs was conducted. Content analysis was used to assess two key characteristics of comments- valence (overall positive or negative orientation) and specificity (detailed nature and actionability of comment) - via a blinded, multi-analyst approach. Differences in comment valence and specificity with gender and race and ethnicity were assessed using multilevel regression, controlling for multiple covariates including quantitative competency ratings. RESULTS: Data included 3,383 evaluations with narrative comments by 597 faculty of 698 residents, including 45% of comments about women residents and 13.2% about residents who identified with race and ethnicities underrepresented in medicine. Most comments were moderately specific and positive. Comments about women residents were more positive (estimate 0.06, p 0.045) but less specific (estimate - 0.07, p 0.002) compared to men. Women residents were more likely to receive non-specific, weakly specific or no comments (adjusted OR 1.29, p 0.012) and less likely to receive highly specific comments (adjusted OR 0.71, p 0.003) or comments with specific examples of things done well or areas for growth (adjusted OR 0.74, p 0.003) than men. Gendered differences in comment specificity and valence were most notable early in training. Comment specificity and valence did not differ with resident race and ethnicity (specificity: estimate 0.03, p 0.32; valence: estimate - 0.05, p 0.26) or faculty gender (specificity: estimate 0.06, p 0.15; valence: estimate 0.02 p 0.54). CONCLUSION: There were significant differences in the specificity and valence of qualitative assessments associated with resident gender with women receiving more praising but less specific and actionable comments. This suggests a lost opportunity for well-rounded assessment feedback to the disadvantage of women.

Exploring gender and thematic differences in qualitative assessments of internal medicine resident performance.

INTRODUCTION: Evidence suggests gender disparities in medical education assessment, including differences in ratings of competency and narrative comments provided in resident performance assessments. This study explores how gender manifests within the content of qualitative assessments (i.e., narrative comments or performance feedback) of resident performance. METHODS: Qualitative content analysis was used to explore gender-based differences in narrative comments included in faculty assessments of resident performance during inpatient medicine rotations at six Internal Medicine residency programs, 2016-2017. A blinded, multi-analyst approach was employed to identify themes across comments. Patterns in themes with resident gender and post-graduate year (PGY) were explored, focusing on PGY2 and PGY3 when residents are serving in the team leader role. RESULTS: Data included 3,383 evaluations with narrative comments of 385 men (55.2%) and 313 women residents (44.8%). There were thematic differences in narrative comments received by men and women residents and how these themes manifested within comments changed with training time. Compared to men, comments about women had a persistent relationship-orientation and emphasized confidence over training including as interns and in PGY2 and PGY3, when serving as team leader. The relationship-orientation was characterized not only by the residents' communal attributes but also their interpersonal and communication skills, including efforts supporting others and establishing the tone for the team. Comments about women residents often highlighted confidence, including recommendations around behaviors that convey confidence in decision-making and team leadership. DISCUSSION: There were gender-based thematic differences in qualitative assessments. Comments about women resident team leaders highlight relationship building skills and urge confidence and actions that convey confidence as team leader. Persistent attention to communal skills suggests gendered expectations for women resident team leaders and a lost opportunity for well-rounded feedback to the disadvantage of women residents. These findings may inform interventions to promote equitable assessment, such as providing feedback across the competencies.

Association of Gender and Race/Ethnicity with Internal Medicine In-Training Examination Performance in Graduate Medical Education.

BACKGROUND: Disparities in objective assessments in graduate medical education such as the In-Training Examination (ITE) that disadvantage women and those self-identifying with race/ethnicities underrepresented in medicine (URiM) are of concern. OBJECTIVE: Examine ITE trends longitudinally across post-graduate year (PGY) with gender and race/ethnicity. DESIGN: Longitudinal analysis of resident ITE metrics at 7 internal medicine residency programs, 2014-2019. ITE trends across PGY of women and URiM residents compared to non-URiM men assessed via ANOVA. Those with ITE scores associated with less than 90% probability of passing the American Board of Internal Medicine certification exam (ABIM-CE) were identified and odds of being identified as at-risk between groups were assessed with chi square. PARTICIPANTS: A total of 689 IM residents, including 330 women and URiM residents (48%). MAIN MEASURES: ITE score KEY RESULTS: There was a significant difference in ITE score across PGY for women and URiM residents compared to non-URiM men (F(2, 1321) 4.46, p=0.011). Adjusting for program, calendar year, and baseline ITE, women and URiM residents had smaller ITE score gains (adjusted mean change in score between PGY1 and PGY3 (se), non-URiM men 13.1 (0.25) vs women and URiM residents 11.4 (0.28), p<0.001). Women and URiM residents had greater odds of being at potential risk for not passing the ABIM-CE (OR 1.75, 95% CI 1.10 to 2.78) with greatest odds in PGY3 (OR 3.13, 95% CI 1.54 to 6.37). CONCLUSION: Differences in ITE over training were associated with resident gender and race/ethnicity. Women and URiM residents had smaller ITE score gains across PGY translating into greater odds of potentially being seen as at-risk for not passing the ABIM-CE. Differences in ITE over training may reflect differences in experiences of women and URiM residents during training and may lead to further disparities.

Convergence of human cellular models and genetics to study neural stem cell signaling to enhance central nervous system regeneration and repair.

Human central nervous system (CNS) regeneration is considered the holy grail of neuroscience research, and is one of the most pressing and difficult questions in biology and science. Despite more than 20 years of work in the field of neural stem cells (NSCs), the area remains in its infancy as our understanding of the fundamental mechanisms that can be leveraged to improve CNS regeneration in neurological diseases is still growing. Here, we focus on the recent lessons from lower organism CNS regeneration genetics and how such findings are starting to illuminate our understanding of NSC signaling pathways in humans. These findings will allow us to improve upon our knowledge of endogenous NSC function, the utility of exogenous NSCs, and the limitations of NSCs as therapeutic vehicles for providing relief from devastating human neurological diseases. We also discuss the limitations of activating NSC signaling for CNS repair in humans, especially the potential for tumor formation. Finally, we will review the recent advances in new culture techniques, including patient-derived cells and cerebral organoids to model the genetic regulation of signaling pathways controlling the function of NSCs during injury and disease states.

Complications from "Stem Cell Tourism" in Neurology.

"Stem cell tourism," the practice of offering unproven cellular preparations to patients as approved therapy, is rising in neurology. Currently, the experiences of patients and reported complications from these procedures are unknown in the United States. We evaluate academic neurologists' experiences with stem cell tourism and assess perceived competency on discussing this topic with patients. We found a lack of neurologist preparedness to discuss stem cell therapies with patients and an alarming list of unreported complications from these unregulated procedures. We also identified an urgent need for neurologist education and the creation of a national registry for reporting patient complications resulting from experimental stem cell interventions. ANN NEUROL 2020;88:661-668.

Gender Bias in Resident Assessment in Graduate Medical Education: Review of the Literature.

BACKGROUND: Competency-based medical education relies on meaningful resident assessment. Implicit gender bias represents a potential threat to the integrity of resident assessment. We sought to examine the available evidence of the potential for and impact of gender bias in resident assessment in graduate medical education. METHODS: A systematic literature review was performed to evaluate the presence and influence of gender bias on resident assessment. We searched Medline and Embase databases to capture relevant articles using a tiered strategy. Review was conducted by two independent, blinded reviewers. We included studies with primary objective of examining the impact of gender on resident assessment in graduate medical education in the USA or Canada published from 1998 to 2018. RESULTS: Nine studies examined the existence and influence of gender bias in resident assessment and data included rating scores and qualitative comments. Heterogeneity in tools, outcome measures, and methodologic approach precluded meta-analysis. Five of the nine studies reported a difference in outcomes attributed to gender including gender-based differences in traits ascribed to residents, consistency of feedback, and performance measures. CONCLUSION: Our review suggests that gender bias poses a potential threat to the integrity of resident assessment in graduate medical education. Future study is warranted to understand how gender bias manifests in resident assessment, impact on learners and approaches to mitigate this bias.

The Health Professions Education Pathway: Preparing Students, Residents, and Fellows to Become Future Educators.

PROBLEM: Training the next generation of health professionals requires leaders, innovators, and scholars in education. Although many medical schools and residencies offer education electives or tracks focused on developing teaching skills, these programs often omit educational innovation, scholarship, and leadership and are narrowly targeted to one level of learner. INTERVENTION: The University of California San Francisco created the Health Professions Education Pathway for medical students, residents, and fellows as well as learners from other health professional schools. The Pathway applies the theoretical framework of communities of practice in its curricular design to promote learner identity formation as future health professions educators. It employs the strategies of engagement, imagination, and alignment for identity formation. CONTEXT: Through course requirements, learners engage and work with members of the educator community of practice to develop the knowledge and skills required to participate in the community. Pathway instructors are faculty members who model a breadth of educator careers to help learners imagine personal trajectories. Last, learners complete mentored education projects, adopting scholarly methods and ethics to align with the broader educator community of practice. OUTCOME: From 2009 to 2014, 117 learners participated in the Pathway. Program evaluations, graduate surveys, and web-based searches revealed positive impacts on learner career development. Learners gained knowledge and skills for continued engagement with the educator community of practice, confirmed their career aspirations (imagination), joined an educator-in-training community (engagement/imagination), and disseminated via scholarly meetings and peer-reviewed publications (alignment). LESSONS LEARNED: Learners identified engagement with the learner community as the most powerful aspect of the Pathway; it provided peer support for imagining and navigating the development of their dual identities in the clinician and educator communities of practice. Also important for learner success was alignment of their projects with the goals of the local educator community of practice. Our community of practice approach to educator career development has shown promising early outcomes by nurturing learners' passion for teaching; expanding their interest in educational leadership, innovation, and scholarship; and focusing on their identity formation as future educators.

Faculty development efforts to promote screening, brief intervention, and referral to treatment (SBIRT) in an internal medicine faculty-resident practice.

BACKGROUND: Screening, brief intervention, and referral to treatment (SBIRT) is a practical means to address substance misuse in primary care. Important barriers to implementing SBIRT include adequacy of training and provider confidence as well as logistical hurdles and time constraints. A faculty development initiative aimed at increasing SBIRT knowledge and treatment of substance use disorders (SUDs) should lead to increased use of SBIRT by faculty and the residents they teach. This study examined how a faculty development program to promote SBIRT influenced faculty practice and resident teaching. METHODS: This was a cross-sectional study of faculty exposed to multiple SBIRT educational interventions over a 5-year period in an academic faculty-resident general medicine practice. Participants completed a brief online survey followed by a semistructured interview. Quantitative responses were examined descriptively. Qualitative questions were reviewed to identify key themes. RESULTS: Fifteen of 29 faculty (52%) completed the survey and 13 (45%) completed the interviews regarding faculty development interventions. Faculty thought that SBIRT was an important skill and had confidence in screening for substance use disorders, although confidence in making treatment referrals and prescribing pharmacotherapy were rated lower. Many faculty reported screening more frequently for SUDs after attending faculty development sessions. However, several reported that the training did not improve their SBIRT teaching to residents during clinic precepting sessions. To improve uptake of SBIRT, a majority of faculty recommended electronic health record (EHR) alerts. CONCLUSIONS: SBIRT is a highly valued set of skills, and training may enhance rates of screening for substance misuse. However, participants did not report a substantial change in SBIRT teaching as a result of faculty development. In the future, small, targeted faculty development sessions, potentially involving strategies for using the electronic health record (EHR), may be an effective way to enhance primary care SBIRT skills.

Teaching residents screening, brief intervention, and referral to treatment (SBIRT) skills for alcohol use: Using chart-stimulated recall to assess curricular impact.

BACKGROUND: Screening, brief intervention, and referral to treatment (SBIRT) improves identification and intervention for patients at risk for developing an alcohol use disorder (AUD). Residency curriculum is designed to teach SBIRT skills, but resources are needed to promote skill implementation. The electronic health record (EHR) can facilitate implementation through integration of decision-support tools. The authors developed electronic tools to facilitate documentation of alcohol assessment and brief intervention and to reinforce skills from an SBIRT curriculum. This prospective cohort study assessed primary care internal medicine residents' use of SBIRT skills and EHR tools in practice using chart-stimulated recall (CSR). METHODS: Postgraduate year 2 and 3 residents received a 5-hour SBIRT curriculum with skills practice and instruction on SBIRT electronic tools. Participants were then given a list of their patients seen in a 1-year period who were drinking at/above the recommended limit. Trainees selected 3 patients to review with a faculty member in a CSR. Faculty used a 24-item chart checklist to assess application of SBIRT skills and electronic tool use and met with residents to complete a CSR interview. CSR interview notes were analyzed qualitatively to understand application of SBIRT skills and EHR tool use. RESULTS: Eighteen of 20 residents participated in the CSR, and 5 faculty reviewed 46 patient charts. Residents documented alcohol use (84.2% of charts) and assessment of quantity/frequency of use (71.0%) but were less likely to document assessment for an AUD (34%), an appropriate plan (50.0%), or follow-up (55%). Few residents used EHR tools. Residents reported barriers in addressing alcohol use, including lack of knowledge, patient barriers, and time constraints. CONCLUSIONS: More intensive training in SBIRT with opportunities for practice and feedback may be necessary for residents to consistently apply SBIRT skills in practice. EHR tools need to be better integrated into the clinic workflow in order to be useful.

Internal Medicine Residents' Perceptions of Team-Based Care and its Educational Value in the Continuity Clinic: A Qualitative Study.

BACKGROUND: In order to teach residents how to work in interprofessional teams, educators in graduate medical education are implementing team-based care models in resident continuity clinics. However, little is known about the impact of interprofessional teams on residents' education in the ambulatory setting. OBJECTIVE: To identify factors affecting residents' experience of team-based care within continuity clinics and the impact of these teams on residents' education. DESIGN: This was a qualitative study of focus groups with internal medicine residents. PARTICIPANTS: Seventy-seven internal medicine residents at the University of California San Francisco at three continuity clinic sites participated in the study. APPROACH: Qualitative interviews were audiotaped and transcribed. The authors used a general inductive approach with sensitizing concepts in four frames (structural, human resources, political and symbolic) to develop codes and identify themes. KEY RESULTS: Residents believed that team-based care improves continuity and quality of care. Factors in four frames affected their ability to achieve these goals. Structural factors included communication through the electronic medical record, consistent schedules and regular team meetings. Human resources factors included the presence of stable teams and clear roles. Political and symbolic factors negatively impacted team-based care, and included low staffing ratios and a culture of ultimate resident responsibility, respectively. Regardless of the presence of these factors or resident perceptions of their teams, residents did not see the practice of interprofessional team-based care as intrinsically educational. CONCLUSIONS: Residents' experiences practicing team-based care are influenced by many principles described in the interprofessional teamwork literature, including understanding team members' roles, good communication and sufficient staffing. However, these attributes are not correlated with residents' perceptions of the educational value of team-based care. Including residents in interprofessional teams in their clinic may not be sufficient to teach residents how team-based care can enhance their overall learning and future practice.

Is Training in a Primary Care Internal Medicine Residency Associated with a Career in Primary Care Medicine?

PURPOSE: Professional and governmental organizations recommend an ideal US physician workforce composed of at least 40 % primary care physicians. They also support primary care residencies to promote careers in primary care. Our study examines the relationship between graduation from a primary care or categorical internal medicine residency program and subsequent career choice. METHODS: We conducted a cross-sectional electronic survey of a cohort of internal medicine residency alumni who graduated between 2001 and 2010 from a large academic center. Our primary predictor was graduation from a primary care versus a categorical internal medicine program and our primary outcome is current career role. We performed chi-square analysis comparing responses of primary care and categorical residents. RESULTS: We contacted 481 out of 513 alumni, of whom 322 responded (67 %). We compared 106 responses from primary care alumni to 169 responses from categorical alumni. Fifty-four percent of primary care alumni agreed that the majority of their current clinical work is in outpatient primary care vs. 20 % of categorical alumni (p < 0.001). While 92.5 % of primary-care alumni were interested in a primary care career prior to residency, only 63 % remained interested after residency. Thirty of the 34 primary care alumni (88 %) who lost interest in a primary care career during residency agreed that their ambulatory experience during residency influenced their subsequent career choice. CONCLUSIONS: A higher percentage of primary care alumni practice outpatient primary care as compared to categorical alumni. Some alumni lost interest in primary care during residency. The outpatient clinic experience may impact interest in primary care.

Do Resident Unions Improve Graduate Medical Education Training? Benefits and Potential Pitfalls.

ABSTRACT: The last 10 years have seen an increase in union representation for residents and fellows across the United States. It is estimated that 15% of residents and fellows are represented by unions. With increasing numbers of U.S. residents and fellows in graduate medical education (GME) programs being represented by unions, the authors contend that it is worthwhile to consider the benefits and potential drawbacks of resident unions and how GME and health system leaders can best work to ensure that the educational needs of residents continue to be emphasized in an era of resident unionization. Union bargaining can be a method to secure salary increases and other benefits for residents. Unionization can also provide a mechanism for more rapidly addressing worker protection issues and allows residents to advocate on behalf of patients. Residents participating as union leaders may develop important leadership and negotiation skills as well as gain beneficial knowledge about health system structure, financing, and priorities. However, with all the possible benefits that may come with resident unionization, there are also potential pitfalls. The collective bargaining process may create an adversarial relationship between program and institution leaders and trainees. Additionally, while residents are considered employees and able to collectively bargain, the National Labor Relations Board has also acknowledged that residents are "students learning their chosen medical craft." Program and institution leaders have an obligation to prioritize resident education and adhere to accreditation requirements even when these requirements conflict with union demands. Furthermore, because of the obligation to protect the public, program leaders should maintain control of resident academic due process issues. Program and institutional leaders must continue to prioritize resident education. Furthermore, GME leaders have a joint responsibility to create clinical learning environments that are conducive to quality patient care and promote resident learning and well-being.

Engaging GME Learners in Health System-Aligned Improvement Work in the Clinical Learning Environment.

Alignment between graduate medical education (GME) and health system priorities is foundational to meaningful engagement of residents and fellows in systems improvement work within the clinical learning environment. The Residents and Fellows Leading Interprofessional Continuous Improvement Teams program at the University of California San Francisco was designed over a decade ago to address barriers to trainee participation in health system-based improvement work. The program provides structure and support for health system-aligned trainee-led improvement projects in the clinic learning environment. Project champions (residents/fellows) from GME programs attend workshops where they learn improvement methodologies and develop proposals for health system-based improvement projects for their training programs. Proposals are supported by local faculty mentors and are reviewed and approved by GME and health systems' leaders. During the academic year, teams share their progress using visual management boards and interactive leader rounds. The health system provides a modest financial incentive for successful projects. Since the program's inception, thousands of trainees from 58 residency and fellowship programs have participated either as champions or participants in the program at least once, and in total over 300 projects have been implemented. Approximately three-quarters of the specific improvement goals were met, all projects meaningfully engaged residents and fellows, and many projects continued after the learners graduated. This active partnership between GME and a health system created a symbiotic relationship; trainees received education and support to complete improvement projects, while the health system reaped additional benefits from the alignment and impact of the projects. This partnership continues to grow with steady increases in participating programs, spread to partner health systems, and scholarship for trainees and faculty.

Team-based learning exercise efficiently teaches brief intervention skills to medicine residents.

BACKGROUND: Evaluations of substance use screening and brief intervention (SBI) curricula typically focus on learner attitudes and knowledge, although effects on clinical skills are of greater interest and utility. Moreover, these curricula often require large amounts of training time and teaching resources. This study examined whether a 3-hour SBI curriculum for internal medicine residents utilizing a team-based learning (TBL) format is effective for SBI skills as measured by a standardized patient (SP) assessment. METHODS: A waitlist-controlled design was employed. RESULTS: Twenty-four postgraduate year 2 (PGY-2) and PGY-3 residents participated in a SP assessment prior to the TBL session (waitlist control group) and 32 participated in a SP assessment after the TBL session (intervention group). The intervention residents demonstrated better brief intervention skills than waitlist control residents, but there were no differences between the groups in screening and assessment skills. Residents receiving the TBL curriculum prior to the SP assessment reported increased confidence in all SBI skills. CONCLUSION: Findings indicate that a brief educational intervention can improve brief intervention skills. However, more intensive education may be needed to improve substance use screening and assessment.

Thoracic splenosis: an important consideration in oncology patients.

SummarySplenosis is the implantation of ectopic splenic tissue after splenic injury or splenectomy. Signs and symptoms of splenosis vary based on anatomic location; however, it remains asymptomatic in many cases. On radiographic imaging, splenosis often appears as a soft tissue mass and can be diagnosed using heat-damaged red blood cell scintigraphy, a non-invasive imaging modality. Radiographic findings of splenosis on imaging may be suspicious for metastatic disease in patients with known solid organ tumours. It is important to have a high degree of suspicion for splenosis with known history of splenic trauma or splenectomy in order to avoid invasive procedures and guide appropriate management.

Stem Cells and Congenital Heart Disease: The Future Potential Clinical Therapy Beyond Current Treatment.

Congenital heart disease (CHD) is the most common congenital anomaly in newborns. Current treatment for cyanotic CHD largely relies on the surgical intervention; however, significant morbidity and mortality for patients with CHD remain. Recent research to explore new avenues of treating CHD includes the utility of stem cells within the field. Stem cells have since been used to both model and potentially treat CHD. Most clinical applications to date have focused on hypoplastic left heart syndrome. Here, we examine the current role of stem cells in CHD and discuss future applications within the field.

The impact of an objective structured teaching evaluation on faculty teaching skills.

BACKGROUND: Objective structured teaching evaluations (OSTEs) have been utilized to evaluate educational curricula and for resident and faculty development. PURPOSE: This study examines the impact of an OSTE on faculty teaching effectiveness and faculty satisfaction. METHODS: From 2004 to 2007, 46 faculty members participated in the OSTE. Faculty assessed their teaching abilities with a retrospective pre-post-test analysis. Faculty teaching evaluations for the 6 months before and after the OSTE were compared. Faculty participants completed satisfaction questionnaires regarding their OSTE experience and made teaching plans for the future. RESULTS: After the OSTE, faculty reported statistically significant improvements in all self-assessed teaching skills. There was, however, no improvement in their teaching evaluations. Faculty satisfaction with the OSTE experience was high. They indicated teaching plans incorporating lessons from the OSTE. CONCLUSIONS: Faculty felt the OSTE was a rewarding experience and reported improvement in their teaching abilities; however, faculty teaching evaluations did not improve.