Does Formal Training in Medical Education and Professional Development Lead to Better Career Outcomes for Clinician Educators?

OBJECTIVES: Medical school and residency training programs rely on skilled clinician-educators to provide high-quality educational experiences. In 2002, the University of Pittsburgh's Institute for Clinical Research Education created a master's-level degree-granting program in medical education, which now has more than a decade of graduates. METHODS: All graduates between 2004 and 2014 were invited to complete an anonymous electronic survey regarding their experiences with the program and their perception of whether the master's program adequately prepared them in domains pertinent to medical educators. Participants also were asked to upload their current curricula vitae (CV) to assess objective measures of academic productivity among program graduates. RESULTS: More than 75% of surveys were completed (47/60) and 75% of CVs were submitted (45/60). Demographics of respondents showed that 66% were woman. The racial demographics of respondents revealed 13% Hispanic/Latino, 28% Asian, and 59% white, respectively. More than 90% of respondents agreed that because they completed the program, they were competent in multiple teaching and learning domains; 94% of respondents believed that they were more effective educators than peers who did not complete this degree. CV abstraction revealed that 98% of respondents currently held academic positions. Number of publications and number of years since program graduation were used to determine the rate of productivity of the graduates. Twenty-six graduates (58%) successfully published at least one peer-reviewed article per year since they graduated. This equated to approximately 3.77 publications per year for these 26 respondents and 2.27 publications per year for the entire cohort. CONCLUSIONS: Program graduates attributed their competence in several key domains that are crucial to excellence as a clinician-educator to their participation in the degree-granting program. The results of this study suggest that receipt of a graduate-level degree in medical education develops and enhances teaching skills and academic productivity among clinician-educators.

A Brief Communication Curriculum Improves Resident and Nurse Communication Skills and Patient Satisfaction.

BACKGROUND: Despite the ever-expanding role that the patient experience plays in healthcare, effective strategies proven to increase patient satisfaction ratings remain scarce. At the University of Pittsburgh Medical Center, we identified patient-doctor and patient-nurse communication as an area for intervention to improve suboptimal patient satisfaction among medicine inpatients. We posited that the likely reasons for underperformance in this area were a lack of adequate training in bedside communication skills. DESIGN: We developed and evaluated a curriculum for medicine residents and nurses focused on clear communication at the bedside. A total of 76 internal medicine residents and 85 medical service nurses participated in 2016. The curriculum utilized didactics, video demonstrations, and role play, and was evaluated using pre- and post-surveys of participants' health literacy knowledge, attitudes, and confidence. Communication skills were evaluated using pre- and post-direct observation at the bedside with a communication skills checklist. Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores were compared 3 months before and after the curriculum to assess changes in patient satisfaction. KEY RESULTS: Knowledge and attitudes improved significantly for both residents and nurses. Residents' and nurses' observed clinical communication skills improved significantly in most domains, and there was moderate increase in communication-specific HCAHPS scores. CONCLUSION: A small investment of curricular time devoted to clear communication skills improved residents' and medical nurses' knowledge, attitudes, skills, and communication-specific HCAHPS scores. This curriculum, focused on improving bedside communication skills, could be implemented in a variety of settings to improve patient satisfaction and patient experience.

Teaching to Teach: An Effective and Feasible Teaching Curriculum for Internal Medicine Interns.

OBJECTIVES: New competency requirements from the Accreditation Council for Graduate Medical Education have prompted greater emphasis on developing residents' teaching skills. Many residents make their first foray into teaching during internship, making it an important yet underrecognized opportunity to develop basic teaching skills. In addition, in the current graduate medical education climate, residents' tasks are compressed into an even shorter time, which has caused teaching opportunities and expectations to be balanced with the need for efficiency. After performing needs assessment surveys of medicine interns and medical students, we developed an interns-as-teachers curriculum to equip internal medicine interns with skills specific to their unique role as medical student teachers. METHODS: We conducted a workshop focused around four specific skills: role modeling, using teachable moments (ie, teaching on the fly), thinking out loud, and coaching. We evaluated the curriculum by comparing pre- and postcurricular teaching knowledge, attitudes, and self-reported teaching behaviors among 51 interns in the intervention group with 20 interns in the comparison group from the previous year's class. RESULTS: Sixty-one interns participated in the curriculum, and 51 (84%) completed both surveys. Knowledge and several self-reported teaching behaviors improved significantly among the intervention group, but not in the comparison group. CONCLUSIONS: Interns participating in a half-day interns-as-teachers workshop aimed at preparing them to teach medical students in clinical settings achieved significant improvement in teaching knowledge and in several core, self-reported teaching behaviors.

Screening for Underage Drinking and Diagnostic and Statistical Manual of Mental Disorders, 5th Edition Alcohol Use Disorder in Rural Primary Care Practice.

OBJECTIVE: To examine the National Institute on Alcohol Abuse and Alcoholism Youth Guide alcohol frequency screening thresholds when applied to Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (DSM-5) diagnostic criteria, and to describe alcohol use patterns and alcohol use disorder (AUD) characteristics in rural youth from primary care settings. STUDY DESIGN: Adolescents (n = 1193; ages 12 through 20 years) visiting their primary care practitioner for outpatient visits in six rural primary care clinics were assessed prior to their practitioner visit. A tablet computer collected youth self-report of past-year frequency and quantity of alcohol use and DSM-5 AUD symptoms. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were determined. RESULTS: For early adolescents (ages 12 through 14 years), 1.9% met DSM-5 criteria for past-year AUD and ≥3 days with alcohol use in the past year yielded a screen for DSM-5 with optimal psychometric properties (sensitivity: 89%; specificity: 95%; PPV: 37%; NPV: 100%). For middle adolescents (ages 15 through 17 years), 9.5% met DSM-5 AUD criteria, and ≥3 past year drinking days showed optimal screening results (sensitivity: 91%; specificity: 89%; PPV: 50%; NPV: 99%). For late adolescents (ages 18 through 20 years), 10.0% met DSM-5 AUD criteria, and ≥12 past year drinking days showed optimal screening results (sensitivity: 92%; specificity: 75%; PPV: 31%; NPV: 99%). The age stratified National Institute on Alcohol Abuse and Alcoholism frequency thresholds also produced effective results. CONCLUSION: In rural primary care clinics, 10% of youth over age 14 years had a past-year DSM-5 AUD. These at-risk adolescents can be identified with a single question on alcohol use frequency.

Faculty Communication Knowledge, Attitudes, and Skills Around Chronic Non-Malignant Pain Improve with Online Training.

OBJECTIVE: Many physicians struggle to communicate with patients with chronic, non-malignant pain (CNMP). Through the use of a Web module, the authors aimed to improve faculty participants' communication skills knowledge and confidence, use of skills in clinical practice, and actual communication skills. SUBJECTS: The module was implemented for faculty development among clinician-educators with university faculty appointments, outpatient clinical practices, and teaching roles. METHODS: Participants completed the Collaborative Opioid Prescribing Education Risk Evaluation and Mitigation Strategy (COPE-REMS®) module, a free Web module designed to improve provider communication around opioid prescribing. Main study outcomes were improvements in CNMP communication knowledge, attitudes, and skills. Skills were assessed by comparing a subset of participants' Observed Structured Clinical Exam (OSCE) performance before and after the curriculum. RESULTS: Sixty-two percent of eligible participants completed the curriculum in 2013. Knowledge-based test scores improved with curriculum completion (75% vs. 90%; P < 0.001). Using a 5-point Likert-type scale, participants reported improved comfort in managing patients with CNMP both immediately post-curriculum and at 6 months (3.6 pre vs. 4.0 post vs. 4.1 at 6 months; P = 0.02), as well as improvements in prescribing opioids (3.3 vs. 3.8 vs. 3.9, P = 0.01) and conducting conversations about discontinuing opioids (2.8 vs. 3.5 vs. 3.9, P < 0.001). Additionally, CNMP-specific communication skills on the OSCE improved after the curriculum (mean 67% vs. 79%, P = 0.03). CONCLUSIONS: Experienced clinician-educators improved their communication knowledge, attitudes, and skills in managing patients with CNMP after implementation of this curriculum. The improvements in attitudes were sustained at six months. A Web-based curriculum such as COPE-REMS® may be useful for other programs seeking improvement in faculty communication with patients who have CNMP.

Diversity supplements: An underutilized opportunity to improve the diversity of the health sciences research workforce.

Purpose: This paper describes the process developed at the University of Pittsburgh to increase the number of NIH-funded Diversity Supplements. Method: The authors formed a Diversity in Academia Workgroup where we created the infrastructure and process to increase the number of Diversity Supplements. Each year, the Office of Sponsored Programs provided a list of grants that would be eligible to submit a Diversity Supplement. We surveyed the Principal Investigators inquiring about their interest in working with a trainee on a Diversity Supplement. If yes, we included their information in a database we built so that trainees could search for eligible research studies. The Diversity Deans then identified underrepresented faculty and postdoctoral researchers. We invited Program Officers from NIH to participate in a panel presentation for trainees, which was well attended. Results: The number of Diversity Supplements awarded to Pitt researchers has significantly increased from 7 in 2020 to 10 in 2021 and to 15 in 2022. Six more have been awarded in the first half of 2023. Conclusions: We created the Diversity in Academia Workgroup with the goal to increase the number of Diversity Supplements at the University of Pittsburgh and in so doing, increase the diversity in the biomedical research workforce. While challenging, we know the critical importance and benefits of increased diversity at the University, and we have made significant strides toward this goal.

Advancing the Science of Mentorship: Future Directions for Sustainable Implementation and Evaluation of Mentorship Education for the Clinical and Translational Science Workforce.

The Advancing the Science of Mentorship: Future Directions for Sustainable Implementation and Evaluation of Mentorship Education for the Clinical and Translational Science Workforce conference was held in Madison, Wisconsin, in April 2023. The conference provided an engaging and scholarly forum for clinical and translational researchers from diverse backgrounds and career stages (including leaders at Clinical and Translational Science Award (CTSA) hubs and affiliated institutions) with a professional interest and commitment to improving and diversifying workforce development and fostering a climate of inclusive excellence through best practices in mentorship. Outcomes from the conference include an online resource and a new Community of Practice.

The impact of inclusive mentoring and identity work on self-efficacy in career advancement and career commitment among underrepresented early-career faculty and post-doctoral fellows.

Objective: Researchers from underrepresented groups leave research positions at a disproportionate rate. We aim to identify factors associated with self-efficacy in career advancement and career commitment among underrepresented post-doctoral fellows and early-career faculty. Methods: Building Up is a cluster-randomized trial with 25 academic health institutions. In September-October 2020, 219 Building Up participants completed the pre-intervention assessment, which included questions on demographics, science identity, mentoring, self-efficacy in career advancement (i.e., advancement is open to me, confidence in career progression, confidence in overcoming professional barriers), and career commitment (i.e., intent to continue research training or studying in a field related to biomedical sciences). Using logistic and multinomial logistic regression, we identified characteristics independently associated with self-efficacy in career advancement and career commitment. Results: The cohort is 80% female, 33% non-Hispanic/Latinx Black, and 34% Hispanic/Latinx. Having mentors that address diversity was significantly associated with the belief that advancement is open to them (OR = 1.7). Higher science identity (OR = 4.0) and having mentors that foster independence (OR = 1.8) were significantly associated with confidence in career progression. Higher science identity was also significantly associated with confidence in overcoming professional barriers (OR = 2.3) and intent to continue studying in a field related to biomedical sciences (OR = 3.3). Higher age (OR = 2.3) and higher science identity (OR = 4.2) were significantly associated with intent to continue research training. Discussion: Science identity and mentoring play key roles in self-efficacy in career advancement and career commitment. These factors may contribute to retention of underrepresented early-career biomedical researchers.

Evaluation of VA Women's Health Fellowships: developing leaders in academic women's health.

BACKGROUND: The Department of Veterans Affairs (VA) instituted the VA Women's Health Fellowship (VAWHF) Program in 1994, to accommodate the health needs of increasing numbers of female veterans and to develop academic leaders in women's health. Despite the longevity of the program, it has never been formally evaluated. OBJECTIVE: To describe the training environments of VAWHFs and career outcomes of female graduates. DESIGN AND PARTICIPANTS: Cross-sectional web-based surveys of current program directors (2010-2011) and VAWHF graduates (1995-2011). RESULTS: Responses were received from six of seven program directors (86 %) and 42 of 74 graduates (57 %). The mean age of graduates was 41.2 years, and mean time since graduation was 8.5 years. Of the graduates, 97 % were female, 74 % trained in internal medicine, and 64 % obtained an advanced degree. Those with an advanced degree were more likely than those without an advanced degree to pursue an academic career (82 % vs. 60 %; P<0.01). Of the female graduates, 76 % practice clinical women's health and spend up to 66 % of their time devoted to women's health issues. Thirty percent have held a VA faculty position. Seventy-nine percent remain in academics, with 39 % in the tenure stream. Overall, 94 % had given national presentations, 88 % had received grant funding, 79 % had published in peer-reviewed journals, 64 % had developed or evaluated curricula, 51 % had received awards for teaching or research, and 49 % had held major leadership positions. At 11 or more years after graduation, 33 % of the female graduates in academics had been promoted to the rank of associate professor and 33 % to the rank of full professor. CONCLUSIONS: The VAWHF Program has been successful in training academic leaders in women's health. Finding ways to retain graduates in the VA system would ensure continued clinical, educational, and research success for the VA women veteran's healthcare program.

Reducing tensions and expediting manuscript submission via an authorship agreement for early-career researchers: A pilot study.

Authorship can be a source of tension on research teams, in academic/industry collaborations, and between mentors/mentees. Authorship misconduct is prevalent among biomedical researchers, and disputes about authorship can generate tensions that have the potential to disrupt professional relationships and damage careers. Early-career researchers may experience particular challenges navigating authorship both because of inexperience and power differentials; in effect, they lack the language and confidence to have these conversations and may feel unwilling to challenge the status quo. The authors implemented an Authorship Agreement for use when collaborating on a manuscript and hypothesized that using this agreement would reduce authorship tensions and speed time to manuscript submission by helping early-career investigators manage authorship conversations more effectively. The authors surveyed trainees (n = 65) on the prevalence of authorship-related tensions and compared the results from the first survey in 2017 to the final survey in 2020. The decrease in tensions around meeting deadlines was significant (z = 2.59, p = 0.010). The authors believe the effect of an Authorship Agreement on authorship-related tensions has not previously been investigated. This work extends what is known about the prevalence of commonly cited authorship tensions, and provides evidence of the effectiveness of steps that can be taken to alleviate them.

Shut Up & Write!® builds writing self-efficacy and self-regulation in early-career researchers.

Introduction: High writing self-efficacy and self-regulation are tied to publication and grant submission. Writers with these attributes are more productive. We investigated whether participating in a Shut Up & Write!®-style intervention (SUAW) would produce statistically significant gains in writing self-efficacy and self-regulation when comparing pre-post-participation surveys. Methods: Forty-seven medical students, TL1/KL2, and early-career faculty from across the USA expressed interest in participating, with 37 completing the pre-survey. We conducted (on Zoom) a 12-week SUAW series and measured the effect using a pre-post survey adapted from the Writer Self-Perception Scale. Paired t-tests (α = 0.05) were conducted on three subscales to test for significant differences between pre- and post-test means. The subscales reflected writing attitudes, writing strategies, and avoiding writing distractions. Subscales showed acceptable internal consistency with Cronbach's alphas of 0.80, 0.71, and 0.72, respectively. Results: Twenty-seven participants attended at least one session. Of these, 81% presented as female, and 60% were from NIH-defined Underrepresented Backgrounds and/or were from Minority-Serving Institutions. Twenty-four completed both the pre- and post-surveys. Sixty percent previously participated in an activity similar to SUAW. We found significant improvements in writing attitudes (p = 0.020) and writing strategies (p = 0.041) for those who previously participated. For those who had not previously participated, we found improved writing strategies (p = 0.002). Eighty percent were very satisfied/satisfied with SUAW. Discussion: Researchers have tied writing self-efficacy and self-regulation to timely publication and grant submission. We found significant gains in self-efficacy and self-regulation, suggesting that participation in a SUAW-style intervention may increase writing productivity.

Leading Emerging and Diverse Scientists to Success: Results from LEADS alumni.

Purpose: In 2015, the University of Pittsburgh partnered with several Minority Serving Institutions to develop the Leading Emerging and Diverse Scientists to Success (LEADS) Program. LEADS was designed to provide skills development, mentoring, and networking support to early career underrepresented faculty. Method: LEADS included three components: skills training (e.g., grant and manuscript writing and team science), mentoring, and networking opportunities. Scholars completed a pre- and post-test survey and an annual alumni survey that included measures on burnout, motivation, leadership, professionalism, mentoring, job and career satisfaction, networking, and an assessment of their research self-efficacy. Results: Scholars demonstrated a significant increase in their research self-efficacy having completed all the modules (t = 6.12; P < 0.001). Collectively, LEADS scholars submitted 73 grants and secured 46 grants for a 63% success rate. Most scholars either agreed or strongly agreed that their mentor was effective in helping to develop their research skills (65%) and provided effective counseling (56%). Scholars did experience increased burnout with 50% feeling burned out at the exit survey (t = 1.42; P = 0.16) and 58% reporting feelings of burnout at the most recent survey in 2020 (t = 3.96; P < 0.001). Conclusions: Our findings support the claim that participation in LEADS enhanced critical research skills, provided networking and mentoring opportunities, and contributed to research productivity for scientists from underrepresented backgrounds.

Continued impact of COVID-19 pandemic on clinical and translational science early-career researchers.

The COVID-19 pandemic had an immediate impact on the lives and work of early-career researchers. We leveraged a cluster-randomized trial and compared survey data collected over two timepoints to explore whether these impacts persisted. Although more than a year had passed, 74% of participants reported that their research was affected in multiple ways in both 2020 and 2021. These data suggest that the effects of the pandemic on early-career researchers may be prolonged. Our findings additionally serve as an impetus to identify and implement solutions to early-career challenges that undoubtedly existed before the pandemic, but which COVID-19 brought into the spotlight.

Perseverance and consistency of interest in underrepresented post-doctoral fellows and early-career faculty.

Introduction: Underrepresented researchers face more challenges than their well-represented counterparts. Perseverance and consistency of interest are associated with career success in well-represented physicians. Therefore, we examined associations of perseverance and consistency of interest with Clinical Research Appraisal Inventory (CRAI), science identity, and other factors related to career success among underrepresented post-doctoral fellows and early-career faculty. Methods: This is a cross-sectional analysis of data collected from September to October 2020 among 224 underrepresented early-career researchers at 25 academic medical centers in the Building Up Trial. We used linear regression to test associations of perseverance and consistency of interest scores with CRAI, science identity, and effort/reward imbalance (ERI) scores. Results: The cohort is 80% female, 33% non-Hispanic Black, and 34% Hispanic. The median perseverance and consistency of interest scores were 3.8 (25th-75th percentile: 3.7,4.2) and 3.7 (25th-75th percentile: 3.2, 4.0), respectively. Higher perseverance was associated with a higher CRAI score (ß = 0.82; 95% CI = 0.30, 1.33, p = 0.002) and science identity (ß = 0.44; 95% CI = 0.19, 0.68, p = 0.001). Higher consistency of interest was associated with a higher CRAI score (ß = 0.60; 95% CI = 0.23, 0.96, p = 0.001) and higher science identity score (ß = 0.20; 95% CI = 0.03, 0.36, p = 0.02), while lower consistency of interest was associated with imbalance favoring effort (ß = -0.22; 95% CI = -0.33, -0.11, p = 0.001). Conclusions: We found that perseverance and consistency of interest are related to CRAI and science identity, indicating that these factors may positively influence one's decision to stay in research.

Time to act: A rubric-based approach for institutionalizing justice, equity, diversity, and inclusion.

Attacks on minoritized communities and increasing awareness of the societal causes of health disparities have combined to highlight deep systemic inequities. In response, academic health centers have prioritized justice, equity, diversity, and inclusion (JEDI) in their strategic goals. To have a sustained impact, JEDI efforts cannot be siloed; rather, they must be woven into the fabric of our work and systematically assessed to promote meaningful outcomes and accountability. To this end, the University of Pittsburgh's Institute for Clinical Research Education assembled a task force to create and apply a rubric to identify short and long-term JEDI goals, assess the current state of JEDI at our Institute, and make recommendations for immediate action. To ensure deep buy-in, we gathered input from diverse members of our academic community, who served on targeted subcommittees. We then applied a three-step process to ensure rapid forward progress. We emerged with concrete actions for priority focus and a plan for ongoing assessment of JEDI institutionalization. We believe our process and rubric offer a scalable and adaptable model for other institutions and departments to follow as we work together across academic medical institutions to put our justice, equity, diversity, and inclusion goals into meaningful action.

Customized Career Development Platform (CCDP) for clinical and translational researchers: A pragmatic cluster-randomized controlled trial.

Introduction: Early-stage clinical and translational researchers who set and track career goals, milestones, and progress are successful in career development. We aimed to determine the effectiveness of the Customized Career Development Platform (CCDP), an online individual development plan (IDP), versus the traditional IDP template in improving research success and career satisfaction. Methods: We conducted a pragmatic cluster-randomized controlled trial of 340 scholars and trainees at 27 US academic healthcare institutions. The primary outcome was number of published manuscripts 24 months post-intervention. Secondary outcomes included the number of grant proposals submitted and funded, job satisfaction, and level of communication with mentors. An analysis of CCDP participants assessed proficiency level for the 14 Clinical and Translational Science Award (CTSA) competencies. Data were analyzed using intention-to-treat. Results: Participants were mostly female (60.3%) and Caucasian (67.2%); mean age was 34 years. Twenty-four months following the intervention, the CCDP versus traditional IDP groups showed a similar number of publications (9.4 vs 8.6), grants submitted (4.1 vs 4.4) and funded (1.3 vs 2.0), and job satisfaction score (3.6 vs 3.7). The CCDP group had higher odds of discussing communication (OR = 2.08) and leadership skills (OR = 2.62) and broadening their network (2.31) than the traditional IDP group. The CCDP arm reported improvements in 9 of the 14 CTSA competencies. Conclusion: The CCDP offers CTSA hubs an innovative alternative to traditional IDP tools. Future studies are needed to elucidate why the CCDP users did not fully appreciate or adopt the functionality of the online platform.

A Mixed-Methods Analysis of Gender and Career Status Differences in the Impact of the COVID-19 Pandemic on Underrepresented Postdoctoral Fellows and Early-Career Faculty.

PURPOSE: The lack of racial and ethnic diversity in the biomedical workforce is pronounced and those from underrepresented backgrounds encounter more challenges than their majority counterparts. The extent of the impact of the COVID-19 pandemic on early-career investigators from underrepresented backgrounds is not yet fully understood. To examine the impact of the pandemic on underrepresented early-career biomedical researchers, this study evaluated differences in productivity, research, and psychological well-being by gender and career status. METHOD: This was a cross-sectional analysis of preintervention data, collected in September-October 2020, from 220 participants enrolled in the Building Up a Diverse Biomedical Research Workforce study. Participants were from 25 academic medical centers in the United States and were underrepresented early-career researchers. The primary outcomes were agreement on a 5-point Likert scale with pandemic impact statements (e.g., "The COVID-19 pandemic has impacted my ability to conduct research"). Thematic analysis was conducted on responses to 2 open-ended questions assessing the pandemic's impact. RESULTS: Most participants were female (79.9%), of non-Hispanic/Latinx/Spanish origin Black/African American (33.2%) or Hispanic/Latinx/Spanish origin (34.1%), and early-career faculty (53.4%). Over half of participants agreed or strongly agreed that the COVID-19 pandemic impacted their ability to work (55.7%) and conduct research (70.7%). Themes from qualitative analysis suggested lower research productivity, concerns about the academic job market and funding, and psychological distress due to the pandemic. Women were more likely to attribute lost productivity and psychological distress to homeschooling and childcare responsibilities. Postdoctoral fellows were concerned about more competition for fewer academic positions. CONCLUSIONS: In this study of early-career underrepresented biomedical researchers, the impact of the COVID-19 pandemic was widely felt by participants, varying by gender and career status. For those postdoctoral fellows and early-career faculty who are underrepresented, it is critical for institutions to offer flexibility in their positions.

Evaluation of two longitudinal faculty leadership training programs: behavioral change and institutional impact.

PURPOSE: Building leadership skills among faculty in academic medicine is essential, yet professional development programs focused on leadership are not always attentive to the needs of faculty on diverse career pathways or at differing career stages-nor are they often rigorously assessed. Evaluations commonly focus on participant satisfaction and short-term learning but not behavior change and institutional impact, which are difficult to assess but arguably more meaningful. Given the substantial time and money invested in these programs, more rigorous evaluation is critical. DESIGN/METHODOLOGY/APPROACH: The authors evaluated an intensive, shared leadership-focused training program for early-career and mid-career faculty, offered by the University of Pittsburgh's School of Medicine over the course of a year. They administered a pre/post-program assessment of confidence in key skill areas, and conducted semi-structured interviews with 21 participants between 1-4 years after program completion. FINDINGS: Participants in both programs showed statistically significant improvement (p < 0.001) on every item measured in the pre/post-test. Analysis of the interviews revealed indications of substantial behavior change as well as institutional impact. The evaluation also suggested particular benefits for female professionals. ORIGINALITY/VALUE: The authors conducted a long-term assessment of leadership training focused on career pathway and career stage and found that it (a) prompted both positive behavioral change and institutional impact and (b) suggested benefits for female faculty in particular, which could potentially help to eliminate gender-based disparities in leadership in academic medical centers.

The Virtual CTSA Visiting Scholar Program to Support Early-Stage Clinical and Translational Researchers: Implementation and Outcomes.

In addition to restrictions on conducting research, COVID-19-related travel bans and scientific meeting cancellations have negatively affected scholars in the Clinical and Translational Science Award (CTSA) Mentored Career Development Award (KL2) program. In response, a national virtual visiting scholar program was developed to provide opportunity for KL2 scholars to be virtual visiting professors at another CTSA hub, meet faculty and scholars, and expand networks and build collaborations. This article describes the design and short-term outcomes of the virtual CTSA Visiting Scholar Program. In 2020, a working group designed core program elements and developed an application and selection process. Anonymized surveys were sent to scholars post visit and to scholars and program directors 6 months post visit to evaluate their experience and solicit suggestions for improvements. Between November 2020 and May 2021, 56 KL2 scholars and 27 hubs participated. Forty-five (80.4%) participating scholars responded to the initial survey. Nearly all scholars (44, 97.7%) agreed their experience was valuable. All respondents indicated they would recommend the program to other KL2 scholars. For the 6-month survey, the response rate was 87.5% (49/56). Within 6 months of their visit, 36 (73.5%) respondents had contacted at least one person at the host hub and for 17 (34.7%) respondents, new collaborations with the host hub ensued. Twenty-five of 27 (92.6%) host hubs responded to the survey. Most (21, 84.0%) agreed that hearing visiting scholar talks was valuable to their own scholars and 23 (92%) indicated likelihood of their hub participating in future round of the program. The virtual Visiting Scholar Program provided KL2 scholars an opportunity to virtually visit another CTSA hub, present their research, and meet with faculty and other scholars to expand their networks. Although geared to KL2 scholars, this model is potentially generalizable to other nationally coordinated career development programs.