Lost in the pandemic: COVID-19's impact on health professions educators.

BACKGROUND: Minimal research has explored the pandemic's impact on health professions educators (HPEs). Given that health professions educator academies provide centralised support and professional development to HPEs through communities of practice and promoting education at their institutions, it is important to examine how academies met HPEs' needs during the pandemic. This study investigates the COVID-19 pandemic's effects on HPEs and examines how academies supported HPEs' educational roles during the pandemic. METHODS: Using a mixed-methods approach, the authors surveyed United States educator academy members on changes in HPEs' activities, emphasising clinical and educational tasks and work-life integration. Participants shared their academies' innovations and support responses. Data were analysed using chi-square and content analyses. FINDINGS: Twenty percent of 2784 recipients (n = 559) completed the survey. Most respondents indicated the pandemic caused them to spend more time on clinical and education leadership/administration than before the pandemic. HPEs integrated innovative instructional strategies, yet many shifted away from teaching, mentoring and scholarship. Over half were dissatisfied with work-life integration during the pandemic. Females, especially, reported that professional work was compromised by personal caregiving. Academies increased their range of member services; however, they did not fully meet their members' needs, including providing expanded professional development and advocating on HPE's behalf for increased protected time dedicated to educator responsibilities. DISCUSSION: HPEs faced unprecedented challenges in their personal and professional lives during the COVID-19 pandemic. Neglecting the needs of HPEs amidst global crises poses a substantial threat to the quality of education for upcoming generations of health care professionals.

Embedding Interprofessional Education in Clinical Settings: Medical and Dental Student Perceptions of a Patient Interview-Storytelling Experience.

PROBLEM: Interprofessional education (IPE) is valued but difficult to deliver, given logistical and other barriers. Centering IPE around patients and grounding it in authentic practice settings are challenging within early undergraduate medical education. APPROACH: This intervention facilitated student-patient conversations to elicit patient reflections on the health care professionals who keep them healthy and care for them when they are unwell. After being introduced to the Interprofessional Education Collaborative (IPEC) core competencies, first-year medical (n = 127) and dental (n = 34) students conducted a brief semistructured patient interview, using an interview card with guiding questions, during a precepted outpatient clinic session in March-May 2021. Students transcribed patients' stories and wrote their own reflections on the interview card. These reflections were used as a stimulus for a class IPE discussion. The authors employed a pragmatic qualitative research approach to explore what students learned about interprofessional collaboration from reflecting on patients' stories. OUTCOMES: Of the 161 students, 158 (98%) completed an interview card. Sixteen health professions were represented in patients' stories. The patients' stories prompted students to recognize and expand their understanding of the IPEC competencies. Students' responses reflected synthesis of the competencies into 3 themes: students value patient-centered holistic care as the goal of interprofessional collaboration; students reflect emerging professional and interprofessional identities in relating to patients, teams, and systems; and students appreciate interprofessional care is complex and challenging, requiring sustained effort and commitment. NEXT STEPS: Next steps include continuing to integrate patient voices through structured conversations across the undergraduate and graduate medical education spectrum and adapting the model to support conversations with other health professionals engaged in shared patient care. These experiences could foster ongoing deliberate reflection by students on their professional and interprofessional identity development but would require investments in student time and faculty development.

Implementation of competence by design in Canadian neurosurgery residency programs.

OBJECTIVE: The Royal College of Physicians and Surgeons of Canada (RCPSC) recently redesigned the Canadian neurosurgery residency training curriculum by implementing a competency-based model of training known as Competence by Design (CBD) centered around the assessment of Entrustable Professional Activities (EPAs). This sequential explanatory mixed-methods study evaluated potential benefits and pitfalls of CBD in Canadian neurosurgery residency education. METHODS: Two four-month interval surveys were distributed to all Canadian neurosurgery residents participating in CBD. The surveys assessed important educational components: CBD knowledge of key stakeholders, potential system barriers, and educational/psychological impacts on residents. Paired t-tests were done to assess changes over time. Based on longitudinal survey responses, semi-structured interviews were conducted to investigate in-depth residents' experience with CBD in neurosurgery. The qualitative analysis followed an explanatory approach, and a thematic analysis was performed. RESULTS: Surveys had 82% average response rate (n = 25). Over time, most residents self-reported that they retrospectively understood concepts around CBD intentions (p = 0.02). Perceived benefits included faculty evaluations with more feedback that was clearer and more objective (53% and 51%). Pitfalls included the amount of time needed to navigate through EPAs (90%) and residents forgetting to initiate EPA forms (71%). There was no significant change over time. During interviews, five key themes were found. Potential solutions identified by residents to enhance their experience included learning analytics data availability, mobile app refinement, and dedicated time to integrate EPAs in the workflow. CONCLUSION: This study was the first to assess resident-perceived benefits and pitfalls of the neurosurgery CBD training program in an educational framework context. In general, residents believed that theoretical principles behind CBD were valuable, but that technological ability and having enough time to request EPA assessments were significant barriers to success. Long-term studies are required to determine the definitive outcomes of CBD on residents' performance and ultimately, on patient care.

Pediatric Trainees' Speaking Up About Unprofessional Behavior and Traditional Patient Safety Threats.

OBJECTIVE: Speaking up is increasingly recognized as essential for patient safety. We aimed to determine pediatric trainees' experiences, attitudes, and anticipated behaviors with speaking up about safety threats including unprofessional behavior. METHODS: Anonymous, cross-sectional survey of 512 pediatric trainees at 2 large US academic children's hospitals that queried experiences, attitudes, barriers and facilitators, and vignette responses for unprofessional behavior and traditional safety threats. RESULTS: Responding trainees (223 of 512, 44%) more commonly observed unprofessional behavior than traditional safety threats (57%, 127 of 223 vs 34%, 75 of 223; P < .001), but reported speaking up about unprofessional behavior less commonly (48%, 27 of 56 vs 79%, 44 of 56; P < .001). Respondents reported feeling less safe speaking up about unprofessional behavior than patient safety concerns (52%, 117 of 223 vs 78%, 173 of 223; P < .001). Respondents were significantly less likely to speaking up to, and use assertive language with, an attending physician in the unprofessional behavior vignette than the traditional safety vignette (10%, 22 of 223 vs 64%, 143 of 223, P < .001 and 12%, 27 of 223 vs 57%, 128 of 223, P < .001, respectively); these differences persisted even among respondents that perceived high potential for patient harm in both vignettes (20%, 16 of 81 vs 69%, 56 of 81, P < .001 and 20%, 16 of 81 vs 69%, 56 of 81, P < .001, respectively). Fear of conflict was the predominant barrier to speaking up about unprofessional behavior and more commonly endorsed for unprofessional behavior than traditional safety threats (67%, 150 of 223 vs 45%, 100 of 223, P < .001). CONCLUSIONS: Findings suggest pediatric trainee reluctance to speak up when presented with unprofessional behavior compared to traditional safety threats and highlight a need to improve elements of the clinical learning environment to support speaking up.

Establishing trust within interprofessional teams with a novel simulation activity in the pediatric clerkship.

Interprofessional trust is essential for effective team-based care. Medical students are transient members of clinical teams during clerkship rotations and there may be limited focus on developing competency in interprofessional collaboration. Within a pediatric clerkship rotation, we developed a novel simulation activity involving an interprofessional conflict, aiming to foster trusting interprofessional relationships. Active participants included a nurse educator and a medical student participant, with additional students using a checklist to actively observe. The debrief focused on teaching points related to interprofessional competencies and conflict resolution. Students completed a written evaluation immediately following the simulation. Descriptive statistics were used to analyze Likert-type scale questions. Conventional content analysis was used to analyze open-ended responses. Two hundred and fourteen students participated in the simulation between June 2018-June 2019. Most students indicated that the simulation was effective (86%) and improved their confidence to constructively manage disagreements about patient care (88%). Students described anticipated changes in practice including developing their role on the interprofessional team as a medical student, developing a shared mental model, and establishing a shared goal. Our findings suggest that simulation-based learning may present an opportunity for developing interprofessional trust in academic health centers.

Agreement of Program Directors With Clinical Competency Committees for Fellow Entrustment.

OBJECTIVES: Fellowship program directors (FPD) and Clinical Competency Committees (CCCs) both assess fellow performance. We examined the association of entrustment levels determined by the FPD with those of the CCC for 6 common pediatric subspecialty entrustable professional activities (EPAs), hypothesizing there would be strong correlation and minimal bias between these raters. METHODS: The FPDs and CCCs separately assigned a level of supervision to each of their fellows for 6 common pediatric subspecialty EPAs. For each EPA, we determined the correlation between FPD and CCC assessments and calculated bias as CCC minus FPD values for when the FPD was or was not a member of the CCC. In addition, we examined the effect of program size, FPD understanding of EPAs, and subspecialty on the correlations. Data were obtained in fall 2014 and spring 2015. RESULTS: A total of 1040 fellows were assessed in the fall and 1048 in the spring. In both periods and for each EPA, there was a strong correlation between FPD and CCC supervision levels (P < .001). The correlation was somewhat lower when the FPD was not a CCC member (P < .001). Overall bias in both periods was small. CONCLUSIONS: The correlation between FPD and CCC assignment of EPA supervision levels is strong. Although slightly weaker when the FPD is not a CCC member, bias is small, so this is likely unimportant in determining fellow entrustment level. The similar performance ratings of FPDs and CCCs support the validity argument for EPAs as competency-based assessment tools.

Addressing implicit bias in pediatric hematology-oncology.

Although awareness of implicit bias and its influence on providers and patients is increasing, the effects of implicit bias on the field of pediatric hematology-oncology are less clear. This Special Report reviews the literature on implicit bias in pediatrics and medical oncology and further provides case examples and suggestions on what can be done to address implicit bias. There is a need for further research on how implicit bias impacts the complex care of pediatric hematology-oncology patients.

Discharge Day: A Case-Based Interprofessional Exercise About Team Collaboration in Pediatrics.

Introduction: Interprofessional education, which gives medical students the opportunity to learn from, with, and about other health professionals, is an essential component of the undergraduate medical education curriculum. Nonetheless, deliberate and sustained integration of interprofessional education into the undergraduate medical learning experience can be challenging, especially within the clinical setting. Methods: We implemented a 75-minute, interactive, collaborative, case-based conference focusing on an interprofessional clinical challenge in a pediatric setting. Medical students on their pediatrics core rotation and trainees within social work, nursing, pharmacy, and nutrition explored the concept of a team, reflected on roles, and considered how interprofessional collaboration could influence patient outcomes. Results: One hundred ninety-two health professions students participated in 15 sessions at three sites over a 10-month period (September 2017-July 2018). After each session, participants completed a session evaluation. They gave high ratings to the effectiveness and relevance of the experience and the case vignette. Responses to open-ended questions revealed that students had learned the importance of leveraging the expertise of team members and had resolved to speak up when faced with an interprofessional challenge in the future. Discussion: This case-based session is a logistically feasible and positively received opportunity for health professions students to discuss interprofessional collaboration. It could be adapted for a variety of learner populations and academic environments and could be incorporated into existing curricula.

Rising to the Challenge: Residency Programs' Experience With Implementing Milestones-Based Assessment.

BACKGROUND: Changes to assessment efforts following the shift to milestones-based assessment in the ACGME Next Accreditation System have not been fully characterized. OBJECTIVE: This study describes themes in initial milestones-based assessment practices with the goal of informing continued implementation and optimization of milestones-based assessment. METHODS: Semistructured interviews were conducted with 15 residency program leaders in 6 specialties at 8 academic medical centers between August and December 2016. We explored what was retained, what was added, and what was changed from pre-milestones assessment efforts. We also examined the perceived impact of the shift to milestones-based assessment on the programs. Thematic analysis began after the first 5 interviews and ended once thematic sufficiency was reached. Two additional authors reviewed the codes, offered critical input, and informed the formation and naming of the final themes. RESULTS: Three themes were identified: (1) program leaders faced challenges to effective implementation; (2) program leaders focused on adaptability and making milestones work in what felt like a less than ideal situation for them; and (3) despite challenges, program leaders see value and utility in their efforts to move to milestones-based assessment. We describe a number of strategies that worked for programs during the transition, with perceived benefits acknowledged. CONCLUSIONS: While adaptation to milestones has occurred and benefits are noted, negative impacts and challenges (eg, perceived lack of implementation guidance and faculty development resources) persist. There are important lessons learned (eg, utilizing implementation experiences formatively to improve curricula and assessment) in the transition to milestones-based assessment.

Funding Sources and Perceived Financial Insecurity in Pediatric Subspecialty Fellowship Programs.

OBJECTIVE: Shortages of pediatric subspecialists exist in many fields with insufficient recruitment of new fellows. The current system of funding graduate medical education is inadequate. We examined funding sources for trainee salary and educational expenses in pediatric fellowship programs, effects of funding constraints, and program characteristics associated with financial insecurity as reported by fellowship program directors (FPD). METHODS: We conducted a national survey of FPD between November 1, 2016 and February 9, 2017. We used multivariable logistic regression to examine the association between perceived financial insecurity, program characteristics, and funding sources for fellow salary. RESULTS: We obtained data from 519 FPD, representing 14 different pediatric subspecialties. FPD reported that funding limitations restricted program size and educational resources in 22% and 36% of programs, respectively. Nineteen percent of FPD perceived funding of their program to be insecure. Programs with 7 or more fellows (OR .50 [95% CI .27-.90], P = .03) or hospital or graduate medical education/Children's Hospital graduate medical education funding (OR .58 [95% CI .35-.96], P = .04) were less likely to be perceived as insecure. Conversely, programs with extramural (OR 1.74 [95% CI 1.07-2.81], P = .03) or division funding (OR 1.70 [95% CI 1.02-2.82], P = .04) or in subspecialties with more than 25% unfilled positions or programs (OR 1.86 [95% CI 1.11-3.09], P = .02) were more likely to be perceived as insecure. CONCLUSIONS: Perceived financial insecurity of fellowship programs was strongly associated with program size, funding source, and unfilled positions, limiting recruitment and resources. Stable funding of fellowship programs is critical to maintain an adequate pediatric subspecialty workforce.

Divide and conquer: Evaluation of a redesign of a pediatric teaching service.

BACKGROUND: Increasing census and work compression on the pediatric inpatient hematologic malignancy (IHM) service yielded resident dissatisfaction, impaired learning, and decreased perceived quality of patient care. This study aimed to evaluate the impact of a service redesign on resident perceptions of (a) the educational value of the rotation and (b) the safety of patient care. As a secondary objective, we evaluated the impact on the time of day of patient discharge. PROCEDURE: A bundled intervention on the IHM service was instituted, including decreased patient volumes, intentional patient assignment, intentional faculty selection, and increased weekend staffing. We distributed an annual survey to end-of-the-year junior residents. We compared responses from residents who experienced the redesign (2017) with residents whose experience predated the redesign (2016). We compared the time of day of patient discharge before and after the redesign. RESULTS: Survey completion rates were 70% (28/40) in 2016 and 57% (29/51) in 2017. Redesign residents rated their educational experience and perceived ability to care for patients on the nights and weekends significantly higher than previous residents. Redesign residents reported that their clinical education was compromised by excessive service less frequently than previous residents (24% vs 82%, P < 0.001). The time of day of patient discharge after the redesign was 35 minutes earlier than before the redesign (4:06 pm vs 4:41 pm, P = 0.01, 95% CI = -63, -6). CONCLUSIONS: A redesign initiative of an oncology service led to improved resident perceptions of the educational value of the rotation and ability to provide safe care to patients, along with earlier discharge times.

Patients of Our Own: Defining "Ownership" of Clinical Care in Graduate Medical Education.

Phenomenon: Learning to assume ownership of patient care is a critical objective of medical training. However, little is known about how ownership is best defined and measured or about its value to trainees. The authors aimed to define ownership and elucidate the significance of developing ownership skills over the course of pediatric residency training. Approach: Focus groups and phone interviews were held with pediatric residency program directors (N = 18) and pediatric residents (N = 14). Focus groups and interviews were audio-recorded, transcribed verbatim, and qualitatively analyzed using thematic analysis. Findings: Program directors and residents characterized ownership as essential to good patient care. Ownership was defined as including personal responsibility, a connection to patients/families, and follow-up and follow-through. For many, ownership was most conspicuous in its absence. Respondents found meaning in their work when exerting ownership and lack of ownership was linked to burnout and frustration. Ownership was recognized as a critical skill that requires development during training to form a professional identity, avoid burnout, become an independent practitioner and function as an integral member of medical teams. Insights: Pediatric residents and faculty considered ownership a cornerstone of patient care and critical to forming a professional identity. The defining characteristics of patient care ownership-personal responsibility, connections with patients and families, and continuity of care-can be used to develop an instrument to assess trainee development of ownership. These findings reinforce the value of ownership in graduate medical education and support creating curricular interventions to foster ownership.

The American Society of Hematology (ASH) Medical Educators Institute: a Pilot Faculty Development Project for Hematology Educators.

Clinician educators at academic medical centers often lack the community, mentorship, and faculty development to support their missions around education scholarship and teaching. Inadequate support for clinician educators can lead to professional dissatisfaction and slowed academic advancement. In 2014, ASH conducted a needs assessment of medical school hematology course directors, hematology-oncology fellowship program directors, and other ASH members identified as educators to determine this community's desire for faculty development in medical education. These data furthered the development of an annual faculty development program for hematology educators offering an interactive curriculum and support for an educational scholarly project. The needs assessment indicated that over 70% of respondents would be personally interested in a faculty development opportunity for hematology educators and only 11% had previously participated in such a program. A steering committee designed an intervention blending didactics, interactive small group exercises, webinars, mentorship for a scholarly project, 360-degree feedback for each participant, and a forum to discuss common career development goals. Of 42 applicants, 20 participants were chosen for the inaugural workshop. Following successful execution of the workshop, participants reported significant increase in confidence in the knowledge, skills, and attitudes targeted by the curriculum. A series of follow-up webinars have been developed to deliver additional content not covered during the workshop and to continue mentorship relationships. The curriculum will be further refined based on feedback from faculty and participants. Long-term outcome measurement will include tracking all participants' publications and presentations, time to promotion, and involvement in national medical education initiatives.

Assessing Ethics Knowledge: Development of a Test of Ethics Knowledge in Neonatology.

OBJECTIVE: To develop and validate the Test of Ethics Knowledge in Neonatology (TEK-Neo) with good internal consistency reliability, item performance, and construct validity that reliably assesses interprofessional staff and trainee knowledge of neonatal ethics. STUDY DESIGN: We adapted a published test of ethics knowledge for use in neonatology. The novel instrument had 46 true/false questions distributed among 7 domains of neonatal ethics: ethical principles, professionalism, genetic testing, beginning of life/viability, end of life, informed permission/decision making, and research ethics. Content and correct answers were derived from published statements and guidelines. We administered the voluntary, anonymous test via e-mailed link to 103 participants, including medical students, neonatology fellows, neonatologists, neonatology nurses, and pediatric ethicists. After item reduction, we examined psychometric properties of the resulting 36-item test and assessed overall sample performance. RESULTS: The overall response rate was 27% (103 of 380). The test demonstrated good internal reliability (Cronbach α = 0.66), with a mean score of 28.5 ± 3.4 out of the maximum 36. Participants with formal ethics training performed better than those without (30.3 ± 2.9 vs 28.1 ± 3.5; P = .01). Performance improved significantly with higher levels of medical/ethical training among the 5 groups: medical students, 25.9 ± 3.7; neonatal nurses/practitioners, 27.7 ± 2.7; neonatologists, 28.8 ± 3.7; neonatology fellows, 29.8 ± 2.9; and clinical ethicists, 33.0 ± 1.9 (P < .0001). CONCLUSIONS: The TEK-Neo reliably assesses knowledge of neonatal ethics among interprofessional staff and trainees in neonatology. This novel tool discriminates between learners with different levels of expertise and can be used interprofessionally to assess individual and group performance, track milestone progression, and address curricular gaps in neonatal ethics.

Assessment of orientation practices for ethics consultation at Harvard Medical School-affiliated hospitals.

BACKGROUND: Few studies have been conducted to assess the quality of orientation practices for ethics advisory committees that conduct ethics consultation. This survey study focused on several Harvard teaching hospitals, exploring orientation quality and committee members' self-evaluation in the American Society of Bioethics and Humanities (ASBH) ethics consultation competencies. METHODS: We conducted a survey study that involved 116 members and 16 chairs of ethics advisory committees, respectively (52% and 62.5% response rates). Predictor variables included professional demographics, duration on committees and level of training. Outcome variables included familiarity with and preparedness in the ASBH competencies and satisfaction with orientations. We hypothesised that responses would be associated with both the aforementioned predictors and whether or not participants had encountered the ASBH competencies in training. RESULTS: A majority of respondents found their orientation curricula to be helpful (62%), although a significant portion of respondents did not receive any orientation (24%) or were unsatisfied with their orientation (14%). Familiarity with ASBH competencies was a statistically significant predictor of respondents' self-evaluation in particular categories (54% had heard of the competencies). Standard educational materials were reported as offered during orientation, such as readings (50%) and case studies (41%); different medium resources were less evidenced such as videos on ethics consultation (19%). CONCLUSIONS: Institutions should re-evaluate orientation practices for ethics committee members that perform ethics consultation. Integrating ASBH competencies and useful methods into a resourceful pedagogy will help improve both member satisfaction with orientation and preparation in consultation.