"I Don't Trust It": Use of a Routine OSCE to Identify Core Communication Skills Required for Counseling a Vaccine-Hesitant Patient.

BACKGROUND: Vaccine hesitancy is challenging for clinicians and of increasing concern since COVID-19 vaccination rollout began. Standardized patients (SPs) provide an ideal method for assessing resident physicians' current skills, providing opportunity to practice and gain immediate feedback, while also informing evaluation of curriculum and training. As such, we designed and implemented an OSCE station where residents were tasked with engaging and educating a vaccine-hesitant patient. AIM: Describe residents' vaccine counseling practices, core communication and interpersonal skills, and effectiveness in meeting the objectives of the case. Explore how effectiveness in overcoming vaccine hesitancy may be associated with communication and interpersonal skills in order to inform educational efforts. SETTING: Annual OSCE at a simulation center. PARTICIPANTS: 106 internal medicine residents (51% PGY1, 49% PGY2). PROGRAM DESCRIPTION: Residents participated in an annual residency-wide, multi-station OSCE, one of which included a Black, middle-aged, vaccine-hesitant male presenting for a routine video visit. Residents had 10 min to complete the encounter, during which they sought to educate, explore concerns, and make a recommendation. After each encounter, faculty gave residents feedback on their counseling skills and reviewed best practices for effective communication on the topic. SPs completed a behaviorally anchored checklist (30 items across 7 clinical skill domains and 2 measures of trust in the vaccine's safety and resident) which will inform future curriculum. PROGRAM EVALUATION: Fifty-five percent (SD: 43%) of the residents performed well on the vaccine-specific education domain. PGY2 residents scored significantly higher on two of the seven domains compared to PGY1s (patient education/counseling-PGY1: 35% (SD: 36%) vs. PGY2: 52% (SD: 41%), p = 0.044 and activation-PGY1: 37% (SD: 45%) vs. PGY2: 59% (SD: 46%), p = 0.016). In regression analyses, education/counseling and vaccine-specific communication skills were strongly, positively associated with trust in the resident and in the vaccine's safety. A review of qualitative data from the SPs' perspective suggested that low performers did not use patient-centered communication skills. DISCUSSION: This needs assessment suggests that many residents needed in-the-moment feedback, additional education, and vaccine-specific communication practice. Our program plans to reinforce evidence-based practices physicians can implement for vaccine hesitancy through ongoing curriculum, practice, and feedback. This type of needs assessment is replicable at other institutions and can be used, as we have, to ultimately shed light on next steps for programmatic improvement.

Validation of parsimonious prognostic models for patients infected with COVID-19.

OBJECTIVES: Predictive studies play important roles in the development of models informing care for patients with COVID-19. Our concern is that studies producing ill-performing models may lead to inappropriate clinical decision-making. Thus, our objective is to summarise and characterise performance of prognostic models for COVID-19 on external data. METHODS: We performed a validation of parsimonious prognostic models for patients with COVID-19 from a literature search for published and preprint articles. Ten models meeting inclusion criteria were either (a) externally validated with our data against the model variables and weights or (b) rebuilt using original features if no weights were provided. Nine studies had internally or externally validated models on cohorts of between 18 and 320 inpatients with COVID-19. One model used cross-validation. Our external validation cohort consisted of 4444 patients with COVID-19 hospitalised between 1 March and 27 May 2020. RESULTS: Most models failed validation when applied to our institution's data. Included studies reported an average validation area under the receiver-operator curve (AUROC) of 0.828. Models applied with reported features averaged an AUROC of 0.66 when validated on our data. Models rebuilt with the same features averaged an AUROC of 0.755 when validated on our data. In both cases, models did not validate against their studies' reported AUROC values. DISCUSSION: Published and preprint prognostic models for patients infected with COVID-19 performed substantially worse when applied to external data. Further inquiry is required to elucidate mechanisms underlying performance deviations. CONCLUSIONS: Clinicians should employ caution when applying models for clinical prediction without careful validation on local data.

The COVID-19 Army: Experiences From the Deployment of Non-Hospitalist Physician Volunteers During the COVID-19 Pandemic.

OBJECTIVE: New York City was the epicenter of the outbreak of the 2019 coronavirus disease (COVID-19) pandemic in the United States. As a large, quaternary care medical center, NYU Langone Medical Center was one of many New York medical centers that experienced an unprecedented influx of patients during this time. Clinical leadership effectively identified, oriented, and rapidly deployed a "COVID Army," consisting of non-hospitalist physicians, to meet the needs of the patient influx. We share feedback from our providers on our processes and offer specific recommendations for systems experiencing a similar influx in the current and future pandemics. METHODS: To assess the experiences and perceived readiness of these physicians (n = 183), we distributed a 32-item survey between March and June of 2020. Thematic analyses and response rates were examined to develop results. RESULTS: Responses highlighted varying experiences and attitudes of our frontline physicians during an emerging pandemic. Thematic analyses revealed a series of lessons learned, including the need to (1) provide orientations, (2) clarify roles/workflow, (3) balance team workload, (4) keep teams updated on evolving policies, (5) make team members feel valued, and (6) ensure they have necessary tools available. CONCLUSIONS: Lessons from our deployment and assessment are scalable at other institutions.

Improving the Care of Patients With Serious Illness: What Are the Palliative Care Education Needs of Internal Medicine Residents?

BACKGROUND: Hospitalized patients with serious illness have significant symptom burden and face complex medical decisions that often require goals of care discussions. Given the shortage of specialty palliative care providers, there is a pressing need to improve the palliative care skills of internal medicine (IM) residents, who have a central role in the care of seriously ill patients hospitalized at academic medical centers. METHODS: We conducted an anonymous survey of IM residents at a large, urban, academic medical center to identify which aspects of palliative care trainees find most important and their knowledge gaps in palliative care. The survey measured trainees' self-assessed degree of importance and knowledge of core palliative care skills and evaluated frequency of completing advance care planning documentation. RESULTS: Overall, 51 (23%) IM residents completed the survey. The majority of trainees considered multiple palliative care skills to be "very important/important": symptom management, prognostication, introducing the palliative care approach, discussing code status, and breaking serious news. Across these same skills, trainees reported variable levels of knowledge. In our sample, trainees reported completing healthcare proxy forms and Medical Orders for Life-Sustaining Treatment infrequently. CONCLUSIONS: IM trainees rated core palliative care skills as important to their practice. Yet, they reported knowledge gaps across multiple core palliative care skills that should be addressed given their role as frontline providers for patients with serious illness.

Swimming With Sharks: Teaching Residents Value-Based Medicine and Quality Improvement Through Resident-Pitched Projects.

BACKGROUND: To create meaningful quality improvement (QI) curricula for graduate medical education (GME) trainees, institutions strive to improve coordination of QI curricula with hospital improvement infrastructure. OBJECTIVE: We created a curriculum to teach residents about QI and value-based medicine (VBM) and assessed curricular effectiveness. METHODS: We designed a 2-week required curriculum for internal medicine residents at a large academic program. After participating in basic skills workshops, trainees developed QI/VBM project ideas with faculty and nonclinical support and pitched them to hospital leaders at the end of the rotation. Pre-post and 1-year follow-up surveys were conducted for residents to self-assess knowledge, attitudes, and skills, participation in QI/VBM projects, and career intentions. We tracked QI/VBM project implementation. RESULTS: In the first 2 years (2017-2018), 92 trainees participated, and 71 of 76 (93%) recommended the curriculum. Surveys (76 of 92, 83%) show improvement in our learning objectives (12%-60% pre to 62%-97% post; P < .001 for all; Cohen's d effect size 0.7-1.2), which are sustained at 1-year follow-up (57%-95%; P < .01). Four of 19 projects have been implemented. At 1 year, 95% of residents had presented a quality/value poster presentation, 44% were involved in QI/VBM beyond required rotations, and 26% plan to pursue careers focused on improving quality, safety, or value. CONCLUSIONS: Our project-based curriculum culminating in a project pitch to hospital leadership was acceptable to GME trainees, improved self-assessed skills sustained at 1 year, and resulted in successfully implemented QI/VBM projects.

A workshop to train medicine faculty to teach clinical reasoning.

Background Clinical reasoning (CR) is a core competency in medical education. Few studies have examined efforts to train faculty to teach CR and lead CR curricula in medical schools and residencies. In this report, we describe the development and preliminary evaluation of a faculty development workshop to teach CR grounded in CR theory. Methods Twenty-six medicine faculty (nine hospitalists and 17 subspecialists) participated in a workshop that introduced a framework to teach CR using an interactive, case-based didactic followed by role-play exercises. Faculty participated in pre- and post-Group Observed Structured Teaching Exercises (GOSTE), completed retrospective pre-post assessments (RPPs), and made commitment to change statements (CTCs). Results In the post-GOSTE, participants significantly improved in their use of problem representation and illness scripts to teach CR. RPPs revealed that faculty were more confident in their ability and more likely to teach CR using educational strategies grounded in CR educational theory. At 2-month follow-up, 81% of participants reported partially implementing these teaching techniques. Conclusions After participating in this 3-h workshop, faculty demonstrated increased ability to use these teaching techniques and expressed greater confidence and an increased likelihood to teach CR. The majority of faculty reported implementing these newly learned educational strategies into practice.