Disparities in the Delivery of Prostate Cancer Survivorship Care in the USA: A Claims-based Analysis of Urinary Adverse Events and Erectile Dysfunction Among Prostate Cancer Survivors.

Background and objective: Incidence rates for prostate cancer (PCa) diagnosis and mortality are higher for Black men. It is unknown whether similar disparities exist in survivorship care. We assessed the delivery and quality of survivorship care for Black men undergoing PCa therapy in terms of the burden of and treatment for urinary adverse events (UAEs) and erectile dysfunction (ED). Methods: We queried Optum Clinformatics data for all patients diagnosed with PCa from January 1, 2002 to December 31, 2017 and identified those who underwent primary PCa treatment. Index cohorts were identified in each year and followed longitudinally until 2017. Data for UAE diagnoses, UAE treatments, and ED treatments were analyzed in index cohorts. Cox proportional-hazards regression models were used to examine associations of race with UAE diagnosis, UAE treatment, and ED treatment. Key findings and limitations: We identified 146, 216 patients with a PCa diagnosis during the study period, of whom 55, 149 underwent primary PCa treatment. In the primary treatment group, 32.7% developed a UAE and 28.2% underwent UAE treatment. The most common UAEs were urinary incontinence (11%), ureteral obstruction/stricture (4.5%), bladder neck contracture (4.5%), and urethral stricture (3.7%). The most common UAE treatments were cystoscopy (13%), suprapubic tube placement (6%), and urethral dilation (5%). Overall, UAE diagnosis rates were higher for Black patients, who had significantly higher risk of urethral obstruction, rectourethral fistula, urinary incontinence, cystitis, urinary obstruction, and ureteral fistula. Overall, UAE treatment rates were lower for Black patients, who had significantly higher risk of fecal diversion and/or rectourethral fistula repair (adjusted hazard ratio [aHR] 1.71, 95% confidence interval [CI] 1.04-2.79). Regarding ED treatments, Black patients had higher risk of penile prosthesis placement (aHR 1.591, 95% CI 1.26-2.00) and intracavernosal injection (aHR 1.215, 95% CI 1.08-1.37). Conclusions and clinical implications: Despite a high UAE burden, treatment rates were low in a cohort with health insurance. Black patients had a higher UAE burden and lower UAE treatment rates. Multilevel interventions are needed to address this stark disparity. ED treatment rates were higher for Black patients. Patient summary: We reviewed data for patients treated for prostate cancer (PCa) and found that 32.7% were diagnosed with a urinary adverse event (UAE) following their PCa treatment. The overall treatment rate for these UAEs was 28.2%. Analysis by race showed that the UAE diagnosis rate was higher for Black patients, who were also more likely to receive treatment for erectile dysfunction.

Using Unannounced Standardized Patients to Assess Clinician Telehealth and Communication Skills at an Urban Student Health Center.

PURPOSE: As the COVID-19 pandemic forced most colleges and universities to go online, student health centers rapidly shifted to telehealth platforms without frameworks for virtual care provision. An urban student health center implemented a needs assessment involving unannounced standardized patients (USPs) to evaluate the integration of a new telehealth workflow and clinicians' virtual communication skills. METHODS: From April to May 2021, USPs conducted two video visits with 12 primary care and four women's health clinicians (N = 16 clinicians; 32 visits). Cases included (1) a 21-year-old female presenting for birth control with a positive Patient Health Questionaire-9 and (2) a 21-year-old male, who vapes regularly, with questions regarding safe sex with men. Clinicians were evaluated using a checklist completed by the USP immediately following the visit and a systematic chart review of the electronic health record. RESULTS: USP feedback indicates most clinicians received high ratings for general communication skills but may benefit from educational intervention in several key telemedicine skills. Clinicians struggled with using nonverbal signals to enrich communication (47% well done), acknowledging emotions (34% well done), and using video for information gathering (34% well done). Low rates of standard screenings (e.g., 63% administered the PHQ-2, <50% asked about alcohol use) suggested protocols for in-person care were not easily incorporated into telehealth practices, and clinicians may benefit from enhanced care team support. Performance reports were shared with clinicians and leadership postvisit. DISCUSSION: Results suggest project design and implementation is scalable and feasible for use at other institutions, offering a structured methodology that can improve general student health care.

The Positive Approach to the Psychiatric Assessment: A Randomized Trial of a Novel Interviewing Technique.

OBJECTIVE: This pilot study compared a novel communication strategy, the positive approach to the psychiatric interview, with the traditional approach to see if the positive approach can be taught to psychiatric residents; reproduced with standardized patients; measured with a structured scale, the "Positive Approach Outcome Measure," by blinded raters; and used to improve rapport (assessed with the Bond score), a key driver of engagement. METHODS: Thirty psychiatric residents were randomly assigned to conduct two psychiatric interviews with standardized patients. The standardized patients completed the Working Alliance Inventory-Short Revised, an assessment of the therapeutic alliance. T tests and linear regression examined the effect of the training on the outcome of interest, the Bond score. RESULTS: The Bond scores for the positive approach group (M = 19.27, SD = 2.87) and the traditional approach group (M = 16.90, SD = 3.44) were statistically significantly different (p = 0.05). All residents trained in the positive approach received a positive score on the Positive Approach Outcome Measure while none of the traditional approach-trained residents attained the threshold. The inter-rater reliability for the blinded raters was high (0.857), as was the intra-rater reliability (1.0). CONCLUSIONS: The positive approach can be taught to residents and reproduced consistently and was associated with improvement in a key driver of treatment engagement: rapport. The positive approach may be an important, inexpensive intervention to improve treatment engagement and ultimately treatment outcomes.

Implementing an Experiential Telehealth Training and Needs Assessment for Residents and Faculty at a Veterans Affairs Primary Care Clinic.

Background: The transition to telehealth during the COVID-19 pandemic revealed a lack of preexisting telehealth training for clinicians. As a workplace-based simulation methodology designed to improve virtual clinical skills, announced standardized patients (ASPs) may help meet evolving educational needs to sustain quality telehealth care. Objective: We describe the development and implementation of an ASP program to assess and provide feedback to resident and faculty clinicians in virtual practice, and report on performance, feasibility, and acceptability. Methods: From June 2021 to April 2022, resident and faculty clinicians at a VA primary care clinic participated in a video visit in which an ASP portrayed either a 70-year-old man with hearing loss and hypertension or a 60-year-old man with hypertension and financial stress. Following the visit, ASPs provided verbal feedback and completed a behaviorally anchored checklist to rate telehealth and communication skills, chronic disease management, and use of resources. Domain summary scores were calculated as the mean percentage of "well done" items. Participants completed a feedback survey on their experience. Results: Seventy-six televisits (60 primary care residents [postgraduate year 1-3], 16 internal medicine faculty) were conducted from August 2021 to April 2022. Clinicians performed well in communication skills: information gathering (79%, 60 of 76, well done), relationship development (67%, 51 of 76), education and counseling (71%, 54 of 76), and patient satisfaction (86%, 65 of 76). They performed less well in telemedicine skills (38%, 29 of 76). Participants agreed that the experience was a good use of their time (88%, 67 of 76). Conclusions: An ASP-facilitated training for resident and faculty clinicians assessed telehealth skills and clinical practice and identified areas for intervention. Clinicians responded well to the training and feedback.

Study protocol: BRInging the Diabetes prevention program to GEriatric Populations.

In the Diabetes Prevention Program (DPP) randomized, controlled clinical trial, participants who were ≥ 60 years of age in the intensive lifestyle (diet and physical activity) intervention had a 71% reduction in incident diabetes over the 3-year trial. However, few of the 26.4 million American adults age ≥65 years with prediabetes are participating in the National DPP. The BRInging the Diabetes prevention program to GEriatric Populations (BRIDGE) randomized trial compares an in-person DPP program Tailored for Older AdulTs (DPP-TOAT) to a DPP-TOAT delivered via group virtual sessions (V-DPP-TOAT) in a randomized, controlled trial design (N = 230). Eligible patients are recruited through electronic health records (EHRs) and randomized to the DPP-TOAT or V-DPP-TOAT arm. The primary effectiveness outcome is 6-month weight loss and the primary implementation outcome is intervention session attendance with a non-inferiority design. Findings will inform best practices in the delivery of an evidence-based intervention.

Educational training to improve opioid overdose response among health center staff: a quality improvement initiative.

BACKGROUND: There were seven opioid overdoses in this New York City (NYC) federally qualified health center from December 2018 through February 2019, reflecting the rising rate of overdose deaths in NYC overall at the time. In response to these overdoses, we sought to increase the readiness of health center staff to recognize and respond to opioid overdoses and decrease stigmatizing attitudes around opioid use disorder (OUD). METHODS: An hour-long training focusing on opioid overdose response was administered to clinical and non-clinical staff of all levels at the health center. This training included didactic education on topics such as the overdose epidemic, stigma around OUD, and opioid overdose response, as well as discussion. A structured assessment was administered immediately before and following the training to evaluate change in knowledge and attitudes. Additionally, participants completed a feedback survey immediately after the training to assess acceptability. Paired t-tests and analysis of variance tests were used to assess changes in pre- and post-test scores. RESULTS: Over 76% of the health center staff participated in the training (N = 310). There were large and significant increases in mean knowledge and attitudinal scores from pre- to post-test (p < .001 and p < .001, respectively). While there was no significant effect of profession on attitudinal change scores, profession did have a significant effect on knowledge change scores, with administrative staff, non-clinical support staff, other healthcare staff, and therapists learning significantly more than providers (p < .001). The training had high acceptability among participants from diverse departments and levels. CONCLUSIONS: An interactive educational training increased staff's knowledge and readiness to respond to an overdose as well as improved attitudes toward individuals living with OUD. TRIAL REGISTRATION: This project was undertaken as a quality improvement initiative at the health center and as such was not formally supervised by the Institutional Review Board per their policies. Further, per the guidelines of the International Committee of Medical Journal Editors, registration is not necessary for clinical trials whose sole purpose is to assess an intervention's effect on providers.

Comparison of Primary Care Patients' and Unannounced Standardized Patients' Perceptions of Care.

The objective of this study was to compare unannounced standardized patient (USP) and patient reports of care. Patient satisfaction surveys and USP checklist results collected at an urban, public hospital were compared to identify items included in both surveys. Qualitative commentary was reviewed to better understand USP and patient satisfaction survey data. Analyses included χ2 and Mann-Whitney U test. Patients provided significantly higher ratings on 10 of the 11 items when compared to USPs. USPs may provide a more objective perspective on a clinical encounter than a real patient, reinforcing the notion that real patients skew overly positive or negative.

Understanding medical student paths to communication skills expertise using latent profile analysis.

PURPOSE: To describe patterns of clinical communication skills that inform curriculum enhancement and guide coaching of medical students. MATERIALS AND METHODS: Performance data from 1182 consenting third year medical students in 9 cohorts (2011-2019), on a 17-item Clinical Communication Skills Assessment Tool (CCSAT) completed by trained Standardized Patients as part of an eight case high stakes Comprehensive Clinical Skills Exam (CCSE) were analyzed using latent profile analysis (LPA). Assessment domains included: information gathering (6 items), relationship development (5 items), patient education (3 items), and organization/time management (3 items). LPA clustered learners with similar strength/weakness into profiles based on item response patterns across cases. One-way analysis of variance (ANOVA) assessed for significant differences by profile for CCSAT items. RESULTS: Student performance clustered into six profiles in three groups, high performing (HP1 and HP2-Low Patient Education, 15.7%), average performing (AP1 and AP2-Interrupters, 40.9%), and lower performing profiles (LP1-Non-interrupters and LP2, 43.4%) with adequate model fit estimations and similar distribution in each cohort. We identified 3 CCSAT items that discriminated among learner's skill profiles. CONCLUSION: Clinical communication skill performance profiles provide nuanced, benchmarked guidance for curriculum improvement and tailoring of communication skills coaching.

Neurology faculty comfort and experience with communication skills.

BACKGROUND: Neurology faculty care for complex patients, teach, and work within multidisciplinary teams. It is imperative for faculty to have strong communication skills. METHODS: We surveyed NYU neurology teaching faculty to determine levels of comfort and experience over the past year with providing negative feedback to a trainee; debriefing after an adverse clinical outcome; and assisting a struggling colleague. We examined the relationship between levels of comfort and experience with 1) faculty self-identified sex and 2) number of years since completion of medical training. RESULTS: The survey was completed by 36/83 teaching neurology faculty (43 %); 17 (47 %) respondents were female and 21 (58 %) were ≤10 years post-training. The proportions of faculty who reported feeling uncomfortable were 44 % (16/36) for assisting a struggling colleague, 28 % (10/36) for providing negative feedback, and 19 % (7/36) for debriefing an adverse outcome. Proportions of faculty who reported they had no experience were 75 % (27/36) for assisting a struggling colleague, 39 % (14/36) for debriefing an adverse clinical event, and 17 % (6/36) for providing negative feedback. Female respondents and faculty who were ≤10 years post-training were more likely to report feeling uncomfortable with assisting a struggling colleague and to have had no experience doing so in the past year. On multivariate analyses accounting for sex and experience, sex remained independently associated with feeling uncomfortable with assisting a struggling colleague (OR = 12.2, 95 % CI: 2.1-69.6, p = 0.005). CONCLUSION: Faculty development may be needed to improve comfort and experience with challenging communication-based interactions. Female faculty and faculty early in their careers may benefit most.

Zoom Objective Structured Clinical Exams: Virtually the Same as the Real Thing?

OBJECTIVE: Objective structured clinical exams (OSCE) are used to train and assess resident foundational family-centered communication skills incorporating key stakeholders. In 2020 encounters were conducted virtually. We sought to compare standardized patient (SP) and family faculty (FF) assessment across OSCE and virtual OSCE (VOSCE) formats. METHODS: The intern classes of 2019 and 2020 completed a live OSCE and VOSCE respectively where they disclosed an error to an SP. The 10 minute encounter was observed by an FF and facilitator followed by a 20 minute debrief. The SP and FF completed a behavioral checklist to evaluate skill mastery. RESULTS: Eighteen (90%) of the 20 interns completed the encounter each year. Total mastery scores were significantly higher for SP assessment than for FF assessment in both OSCE [68% vs 46% (z = -3.005, P < .05)] and VOSCE formats [68% vs 53% (z = -2.105, P < .05)]. Total mastery scores of SPs across OSCE and VOSCE formats did not significantly differ, nor did FF scores based on evaluation format. CONCLUSIONS: Our current experience suggests VOSCEs are a viable alternative to in person sessions given the comparable assessment across the two modalities. The ease of participating in virtual sessions may provide a way to more easily partner with key stakeholders.

Viewing Readiness-for-Residency through Binoculars: Mapping Competency-Based Assessments to the AAMC's 13 Core Entrustable Professional Activities (EPAs).

Construct: The construct being assessed is readiness-for-residency of graduating medical students, as measured through two assessment frameworks. Background: Readiness-for-residency of near-graduate medical students should be but is not consistently assessed. To address this, the Association of American Medical Colleges (AAMC), in 2014, identified and described 13 core Entrustable Professional Activities (EPAs), which are tasks that all residents should be able to perform unsupervised upon entering residency. However, the AAMC did not initially provide measurement guidelines or propose standardized assessments. We designed Night-onCall (NOC), an immersive simulation for our near-graduating medical students to assess and address their readiness-for-residency, framed around tasks suggested by the AAMC's core EPAs. In adopting this EPA assessment framework, we began by building upon an established program of competency-based clinical skills assessments, repurposing competency-based checklists to measure components of the EPAs where possible, and designing new checklists, when necessary. This resulted in a blended suite of 14 checklists, which theoretically provide substantive assessment of all 13 core EPAs. In this paper, we describe the consensus-based mapping process conducted to ensure we understood the relationship between competency and EPA-based assessment lenses and could therefore report meaningful feedback on both to transitioning students in the NOC exercise. Approach: Between January-November 2017, five clinician and two non-clinician health professions educators at NYU Grossman School of Medicine conducted a rigorous consensus-based mapping process, which included each rater mapping each of the 310 NOC competency-based checklist items to lists of entrustable behaviors expected of learners according to the AAMC 13 core EPAs. Findings: All EPAs were captured to varying degrees by the 14 NOC checklists (overall Intraclass Correlation Coefficient (ICC) = 0.77). Consensus meetings resolved discrepancies and improved ICC values for three (EPA-9, EPA-10, EPA-12) of the four EPAs that initially showed poor reliability. Conclusions: Findings suggest that with some limitations (e.g., EPA-7 "form clinical questions/retrieve evidence") established competency-based assessments can be repurposed to measure readiness-for-residency through an EPA lens and both can be reported to learners and faculty.

Bridging the Gap from Student to Doctor: Developing Coaches for the Transition to Residency.

BACKGROUND: A lack of educational continuity creates disorienting friction at the onset of residency. Few programs have harnessed the benefits of coaching, which can facilitate self-directed learning, competency development, and professional identity formation, to help ease this transition. OBJECTIVE: To describe the process of training faculty Bridge Coaches for the Transition to Residency Advantage (TRA) program for interns. METHODS: Nineteen graduate faculty educators participated in a coaching training course with formative skills assessment as part of a faculty development program starting in January 2020. Surveys (n = 15; 79%) and a focus group (n = 7; 37%) were conducted to explore the perceived impact of the training course on coaching skills, perceptions of coaching, and further program needs during the pilot year of the TRA program. RESULTS: Faculty had strong skills around establishing trust, authentic listening, and supporting goal-setting. They required more practice around guiding self-discovery and following a coachee-led agenda. Faculty found the training course to be helpful for developing coaching skills. Faculty embraced their new roles as coaches and appreciated having a community of practice with other coaches. Suggestions for improvement included more opportunities to practice and receive feedback on skills and additional structures to further support TRA program encounters with coaches. CONCLUSIONS: The faculty development program was feasible and had good acceptance among participants. Faculty were well-suited to serve as coaches and valued the coaching mindset. Adequate skills reinforcement and program structure were identified as needs to facilitate a coaching program in graduate medical education.

Addressing social determinants of health in primary care: a quasi-experimental study using unannounced standardised patients to evaluate the impact of audit/feedback on physicians' rates of identifying and responding to social needs.

BACKGROUND: Although efforts are underway to address social determinants of health (SDOH), little is known about physicians' SDOH practices despite evidence that failing to fully elicit and respond to social needs can compromise patient safety and undermine both the quality and effectiveness of treatment. In particular, interventions designed to enhance response to social needs have not been assessed using actual practice behaviour. In this study, we evaluate the degree to which providing primary care physicians with feedback on their SDOH practice behaviours is associated with increased rates of eliciting and responding to housing and social isolation needs. METHODS: Unannounced standardised patients (USPs), actors trained to consistently portray clinical scenarios, were sent, incognito, to all five primary care teams in an urban, safety-net healthcare system. Scenarios involved common primary care conditions and each included an underlying housing (eg, mould in the apartment, crowding) and social isolation issue and USPs assessed whether the physician fully elicited these needs and if so, whether or not they addressed them. The intervention consisted of providing physicians with audit/feedback reports of their SDOH practices, along with brief written educational material. A prepost comparison group design was used to evaluate the intervention; four teams received the intervention and one team served as a 'proxy' comparison (no intervention). Preintervention (February 2017 to December 2017) rates of screening for and response to the scripted housing and social needs were compared with intervention period (January 2018 to March 2019) rates for both intervention and comparison teams. RESULTS: 108 visits were completed preintervention and 183 during the intervention period. Overall, social needs were not elicited half of the time and fully addressed even less frequently. Rates of identifying the housing issue increased for teams that received audit/feedback reports (46%-60%; p=0.045) and declined for the proxy comparison (61%-42%; p=0.174). Rates of responding to housing needs increased significantly for intervention teams (15%-41%; p=0.004) but not for the comparison team (21%-29%; p=0.663). Social isolation was identified more frequently postintervention (53%) compared with baseline (39%; p=0.041) among the intervention teams but remained unchanged for the comparison team (39% vs 32%; p=0.601). Full exploration of social isolation remained low for both intervention and comparison teams. CONCLUSIONS: Results suggest that physicians may not be consistently screening for or responding to social needs but that receiving feedback on those practices, along with brief targeted education, can improve rates of SDOH screening and response.

Does it get better? An ongoing exploration of physician experiences with and acceptance of telehealth utilization.

INTRODUCTION: COVID-19 forced health systems to rapidly implement telehealth for routine practice, often without sufficient training or standards. We conducted a longitudinal survey of physicians to explore changes in their perceptions of the challenges and benefits of telehealth and identify recommendations for future practice. METHODS: An anonymous online survey was distributed to a cohort of internal medicine physicians in May to June 2020 and March to June 2021. Changes in responses between 2020 and 2021 and by site (private vs. public) were described. These findings, along with those of a thematic analysis of open-ended responses to questions on telehealth experiences, informed a set of recommendations. RESULTS: The survey response rate was 111/391 in 2021 compared to 122/378 in 2020. Fewer physicians reported that telehealth was more difficult than in person with regards to taking a history (49% in 2020, 33% in 2021, p= 0.015), maximizing patient adherence (33% in 2020, 19% in 2021, p = 0.028), and maintaining patient relationships (31%, 25%, p = 0.009) in 2021. Similar proportions of physicians reported continued challenges with building new patient relationships (75%, 77%, p = 0.075), educating patients (40%, 32%, p = 0.393), and working collaboratively with their team (38%, 41%, p = 0.794). Physicians reported increased satisfaction with tele-visits over in-person visits (13%, 27%, p = 0.006) and less worry over doing future tele-visits (45%, 31%, p = 0.027). Physicians' open-ended responses identified recommendations for further improving the design and use of telehealth. DISCUSSION: Results suggest that physician experience with telehealth improved but opportunities for training and improved integration remain. Longitudinal assessment can deepen understanding of the evolution of telehealth care.

"I Don't Trust It": Use of a Routine OSCE to Identify Core Communication Skills Required for Counseling a Vaccine-Hesitant Patient.

BACKGROUND: Vaccine hesitancy is challenging for clinicians and of increasing concern since COVID-19 vaccination rollout began. Standardized patients (SPs) provide an ideal method for assessing resident physicians' current skills, providing opportunity to practice and gain immediate feedback, while also informing evaluation of curriculum and training. As such, we designed and implemented an OSCE station where residents were tasked with engaging and educating a vaccine-hesitant patient. AIM: Describe residents' vaccine counseling practices, core communication and interpersonal skills, and effectiveness in meeting the objectives of the case. Explore how effectiveness in overcoming vaccine hesitancy may be associated with communication and interpersonal skills in order to inform educational efforts. SETTING: Annual OSCE at a simulation center. PARTICIPANTS: 106 internal medicine residents (51% PGY1, 49% PGY2). PROGRAM DESCRIPTION: Residents participated in an annual residency-wide, multi-station OSCE, one of which included a Black, middle-aged, vaccine-hesitant male presenting for a routine video visit. Residents had 10 min to complete the encounter, during which they sought to educate, explore concerns, and make a recommendation. After each encounter, faculty gave residents feedback on their counseling skills and reviewed best practices for effective communication on the topic. SPs completed a behaviorally anchored checklist (30 items across 7 clinical skill domains and 2 measures of trust in the vaccine's safety and resident) which will inform future curriculum. PROGRAM EVALUATION: Fifty-five percent (SD: 43%) of the residents performed well on the vaccine-specific education domain. PGY2 residents scored significantly higher on two of the seven domains compared to PGY1s (patient education/counseling-PGY1: 35% (SD: 36%) vs. PGY2: 52% (SD: 41%), p = 0.044 and activation-PGY1: 37% (SD: 45%) vs. PGY2: 59% (SD: 46%), p = 0.016). In regression analyses, education/counseling and vaccine-specific communication skills were strongly, positively associated with trust in the resident and in the vaccine's safety. A review of qualitative data from the SPs' perspective suggested that low performers did not use patient-centered communication skills. DISCUSSION: This needs assessment suggests that many residents needed in-the-moment feedback, additional education, and vaccine-specific communication practice. Our program plans to reinforce evidence-based practices physicians can implement for vaccine hesitancy through ongoing curriculum, practice, and feedback. This type of needs assessment is replicable at other institutions and can be used, as we have, to ultimately shed light on next steps for programmatic improvement.

A novel simulation-based approach to training for recruitment of older adults to clinical trials.

BACKGROUND: The need to engage adults, age 65 and older, in clinical trials of conditions typical in older populations, (e.g. hypertension, diabetes mellitus, Alzheimer's disease and related dementia) is exponentially increasing. Older adults have been markedly underrepresented in clinical trials, often exacerbated by exclusionary study criteria as well as functional dependencies that preclude participation. Such dependencies may further exacerbate communication challenges. Consequently, the evidence of what works in subject recruitment is less generalizable to older populations, even more so for those from racial and ethnic minority and low-income communities. METHODS: To support capacity of research staff, we developed a virtual, three station simulation (Group Objective Structured Clinical Experience-GOSCE) to teach research staff communication skills. This 2-h course included a discussion of challenges in recruiting older adults; skills practice with Standardized Participants (SPs) and faculty observer who provided immediate feedback; and debrief to highlight best practices. Each learner had opportunities for active learning and observational learning. Learners completed a retrospective pre-post survey about the experience. SP completed an 11-item communication checklist evaluating the learner on a series of established behaviorally anchored communication skills (29). RESULTS: In the research staff survey, 92% reported the overall activity taught them something new; 98% reported it provided valuable feedback; 100% said they would like to participate again. In the SP evaluation there was significant variation: the percent well-done of items by case ranged from 25-85%. CONCLUSIONS: Results from this pilot suggest that GOSCEs are a (1) acceptable; (2) low cost; and (3) differentiating mechanism for training and assessing research staff in communication skills and structural competency necessary for participant research recruitment.

Standardizing Quality of Virtual Urgent Care: Using Standardized Patients in a Unique Experiential Onboarding Program.

Introduction: Virtual urgent care (VUC) provides real-time evaluation, triage, and treatment of low-acuity medical problems; however, VUC physicians have varying levels of telemedicine training. We created a workplace-based experiential onboarding program that deployed standardized patients (SPs) into a VUC clinic to evaluate and deliver feedback to independently practicing physicians, providing quality assurance and identifying areas for improvement. Methods: We simulated evaluation of an adult with upper respiratory symptoms. To replicate a real-life encounter, we developed a mock electronic medical entry with demographic and medical information and scheduled SPs into the clinic's actual patient queue. SPs provided seamless, realistic training within the real-world virtual clinic environment. Using an adapted assessment tool anchored to not done, partly done, or well done, SPs evaluated communication, disease-specific, and telemedicine skills by observing behaviors. We surveyed participants to evaluate the program. Results: Twenty-one physicians participated. All performed well in core communication and disease management domains. Ninety-three percent of behaviors (SD = 11%) were rated well done within the information gathering domain, 90% (SD = 8%) within relationship development, and 95% (SD = 5%) within disease management. Physicians struggled with telemedicine-specific skills-55% (SD = 38%) well done-and education and counseling-32% (SD = 34%) well done-highlighting specific behaviors most ripe for improvement. All queried participants indicated that this simulation improved communication and telemedicine skills. Discussion: This workplace-based experiential onboarding program uncovered knowledge gaps within telemedicine skills and patient education domains. Identification of these gaps can help drive new virtual care curricula.

Design and comparison of a hybrid to a traditional in-person point-of-care ultrasound course.

BACKGROUND: Traditional introductory point-of-care ultrasound (POCUS) courses are resource intensive, typically requiring 2-3 days at a remote site, consisting of lectures and hands-on components. Social distancing requirements resulting from the COVID-19 pandemic led us to create a novel hybrid course curriculum consisting of virtual and in-person components. METHODS: Faculty, chief residents, fellows and advanced practice providers (APPs) in the Department of Medicine were invited to participate in the hybrid curriculum. The course structure included 4 modules of recorded lectures, quizzes, online image interpretation sessions, online case discussions, and hands-on sessions at the bedside of course participant's patients. The components of the course were delivered over approximately 8 months. Those participants who completed a minimum of 3 modules over the year were invited for final assessments. Results from the hybrid curriculum cohort were compared to the year-end data from a prior traditional in-person cohort. RESULTS: Participant knowledge scores were not different between traditional (n = 19) and hybrid (n = 24) groups (81% and 84%, respectively, P = 0.9). There was no change in POCUS skills as measured by the hands-on test from both groups at end-of-course (76% and 76%, respectively, P = 0.93). Confidence ratings were similar across groups from 2.73 traditional to 3.0 hybrid (out of possible 4, P = 0.46). Participants rated the course highly, with an average overall rating of 4.6 out 5. CONCLUSIONS: A hybrid virtual and in-person POCUS course was highly rated and as successful as a traditional course in improving learner knowledge, hands-on skill and confidence at 8 months after course initiation. These results support expanding virtual elements of POCUS educational curricula.