Requested a Different Doctor: Developing and Evaluating an OSCE Assessing Core Skills in Supporting Trainees Facing Patient Discrimination.

BACKGROUND: Suboptimal support for colleagues experiencing discrimination can adversely impact clinician well-being and patient care. AIM: To describe resident performance and experience during an Objective Structured Clinical Examination (OSCE) case centered on supporting a trainee facing discrimination to inform enhanced, supportive learning environments. SETTING: Formative, internal medicine OSCE at a simulation center. PARTICIPANTS: 148 second-year residents across 2018, 2019, 2021, 2022. PROGRAM DESCRIPTION: Residents had 10 min to support a Muslim standardized intern (SI) experiencing discrimination from a patient. The SI rated resident performance across Supervision, Relationship Development, and Support domains and provided written feedback. Post-OSCE evaluations elicited resident reflections on case challenges. PROGRAM EVALUATION: Proficient residents (≥ 80% average score across domains, n = 85) performed better in all items, except in not acting defensive and collaborating with SI to develop follow-up plan, compared to non-proficient residents (n = 65). The SI described effective approaches to feeling supported, including using empathetic statements, stating personal stance on discrimination, exhibiting supportive body language, and verbalizing support. Stating knowledge of situation upfront was an area of improvement. Residents found engaging the distressed SI difficult. DISCUSSION: Use of an explicit discrimination OSCE case can help identify effective approaches to supporting targets of discriminatory patients to inform future training.

The Positive Approach to the Psychiatric Assessment: A Randomized Trial of a Novel Interviewing Technique.

OBJECTIVE: This pilot study compared a novel communication strategy, the positive approach to the psychiatric interview, with the traditional approach to see if the positive approach can be taught to psychiatric residents; reproduced with standardized patients; measured with a structured scale, the "Positive Approach Outcome Measure," by blinded raters; and used to improve rapport (assessed with the Bond score), a key driver of engagement. METHODS: Thirty psychiatric residents were randomly assigned to conduct two psychiatric interviews with standardized patients. The standardized patients completed the Working Alliance Inventory-Short Revised, an assessment of the therapeutic alliance. T tests and linear regression examined the effect of the training on the outcome of interest, the Bond score. RESULTS: The Bond scores for the positive approach group (M = 19.27, SD = 2.87) and the traditional approach group (M = 16.90, SD = 3.44) were statistically significantly different (p = 0.05). All residents trained in the positive approach received a positive score on the Positive Approach Outcome Measure while none of the traditional approach-trained residents attained the threshold. The inter-rater reliability for the blinded raters was high (0.857), as was the intra-rater reliability (1.0). CONCLUSIONS: The positive approach can be taught to residents and reproduced consistently and was associated with improvement in a key driver of treatment engagement: rapport. The positive approach may be an important, inexpensive intervention to improve treatment engagement and ultimately treatment outcomes.

Understanding medical student paths to communication skills expertise using latent profile analysis.

PURPOSE: To describe patterns of clinical communication skills that inform curriculum enhancement and guide coaching of medical students. MATERIALS AND METHODS: Performance data from 1182 consenting third year medical students in 9 cohorts (2011-2019), on a 17-item Clinical Communication Skills Assessment Tool (CCSAT) completed by trained Standardized Patients as part of an eight case high stakes Comprehensive Clinical Skills Exam (CCSE) were analyzed using latent profile analysis (LPA). Assessment domains included: information gathering (6 items), relationship development (5 items), patient education (3 items), and organization/time management (3 items). LPA clustered learners with similar strength/weakness into profiles based on item response patterns across cases. One-way analysis of variance (ANOVA) assessed for significant differences by profile for CCSAT items. RESULTS: Student performance clustered into six profiles in three groups, high performing (HP1 and HP2-Low Patient Education, 15.7%), average performing (AP1 and AP2-Interrupters, 40.9%), and lower performing profiles (LP1-Non-interrupters and LP2, 43.4%) with adequate model fit estimations and similar distribution in each cohort. We identified 3 CCSAT items that discriminated among learner's skill profiles. CONCLUSION: Clinical communication skill performance profiles provide nuanced, benchmarked guidance for curriculum improvement and tailoring of communication skills coaching.

Viewing Readiness-for-Residency through Binoculars: Mapping Competency-Based Assessments to the AAMC's 13 Core Entrustable Professional Activities (EPAs).

Construct: The construct being assessed is readiness-for-residency of graduating medical students, as measured through two assessment frameworks. Background: Readiness-for-residency of near-graduate medical students should be but is not consistently assessed. To address this, the Association of American Medical Colleges (AAMC), in 2014, identified and described 13 core Entrustable Professional Activities (EPAs), which are tasks that all residents should be able to perform unsupervised upon entering residency. However, the AAMC did not initially provide measurement guidelines or propose standardized assessments. We designed Night-onCall (NOC), an immersive simulation for our near-graduating medical students to assess and address their readiness-for-residency, framed around tasks suggested by the AAMC's core EPAs. In adopting this EPA assessment framework, we began by building upon an established program of competency-based clinical skills assessments, repurposing competency-based checklists to measure components of the EPAs where possible, and designing new checklists, when necessary. This resulted in a blended suite of 14 checklists, which theoretically provide substantive assessment of all 13 core EPAs. In this paper, we describe the consensus-based mapping process conducted to ensure we understood the relationship between competency and EPA-based assessment lenses and could therefore report meaningful feedback on both to transitioning students in the NOC exercise. Approach: Between January-November 2017, five clinician and two non-clinician health professions educators at NYU Grossman School of Medicine conducted a rigorous consensus-based mapping process, which included each rater mapping each of the 310 NOC competency-based checklist items to lists of entrustable behaviors expected of learners according to the AAMC 13 core EPAs. Findings: All EPAs were captured to varying degrees by the 14 NOC checklists (overall Intraclass Correlation Coefficient (ICC) = 0.77). Consensus meetings resolved discrepancies and improved ICC values for three (EPA-9, EPA-10, EPA-12) of the four EPAs that initially showed poor reliability. Conclusions: Findings suggest that with some limitations (e.g., EPA-7 "form clinical questions/retrieve evidence") established competency-based assessments can be repurposed to measure readiness-for-residency through an EPA lens and both can be reported to learners and faculty.

Educational training to improve opioid overdose response among health center staff: a quality improvement initiative.

BACKGROUND: There were seven opioid overdoses in this New York City (NYC) federally qualified health center from December 2018 through February 2019, reflecting the rising rate of overdose deaths in NYC overall at the time. In response to these overdoses, we sought to increase the readiness of health center staff to recognize and respond to opioid overdoses and decrease stigmatizing attitudes around opioid use disorder (OUD). METHODS: An hour-long training focusing on opioid overdose response was administered to clinical and non-clinical staff of all levels at the health center. This training included didactic education on topics such as the overdose epidemic, stigma around OUD, and opioid overdose response, as well as discussion. A structured assessment was administered immediately before and following the training to evaluate change in knowledge and attitudes. Additionally, participants completed a feedback survey immediately after the training to assess acceptability. Paired t-tests and analysis of variance tests were used to assess changes in pre- and post-test scores. RESULTS: Over 76% of the health center staff participated in the training (N = 310). There were large and significant increases in mean knowledge and attitudinal scores from pre- to post-test (p < .001 and p < .001, respectively). While there was no significant effect of profession on attitudinal change scores, profession did have a significant effect on knowledge change scores, with administrative staff, non-clinical support staff, other healthcare staff, and therapists learning significantly more than providers (p < .001). The training had high acceptability among participants from diverse departments and levels. CONCLUSIONS: An interactive educational training increased staff's knowledge and readiness to respond to an overdose as well as improved attitudes toward individuals living with OUD. TRIAL REGISTRATION: This project was undertaken as a quality improvement initiative at the health center and as such was not formally supervised by the Institutional Review Board per their policies. Further, per the guidelines of the International Committee of Medical Journal Editors, registration is not necessary for clinical trials whose sole purpose is to assess an intervention's effect on providers.

"I Don't Trust It": Use of a Routine OSCE to Identify Core Communication Skills Required for Counseling a Vaccine-Hesitant Patient.

BACKGROUND: Vaccine hesitancy is challenging for clinicians and of increasing concern since COVID-19 vaccination rollout began. Standardized patients (SPs) provide an ideal method for assessing resident physicians' current skills, providing opportunity to practice and gain immediate feedback, while also informing evaluation of curriculum and training. As such, we designed and implemented an OSCE station where residents were tasked with engaging and educating a vaccine-hesitant patient. AIM: Describe residents' vaccine counseling practices, core communication and interpersonal skills, and effectiveness in meeting the objectives of the case. Explore how effectiveness in overcoming vaccine hesitancy may be associated with communication and interpersonal skills in order to inform educational efforts. SETTING: Annual OSCE at a simulation center. PARTICIPANTS: 106 internal medicine residents (51% PGY1, 49% PGY2). PROGRAM DESCRIPTION: Residents participated in an annual residency-wide, multi-station OSCE, one of which included a Black, middle-aged, vaccine-hesitant male presenting for a routine video visit. Residents had 10 min to complete the encounter, during which they sought to educate, explore concerns, and make a recommendation. After each encounter, faculty gave residents feedback on their counseling skills and reviewed best practices for effective communication on the topic. SPs completed a behaviorally anchored checklist (30 items across 7 clinical skill domains and 2 measures of trust in the vaccine's safety and resident) which will inform future curriculum. PROGRAM EVALUATION: Fifty-five percent (SD: 43%) of the residents performed well on the vaccine-specific education domain. PGY2 residents scored significantly higher on two of the seven domains compared to PGY1s (patient education/counseling-PGY1: 35% (SD: 36%) vs. PGY2: 52% (SD: 41%), p = 0.044 and activation-PGY1: 37% (SD: 45%) vs. PGY2: 59% (SD: 46%), p = 0.016). In regression analyses, education/counseling and vaccine-specific communication skills were strongly, positively associated with trust in the resident and in the vaccine's safety. A review of qualitative data from the SPs' perspective suggested that low performers did not use patient-centered communication skills. DISCUSSION: This needs assessment suggests that many residents needed in-the-moment feedback, additional education, and vaccine-specific communication practice. Our program plans to reinforce evidence-based practices physicians can implement for vaccine hesitancy through ongoing curriculum, practice, and feedback. This type of needs assessment is replicable at other institutions and can be used, as we have, to ultimately shed light on next steps for programmatic improvement.

A novel simulation-based approach to training for recruitment of older adults to clinical trials.

BACKGROUND: The need to engage adults, age 65 and older, in clinical trials of conditions typical in older populations, (e.g. hypertension, diabetes mellitus, Alzheimer's disease and related dementia) is exponentially increasing. Older adults have been markedly underrepresented in clinical trials, often exacerbated by exclusionary study criteria as well as functional dependencies that preclude participation. Such dependencies may further exacerbate communication challenges. Consequently, the evidence of what works in subject recruitment is less generalizable to older populations, even more so for those from racial and ethnic minority and low-income communities. METHODS: To support capacity of research staff, we developed a virtual, three station simulation (Group Objective Structured Clinical Experience-GOSCE) to teach research staff communication skills. This 2-h course included a discussion of challenges in recruiting older adults; skills practice with Standardized Participants (SPs) and faculty observer who provided immediate feedback; and debrief to highlight best practices. Each learner had opportunities for active learning and observational learning. Learners completed a retrospective pre-post survey about the experience. SP completed an 11-item communication checklist evaluating the learner on a series of established behaviorally anchored communication skills (29). RESULTS: In the research staff survey, 92% reported the overall activity taught them something new; 98% reported it provided valuable feedback; 100% said they would like to participate again. In the SP evaluation there was significant variation: the percent well-done of items by case ranged from 25-85%. CONCLUSIONS: Results from this pilot suggest that GOSCEs are a (1) acceptable; (2) low cost; and (3) differentiating mechanism for training and assessing research staff in communication skills and structural competency necessary for participant research recruitment.

The Telemedicine Takeover: Lessons Learned During an Emerging Pandemic.

Introduction: Health care systems rose to the challenges of COVID-19 by creating or expanding telehealth programs to ensure that patients could access care without an in-person appointment. Traditionally, physicians receive limited formal telemedicine training, making preparedness for this transition uneven. To describe challenges to and attitudes toward providing virtual patient care, we distributed a survey to physicians within our system who largely had no formal prior training/experience with telemedicine, but transitioned to routine telemedicine use. Data collected are then used to offer actionable recommendations for health system leaders and medical educators. Materials and Methods: Surveys were distributed to all faculty outpatient general internal medicine physicians working at any New York University Langone Health, New York City Health + Hospitals/Bellevue and Gouverneur, and the VA NY Harbor Health System (n = 378) in mid-2020. Survey items consisted of Likert and open-ended questions related to experience with televisits (13 items) and attitudes toward care (24 items). Results: Telehealth-related challenges varied by site and modality. Primary challenges included establishing a connection from the patient's (98%) or physician's end (84%) and difficulty in the following domains: working with team members (39%), physical examinations (95%), establishing new patient relationships (70%), and taking history (40%), among others. In thematic analysis, significant themes with illustrative qualitative commentary emerged related to technological challenges, new systems issues, and new patient/physician communication experiences. Discussion: Experience differences were rooted in the type of technology employed. Safety-net practices conducted mostly telephonic visits, whereas private outpatient sites utilized video, despite both using identical electronic medical records. As we consider a "new normal" and prolonged community transmission of COVID-19 infection, it is essential to establish telemedicine training, tools, and protocols that meet the needs of both patients and physicians.

A novel method of assessing clinical preparedness for COVID-19 and other disasters.

QUALITY ISSUE: The emergence of coronavirus disease of 2019 (COVID-19) highlights the necessity of rapidly identifying and isolating potentially infected individuals. Evaluating this preparedness requires an assessment of the full clinical system, from intake to isolation. INITIAL ASSESSMENT: Unannounced Standardized Patients (USPs) present a nimble, sensitive methodology for assessing this readiness. CHOICE OF SOLUTION: Pilot the USP methodology, which employs an actor trained to present as a standardized, incognito potentially infected patient, to assess clinical readiness for potential COVID-19 patients at an urban, community safety-net clinic. IMPLEMENTATION: The USP was trained to present at each team's front desk with the complaint of feeling unwell (reporting a fever of 101 degrees Fahrenheit in the past 24 hours) and exposure to a roommate recently returned from Beijing. The USP was trained to complete a behaviorally anchored assessment of the care she received from the clinical system. EVALUATION: There was clear variation in care USPs received; some frontline clerical staff followed best practices; others did not. Signage and information on disease spread prevention publicly available was inconsistent. Qualitative comments shared by the USPs and those gathered during group debrief reinforced the experiences of the USPs and hospital leadership. LESSONS LEARNED: USPs revealed significant variation in care practices within a clinical system. Utilization of this assessment methodology can provide just-in-time clinical information about readiness and safety practices, particularly during emerging outbreaks. USPs will prove especially powerful as clinicians and systems return to outpatient visits while remaining vigilant about potentially infected individuals.

Design and evaluation of the I-SCAN faculty POCUS program.

BACKGROUND: Point-of-care ultrasound (POCUS) is becoming widely adopted with increasing accessibility of courses. Little is known about the optimal design of the introductory course or longitudinal training programs targeting hospitalists that are critical to success. METHODS: Hospitalists at four academic sites participated in a two-day introductory course and a longitudinal phase comprising clinical POCUS practice, clip uploading with online feedback, hands-on teaching, and monthly ultrasound conferences. Assessments were performed immediately before and after the two-day course and after 1 year. RESULTS: Knowledge increased from baseline to post two-day course (median score 58 and 85%, respectively, p < 0.001) and decreased slightly at 1 year (median score 81%, p = 0.012). After the two-day introductory course, the median score for hands-on image acquisition skills, the principal metric of participant success, was 75%. After 1 year, scores were similar (median score 74%). Confidence increased from baseline to post two-day course (1.5 to 3.1 on a 4 point Likert scale from Not at all confident (1) to Very confident (4), p < 0.001), and remained unchanged after 1 year (2.73). Course elements correlating with a passing score on the final hands-on test included number of clip uploads (r = 0.85, p,0.001), attendance at hands-on sessions (r = 0.7, p = 0.001), and attendance at monthly conferences (r = 0.50, p = 0.03). CONCLUSIONS: The I-ScaN POCUS training program increased hospitalist knowledge, skill and confidence with maintained skill and confidence after 1 year. Uploading clips and attending hands-on teaching sessions were most correlative with participant success.

Using Objective Structured Clinical Exams (OSCE) to Teach Neurology Residents to Disclose Prognosis after Hypoxic Ischemic Brain Injury.

BACKGROUND: Neurologists need to be adept at disclosing prognosis and breaking bad news. Objective structured clinical examinations (OSCE) allow trainees to practice these skills. METHODS: In 2017, in conjunction with the NYU School of Medicine Simulation Center, neurology faculty designed an OSCE case in which a resident had to inform a standardized patient (SP) her father had severe global hypoxic ischemic injury. The residents were surveyed on the experience using a Likert scale from 1 (worst) to 5 (best). The SP completed a behavioral anchored checklist and marked items as "not done," "partly done," or "well done". RESULTS: 57 third and fourth year neurology residents completed the case from 2018 to 2020, 54 (95%) of whom completed the post-OSCE survey. Residents reported feeling moderately prepared for the simulation (mean Likert score 3.7/5), and thought their performance was average (3.4/5). Overall, they found the case to be very helpful (4.6/5). The residents performed well in the realms of maintaining professionalism (64% rated "well done"), developing a relationship (62% rated "well done"), and information gathering (61% rated "well done"). There was room for improvement in the realms of providing education and presenting the bad news (39% and 37% rated "partly/not done," respectively). CONCLUSIONS: OSCE cases can be used to teach neurology trainees how to discuss prognosis and break bad news. Feedback about this simulation was positive, though its efficacy has yet to be evaluated and could be a future direction of study.

Reasons geriatrics fellows choose geriatrics as a career, and implications for workforce recruitment.

Objectives: Although the population of older adults is rising, the number of physicians seeking geriatrics training is decreasing. This study of fellows in geriatrics training programs across the United States explored motivating factors that led fellows to pursue geriatrics in order to inform recruitment efforts. Design: Semi-structured telephone interviews with geriatrics fellows. Setting: Academic medical centers. Participants: Fifteen geriatrics fellows from academic medical centers across the United States. Measurements: This qualitative telephone study involved interviews that were transcribed and descriptively coded by two independent reviewers. A thematic analysis of the codes was summarized. Results: Fellows revealed that mentorship and early exposure to geriatrics were the most influential factors affecting career choice. Conclusion: The results of this study have the potential for a large impact, helping to inform best practices in encouraging trainees to enter the field, and enhancing medical student and resident exposure to geriatrics.

Building Telemedicine Capacity for Trainees During the Novel Coronavirus Outbreak: a Case Study and Lessons Learned.

INTRODUCTION: Hospital and ambulatory care systems are rapidly building their virtual care capacity in response to the novel coronavirus (COVID-19) pandemic. The use of resident trainees in telemedicine is one area of potential development and expansion. To date, however, training opportunities in this field have been limited, and residents may not be adequately prepared to provide high-quality telemedicine care. AIM: This study evaluates the impact of an adapted telemedicine Objective Structured Clinical Examination (OSCE) on telemedicine-specific training competencies of residents. SETTING: Primary Care Internal Medicine residents at a large urban academic hospital. PROGRAM DESCRIPTION: In March 2020, the New York University Grossman School of Medicine Primary Care program adapted its annual comprehensive OSCE to a telemedicine-based platform, to comply with distance learning and social distancing policies during the COVID-19 pandemic. A previously deployed in-person OSCE on the subject of a medical error was adapted to a telemedicine environment and deployed to 23 primary care residents. Both case-specific and core learning competencies were assessed, and additional observations were conducted on the impact of the telemedicine context on the encounter. PROGRAM EVALUATION: Three areas of telemedicine competency need were identified in the OSCE case: technical proficiency; virtual information gathering, including history, collateral information collection, and physical exam; and interpersonal communication skills, both verbal and nonverbal. Residents expressed enthusiasm for telemedicine training, but had concerns about their preparedness for telemedicine practice and the need for further competency and curricular development. DISCUSSION: Programs interested in building capacity among residents to perform telemedicine, particularly during the COVID-19 pandemic, can make significant impact in their trainees' comfort and preparedness by addressing key issues in technical proficiency, history and exam skills, and communication. Further research and curricular development in digital professionalism and digital empathy for trainees may also be beneficial.

Development and maintenance of a medical education research registry.

BACKGROUND: Medical Education research suffers from several methodological limitations including too many single institution, small sample-sized studies, limited access to quality data, and insufficient institutional support. Increasing calls for medical education outcome data and quality improvement research have highlighted a critical need for uniformly clean and easily accessible data. Research registries may fill this gap. In 2006, the Research on Medical Education Outcomes (ROMEO) unit of the Program for Medical Innovations and Research (PrMEIR) at New York University's (NYU) Robert I. Grossman School of Medicine established the Database for Research on Academic Medicine (DREAM). DREAM is a database of routinely collected, de-identified undergraduate (UME, medical school leading up to the Medical Doctor degree) and graduate medical education (GME, residency also known as post graduate education leading to eligibility for specialty board certification) outcomes data available, through application, to researchers. Learners are added to our database through annual consent sessions conducted at the start of educational training. Based on experience, we describe our methods in creating and maintaining DREAM to serve as a guide for institutions looking to build a new or scale up their medical education registry. RESULTS: At present, our UME and GME registries have consent rates of 90% (n = 1438/1598) and 76% (n = 1988/2627), respectively, with a combined rate of 81% (n = 3426/4225). 7% (n = 250/3426) of these learners completed both medical school and residency at our institution. DREAM has yielded a total of 61 individual studies conducted by medical education researchers and a total of 45 academic journal publications. CONCLUSION: We have built a community of practice through the building of DREAM and hope, by persisting in this work the full potential of this tool and the community will be realized. While researchers with access to the registry have focused primarily on curricular/ program evaluation, learner competency assessment, and measure validation, we hope to expand the output of the registry to include patient outcomes by linking learner educational and clinical performance across the UME-GME continuum and into independent practice. Future publications will reflect our efforts in reaching this goal and will highlight the long-term impact of our collaborative work.

"I Cannot Take This Any More!": Preparing Interns to Identify and Help a Struggling Colleague.

BACKGROUND: Few programs train residents in recognizing and responding to distressed colleagues at risk for suicide. AIM: To assess interns' ability to identify a struggling colleague, describe resources, and recognize that physicians can and should help colleagues in trouble. SETTING: Residency programs at an academic medical center. PARTICIPANTS: One hundred forty-five interns. PROGRAM DESIGN: An OSCE case was designed to give interns practice and feedback on their skills in recognizing a colleague in distress and recommending the appropriate course of action. Embedded in a patient "sign-out" case, standardized health professionals (SHP) portrayed a resident with depressed mood and an underlying drinking problem. The SHP assessed intern skills in assessing symptoms and directing the resident to seek help. PROGRAM EVALUATION: Interns appreciated the opportunity to practice addressing this situation. Debriefing the case led to productive conversations between faculty and residents on available resources. Interns' skills require further development: while 60% of interns asked about their colleague's emotional state, only one-third screened for depression and just under half explored suicidal ideation. Only 32% directed the colleague to specific resources for his depression (higher among those that checked his emotional state, 54%, or screened for depression, 80%). DISCUSSION: This OSCE case identified varying intern skill levels for identifying and assessing a struggling colleague while also providing experiential learning and supporting a culture of addressing peer wellness.

Objective Structured Clinical Exams (OSCE) are a feasible method of teaching how to discuss a nonepileptic seizure diagnosis.

OBJECTIVE: Presenting the diagnosis of psychogenic nonepileptic seizures (PNES) can be a difficult task, but disclosing this information effectively is important to optimize patient outcomes. We sought to develop a standardized method to teach neurology residents how to introduce the diagnosis of PNES via an objective structured clinical examination (OSCE) with a standardized patient (SP). METHODS: In conjunction with the New York University School of Medicine Simulation Center (NYSIM), we designed an OSCE in which a resident had to inform a SP of her diagnosis of PNES and discuss a treatment plan. The SP was provided with details to gradually disclose depending on what the resident said about the history of her episodes, triggers for her episodes and her history of sexual abuse. Each encounter was observed by an attending physician who provided real-time feedback to the resident after the session. Additionally, the SP completed an objective written checklist of items the resident should have covered in the session and gave them verbal feedback. RESULTS: Twenty-six adult neurology (n = 22), child neurology (n = 3), and neuropsychiatry (n = 1) residents participated in this OSCE in 2018 and 2019, with full data available for 25 participants. Residents reported the OSCE was very useful (mean Likert score of 4.9/5). They felt moderately prepared (mean Likert score 3.8/5) and rated their performance as a mean of 3.3/5. On the SP's checklist, most residents were rated as Well Done in the domains of information gathering, relationship development, and education and counseling. Only in the domain of psychosocial assessment were most residents rated as Not Done (only 7/25 inquired about past trauma as a risk factor for PNES). SIGNIFICANCE: The OSCEs are a feasible and useful way to teach neurology residents about discussing PNES, as they allow for provision of real-time practice and feedback in a safe environment without real patients.

Assessment of Abilities of Gastroenterology Fellows to Provide Information to Patients With Liver Disease.

BACKGROUND & AIMS: Patient education is critical in ensuring patient compliance and good health outcomes. Fellows must be able to effectively communicate with their patients, delivering enough information for the patient to understand their medical problem and maximize patient compliance. We created an objective structured clinical examination (OSCE) with 4 liver disease cases to assess fellows' knowledge and ability to inform standardized patients (SPs) about their clinical condition. METHODS: We developed 4 cases highlighting different aspects of liver disease and created a 4-station OSCE: hepatitis B, acute hepatitis C, new diagnosis of cirrhosis, and an end-stage cirrhotic nontransplant candidate. The SP with hepatitis B was minimizing the fact that she could not read English. The acute hepatitis C SP was a nursing student who is afraid that having hepatitis C might jeopardize her career. The SP with the new diagnosis of alcoholic cirrhosis needed to stop drinking, and the end-stage liver disease patient had to grapple with his advanced directives. Twelve fellows from 4 GI training programs participated. Our focus was to assess the fellows' knowledge about liver diseases and the Accreditation Council for Graduate Medical Education competencies of health literacy, shared decision making, advanced directives, and goals of care. The goal for the fellows was to communicate effectively with the SPs, and acknowledge that each patient had an emotionally charged issue to overcome. The SPs used a checklist to rate fellows' performance. Faculty and the SPs observed the cases and provided feedback. The fellows were surveyed on their performance regarding the case. RESULTS: The majority of fellows were able to successfully summarize findings and discuss a plan with the patient in the new diagnosis of cirrhosis (76.92%) and hepatitis C case (100%), but were less successful in the hepatitis B case (30.77%) and the end-of-life case (41.67%). Overall, a small percentage of fellows reflected that they did a good job (22%-33%), except at the end-of-life case (67%). The fellows' greatest challenge was trying to cover a lot of information in a single outpatient visit. CONCLUSIONS: Caring for patients with liver diseases can be complex and time consuming. The patients and fellows' observations were discordant in several areas: for example, the fellows believed they excelled in the end-of-life case, but the SP thought only a small percentage of fellows were able to successfully summarize and discuss the plan. This discrepancy and others highlight important areas of focus in training programs. OSCEs are important to help the fellows facilitate striking the right balance of information delivery and empathy, and this will lead to better patient education, compliance, rapport, and satisfaction.

Using the Objective Structured Clinical Examination to Assess ACGME Competencies in Pediatric Gastroenterology Fellows.

BACKGROUND: The Accreditation Council for Graduate Medical Education has described 6 core competencies with which trainees should demonstrate proficiency. Using the Objective Structured Clinical Examination (OSCE), we aimed to assess 4 of these competencies among Pediatric Gastrointestinal (GI) fellows (PGs). METHODS: Eight first-year PGs from 6 medical centers in the New York area participated in a 4-station OSCE with trained standardized patient (SP) actors. The cases included an emergency department (ED) consult, or "ED Consult" for lower gastrointestinal bleeding; "Breaking Bad News" focusing on CF nutritional complications; "Second Opinion" for abdominal pain; "Transition of Care" for inflammatory bowel disease. At each station, attending faculty observed the encounters behind a 1-way mirror. SPs and faculties provided immediate feedback to the examined fellows. Previously validated OSCE checklists were used to assess performance. On completion, fellows attended debriefing sessions and completed surveys about the educational value. RESULTS: Median overall milestone competency scores were 6.9 (PC1), 4.8 (PC2), 5.9 (MK1), 5.7 (MK2), 6.4 (ICS1), 6.9 (Prof1), and 6.7 (Prof3). Overall, fellows score highest (7/9) on the inflammatory bowel disease "Transition of Care" case, found the "Breaking Bad News" Cystic Fibrosis OSCE to be the most challenging, and were most comfortable with the "ED Consult" OSCE, as a commonly encountered scenario. Overall, the fellows rated the educational value of the program highly. CONCLUSIONS: To our knowledge, although the OSCE has been validated in other medical fields, this is the first OSCE program developed for PGs fellows. These OSCEs have included Accreditation Council for Graduate Medical Education competencies, serving to assess fellows' skills in these areas while exposing them to challenging medical and psychosocial cases that they may not frequently encounter.