Standardizing Quality of Virtual Urgent Care: Using Standardized Patients in a Unique Experiential Onboarding Program.

Introduction: Virtual urgent care (VUC) provides real-time evaluation, triage, and treatment of low-acuity medical problems; however, VUC physicians have varying levels of telemedicine training. We created a workplace-based experiential onboarding program that deployed standardized patients (SPs) into a VUC clinic to evaluate and deliver feedback to independently practicing physicians, providing quality assurance and identifying areas for improvement. Methods: We simulated evaluation of an adult with upper respiratory symptoms. To replicate a real-life encounter, we developed a mock electronic medical entry with demographic and medical information and scheduled SPs into the clinic's actual patient queue. SPs provided seamless, realistic training within the real-world virtual clinic environment. Using an adapted assessment tool anchored to not done, partly done, or well done, SPs evaluated communication, disease-specific, and telemedicine skills by observing behaviors. We surveyed participants to evaluate the program. Results: Twenty-one physicians participated. All performed well in core communication and disease management domains. Ninety-three percent of behaviors (SD = 11%) were rated well done within the information gathering domain, 90% (SD = 8%) within relationship development, and 95% (SD = 5%) within disease management. Physicians struggled with telemedicine-specific skills-55% (SD = 38%) well done-and education and counseling-32% (SD = 34%) well done-highlighting specific behaviors most ripe for improvement. All queried participants indicated that this simulation improved communication and telemedicine skills. Discussion: This workplace-based experiential onboarding program uncovered knowledge gaps within telemedicine skills and patient education domains. Identification of these gaps can help drive new virtual care curricula.

The OSPE.

OBJECTIVES: Resident assessment tends to consist of multiple-choice examinations, even in nuanced areas, such as quality assurance. Internal medicine and many other specialties use objective structured clinical examinations, or OSCEs, to evaluate residents. We adapted the OSCE for pathology, termed the Objective Structured Pathology Examination (OSPE). METHODS: The OSPE was used to evaluate first- and second-year residents over 2 years. The simulation included an anatomic pathology sign-out session, where the resident could be evaluated on diagnostic skills and knowledge of key information for cancer staging reports, as well as simulated frozen-section analysis, where the resident could be evaluated on communication skills with a "surgeon." The OSPE also included smaller cases with challenging quality issues, such as mismatched slides or gross description irregularities. All cases were scored based on the Pathology Milestones created by the Accreditation Council for Graduate Medical Education. RESULTS: Using this OSPE, we were able to demonstrate that simulated experiences can be an appropriate tool for standardized evaluation of pathology residents. CONCLUSIONS: Yearly evaluation using the OSPE could be used to track the progress of both individual residents and the residency program as a whole, identifying problem areas for which further educational content can be developed.

The COVID-19 Army: Experiences From the Deployment of Non-Hospitalist Physician Volunteers During the COVID-19 Pandemic.

OBJECTIVE: New York City was the epicenter of the outbreak of the 2019 coronavirus disease (COVID-19) pandemic in the United States. As a large, quaternary care medical center, NYU Langone Medical Center was one of many New York medical centers that experienced an unprecedented influx of patients during this time. Clinical leadership effectively identified, oriented, and rapidly deployed a "COVID Army," consisting of non-hospitalist physicians, to meet the needs of the patient influx. We share feedback from our providers on our processes and offer specific recommendations for systems experiencing a similar influx in the current and future pandemics. METHODS: To assess the experiences and perceived readiness of these physicians (n = 183), we distributed a 32-item survey between March and June of 2020. Thematic analyses and response rates were examined to develop results. RESULTS: Responses highlighted varying experiences and attitudes of our frontline physicians during an emerging pandemic. Thematic analyses revealed a series of lessons learned, including the need to (1) provide orientations, (2) clarify roles/workflow, (3) balance team workload, (4) keep teams updated on evolving policies, (5) make team members feel valued, and (6) ensure they have necessary tools available. CONCLUSIONS: Lessons from our deployment and assessment are scalable at other institutions.

The TeleHealth OSCE: Preparing Trainees to Use Telemedicine as a Tool for Transitions of Care.

BACKGROUND: Telemedicine holds promise to bridge the transition of care between inpatient and outpatient settings. Despite this, the unique communication and technical skills required for virtual encounters are not routinely taught or practiced in graduate medical education (GME) programs. OBJECTIVE: To develop an objective structured clinical examination (OSCE) case to assess residents' telemedicine-specific skills and identify potential gaps in our residency program's curriculum. METHODS: As part of a multi-station OSCE in 2019, we developed a case simulating a remote encounter between a resident and a recently discharged standardized patient. We developed an assessment tool comprising specific behaviors anchored to "not done," "partly done," and "well done" descriptors to evaluate core communication and telemedicine-specific skills. RESULTS: Seventy-eight NYU internal medicine residents participated in the case. Evaluations from 100% of participants were obtained. Residents performed well in Information Gathering and Relationship Development domains. A mean 95% (SD 3.3%) and 91% (SD 4.9%) of residents received "well done" evaluations across these domains. A mean 78% (SD 14%) received "well done" within Education/Counseling domain. However, only 46% (SD 45%) received "well done" evaluations within the Telemedicine domain; specific weak areas included performing a virtual physical examination (18% well done) and leveraging video to augment history gathering (17% well done). There were no differences in telemedicine-specific skill evaluations when stratified by training track or postgraduate year. CONCLUSIONS: We simulate a post-discharge virtual encounter and present a novel assessment tool that uncovers telemedicine-specific knowledge gaps in GME trainees.

Clinical problem solving and social determinants of health: a descriptive study using unannounced standardized patients to directly observe how resident physicians respond to social determinants of health.

Objectives While the need to address patients' social determinants of health (SDoH) is widely recognized, less is known about physicians' actual clinical problem-solving when it comes to SDoH. Do physicians include SDoH in their assessment strategy? Are SDoH incorporated into their diagnostic thinking and if so, do they document as part of their clinical reasoning? And do physicians directly address SDoH in their "solution" (treatment plan)? Methods We used Unannounced Standardized Patients (USPs) to assess internal medicine residents' clinical problem solving in response to a patient with asthma exacerbation and concern that her moldy apartment is contributing to symptoms - a case designed to represent a clear and direct link between a social determinant and patient health. Residents' clinical practices were assessed through a post-visit checklist and systematic chart review. Patterns of clinical problem solving were identified and then explored, in depth, through review of USP comments and history of present illness (HPI) and treatment plan documentation. Results Residents fell into three groups when it came to clinical problem-solving around a housing trigger for asthma: those who failed to ask about housing and therefore did not uncover mold as a potential trigger (neglectors ­ 21%; 14/68); those who asked about housing in negative ways that prevented disclosure and response (negative elicitors ­ 23%, 16/68); and those who elicited and explored the mold issue (full elicitors ­ 56%; 38/68) [corrected]. Of the full elicitors 53% took no further action, 26% only documented the mold; and 21% provided resources/referral. In-depth review of USP comments/explanations and residents' notes (HPI, treatment plan) revealed possible influences on clinical problem solving. Failure to ask about housing was associated with both contextual factors (rushed visit) and interpersonal skills (not fully engaging with patient) and with possible differences in attention ("known" vs. unknown/new triggers, usual symptoms vs. changes, not attending to relocation, etc.,). Use of close-ended questions often made it difficult for the patient to share mold concerns. Negative responses to sharing of housing information led to missing mold entirely or to the patient not realizing that the physician agreed with her concerns about mold. Residents who fully elicited the mold situation but did not take action seemed to either lack knowledge or feel that action on SDoH was outside their realm of responsibility. Those that took direct action to help the patient address mold appeared to be motivated by an enhanced sense of urgency. Conclusions Findings provide unique insight into residents' problem solving processes including external influences (e.g., time, distractions), the role of core communication and interpersonal skills (eliciting information, creating opportunities for patients to voice concerns, sharing clinical thinking with patients), how traditional cognitive biases operate in practice (premature closure, tunneling, and ascertainment bias), and the ways in which beliefs about expectancies and scope of practice may color clinical problem-solving strategies for addressing SDoH.

When surgeons decide to become surgeons: new opportunities for surgical education.

BACKGROUND: When surgeons decide to become surgeons has important implications. If the decision is made prior to or early in medical school, surgical education can be more focused on surgical diseases and resident skills. METHODS: To determine when surgeons - compared with their nonsurgical colleagues - decide on their medical path, residents in surgery, internal medicine, obstetrics and gynecology, pediatrics, psychiatry, and emergency medicine were surveyed. Timing of residency choice, demographic data, personal goals, and reason for residency choice were queried. RESULTS: A total of 234 residents responded (53 surgical residents). Sixty-two percent of surgeons reported that they were "fairly certain" of surgery before medical school, 13% decided during their preclinical years, and 25% decided during their clerkship years. This compares with an aggregate 40%, 7%, and 54%, respectively, for the other 5 residency specialties. These differences were statistically significant (P = .001). When the 234 residents were asked about their primary motivation for choosing their field, 51% pointed to expected job satisfaction and 44% to intellectual curiosity, and only 3% mentioned lifestyle, prestige, or income. CONCLUSIONS: General surgery residents decide on surgery earlier than residents in other programs. This may be advantageous, resulting in fast-tracking of these medical students in acquiring surgical knowledge, undertaking surgical research, and early identification for surgical residency programs. Surgical training in the era of the 80-hour work week could be enhanced if medical students bring much deeper knowledge of surgery to their first day of residency.

A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

OBJECTIVES: Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. METHODS: Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. RESULTS: Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. CONCLUSIONS: Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers.

The stress of residency: recognizing the signs of depression and suicide in you and your fellow residents.

BACKGROUND: Stress, depression, and suicide are universal but frequently unrecognized issues for women and men in residency training. Stress affects cognitive and psychomotor performance both inside and outside of the operating room. Stress impairs the 2 key components of a surgeon's responsibilities: intellectual judgment and technical skill. We hypothesized that the recognition of depression, substance abuse, failing personal relationships, and potential suicide is poor among surgeons. If residents can recognize the signs of stress, depression, and suicide among colleagues, we believe it will not only improve their quality of life but also may preserve it. METHODS: We first determined baseline resident knowledge of the signs of surgical stress including fatigue; burn out; depression; physician suicide; drug and alcohol abuse; and their effects on family, friends, and relationships. We then developed a curriculum to identify these signs in first, second, third, and fourth year surgical residents were identified as the target learners. The major topics discussed were depression; physician suicide; drug and alcohol abuse; and the effects of stress on family, friends, and our goals. Secondary objectives included identifying major sources of stress, general self-awareness, understanding professional choices, and creating a framework to manage stress. Residents participated in an interactive seminar with a surgical facilitator. Before and after the seminar, a multiple-choice test was administered with questions to assess knowledge of the signs of stress (eg, fatigue, burn out, and depression). RESULTS: Twenty-one residents participated in this study. Seventeen completed the pretest, and 21 participated in the interactive seminar and completed the post-test. The pretest revealed that surgical residents were correct in 46.8% (standard deviation [SD] = 25.4%) of their responses. The postseminar test showed an improvement to 89.7% (SD = 6.1%, P < .001, paired Student t test = 5.37). The same test administered 4 months later to 17 of the 21 learners revealed 76.9% (SD = 18.7%) correct answers, suggesting that the information had been internalized. Cronbach α was calculated to be .67 for the pretest and .76 for the post-test, suggesting a moderate to high degree of internal consistency. CONCLUSIONS: Stress is a significant and regularly overlooked component of a surgeon's life. Because its effects often go unrecognized, stress frequently remains unresolved. To prevent its associated consequences such as depression, substance abuse, divorce, and suicide, educating house staff about stress is crucial. This study suggests that the symptoms, causes, and treatment of stress among surgeons can be taught effectively to surgical resident learners.

The impact of primary care resident physician training on patient weight loss at 12 months.

OBJECTIVE: It is unclear whether training physicians to counsel obese patients leads to weight loss. This study assessed whether a 5-h multimodal longitudinal obesity curriculum for residents on the basis of the 5As (assess, advise, agree, assist, and arrange) was associated with weight loss in their obese patients. DESIGN AND METHODS: Twenty-three primary care internal medicine residents were assigned by rotation schedule to intervention (curriculum) or control groups. We then conducted follow-up chart reviews to determine weight change at up to 12 months following the index visit. 158 obese patients (76 in the intervention group and 82 in the control group) completed exit interviews; 22 patients who presented for acute care at the index visit were excluded. Chart reviews were conducted on the 46 patients in the intervention group and 41 patients in the control group who were seen again within 12 months of the index visit and had follow-up weight measurements. RESULTS: The main outcome of interest was mean change in weight at 12 months compared between the intervention and control groups. Patients of residents in the intervention group had a mean weight loss of -1.53 kg (s.d. = 3.72) although the patients of those in the control group had a mean weight gain of 0.30 kg (s.d. = 3.60), P = 0.03. Six (15.8%) patients in the intervention group and 2 (5.4%) patients in the control group lost >5% body weight (P = 0.14). CONCLUSIONS: Although the magnitude of weight loss was small, this study shows that training physicians to counsel patients can produce measurable patient outcomes.

The professionalism curriculum as a cultural change agent in surgical residency education.

BACKGROUND: Teaching professionalism effectively to fully engaged residents is a significant challenge. A key question is whether the integration of professionalism into residency education leads to a change in resident culture. METHODS: The goal of this study was to assess whether professionalism has taken root in the surgical resident culture 3 years after implementing our professionalism curriculum. Evidence was derived from 3 studies: (1) annual self-assessments of the residents' perceived professionalism abilities to perform 20 defined tasks representing core Accrediting Council on Graduate Medical Education professionalism domains, (2) objective metrics of their demonstrated professionalism skills as rated by standardized patients annually using the objective structure clinical examination tool, and (3) a national survey of the Surgical Professionalism and Interpersonal Communications Education Study Group. RESULTS: Study 1: aggregate perceived professionalism among surgical residents shows a statistically significant positive trend over time (P = .016). Improvements were seen in all 6 domains: accountability, ethics, altruism, excellence, patient sensitivity, and respect. Study 2: the cohort of residents followed up over 3 years showed a marked improvement in their professionalism skills as rated by standardized patients using the objective structure clinical examination tool. Study 3: 41 members of the national Surgical Professionalism and Interpersonal Communications Education Study Group rated their residents' skills in admitting mistakes, delivering bad news, communication, interdisciplinary respect, cultural competence, and handling stress. Twenty-nine of the 41 responses rated their residents as "slightly better" or "much better" compared with 5 years ago (P = .001). Thirty-four of the 41 programs characterized their department's leadership view toward professionalism as "much better" compared with 5 years ago. CONCLUSIONS: All 3 assessment methods suggest that residents feel increasingly prepared to effectively deal with the professionalism challenges they face. Although professionalism seminars may have seemed like an oddity several years ago, residents today recognize their importance and value their professionalism skills. As importantly, department chairpersons report that formal professionalism education for residents is viewed more favorably compared with 5 years ago.

Perspective: Malpractice in an academic medical center: a frequently overlooked aspect of professionalism education.

Understanding how medical malpractice occurs and is resolved is important to improving patient safety and preserving the viability of a physician's career in academic medicine. Every physician is likely to be sued by a patient, and how the physician responds can change his or her professional life. However, the principles of medical malpractice are rarely taught or addressed during residency training. In fact, many faculty at academic medical centers know little about malpractice.In this article, the authors propose that information about the inciting causes of malpractice claims and their resolution should be incorporated into residency professionalism curricula both to improve patient safety and to decrease physician anxiety about a crucial aspect of medicine that is not well understood. The authors provide information on national trends in malpractice litigation and residents' understanding of malpractice, then share the results of their in-depth review of surgical malpractice claims filed during 2001-2008 against their academic medical center. The authors incorporated those data into an evidence-driven curriculum for residents, which they propose as a model for helping residents better understand the events that lead to malpractice litigation, as well as its process and prevention.

New measures to establish the evidence base for medical education: identifying educationally sensitive patient outcomes.

Researchers lack the rich evidence base and benchmark patient outcomes needed to evaluate the effectiveness of medical education practice and guide policy. The authors offer a framework for medical education research that focuses on physician-influenced patient outcomes that are potentially sensitive to medical education. Adapting the concept of ambulatory care sensitive conditions, which provided traction to health services research by defining benchmark patient outcomes to measure health system performance, the authors introduce the concept and propose the adoption of educationally sensitive patient outcomes and suggest two measures: patient activation and clinical microsystem activation. They assert that the ultimate goal of medical education is to ensure that measurement of future physicians' competence and skills is based not only on biomedical knowledge and critical clinical skills but also on the ability to translate these competencies into effective patient- and systems-level outcomes. The authors consider methodological approaches and challenges to measuring such outcomes and argue for large, multiinstitutional, prospective cohort studies and the development of a national Database for Research in Education in Academic Medicine to provide the needed infrastructure. They advocate taking the next steps to establish an educational evidence base to guide the academic medical centers of the 21st century in aligning medical education practice with health care delivery that meets the needs of individuals and populations.

Two decades of Title VII support of a primary care residency: process and outcomes.

PURPOSE: To assess 23 years of Health Resources and Services Administration (HRSA) Title VII Training in Primary Care Medicine and Dentistry funding to the New York University School of Medicine/Bellevue Primary Care Internal Medicine Residency Program. The program, begun in 1983 within a traditional, inner-city, subspecialty-oriented internal medicine program, evolved into a crucible of systematic innovation, catalyzed and made feasible by initiatives funded by the HRSA. The curriculum stressed three pillars of generalism: psychosocial medicine, clinical epidemiology, and health policy. It developed tight, objectives-driven, effective, nonmedical specialty blocks and five weekly primary care activities that created a paradigm-driven, community-based, role-modeling matrix. Innovation was built in. Every block and activity was evaluated immediately and in an annual, program-wide retreat. Evaluation evolved from behavioral checklists of taped interviews to performance-based, systematic, annual objective structured clinical examinations. METHOD: The authors reviewed eight grant proposals, project reports, and curriculum and program evaluations. They also quantitatively and qualitatively surveyed the 122 reachable graduates from the first 20 graduating classes of the program. RESULTS: Analysis of program documents revealed recurring emphases on the use of proven educational models, strategic innovation, and assessment and evaluation to design and refine the program. There were 104 respondents (85%) to the survey. A total of 87% of the graduates practice as primary care physicians, 83% teach, and 90% work with the underserved; 54% do research, 36% actively advocate on health issues for their patients, programs, and other constituencies, and 30% publish. Graduates cited work in the community and faculty excitement and energy as essential elements of the program's impact; overall, graduates reported high personal and career satisfaction and low burnout. CONCLUSIONS: With HRSA support, a focused, innovative program evolved which has already met each of the six recommendations for future innovation of the Alliance for Academic Internal Medicine Education Redesign Task Force. This article is part of a theme issue of Academic Medicine on the Title VII health professions training programs.