Beyond multiple choice: Clinical simulation as a rigorous and inclusive method for assessing genetic counseling competencies.

Educational use of clinical simulation is a way for students to immerse themselves within a realistic yet safe and structured environment as they practice clinical skills. It is widely used in healthcare training and evaluation, and there are best practices for design, implementation, debriefing, and assessment. An increasing number of genetic counseling graduate programs use simulation in various ways, ranging from role-plays to working with professional simulated/standardized patient (SP) actors. At this time, there is very little consistency across programs, research on the approaches, and standards by which simulation is incorporated into training. Simulation is an understudied but promising approach for genetic counselor (GC) education and assessment. After graduation, GCs demonstrate their competence as entry-level providers through American Board of Genetic Counseling (ABGC) multiple-choice examination (MCE), along with their participatory clinical encounters from graduate training. Data from genetic counseling and other professions highlight the limitations and biases of MCEs, suggesting they not only fail to accurately capture competency, but also that they disadvantage underrepresented individuals from entering the field. In addition, MCEs are limited as a tool for assessing nuanced counseling and communication skills, as compared to more quantitative scientific knowledge. We propose that innovative, evidence-based approaches such as simulation have the potential to not only enhance learning, but also to allow GCs to better demonstrate competency during training and in relation to the board examination. Collaborative approaches, research, and funding are needed to further explore the viability of routinely incorporating simulation into GC training and assessment.

Faculty standardized patients versus traditional teaching method to improve clinical competence among traditional Chinese medicine students: a prospective randomized controlled trial.

BACKGROUND: Standardized patients (SPs) simulation training models have been widely used in various fields, the study of using SPs in Traditional Chinese medicine (TCM) is still a new filed. Previous studies have demonstrated the effectiveness of occupational SP for TCM (OSP-TCM), which has an increasingly problem of high time and financial costs. The faculty SPs for TCM (FSP-TCM) simulation training model may provide a better alternative. This study aims to test and determine whether FSP-TCM simulations are more cost-effective than OSP-TCM and traditional educational models to improve the clinical competence of TCM students. METHODS: This study was a single-blind, prospective, randomized controlled trial conducted between February 2023 and October 2023. The participants were randomized into FSP-TCM group, OSP-TCM group and traditionally taught group (TT group) in the ratio of 1:1:1. The duration of this training program was 12 weeks (36 credit hours). Formative and summative assessments were integrated to evaluate the effectiveness of teaching and learning. Three distinct questionnaires were utilized to collect feedback from students, SPs, and teachers at the conclusion of the course. Additionally, analysis of cost comparisons between OSP-TCM and FSP-TCM were performed in the study. RESULTS: The study comprised a total of 90 students, with no dropouts during the research. In the formative evaluation, students assigned to both the FSP-TCM and OSP-TCM groups demonstrated higher overall scores compared to those in the TT group. Notably, their performance in "physical examination" (Pa = 0.01, Pb = 0.04, Pc = 0.93) and "comprehensive ability" (Pa = 0.01, Pb = 0.006, Pc = 0.96) significantly exceeded that of the TT group. In the summary evaluation, both SP-TCM groups students outperforms TT group in the online systematic knowledge test (Pa = 0.019, Pb = 0.04, Pc = 0.97), the application of TCM technology (Pa = 0.01, Pb = 0.03, Pc = 0.93) and real-time assessment (Pa= 0.003, Pb = 0.01, Pc = 0.93). The feedback questionnaire demonstrated that both SP-TCM groups showed higher levels of agreement for this course in "satisfaction with the course" (Pa = 0.03; Pb = 0.02) and "enhanced TCM clinical skills" (Pa = 0.02; Pb = 0.03) than TT group. The SP questionnaire showed that more FSPs than OSPs in "provided professional feedback" (FSPs: strongly agree 30%, agree 50% vs. OSPs: strongly agree 20%, agree 40%. P = 0.69), and in "gave hints" during the course (FSPs: strongly agree 10%, agree 30% vs. OSPs: strongly agree 0%, agree 10%. P = 0.42). It is noteworthy that FSP-TCM was significantly lower than the OSP-TCM in overall expense (FSP-TCM $7590.00 vs. OSP-TCM $17415.60), and teachers have a positive attitude towards the FSP-TCM. CONCLUSION: FSP-TCM training mode showed greater effectiveness than traditional teaching method in improving clinical competence among TCM students. It was feasible, practical, and cost-effective, and may serve as an alternative method to OSP-TCM simulation.

Virtual patients versus standardized patients for improving clinical reasoning skills in ophthalmology residents. A randomized controlled trial.

BACKGROUND: History taking and clinical reasoning are important skills that require knowledge, cognition and meta-cognition. It is important that a trainee must experience multiple encounters with different patients to practice these skills. However, patient safety is also important, and trainees are not allowed to handle critically ill patients. To address this issue, a randomized controlled trial was conducted to determine the effectiveness of using Virtual Patients (VP) versus Standardized Patients (SP) in acquiring clinical reasoning skills in ophthalmology postgraduate residents. METHODS: Postgraduate residents from two hospitals in Lahore, Pakistan, were randomized to either the VP group or the SP group and were exposed to clinical reasoning exercise via the VP or SP for 30 min after the pretest. This was followed by a posttest. One month after this activity, a follow-up posttest was conducted. The data were collected and analysed using IBM-SPSS version 25. Repeated measures ANOVA was used to track the effect of learning skills over time. RESULTS: The mean age of the residents was 28.5 ± 3 years. The male to female ratio was 1:1.1. For the SP group, the mean scores were 12.6 ± 3.08, 16.39 ± 3.01 and 15.39 ± 2.95, and for the VP group, the mean scores were 12.7 ± 3.84, 16.30 ± 3.19 and 15.65 ± 3.18 for the pretest, posttest and follow-up posttest, respectively (p value < 0.00). However, the difference between the VP and SP groups was not statistically significant (p = 0.896). Moreover, there was no statistically significant difference between the VP and SP groups regarding the retention of clinical reasoning ability. In terms of learning gain, compared with the VP group, the SP group had a score of 51.46% immediately after clinical reasoning exercise as compared to VP group, in which it was 49.1%. After one month, it was 38.01 in SP and 40.12% in VP group. CONCLUSION: VPs can be used for learning clinical reasoning skills in postgraduate ophthalmology residents in a safe environment. These devices can be used repeatedly without any risk to the real patient. Although similarly useful, SP is limited by its nonavailability for repeated exercises.

Standardized patients' experience of participating in medical students' education: a qualitative content analysis.

BACKGROUND: Standardized patients are considered a significant educational method in medical sciences and have been successfully employed for many years. This study was conducted with the aim of explaining the experience of standardized patients participating in the education of medical student. METHOD: A qualitative content analysis approach was used. This study was conducted at Standardized Patient Center, Tehran University of Medical Sciences, Tehran, Iran, May to February 2022. Fifteen standard patients were selected through purposive sampling with maximum variation. Semi-structured, in-depth, face-to-face interviews were conducted with standard patients. The average duration of the interviews was 60 to 90 min. Data were transcribed and analyzed using the Graneheim and Lundman approach. RESULTS: A passport for the future and duality of feelings were the two main themes identified in this study with six subthemes. One of the main themes was passport for the future with subthemes creative, participation in educating future generation, reflection and another theme was duality of feeling with subthemes feeling of value, guilty conscience, and fear of judgment by others. CONCLUSION: The participants expressed having mixed feelings about their role as standard patients. They felt conflicted because they were compensated for their participation, which made them worry about being judged by others and feel guilty about taking the fee. Therefore, it is recommended to conduct further studies in this area.

Interprofessional Ethics Simulations and Debriefing to Develop Collaborative Skills.

The Interprofessional Education Collaborative's (IPEC's) core competencies are accreditation standards of most, if not all, healthcare professions (Interprofessional Education Collaborative Expert Panel [2016, Core Competencies for Interprofessional Collaborative Practice: 2016 Update. Washington, DC: IPEC]). Limited literature exists on interprofessional (IP) learning outcomes in healthcare ethics; even fewer studies include debrief sessions. Interprofessional education (IPE) case discussion using web-based technology is a promising way to incorporate ethics content. This article summarizes a model for healthcare programs to create, conduct, and assess synchronous IPE ethics discussions and debrief sessions. Specifically, this article highlights debrief sessions that followed a standardized patient (SP) IP interaction with students from pharmacy and advanced practice nursing. Qualitative analysis of debrief comments identified four themes: the benefit of IP collaboration, the importance of patient-centered care, the need to adapt clinical recommendations with ethical challenges, and the importance of trust among team members. The findings indicate web-based, synchronous IP/SP ethics simulations and debrief sessions are an effective, albeit laborious, method for collaboration and reflection.

Directly Observed Care: Crossing the Chasm of Quality Measurement.

After more than two decades of national attention to quality improvement in US healthcare, significant gaps in quality remain. A fundamental problem is that current approaches to measure quality are indirect and therefore imprecise, focusing on clinical documentation of care rather than the actual delivery of care. The National Academy of Medicine (NAM) has identified six domains of quality that are essential to address to improve quality: patient-centeredness, equity, timeliness, efficiency, effectiveness, and safety. In this perspective, we describe how directly observed care-a recorded audit of clinical care delivery-may address problems with current quality measurement, providing a more holistic assessment of healthcare delivery. We further show how directly observed care has the potential to improve each NAM domain of quality.

Acceptability of an online communication training intervention for genetic counseling students.

Technology provides opportunities to enhance communication skills training for genetic counseling graduate students. We assessed the acceptability of an online communication training program. Graduate student volunteers completed five online training modules on basic communication skills with opportunities to practice the skills within three simulated/standardized patient (SP) sessions. Participants completed online questionnaires reporting on acceptability, perceived usefulness, and realism of the modules and SP sessions. They also reported on the ease of transferring skills from the modules to clinical practice. Out of the 60 students who completed the baseline session, 35 (58%) completed all five training modules. Out of these 35 students, most found the modules to be useful (94%) and agreed that they were relevant to clinical practice (97%). At least 88% of participants found the genetic counselors, patient, and case scenarios to be realistic. Twenty-eight students had participated in clinical rotations since completing the intervention. Of these, 17 (61%) reported that it was at least slightly easy to use the skills in actual clinical cases. Most students also reported being able to transfer the skills they had learned into clinical practice. While the training was well-received, the relatively low completion rate of 58% raises concern that the intervention may need formal integration into the program curriculum to succeed due to the time and effort demands on students.

Virtual Standardized Patients Versus Traditional Academic Training for Improving Clinical Competence Among Traditional Chinese Medicine Students: Prospective Randomized Controlled Trial.

BACKGROUND: The practical training course of internal medicine of traditional Chinese medicine (PTC-IMTCM) is primarily based on traditional case teaching, which can be stressful for teachers. The use of virtual standardized patient (VSP) applications could be an alternative; however, there is limited evidence regarding their feasibility and effectiveness. OBJECTIVE: This study aimed to build a VSP-TCM application according to the characteristics of PTC-IMTCM and the needs of students and to compare its efficacy with that of traditional teaching in improving TCM clinical competence among students. METHODS: A prequestionnaire investigation was conducted before the course, and a VSP-TCM system was developed based on the results of the questionnaire. A randomized controlled trial was then conducted between February 26, 2020, and August 20, 2021. A total of 84 medical students were included and were divided into 2 groups: an observation group, trained with VSP-TCM (n=42, 50%), and a control group, trained with traditional academic training (n=42, 50%). Formative and summative assessments were conducted to evaluate teaching effectiveness. After completing the course, the students were administered a questionnaire to self-assess their satisfaction with the course. A questionnaire was also administered to 15 teachers to uncover their perspectives on VSP-TCM. RESULTS: All participants completed the study. In the formative assessment, the VSP-TCM group performed better in medical interviewing ability (mean 7.19, SD 0.63, vs mean 6.83, SD 0.81; P=.04), clinical judgment (mean 6.48, SD 0.98, vs mean 5.86, SD 1.04; P=.006), and comprehensive ability (mean 6.71, SD 0.59, vs mean 6.40, SD 0.58; P=.02) than the control group. Similarly, in the summative evaluation, the VSP-TCM group performed better in the online systematic knowledge test (OSKT; mean 86.62, SD 2.71, vs mean 85.38, SD 2.62; P=.046), application of TCM technology (mean 87.86, SD 3.04, vs mean 86.19, SD 3.08; P=.02), TCM syndrome differentiation and therapeutic regimen (mean 90.93, SD 2.42, vs mean 89.60, SD 2.86; P=.03), and communication skills (mean 90.67, SD 4.52, vs mean 88.24, SD 4.56; P=.02) than the control group. There was no significant difference in medical writing between both groups (mean 75.07, SD 3.61, vs mean 75.71, SD 2.86; P=.37). The postcourse feedback questionnaire indicated that VSP-TCM can better enhance students' TCM thinking ability (n=39, 93%, vs n=37, 88%; P=.002), medical history collection (n=38, 90%, vs n=30, 72; P=.001), syndrome differentiation and treatment and critical thinking (n=38, 90%, vs n=37, 88%; P=.046), comprehensive clinical application ability (n=40, 95%, vs n=36, 86%; P=.009), interpersonal communication skills (n=36, 86%, vs n=28, 67%; P=.01), and autonomous learning ability (n=37, 88%, vs n=28, 67%; P=.01) than traditional academic training. Similarly, the teachers held a positive perspective on VSP-TCM. CONCLUSIONS: VSP-TCM enhances students' TCM clinical competence and dialectical thinking and improves their ability to work autonomously. Moreover, the VSP-TCM system is feasible, practical, and cost-effective and thus merits further promotion in TCM education.

Prior participation as a standardized patient improves OSCE scores of third-year medical students: A pilot comparative study at Université Paris Cité Medical School.

OBJECTIVE: Objective structured clinical examinations (OSCE) are one of the main modalities of skills' assessment of medical students. We aimed to evaluate the educational value of the participation of third-year medical students in OSCE as standardized patients. METHODS: We conducted a pilot OSCE session where third-year students participated in sixth-year students' OSCE as standardized patients (cases). Their scores in their own subsequent OSCE exams were compared with third-year students who had not participated (controls). Students' perceptions (stress, preparedness, ease) regarding their OSCE were compared with self-administered questionnaires. RESULTS: A total of 42 students were included (9 cases and 33 controls). Median [IQR] overall score (out of 20 points) obtained by the cases was 17 [16.3-18] versus 14.5 [12.7-16.3] for controls (p < 0.001). Students' perception of their evaluation (difficulty, stress, communication) was not significantly different between cases and controls. Most cases agreed that their participation was beneficial in reducing their stress (67%), increasing their preparedness (78%) and improving their communication skills (100%). All cases agreed that this participation should be offered more widely. CONCLUSION: Students' participation in OSCE as standardized patients led to better performance on their own OSCE and were considered beneficial. This approach could be more broadly generalized to improve student performance.

Learning patient-centredness with simulated/standardized patients: A realist review: BEME Guide No. 68.

BACKGROUND: Given the positive outcomes of patient-centred care on health outcomes, future doctors should learn how to deliver patient-centred care. The literature describes a wide variety of educational interventions with standardized patients (SPs) that focus on learning patient-centredness. However, it is unclear which mechanisms are responsible for learning patient-centredness when applying educational interventions with SPs. OBJECTIVE: This study aims to clarify how healthcare learners and professionals learn patient-centredness through interventions involving SPs in different healthcare educational contexts. METHODS: A realist approach was used to focus on what works, for whom, in what circumstances, in what respect and why. Databases were searched through 2019. Nineteen papers were included for analysis. Through inductive and deductive coding, CIC'MO configurations were identified to build partial program theories. These CIC'MOs describe how Interventions with SPs change the Context (C→C') such that Mechanisms (M) are triggered that are expected to foster patient-centredness as Outcome. RESULTS: Interventions with SPs create three contexts which are 'a safe learning environment,' 'reflective practice,' and 'enabling people to learn together.' These contexts trigger the following seven mechanisms: feeling confident, feeling a sense of comfort, feeling safe, self-reflection, awareness, comparing & contrasting perspectives, combining and broadening perspectives. A tentative final program theory with mechanisms belonging to three main learning components (cognitive, regulative metacognitive and affective) is proposed: Interventions with SPs create a safe learning environment (C') in which learners gain feelings of confidence, comfort and safety (affective M). This safe learning environment enables two other mutual related contexts in which learners learn together (C'), through comparing & contrasting, combining and broadening their perspectives (cognitive M) and in which reflective practice (C') facilitates self-reflection and awareness (metacognitive M) in order to learn patient-centeredness. CONCLUSION: These insights offer educators ways to deliberately use interventions with SPs that trigger the described mechanisms for learning patient-centredness.

Student standardized patients versus occupational standardized patients for improving clinical competency among TCM medical students: a 3-year prospective randomized study.

BACKGROUND: Standardized patient (SP) simulations are well-recognized patterns for practicing clinical skills and interactions. Our previous study showed that a simulation program using occupational SP for Traditional Chinese Medicine (OSP-TCMs) was efficient, however, a high cost and time-intensive nature have limited its use. TCM postgraduates trained as student SPs (SSP-TCMs) present a potentially cost-effective alternative. The purpose of this study was to examine and determine whether SSP simulation offered more benefits over didactic training alone for improving clinical competency among TCM medical students, and conduct a multifaceted analysis comparing SSP-TCMs and OSP-TCMs. METHODS: This was a prospective, single-blinded, randomized controlled trial. Fourth-year TCM undergraduates were recruited as trainees from the Clinical Medical School, Chengdu University of TCM. Data were collected from September 2018 to December 2020. Trainees were randomly divided into the three following groups: traditional method training group, OSP-TCM training group, and SSP-TCM training group (1:1:1). At the end of a 10-week curriculum, trainees received a two-station examination comprising a systematic online knowledge test and an offline clinical performance examination. Post-training and post-exam questionnaires were administered to collect feedback from these trainees. RESULTS: Students assigned to the SSP-TCM training and OSP-TCM training groups received favorable marks for the "systematic knowledge test" and "TCM clinical skills" (2018, Pa=0.018, Pb=0.042; 2019, Pa=0.01, Pb=0.033; 2020, Pa=0.035, Pb=0.039) compared to the TM trainees. Additionally, trainees in the intervention groups demonstrated a positive post-training edge in scores of "medical records" (2018, Pa=0.042, Pb=0.034; 2019, Pa=0.032, Pb=0.042; 2020, Pa=0.026, Pb=0.03) and "TCM syndrome differentiation and therapeutic regimen" (2018, Pb=0.032; 2019, Pa=0.037, Pb=0.024; 2020, Pa=0.036, Pb=0.043). For the simulation encounter assessment given by SP-TCMs, OSP-TCM trainees and SSP-TCM trainees scored higher than TM trainees (2018, Pa=0.038, Pb=0.037; 2019, Pa=0.024, Pb=0.022; 2020, Pa=0.019, Pb=0.021). For the feedback questionnaires, the students in TM group provided less positive feedback for training efficacy and test performance compared to those in the SSP-TCM and OSP-TCM groups. The trainees responded that the training effect of clinical simulations was similar between the SSP-TCM and OSP-TCM groups. SSP-TCMs were more responsive to unexpected emergencies (Pa=0.022, Pb>0.05) and more likely to encourage questioning (Pa=0.029, Pb>0.05) but tended to provide implied hints (Pc=0.015) and utilize medical jargon (Pc=0.007) as compared to OSP-TCMs. CONCLUSION: Simulation training for SSP-TCMs and OSP-TCMs showed great benefits for enhancing clinical competency. SSP-TCM simulation was feasible, practical, and cost-effective, and may serve as an alternative method to OSP-TCM simulation.

Using standardized patients for undergraduate clinical skills training in an introductory course to psychiatry.

BACKGROUND: The goal of this study was to assess the value and acceptance of Standardized or Simulated Patients (SPs) for training clinically inexperienced undergraduate medical students in psychiatric history taking, psychopathological assessment, and communication with psychiatric patients. METHODS: As part of a newly developed introductory course to psychiatry, pairs of 3rd year medical students conducted psychiatric assessments of SPs, including history and psychopathological state, under the supervision of a clinical lecturer. Prior to the assessment, students attended introductory lectures to communication in psychiatry and psychopathology but were clinically inexperienced. After the interview, the students' summary of their findings was discussed with other students and the lecturer. Students, lecturers, and actors were invited to a survey after the course. Questions for the students included self-reports about perceived learning success and authenticity of the interviews. RESULTS: 41 students, 6 actors and 8 lecturers completed the survey (response rates of 48%, 50%, and 100%, respectively). The survey results indicated that, despite their lack of clinical experience, students learned how to conduct a psychiatric interview, communicate in a non-judgmental and empathetic manner, take a psychiatric history and perform a psychopathological examination. SPs were perceived as authentic. The survey results suggested that this setting allowed for an enjoyable, non-distressful and motivating learning experience within a restricted time frame of just two afternoons. CONCLUSION: The results indicated that the SP approach presented is useful for teaching clinical skills in psychiatry to students with limited previous clinical experience and knowledge of psychiatry. We argue that SPs can be used to teach practical psychiatric skills already during an early phase of the curriculum. Limitations of our study include a limited sample size, a temporal gap between the course and the survey, reliance on self-reports, and lack of comparison to alternative interventions.

A different approach to teaching pre-clerkship students physical diagnosis: standardized patient instructor-senior medical student teaching teams.

BACKGROUND: Faculty have traditionally taught the physical examination (PE) to novice medical students (pre-clerkship students.), despite recruiting and cost issues and problems standardizing their approach. ACTIVITY: We present a model using standardized patient instructor (SPI)-fourth year medical student (MS4) teams to teach PE to pre-clerkship students, leveraging the benefits of co-teaching and peer-assisted learning. RESULTS: Surveys of pre-clerkship students, MS4s and SPIs indicate positive perceptions of the program, including MS4s reporting significant growth in their professional identities as educators. Pre-clerkship students' performance on the spring clinical skills exams was equivalent to or better than their peer performance pre-program implementation. IMPLICATIONS: SPI-MS4 teams can effectively teach novice students the mechanics and clinical context of the beginners' physical exam.

Standardized Patient Simulation in an Oncology Symptom Management Seminar-Style Course: Prelicensure Nursing Student Outcomes.

A critical role of the professional nurse is to manage symptoms associated with cancer and its treatments. Currently, prelicensure nursing curricula lack adequate oncology content and associated opportunities for clinical application. Thus, many graduate nurses do not possess the requisite knowledge and skills required to effectively manage cancer-related symptoms upon entry to practice. The purposes of this study were to evaluate the effect of standardized patient simulation on nursing students' knowledge, confidence, and competence (objective and self-perceived) related to oncology evidence-based symptom management principles, and to determine nursing students' perceptions, satisfaction, and self-confidence with learning using standardized patient simulation in a seminar-style course. A longitudinal, one-group, convergent mixed-methods design with questionnaire variant was used. Data were collected at three time points: (T1) pre-seminar, (T2) pre-simulation, and (T3) post-simulation. A convenience sample of sixty-three senior baccalaureate nursing students in an oncology symptom management seminar participated in two standardized patient simulation scenarios. There was a significant increase in students' knowledge, confidence, and self-perceived competence over time with a large effect size. All student groups (n = 14) demonstrated objective competence in the colorectal cancer scenario and all participants, with the exception of one student group, demonstrated objective competence in the breast cancer scenario. Participants also reported positive perceptions of, a high level of satisfaction with, and self-confidence in learning with the standardized patient simulations. Qualitative themes identified included unique focus, realism, and application of knowledge. Standardized patient simulation holds promise to enhance nursing students' knowledge, confidence, and competence related to oncology evidence-based symptom management principles.

Web-based standardized patient simulation for taking anamnesis: an approach in nursing education during the pandemic.

BACKGROUND: To address the challenges in nursing education brought about by the pandemic, this study aimed to evaluate the use of a web-based standardized patient practice in the development of nursing students' anamnesis taking skills and their views about its application. METHOD: We conducted a descriptive intervention study with 39 s-year nursing students. The students completed anamnesis using the standardized patient practice in line with a scenario with real standardized patients in a web-based environment with audio and video. RESULTS: The total scores of students' anamnesis skills were low. The agreement between the total scores, scores obtained from the health patterns, and each item in the control list was statistically significant (p < 0.05). CONCLUSION: Web-based standardized patient practice is an alternative for clinical practice facilitating the gaining of competencies in making holistic nursing diagnoses under conditions that limit face-to-face interactions, such as pandemics.

Standardized Vaccine-Hesitant Patients in the Assessment of the Effectiveness of Vaccine Communication Training.

OBJECTIVES: To determine if training residents in a structured communication method elicits specific behaviors in a laboratory model of interaction with vaccine-hesitant parents. STUDY DESIGN: Standardized patients portraying vaccine-hesitant parents were used to assess the effectiveness of training in the Announce, Inquire, Mirror, Secure (AIMS) Method for Healthy Conversations. Blinded pediatric residents were pseudorandomized to receive AIMS or control training and underwent pre- and post-training encounters with blinded standardized patients. Encounters were assessed by blinded raters using a novel tool. Participant confidence and standardized patient evaluations of the participants' general communication skills were assessed. RESULTS: Ratings were available for 27 AIMS and 26 control participants. Statistically significant increases in post-training scores (maximum = 30) were detected in AIMS, but not in control, participants (median, 21.3 [IQR, 19.8-24.8] vs 18.8 [IQR, 16.9-20.9]; P < .001). Elements (maximum score = 6) with significant increases were Inquire (0.67 [IQR, 0-1.76] vs -0.33 [IQR, -0.67 to 0.33]; P < .001); Mirror (1.33 [IQR, 0 to 2] vs -0.33 [IQR, -0.92 to 0]; P < .001) and Secure (0.33 [IQR, 0 to 1.67] vs -0.17 [IQR, -0.67 to 0.33]; P = .017). Self-confidence increased equally in both groups. Standardized patients did not detect a difference in communication skills after training and between groups. Internal consistency and inter-rater reliability of the assessment tool were modest. CONCLUSIONS: Standardized patients proved useful in studying the effectiveness of structured communication training, but may have been limited in their ability to perceive a difference between groups owing to the predetermined encounter outcome of vaccine refusal. AIMS training should be studied in real-world scenarios to determine if it impacts vaccine acceptance.

Investigating the relationship between consultation length and quality of tele-dermatology E-consults in China: a cross-sectional standardized patient study.

BACKGROUND: Consultation length, the time a health provider spend with the patient during a consultation, is a crucial aspect of patient-physician interaction. Prior studies that assessed the relationship between consultation length and quality of care were mainly based on offline visits. Research was lacking in E-consults settings, an emerging modality for primary health care. This study aims to examine the association between consultation length and the quality of E-consults services. METHODS: We defined as standardized patient script to present classic urticaria symptoms in asynchronous E-consults at tertiary public hospitals in Beijing and Hangzhou, China. We appraised consultation length using six indicators, time waiting for first response, time waiting for each response, time for consultation, total times of provider's responses, total words of provider's all responses, and average words of provider's each response. We appraised E-consults services quality using five indicators building on China's clinical guidelines (adherence to checklist; accurate diagnosis; appropriate prescription; providing lifestyle modification advice; and patient satisfaction). We performed ordinary least squares (OLS) regressions and logistic regressions to investigate the association between each indictor of consultation length and E-consults services quality. RESULTS: Providers who responded more quickly were more likely to provide lifestyle modification advice and achieve better patient satisfaction, without compromising process, diagnosis, and prescribing quality; Providers who spent more time with patients were likely to adhere to clinical checklists; Providers with more times and words of responses were significantly more likely to adhere to the clinical checklist, provide an accurate diagnosis, appropriate prescription, and lifestyle modification advice, which achieved better satisfaction rate from the patient as well. CONCLUSIONS: The times and words that health providers provide in E-consult can serve as a proxy measure for quality of care. It is essential and urgent to establish rules to regulate the consultation length for Direct-to-consumer telemedicine to ensure adequate patient-provider interaction and improve service quality to promote digital health better.

Medical student confidence when training for a female genitourinary exam using models and standardized patients.

AIM: The purpose of this study is to investigate what factors make students feel confident and competent when performing a female genitourinary exam (FGUE) with normal, nonpathologic findings. We anticipated that students would increase their confidence and perceived competence from the first year to the second year of medical school, would prefer the use of specialized standardized patients (SSPs) over models, and that the results would vary by student demographics. METHODS: Student confidence and perceived competence were measured using voluntary survey methods pre- and postinterventions. Interventions were defined as learning the FGUE on models alone for first-year medical students and learning the FGUE on SSPs with prior experience using models for second-year students. Survey responses were evaluated via generalized linear mixed models for numeric responses. RESULTS: The results demonstrated that first- and second-year medical students of racial and ethnic minorities rated themselves as more confident and competent than Caucasian counterparts, which was in many cases more extensive than the effect of an additional year of medical education. Students felt that using SSPs alone was the best mode of learning the exam than either models alone or the combination of models and SSPs. Students' current specialty of choice did not correlate with increased confidence or perceived competence. CONCLUSION: This study highlights how cultural differences have an impact on confidence and perceived competence in medical students as they prepare for performing a procedure as intimate to the patient as the FGUE.

Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity.

INTRODUCTION: Advances in natural language understanding have facilitated the development of Virtual Standardized Patients (VSPs) that may soon rival human patients in conversational ability. We describe herein the development of an artificial intelligence (AI) system for VSPs enabling students to practice their history taking skills. METHODS: Our system consists of (1) Automated Speech Recognition (ASR), (2) hybrid AI for question identification, (3) classifier to choose between the two systems, and (4) automated speech generation. We analyzed the accuracy of the ASR, the two AI systems, the classifier, and student feedback with 620 first year medical students from 2018 to 2021. RESULTS: System accuracy improved from ∼75% in 2018 to ∼90% in 2021 as refinements in algorithms and additional training data were utilized. Student feedback was positive, and most students felt that practicing with the VSPs was a worthwhile experience. CONCLUSION: We have developed a novel hybrid dialogue system that enables artificially intelligent VSPs to correctly answer student questions at levels comparable with human SPs. This system allows trainees to practice and refine their history-taking skills before interacting with human patients.

A resource efficient and reliable standard setting method for OSCEs: Borderline regression method using standardized patients as sole raters in clinical case encounters with medical students.

Finding a reliable, practical and low-cost criterion-referenced standard setting method for performance-based assessments has proved challenging. The borderline regression method of standard setting for OSCEs has been shown to estimate reliable scores in studies using faculty as raters. Standardized patients (SPs) have been shown to be reliable OSCE raters but have not been evaluated as raters using this standard setting method. Our study sought to find whether SPs could be reliably used as sole raters in an OSCE of clinical encounters using the borderline regression standard setting method.SPs were trained for on a five-point global rating scale. In an OSCE for medical students, SPs completed skills checklists and the global rating scale. The borderline regression method was used to create case passing scores. We estimated the dependability of the final pass or fail decisions and the absolute dependability coefficients for global ratings, checklist scores, and case pass-score decisions using generalizability theory.The overall dependability estimate is 0.92 for pass or fail decisions for the complete OSCE. Dependability coefficients (0.70-0.86) of individual case passing scores range demonstrated high dependability.Based on our findings, the borderline regression method of standard setting can be used with SPs as sole raters in a medical student OSCE to produce a dependable passing score. For those already using SPs as raters, this can provide a practical criterion-referenced standard setting method for no additional cost or faculty time.