Integrating virtual patients into undergraduate health professions curricula: a framework synthesis of stakeholders' opinions based on a systematic literature review.

BACKGROUND: Virtual patients (VPs) are widely used in health professions education. When they are well integrated into curricula, they are considered to be more effective than loosely coupled add-ons. However, it is unclear what constitutes their successful integration. The aim of this study was to identify and synthesise the themes found in the literature that stakeholders perceive as important for successful implementation of VPs in curricula. METHODS: We searched five databases from 2000 to September 25, 2023. We included qualitative, quantitative, mixed-methods and descriptive case studies that defined, identified, explored, or evaluated a set of factors that, in the perception of students, teachers, course directors and researchers, were crucial for VP implementation. We excluded effectiveness studies that did not consider implementation characteristics, and studies that focused on VP design factors. We included English-language full-text reports and excluded conference abstracts, short opinion papers and editorials. Synthesis of results was performed using the framework synthesis method with Kern's six-step model as the initial framework. We appraised the quality of the studies using the QuADS tool. RESULTS: Our search yielded a total of 4808 items, from which 21 studies met the inclusion criteria. We identified 14 themes that formed an integration framework. The themes were: goal in the curriculum; phase of the curriculum when to implement VPs; effective use of resources; VP alignment with curricular learning objectives; prioritisation of use; relation to other learning modalities; learning activities around VPs; time allocation; group setting; presence mode; VPs orientation for students and faculty; technical infrastructure; quality assurance, maintenance, and sustainability; assessment of VP learning outcomes and learning analytics. We investigated the occurrence of themes across studies to demonstrate the relevance of the framework. The quality of the studies did not influence the coverage of the themes. CONCLUSIONS: The resulting framework can be used to structure plans and discussions around implementation of VPs in curricula. It has already been used to organise the curriculum implementation guidelines of a European project. We expect it will direct further research to deepen our knowledge on individual integration themes.

Medical education in times of war: a mixed-methods needs analysis at Ukrainian medical schools.

BACKGROUND: As Ukraine struggles with the education of healthcare professionals due to the war, we aimed to identify the specific effects of the war on medical education, the resulting needs, and the expected consequences for schools, faculty, staff, students, and the healthcare system. METHODS: In October and November 2022, we performed a survey of students, faculty, and staff of medical schools in Ukraine and conducted semi-structured interviews with faculty leaders (i.e., rectors, vice-rectors). We conducted a descriptive analysis of the survey's closed-ended questions. The survey and the interviews included open-ended questions about war-related restrictions to teaching and learning, resulting needs, and expected consequences, for which we applied a thematic analysis. RESULTS: We received 239 survey responses (N = 49 faculty and staff, N = 190 students) and conducted nine interviews with faculty leaders across Ukraine. Most survey participants indicated that they had experienced restrictions or changes to their work or study due to the war (86% of faculty and staff, 69% of students). From the thematic analysis of the survey and interviews, we identified eight themes: disruption of teaching, increased workload, mental stress, financial restrictions, non-war related needs, international cooperation, quality of education, and prospects of future professionals. The quality of healthcare education in Ukraine was threatened, and schools, faculty, staff, and students were under great strain. While already established international cooperation has been supportive, some needs have still not been addressed. CONCLUSIONS: We hope that our findings will help researchers and educators from abroad contribute to meeting Ukraine's needs in medical education.

Clinical reasoning: What do nurses, physicians, and students reason about.

Clinical reasoning is a core ability in the health professions, but the term is conceptualised in multiple ways within and across professions. For interprofessional teamwork it is indispensable to recognise the differences in understanding between professions. Therefore, our aim was to investigate how nurses, physicians, and medical and nursing students define clinical reasoning. We conducted 43 semi-structured interviews with an interprofessional group from six countries and qualitatively analysed their definitions of clinical reasoning based on a coding guide. Our results showed similarities across professions, such as the emphasis on clinical skills as part of clinical reasoning. But we also revealed differences, such as a more patient-centered view and a broader understanding of the clinical reasoning concept in nurses and nursing students. The explicit sharing and discussion of differences in the understanding of clinical reasoning across health professions can provide valuable insights into the perspectives of different team members on clinical practice and education. This understanding may lead to improved interprofessional collaboration, and our study's categories and themes can serve as a basis for such discussions.

Why is it so difficult to implement a longitudinal clinical reasoning curriculum? A multicenter interview study on the barriers perceived by European health professions educators.

BACKGROUND: Effective clinical reasoning is a core competency of health professionals that is necessary to assure patients' safety. Unfortunately, adoption of longitudinal clinical reasoning curricula is still infrequent. This study explores the barriers that hinder the explicit teaching of clinical reasoning from a new international perspective. METHODS: The context of this study was a European project whose aim is to develop a longitudinal clinical reasoning curriculum. We collected data in semi-structured interviews with responders from several European countries who represent various health professions and have different backgrounds, roles and experience. We performed a qualitative content analysis of the gathered data and constructed a coding frame using a combined deductive/inductive approach. The identified themes were validated by parallel coding and in group discussions among project members. RESULTS: A total of 29 respondents from five European countries participated in the interviews; the majority of them represent medicine and nursing sciences. We grouped the identified barriers into eight general themes: Time, Culture, Motivation, Clinical Reasoning as a Concept, Teaching, Assessment, Infrastructure and Others. Subthemes included issues with discussing errors and providing feedback, awareness of clinical reasoning teaching methods, and tensions between the groups of professionals involved. CONCLUSIONS: This study provides an in-depth analysis of the barriers that hinder the teaching of explicit clinical reasoning. The opinions are presented from the perspective of several European higher education institutions. The identified barriers are complex and should be treated holistically due to the many interconnections between the identified barriers. Progress in implementation is hampered by the presence of reciprocal causal chains that aggravate this situation. Further research could investigate the perceptual differences between health professions regarding the barriers to clinical reasoning. The collected insights on the complexity and diversity of these barriers will help when rolling out a long-term agenda for overcoming the factors that inhibit the implementation of clinical reasoning curricula.

The need for longitudinal clinical reasoning teaching and assessment: Results of an international survey.

Background: Clinical reasoning is a key ability essential for practising health professionals. However, little is known about the current global adoption of clinical reasoning teaching and assessment.Purpose: We aimed to provide insights into how clinical reasoning is deliberately taught and assessed in curricula worldwide and to identify needs and perceived barriers for teaching clinical reasoning to students and educators.Methods: A questionnaire was devised by an international expert group and distributed in a large international medical education community. Data were collected in 2018 and analysed using descriptive statistics. We identified themes in free-text responses using content analysis.Results: Three hundred and thirteen responses from 76 countries were collected. Most respondents were from Europe (34%). While the presence of a longitudinal clinical reasoning curriculum was only reported by 28%, 85% stated that such a curriculum was needed. The lack of awareness of the need to explicitly teach clinical reasoning was the most commonly identified barrier. For assessment, the greatest need identified was for more workplace-based assessment.Conclusions: Global respondents indicate the need to implement explicit longitudinal clinical reasoning curricula. Our findings suggest that efforts should be put into improving faculty development, including evidence-based materials on how to teach and assess clinical reasoning.

Automatic analysis of summary statements in virtual patients - a pilot study evaluating a machine learning approach.

BACKGROUND: The ability to compose a concise summary statement about a patient is a good indicator for the clinical reasoning abilities of healthcare students. To assess such summary statements manually a rubric based on five categories - use of semantic qualifiers, narrowing, transformation, accuracy, and global rating has been published. Our aim was to explore whether computer-based methods can be applied to automatically assess summary statements composed by learners in virtual patient scenarios based on the available rubric in real-time to serve as a basis for immediate feedback to learners. METHODS: We randomly selected 125 summary statements in German and English composed by learners in five different virtual patient scenarios. Then we manually rated these statements based on the rubric plus an additional category for the use of the virtual patients' name. We implemented a natural language processing approach in combination with our own algorithm to automatically assess 125 randomly selected summary statements and compared the results of the manual and automatic rating in each category. RESULTS: We found a moderate agreement of the manual and automatic rating in most of the categories. However, some further analysis and development is needed, especially for a more reliable assessment of the factual accuracy and the identification of patient names in the German statements. CONCLUSIONS: Despite some areas of improvement we believe that our results justify a careful display of the computer-calculated assessment scores as feedback to the learners. It will be important to emphasize that the rating is an approximation and give learners the possibility to complain about supposedly incorrect assessments, which will also help us to further improve the rating algorithms.

Learning clinical reasoning: how virtual patient case format and prior knowledge interact.

INTRODUCTION: Clinical reasoning has been fostered with varying case formats including the use of virtual patients. Existing literature points to different conclusions regarding which format is most beneficial for learners with diverse levels of prior knowledge. We designed our study to better understand which case format affects clinical reasoning outcomes and cognitive load, dependent on medical students' prior knowledge. METHODS: Overall, 142 medical students (3 rd to 6 th year) were randomly assigned to either a whole case or serial cue case format. Participants worked on eight virtual patients in their respective case format. Outcomes included diagnostic accuracy, knowledge, and cognitive load. RESULTS: We found no effect of case format on strategic knowledge scores pre- vs post-test (whole case learning gain = 3, 95% CI. -.01 to .01, serial cue learning gain = 3, 95% CI. -.06 to .00 p = .50). In both case formats, students with high baseline knowledge (determined by median split on the pre-test in conceptual knowledge) benefitted from learning with virtual patients (learning gain in strategic knowledge = 5, 95% CI .03 to .09, p = .01) while students with low prior knowledge did not (learning gain = 0, 95%CI -.02 to .02). We found no difference in diagnostic accuracy between experimental conditions (difference = .44, 95% CI -.96 to .08, p = .22), but diagnostic accuracy was higher for students with high prior knowledge compared to those with low prior knowledge (difference = .8, 95% CI 0.31 to 1.35, p < .01). Students with low prior knowledge experienced higher extraneous cognitive load than students with high prior knowledge (multiple measurements, p < .01). CONCLUSIONS: The whole case and serial cue case formats alone did not affect students' knowledge gain or diagnostic accuracy. Students with lower knowledge experienced increased cognitive load and appear to have learned less from their interaction with virtual patients. Cognitive load should be taken into account when attempting to help students learn clinical reasoning with virtual patients, especially for students with lower knowledge.

How to tell a patient's story? Influence of the case narrative design on the clinical reasoning process in virtual patients.

BACKGROUND: Virtual patients (VPs) are narrative-based educational activities to train clinical reasoning in a safe environment. Our aim was to explore the influence of the design of the narrative and level of difficulty on the clinical reasoning process, diagnostic accuracy and time-on-task. METHODS: In a randomized controlled trial, we analyzed the clinical reasoning process of 46 medical students with six VPs in three different variations: (1) patients showing a friendly behavior, (2) patients showing a disruptive behavior and (3) a version without a patient story. RESULTS: For easy VPs, we did not see a significant difference in diagnostic accuracy. For difficult VPs, the diagnostic accuracy was significantly higher for participants who worked on the friendly VPs compared to the other two groups. Independent from VP difficulty, participants identified significantly more problems and tests for disruptive than for friendly VPs; time on task was comparable for these two groups. The extrinsic motivation of participants working on the VPs without a patient story was significantly lower than for the students working on the friendly VPs. CONCLUSIONS: Our results indicate that the measured VP difficulty has a higher influence on the clinical reasoning process and diagnostic accuracy than the variations in the narratives.

The power of the pen: how to make physicians more friendly and patients more attractive.

CONTEXT: Studies have shown that patients' subjective perceptions of physicians' competence and friendliness are relevant aspects of a successful treatment, influencing patients' well-being and trust in the physician. Psychological research has repeatedly shown that unconsciously contracting muscles that are usually used to smile can intensify and even elicit positive feelings (known as facial feedback). Empirical evidence also suggests that a smiling person is favourably judged by others with respect to attractiveness and trustworthiness. AIM: This study's purpose was to investigate how an induced muscle contraction, similar to that of a smile, affects physicians' interactions with a standardised patient. It was expected that the 'smile intervention' would affect physicians' and patients' perceptions, resulting in higher ratings of the friendliness and attractiveness of physicians in the intervention group. METHODS: Twenty physicians participated in the randomised controlled study (10 male, 10 female). Physicians were randomly assigned to one of two conditions: an intervention group (performing an easy cognitive task while smiling; n = 11) or a control group (performing an easy cognitive task without smiling; n = 9). Afterwards, physicians had a 5-minute consultation with a standardised patient. This consultation was subsequently rated by physicians, the patient and an external rater using 10-point Likert scales. RESULTS: Physicians in the intervention group were rated as significantly friendlier by the external rater (mean 7.81 versus 7.11; p = 0.097, η2  = 0.15). In addition, physicians in the intervention group rated the patient as significantly more attractive (mean 6.91 versus 4.78; p = 0.017; η2  = 0.28). CONCLUSIONS: Our results suggest that physicians can influence their friendliness and their perception of patients' attractiveness. Thereby the 'power of pen' can be an efficient method for making the hospital a friendlier place.

A qualitative analysis of virtual patient descriptions in healthcare education based on a systematic literature review.

BACKGROUND: Virtual Patients (VPs) have been in the focus of research in healthcare education for many years. The aim of our study was to analyze how virtual patients are described in the healthcare education literature, and how the identified concepts relate to each other. METHODS: We performed a literature review and extracted 185 descriptions of virtual patients from the articles. In a qualitative content analysis approach we inductively-deductively developed categories and deducted subcategories. We constructed a concept map to illustrate these concepts and their interrelations. RESULTS: We developed the following five main categories: Patient, Teacher, Virtual Patient, Curriculum, and Learner. The concept map includes these categories and highlights aspects such as the under-valued role of patients in shaping their virtual representation and opposing concepts, such as standardization of learner activity versus learner-centeredness. CONCLUSIONS: The presented concept map synthesizes VP descriptions and serves as a basis for both, VP use and discussions of research topics related to virtual patients.

Virtual patients--what are we talking about? A framework to classify the meanings of the term in healthcare education.

BACKGROUND: The term "virtual patients" (VPs) has been used for many years in academic publications, but its meaning varies, leading to confusion. Our aim was to investigate and categorize the use of the term "virtual patient" and then classify its use in healthcare education. METHODS: A literature review was conducted to determine all articles using the term "virtual patient" in the title or abstract. These articles were categorized into: Education, Clinical Procedures, Clinical Research and E-Health. All educational articles were further classified based on a framework published by Talbot et al. which was further developed using a deductive content analysis approach. RESULTS: 536 articles published between 1991 and December 2013 were included in the study. From these, 330 were categorized as educational. Classifying these showed that 37% articles used VPs in the form of Interactive Patient Scenarios. VPs in form of High Fidelity Software Simulations (19%) and Virtual Standardized Patients (16%) were also frequent. Less frequent were other forms, such as VP Games. Analyzing the literature across time shows an overall trend towards the use of Interactive Patient Scenarios as the predominant form of VPs in healthcare education. CONCLUSIONS: The main form of educational VPs in the literature are Interactive Patient Scenarios despite rapid technical advances that would support more complex applications. The adapted classification provides a valuable model for VP developers and researchers in healthcare education to more clearly communicate the type of VP they are addressing avoiding misunderstandings.

Learning the facts in medical school is not enough: which factors predict successful application of procedural knowledge in a laboratory setting?

BACKGROUND: Medical knowledge encompasses both conceptual (facts or "what" information) and procedural knowledge ("how" and "why" information). Conceptual knowledge is known to be an essential prerequisite for clinical problem solving. Primarily, medical students learn from textbooks and often struggle with the process of applying their conceptual knowledge to clinical problems. Recent studies address the question of how to foster the acquisition of procedural knowledge and its application in medical education. However, little is known about the factors which predict performance in procedural knowledge tasks. Which additional factors of the learner predict performance in procedural knowledge? METHODS: Domain specific conceptual knowledge (facts) in clinical nephrology was provided to 80 medical students (3rd to 5th year) using electronic flashcards in a laboratory setting. Learner characteristics were obtained by questionnaires. Procedural knowledge in clinical nephrology was assessed by key feature problems (KFP) and problem solving tasks (PST) reflecting strategic and conditional knowledge, respectively. RESULTS: Results in procedural knowledge tests (KFP and PST) correlated significantly with each other. In univariate analysis, performance in procedural knowledge (sum of KFP+PST) was significantly correlated with the results in (1) the conceptual knowledge test (CKT), (2) the intended future career as hospital based doctor, (3) the duration of clinical clerkships, and (4) the results in the written German National Medical Examination Part I on preclinical subjects (NME-I). After multiple regression analysis only clinical clerkship experience and NME-I performance remained independent influencing factors. CONCLUSIONS: Performance in procedural knowledge tests seems independent from the degree of domain specific conceptual knowledge above a certain level. Procedural knowledge may be fostered by clinical experience. More attention should be paid to the interplay of individual clinical clerkship experiences and structured teaching of procedural knowledge and its assessment in medical education curricula.

What are effects of a spaced activation of virtual patients in a pediatric course?

BACKGROUND: Virtual patients (VPs) have a long tradition in the curriculum of the medical faculty at the Ludwig-Maximilians-University (LMU) Munich. However, the pediatric VPs were not well integrated into the curriculum and hardly used by students. METHODS: Therefore we created and implemented a self-contained E-learning module based on virtual patients (VPs), which was embedded into the pediatric curriculum.Students taking this course were divided into two groups. For Group A the virtual patients were activated in a timed order ("spaced activation"), whereas Group B could work on all VPs from the beginning.We investigated the performance of these two groups concerning usage pattern including number of sessions and session duration, score on questions integrated into the VP and results of the intermediate exam. RESULTS: The integration of the VPs into the pediatric course was successful for both groups. The usage pattern for the spaced activation turned out to be more balanced, however we did not find any significant differences in the results of the intermediate exam, the score on questions included in the VPs nor in the time students spent working on the VPs. CONCLUSIONS: Our study showed that the spaced activation led to a more balanced VP usage pattern with a lower peak of sessions at the end of the course. Further studies will have to investigate whether a spaced activation of VPs leads to favorable long-term learning outcomes.

Differences in clinical reasoning between female and male medical students.

OBJECTIVES: In undergraduate medical education virtual patients (VPs) are a suitable method to teach clinical reasoning and support the visualization of this thinking process in a safe environment. The aim of our study was to investigate differences in the clinical reasoning process and diagnostic accuracy of female and male medical students. METHODS: During the summer term 2020, we provided access to 15 VPs for undergraduate students enrolled in a medical school in Bavaria, Germany. All interactions of the 179 learners within the VP system CASUS were recorded, exported, and analyzed. RESULTS: We found significant differences in the clinical reasoning of female and male learners. Female students documented more findings, differential diagnoses, tests, and treatment options and more often created a summary statement about the VP. Their overall performance was higher than those of their male peers, but we did not see any significant differences in diagnostic accuracy. CONCLUSIONS: The significant differences between male and female medical students should be considered when planning teaching and research activities. A future study should investigate whether these differences can also be found in physicians.

The association between quality of connections and diagnostic accuracy in student-generated concept maps for clinical reasoning education with virtual patients.

Objectives: Concept maps are a learning tool that fosters clinical reasoning skills in healthcare education. They can be developed by students in combination with virtual patients to create a visual representation of the clinical reasoning process while solving a case. However, in order to optimize feedback, there is a need to better understand the role of connections between concepts in student-generated maps. Therefore, in this study we investigated whether the quality of these connections is indicative of diagnostic accuracy. Methods: We analyzed 40 concept maps created by fifth-year medical students in the context of four virtual patients with commonly encountered diagnoses. Half of the maps were created by students who made a correct diagnosis on the first attempt; the other half were created by students who made an error in their first diagnosis. The connections in the maps were rated by two reviewers using a relational scoring system. Analysis of covariance was employed to examine the difference in mean connection scores among groups while controlling for the number of connections. Results: There were no differences between the groups in the number of concepts or connections in the maps; however, maps made by students who made a correct first diagnosis had higher scores for the quality of connections than those created by students who made an incorrect first diagnosis (12.13 vs 9.09; p=0.03). We also observed students' general reluctance to use connections in their concept maps. Conclusion: Our results suggest that the quality, not the quantity, of connections in concept maps is indicative of their diagnostic accuracy.

Developing a European longitudinal and interprofessional curriculum for clinical reasoning.

Clinical reasoning is a complex and crucial ability health professions students need to acquire during their education. Despite its importance, explicit clinical reasoning teaching is not yet implemented in most health professions educational programs. Therefore, we carried out an international and interprofessional project to plan and develop a clinical reasoning curriculum with a train-the-trainer course to support educators in teaching this curriculum to students. We developed a framework and curricular blueprint. Then we created 25 student and 7 train-the-trainer learning units and we piloted 11 of these learning units at our institutions. Learners and faculty reported high satisfaction and they also provided helpful suggestions for improvements. One of the main challenges we faced was the heterogeneous understanding of clinical reasoning within and across professions. However, we learned from each other while discussing these different views and perspectives on clinical reasoning and were able to come to a shared understanding as the basis for developing the curriculum. Our curriculum fills an important gap in the availability of explicit clinical reasoning educational materials both for students and faculty and is unique with having specialists from different countries, schools, and professions. Faculty time and time for teaching clinical reasoning in existing curricula remain important barriers for implementation of clinical reasoning teaching.

Criteria to assess the quality of virtual patients.

Quality assessment of virtual patients (VP) is important but still insufficiently standardized. We developed categories and criteria to assess the quality of virtual patients. These categories reflect the life cycle of a VP from the planning to the development, implementation and evaluation. Such elaborated criteria will help authors to create VPs and curriculum planners to assess the quality of implemented VPs and choose high quality VPs from repositories.

New approaches to linking clinical guidelines to virtual patients.

An often reported challenge of evidence-based medicine concerns increasing use of clinical guidelines in practice. One of the proposed improvements is to promote guidelines by presenting them in conjunction with virtual patients. Three approaches to linking clinical guidelines to virtual patients are presented in this paper: (1) guidelines as a source for generating virtual patients; (2) guidelines hyper-flowchart as a virtual patient progress indicator; (3) guidelines flowchart reconstruction as a learning activity in virtual patient systems. The scenarios have been preliminarily evaluated using two demonstrator applications: Bit Pathways and CASUS. Challenges and direction for further development are proposed.

How is the situation of women in leadership positions in medical education in Germany?

In Germany, about two thirds of students and doctoral candidates in medicine are female. The proportion is only about 35% for post-doctoral degrees and much lower for many leadership positions at medical schools and on medical education committees. Although reasons for this have long been known, changes are slow in coming. Therefore, with this commentary, we would like to shed light on the current situation regarding gender equality in Germany in medical education and identify and discuss measures. These include, for example, mentoring and networking programs as well as greater consideration of women in committees.

Implementing Remote Collaboration in a Virtual Patient Platform: Usability Study.

BACKGROUND: Learning with virtual patients is highly popular for fostering clinical reasoning in medical education. However, little learning with virtual patients is done collaboratively, despite the potential learning benefits of collaborative versus individual learning. OBJECTIVE: This paper describes the implementation of student collaboration in a virtual patient platform. Our aim was to allow pairs of students to communicate remotely with each other during virtual patient learning sessions. We hypothesized that we could provide a collaborative tool that did not impair the usability of the system compared to individual learning and that this would lead to better diagnostic accuracy for the pairs of students. METHODS: Implementing the collaboration tool had five steps: (1) searching for a suitable software library, (2) implementing the application programming interface, (3) performing technical adaptations to ensure high-quality connections for the users, (4) designing and developing the user interface, and (5) testing the usability of the tool in 270 virtual patient sessions. We compared dyad to individual diagnostic accuracy and usability with the 10-item System Usability Scale. RESULTS: We recruited 137 students who worked on 6 virtual patients. Out of 270 virtual patient sessions per group (45 dyads times 6 virtual patients, and 47 students working individually times 6 virtual patients minus 2 randomly selected deleted sessions) the students made successful diagnoses in 143/270 sessions (53%, SD 26%) when working alone and 192/270 sessions (71%, SD 20%) when collaborating (P=.04, η2=0.12). A usability questionnaire given to the students who used the collaboration tool showed a usability score of 82.16 (SD 1.31), representing a B+ grade. CONCLUSIONS: The collaboration tool provides a generic approach for collaboration that can be used with most virtual patient systems. The collaboration tool helped students diagnose virtual patients and had good overall usability. More broadly, the collaboration tool will provide an array of new possibilities for researchers and medical educators alike to design courses for collaborative learning with virtual patients.