Diagnosing virtual patients: the interplay between knowledge and diagnostic activities.

Clinical reasoning theories agree that knowledge and the diagnostic process are associated with diagnostic success. However, the exact contributions of these components of clinical reasoning to diagnostic success remain unclear. This is particularly the case when operationalizing the diagnostic process with diagnostic activities (i.e., teachable practices that generate knowledge). Therefore, we conducted a study investigating to what extent knowledge and diagnostic activities uniquely explain variance in diagnostic success with virtual patients among medical students. The sample consisted of N = 106 medical students in their third to fifth year of university studies in Germany (6-years curriculum). Participants completed professional knowledge tests before diagnosing virtual patients. Diagnostic success with the virtual patients was assessed with diagnostic accuracy as well as a comprehensive diagnostic score to answer the call for more extensive measurement of clinical reasoning outcomes. The three diagnostic activities hypothesis generation, evidence generation, and evidence evaluation were tracked. Professional knowledge predicted performance in terms of the comprehensive diagnostic score and displayed a small association with diagnostic accuracy. Diagnostic activities predicted comprehensive diagnostic score and diagnostic accuracy. Hierarchical regressions showed that the diagnostic activities made a unique contribution to diagnostic success, even when knowledge was taken into account. Our results support the argument that the diagnostic process is more than an embodiment of knowledge and explains variance in diagnostic success over and above knowledge. We discuss possible mechanisms explaining this finding.

Learning to diagnose accurately through virtual patients: do reflection phases have an added benefit?

BACKGROUND: Simulation-based learning with virtual patients is a highly effective method that could potentially be further enhanced by including reflection phases. The effectiveness of reflection phases for learning to diagnose has mainly been demonstrated for problem-centered instruction with text-based cases, not for simulation-based learning. To close this research gap, we conducted a study on learning history-taking using virtual patients. In this study, we examined the added benefit of including reflection phases on learning to diagnose accurately, the associations between knowledge and learning, and the diagnostic process. METHODS: A sample of N = 121 medical students completed a three-group experiment with a control group and pre- and posttests. The pretest consisted of a conceptual and strategic knowledge test and virtual patients to be diagnosed. In the learning phase, two intervention groups worked with virtual patients and completed different types of reflection phases, while the control group learned with virtual patients but without reflection phases. The posttest again involved virtual patients. For all virtual patients, diagnostic accuracy was assessed as the primary outcome. Current hypotheses were tracked during reflection phases and in simulation-based learning to measure diagnostic process. RESULTS: Regarding the added benefit of reflection phases, an ANCOVA controlling for pretest performance found no difference in diagnostic accuracy at posttest between the three conditions, F(2, 114) = 0.93, p = .398. Concerning knowledge and learning, both pretest conceptual knowledge and strategic knowledge were not associated with learning to diagnose accurately through reflection phases. Learners' diagnostic process improved during simulation-based learning and the reflection phases. CONCLUSIONS: Reflection phases did not have an added benefit for learning to diagnose accurately in virtual patients. This finding indicates that reflection phases may not be as effective in simulation-based learning as in problem-centered instruction with text-based cases and can be explained with two contextual differences. First, information processing in simulation-based learning uses the verbal channel and the visual channel, while text-based learning only draws on the verbal channel. Second, in simulation-based learning, serial cue cases are used to gather information step-wise, whereas, in text-based learning, whole cases are used that present all data at once.

The influence of prompts on final year medical students' learning process and achievement in ECG interpretation.

Objective: ECG interpretation is prone to errors that can lead to relevant misdiagnoses and incorrect treatment. Prompts are one way in lectures to encourage learning from one's own mistakes and to reduce error rates. Prompts are measures such as questions, hints, and suggestions of content-related or metacognitive nature, which can lead to self-explanation in the learner and thus to a deeper understanding of an issue. The aim of the study was therefore to investigate whether the use of prompts can reduce the error rate in ECG interpretation among students. Method: In a 2x2 experimental test and control group design, N=100 final year medical students carried out ECG interpretation tasks in the form of online case vignettes in CASUS®. In these tasks, justification prompts (B) and error analysis prompts (F) were systematically varied in four groups and the learning success was measured using a knowledge test. In addition, prior knowledge in ECG interpretation, motivation, interest in the topic, subjective confidence in ECG interpretation, and cognitive load was collected. Results: Neither error analysis prompts nor justification prompts had a significant effect on the correct ECG interpretation by students, F(1,96)=1.03, p=.31. Justification prompts seemed to have a positive effect on the confidence of answering the questions, F(1,96)=10.15, p=.002, partial η2 =.10; and a negative effect on student motivation, F(1,96)=8.13 , p=.005, partial η2 =.08; but both with comparable diagnostic accuracy. Conclusion: The present study could not confirm the positive effects of prompts on the error rate in ECG interpretation reported in the literature but showed significant effects on subjective confidence and motivation which should be investigated in further studies.

Fostering interprofessional communication through case discussions and simulated ward rounds in nursing and medical education: A pilot project.

BACKGROUND: Poor communication between physicians and nursing staff could result in inadequate interprofessional collaboration with negative effects on patient health. In order to ensure optimal health care for patients, it is important to strengthen interprofessional communication and collaboration between physicians and nurses during their education. AIM: The aim of this project is to foster communication for medical and nursing students through interprofessional case discussions and simulated ward rounds as a form of training. METHOD: In 2013-15 a total of 39 nursing students and 22 medical students participated in eight seminars, each covering case discussions and simulated ward rounds. The seminar was evaluated based on student assessment of the educational objectives. RESULTS: Students who voluntarily signed up for the seminar profited from the interprofessional interaction and gathered positive experiences working in a team. CONCLUSION: Through practicing case discussions and ward rounds as a group, interprofessional communication could be fostered between medical and nursing students. Students took advantage of the opportunity to ask those from other profession questions and realized that interprofessional interaction can lead to improved health care.

The Learning Objective Catalogue for Patient Safety in Undergraduate Medical Education--A Position Statement of the Committee for Patient Safety and Error Management of the German Association for Medical Education.

BACKGROUND: Since the report "To err is human" was published by the Institute of Medicine in the year 2000, topics regarding patient safety and error management are in the focal point of interest of science and politics. Despite international attention, a structured and comprehensive medical education regarding these topics remains to be missing. GOALS: The Learning Objective Catalogue for Patient Safety described below the Committee for Patient Safety and Error Management of the German Association for Medical Education (GMA) has aimed to establish a common foundation for the structured implementation of patient safety curricula at the medical faculties in German-speaking countries. METHODS: The development the Learning Objective Catalogue resulted via the participation of 13 faculties in two committee meetings, two multi-day workshops, and additional judgments of external specialists. RESULTS: The Committee of Patient Safety and Error Management of GMA developed the present Learning Objective Catalogue for Patient Safety in Undergraduate Medical Education, structured in three chapters: Basics, Recognize Causes as Foundation for Proactive Behavior, and Approaches for Solutions. The learning objectives within the chapters are organized on three levels with a hierarchical organization of the topics. Overall, the Learning Objective Catalogue consists of 38 learning objectives. All learning objectives are referenced with the National Competency-based Catalogue of Learning Objectives for Undergraduate Medical Education. DISCUSSION: The Learning Objective Catalogue for Patient Safety in Undergraduate Medical Education is a product that was developed through collaboration of members from 13 medical faculties. In the German-speaking countries, the Learning Objective Catalogue should advance discussion regarding the topics of patient safety and error management and help develop subsequent educational structures. The Learning Objective Catalogue for Patient Safety can serve as a common ground for an intensified, constructive, subject-specific discussion about these topics at the medical faculties, and guide the implementation of hopefully multiple patient safety curricula in undergraduate medical education.

Enhancing diagnostic competence with self-explanation prompts and adaptable feedback.

CONTEXT: The fostering of diagnostic competence is an important goal of medical education. Worked-example cases with integrated errors represent a promising method of doing so. OBJECTIVES: This study investigates whether the provision of self-explanation prompts and adaptable feedback fosters diagnostic competence in a computer-supported learning environment based on worked-example cases with integrated errors. METHODS: A total of 103 medical students participated in the study. After a test of prior diagnostic competence, learners studied worked examples with integrated errors for cases of heart failure of different causes in a computer-based learning environment. The worked examples started with the description of a clinical situation in which a student apprentice diagnoses a patient and commits errors in the conclusions he draws from the information presented. Participants were randomly assigned to four learning conditions that varied in two factors: self-explanation prompts and adaptable feedback. In the self-explanation prompts condition, students were prompted to reflect on the errors. Independently of the condition, the student apprentice in the worked example receives feedback on his diagnosis. In the adaptable feedback condition, students were able to adjust the level of elaboration of the feedback. A post-test of diagnostic competence was administered. RESULTS: Adaptable feedback had a positive effect on important aspects of diagnostic competence (strategic knowledge: F(1,93)  = 4.15, p < 0.05, partial η(2)  = 0.04; decision-oriented practical knowledge: F(1,93)  = 4.41, p < 0.05, partial η(2)  = 0.05), whereas self-explanation prompts did not further improve the effectiveness of the learning environment. CONCLUSIONS: In the use of worked examples with integrated errors, the provision of adaptable feedback whereby learners have control over the amount of feedback they receive seems to be advantageous to the development of important decision-oriented aspects of diagnostic competence. Additional help to stimulate reflection about the error by self-explanation prompts does not seem to be critical.

An educational web-based external quality assessment outcome and evaluation: first experiences with urinary sediment and hemostaseology.

External quality assessment is a standard procedure for many medical laboratories, especially those accredited according to ISO 15189. INSTAND has developed web-based quality control surveys (WQ) with integrated case-based learning in collaboration with the Institute for Teaching and Educational Research in Health Sciences (IDBG), University of Witten/Herdecke. The WQs were presented via a weblink using the learning management system CASUS. Laboratories registered with INSTAND for conventional EQAs covering the same topic were invited to participate in the WQs. Statistics were calculated with the INSTAND EQA-evaluation program and with the "Statistical Program for Social Sciences" (SPSS Version 20). While the two pilot surveys (hemostaseology) were designed for laboratory technicians, WQ III (urine sediment) addressed the whole laboratory team. From the invited laboratories more than 80% participated successfully and the evaluations showed that, in general, more than half the participants solved the tasks as a team. The web-based EQAs were well accepted by the users, with some technical problems in WQ III and moderate criticism on the images and relevance for daily practice in the evaluation sheets. Well above 80% would like to participate in further WQs and would recommend them to other laboratories. Thus web-based quality control surveys can emerge as an important supplement to conventional EQAs.