[Quality assurance of faculty examinations: Optimization of examination management in the Heidelberg Curriculum Medicinale (HeiCuMed)]. / Qualitätssicherung fakultätsinterner Prüfungen ­ Optimierung des Prüfungsmanagements im Heidelberger Curriculum Medicinale (HeiCuMed).

INTRODUCTION: Examinations are a central element of the medical curriculum: they contribute significantly to the quality assurance of medical training and subsequent medical care. In order to meet the high expectations placed on examinations in terms of content, legal and organizational aspects, continuous quality assurance measures are necessary. The aim of this paper was to record and analyze the quality assurance measures implemented at the medical faculty of Heidelberg. METHODS: We investigated quality indicators that are relevant to medical examinations - adequate choice of examination formats, blueprint/validity, reliability and distribution of grades, feedback to students, consequences of examinations - within the faculty examinations in the decentrally organized Heidelberg Curriculum Medicinale (HeiCuMed). In addition, the organizational structures in examination management were examined. For this purpose, interviews were conducted with teaching staff, students and the technical examination administration. RESULTS: The surveys show that the quality indicators in HeiCuMed have already been met in many areas. Optimization work remains to be done concerning the criteria "adequate choice of examination formats", "feedback to students" as well as the documentation of the examination process and the definition of substitution regulations. DISCUSSION: Training courses, statistical analysis and accompanying research are essential for establishing additional innovative, practice-oriented examination formats. In order to improve feedback to students, formative assessments should be more intensively integrated into the curriculum. As a measure for structured quality-oriented examination management, it is also helpful to document the examination procedure and the staff assigned to it using templates. CONCLUSION: Especially with decentralized examination management, the internal coordination of individual departments is of great importance in order to guarantee the quality of examinations. Regular surveys of the parties involved can be of support by collecting best-practice examples and deliver the respective information in handouts encouraging interdisciplinary exchange.

Measuring competency-relevant knowledge in the competency-oriented student progress test.

Background: Since 2013 a competency-oriented student progress test (SKPT) has been administered at a number of German medical schools. The questions are generated on the basis of a two-dimensional blueprint, on which one axis contains the five competency domains - communicative competence (CO), practical clinical competence (CP), theoretical clinical competence (CT), scientific competence (SC), and professional decision-making competence (PR) - that form part of the competency model of the National Competency-based Catalogue of Learning Objectives for Undergraduate Medicine (NKLM). The feedback for students is structured in part according to these domains. The aim of our study is to examine if the results differentiated by competency domain show adequate measurement accuracy and if the results for the different domains also contain different information. Methods: The SKPTs for the years 2013 to 2017, taken by a total of 3,027 students, were examined. The measurement accuracy was determined using the coefficient glb (greatest bound to reliability) and the standard error of measurement; discriminant analysis of the principal components was carried out to demonstrate differentiation between the competency domains. Results: The reliability of the competency domains was above 0.8 for all SKPTs; exceptions to this were seen in two of the tests for CO and PR that had a reliability of 0.7-0.8. The results for all of the individual competency domains differed in their informational content compared to the overall of the other domains; the same applies for all pairwise comparisons, with the exceptions of CP and CT. Discussion: The SKPT feedback for students that is differentiated by competency domains basically fulfills the requirements for measurement reliability and distinctness. An improvement of the measurement quality for CO and PR and a better differentiation between CP and CT is desirable.

The frequency of using certain feedback methods in the teaching of medicine: a survey of teachers at the medical faculties in Baden-Wurttemberg.

Objectives: Feedback is one of the most important methods for competency-based teaching. A survey was conducted to learn more about the use of feedback methods at five medical faculties. Methods: In the 2017 summer semester, teachers at Baden-Wurttemberg's medical schools in Freiburg, Heidelberg, Mannheim, Tuebingen and Ulm were invited to participate in the survey. The link to the questionnaire was sent to the teaching coordinators at the various departments at each of the five medical schools. The teaching coordinators were asked to forward the link to the questionnaire to all instructors in their department. At one location, all instructors were directly addressed. The data were collected online. Results: A total of 464 instructors participated in the survey. Most consider feedback in medical education as important (23%) or very important (72%). However, some feedback methods are hardly used. The reason for this is, in particular, that some of the feedback methods are unfamiliar, e.g. checklists (56%), or not considered necessary by the instructors, e.g. written feedback (31%). Fifty-five percent of the instructors would like to receive further education or information on feedback. Conclusion: The results show that the use of feedback methods in medical teaching is expandable and that teachers find feedback to be important. Accordingly, nothing should stand in the way of a greater use of feedback methods in teaching. However, in order for this to happen, it is important that instructors are made more familiar with feedback methods.