Validation and perception of a key feature problem examination in neurology.

OBJECTIVE: To validate a newly-developed Key Feature Problem Examination (KFPE) in neurology, and to examine how it is perceived by students. METHODS: We have developed a formative KFPE containing 12 key feature problems and 44 key feature items. The key feature problems covered four typical clinical situations. The items were presented in short- and long-menu question formats. Third- and fourth-year medical students undergoing the Neurology Course at our department participated in this study. The students' perception of the KFPE was assessed via a questionnaire. Students also had to pass a summative multiple-choice question examination (MCQE) containing 39 Type-A questions. All key feature and multiple-choice questions were classified using a modified Bloom's taxonomy. RESULTS: The results from 81 KFPE participants were analyzed. The average score was 6.7/12 points. Cronbach's alpha for the 12 key-feature problems was 0.53. Item difficulty level scores were between 0.39 and 0.77, and item-total correlations between 0.05 and 0.36. Thirty-two key feature items of the KFPE were categorized as testers of comprehension, application and problem-solving, and 12 questions as testers of knowledge (MCQE: 15 comprehension and 24 knowledge, respectively). Overall correlations between the KFPE and the MCQE were intermediate. The KFPE was perceived well by the students. CONCLUSIONS: Adherence to previously-established principles enables the creation of a valid KFPE in the field of Neurology.

Teaching neurology to medical students with a simplified version of team-based learning.

OBJECTIVE: To compare the effect of a simplified version of team-based learning (sTBL), an active learning/small group instructional strategy, with that of the traditionally used small group interactive seminars on the acquisition of knowledge and clinical reasoning (CR) skills. METHODS: Third- and fourth-year medical students (n = 122) were randomly distributed into 2 groups. A crossover design was used in which 2 neurologic topics were taught by sTBL and 2 by small group interactive seminars. Knowledge was assessed with a multiple-choice question examination (MCQE), CR skills with a key feature problem examination (KFPE). Questionnaires were used for further methodologic evaluation. RESULTS: No group differences were found in the MCQE results. sTBL instruction of the topic "acute altered mental status" was associated with a significantly better student performance in the KFPE (p = 0.008), with no differences in the other 3 topics covered. Although both teaching methods were highly rated by the students, a clear majority voted for sTBL as their preferred future teaching method. CONCLUSIONS: sTBL served as an equivalent alternative to small group interactive seminars for imparting knowledge and teaching CR skills, and was particularly advantageous for teaching CR in the setting of a complex neurologic topic. Furthermore, students reported a strong preference for the sTBL approach, making it a promising tool for effectively teaching neurology.

Effects of additional team-based learning on students' clinical reasoning skills: a pilot study.

BACKGROUND: In the field of Neurology good clinical reasoning skills are essential for successful diagnosing and treatment. Team-based learning (TBL), an active learning and small group instructional strategy, is a promising method for fostering these skills. The aim of this pilot study was to examine the effects of a supplementary TBL-class on students' clinical decision-making skills. METHODS: Fourth- and fifth-year medical students participated in this pilot study (static-group comparison design). The non-treatment group (n = 15) did not receive any additional training beyond regular teaching in the neurology course. The treatment group (n = 11) took part in a supplementary TBL-class optimized for teaching clinical reasoning in addition to the regular teaching in the neurology course. Clinical decision making skills were assessed using a key-feature problem examination. Factual and conceptual knowledge was assessed by a multiple-choice question examination. RESULTS: The TBL-group performed significantly better than the non-TBL-group (p = 0.026) in the key-feature problem examination. No significant differences between the results of the multiple-choice question examination of both groups were found. CONCLUSIONS: In this pilot study participants of a supplementary TBL-class significantly improved clinical decision-making skills, indicating that TBL may be an appropriate method for teaching clinical decision making in neurology. Further research is needed for replication in larger groups and other clinical fields.

Twelve tips for successfully implementing logbooks in clinical training.

BACKGROUND: Logbooks are widely used to set learning outcomes and to structure and standardize teaching in clinical settings. Experience shows that logbooks are not always optimally employed in clinical training. In this article, we have summarized our own experiences as well as results of studies into twelve tips on how to successfully implement logbooks into clinical settings. METHODS: We conducted both a workshop concerning the importance of logbook training to exchange experiences in teaching practice, organization, didactic knowledge and a literature research to compare our own experiences and add additional aspects. RESULTS: Tips include the process of developing the logbook itself, the change-management process, conditions of training and the integration of logbooks into the curriculum. CONCLUSIONS: Logbooks can be a valuable tool for training in clinical settings, especially when multiple sites are involved, when you take our tips into consideration.

The Final Oral/Practical State Examination at Freiburg Medical Faculty in 2012--Analysis of grading to test quality assurance.

AIM: The aim of this study is to analyze the grades given for the oral/practical part of the German State Examination at the Medical Faculty of Freiburg. We examined whether or not the grades given for the written and the oral/practical examinations correlated and if differences in grading between the Freiburg University Medical Center (UMC) and the other teaching hospitals could be found. In order to improve the quality of the state examination, the medical school has been offering standardized training for examiners for several years. We evaluated whether or not trained and untrained examiners differed in their grading of the exam and how these differences have changed over time. METHODS: The results of the 2012 spring and fall exams were analyzed (N=315). The relevant data set was made available to us by the Baden-Württemberg Examination Office (Landesprüfungsamt). The data were analyzed by means of descriptive and inferential statistics. RESULTS: We observed a correlation of ρ=0.460** between the grades for the written and the oral/practical exams. The UMC and the teaching hospitals did not differ significantly in their grade distributions. Compared to untrained examiners, trained ones assigned the grade of "very good" less often. Furthermore, they displayed a significantly higher variance in the grades given (p=0.007, phi=0.165). This effect is stronger when concentrating specifically on those examiners who took part in the training less than a year before. CONCLUSION: The results of this study suggest that the standardized training for examiners at the Medical Faculty of Freiburg is effective for quality assurance. As a consequence, more examiners should be motivated to take part in the training.

Development of a competency-based formative progress test with student-generated MCQs: Results from a multi-centre pilot study.

INTRODUCTION: Progress tests provide students feedback on their level of proficiency over the course of their medical studies. Peer-assisted learning and competency-based education have become increasingly important in medical education. Although progress tests have been proven to be useful as a longitudinal feedback instrument, there are currently no progress tests that have been created in cooperation with students or that focus on competency in medical education. In this study, we investigated the extent to which students can be included in the development of a progress test and demonstrated that aspects of knowledge related to competency can be represented on a competency-based progress test. METHODS: A two-dimensional blueprint for 144 multiple-choice questions (MCQs) covering groups of medical subjects and groups of competency areas was generated by three expert groups for developing the competency-based progress test. A total of 31 students from seven medical schools in Germany actively participated in this exercise. After completing an intensive and comprehensive training programme, the students generated and reviewed the test questions for the competency-based progress test using a separate platform of the ItemManagementSystem (IMS). This test was administered as a formative test to 469 students in a pilot study in November 2013 at eight medical schools in Germany. The scores were analysed for the overall test and differentiated according to the subject groups and competency areas. RESULTS: A pool of more than 200 MCQs was compiled by the students for pilot use, of which 118 student-generated MCQs were used in the progress test. University instructors supplemented this pool with 26 MCQs, which primarily addressed the area of scientific skills. The post-review showed that student-generated MCQs were of high quality with regard to test statistic criteria and content. Overall, the progress test displayed a very high reliability. When the academic years were compared, the progress test mapped out over the course of study not only by the overall test but also in terms of the subject groups and competency areas. OUTLOOK: Further development in cooperation with students will be continued. Focus will be on compiling additional questions and test formats that can represent competency at a higher skill level, such as key feature questions, situational judgement test questions and OSCE. In addition, the feedback formats will be successively expanded. The intention is also to offer the formative competency-based progress test online.

Promotion of family-friendliness at the Medical Faculty of Freiburg - taking stock of study participation.

The survey on family-friendly study organisation in medical schools conducted by the University Hospital in Ulm has identified a need for improvement in various respects in Freiburg. Due to the specific structure of medical school and the high amount of mandatory lectures, students with children face serious problems in balancing family life and their studies at the same time. On the other hand, the freer, modular structure of the clinical curriculum in Freiburg has been mainly rated as positive by the interviewees. In order to improve the situation of students with children, the interviewees favour a more flexible curriculum in general as well as an increase in information and advice services offered by the faculty. In the first place, the results of the study encourage us to maintain the modular structure in the final two clinical years in Freiburg in view of current curriculum developments. Additionally, we aim to offer targeted support to students with children. Furthermore, a wider range of e-learning supported lectures is to help students manage their studies with childcare and family obligations.