First-year Medical Students' Varying Vulnerability to Developing Depressive Symptoms and Its Predictors: a Latent Profile Analysis.

OBJECTIVE: Previous meta-analytic data have demonstrated the propensity for mental morbidity among medical students (Rotenstein et al. JAMA. 2016;316(21):2214-36). However, there is a lack of research on medical students' varying depression vulnerabilities and predictive factors. The present study aims to gain a better understanding of the development of mental health morbidity and its predictive factors among first-semester medical students. METHODS: In November 2020 and January 2021, 184 first-semester students from two medical schools were surveyed regarding depression (PHQ-9), self-efficacy, resilience, and cognitive self-regulation. Using latent profile analysis, we identified distinct depression development profiles. We applied a multinomial logistic regression analysis to determine how self-efficacy, resilience, and cognitive self-regulation and their changes predicted profile membership. RESULTS: Five profiles of depression development were identified: profile 1, no depression (53.8%); profile 2, mild depression (26.1%); profile 3, depression increase I (9.2%); profile 4, depression increase II (9.8%); and profile 5, persistent depression (1.1%). Students with initially high self-efficacy, resilience, and cognitive self-regulation levels were more likely to belong to the no depression profile. A decrease in self-efficacy and cognitive self-regulation was associated with both depression increase profiles (profiles 3 and 4), and a decrease in resilience was found to be a predictor of profile 4. CONCLUSION: Students who enter medical school have varying states of mental health, and they differ in their vulnerability to developing depressive symptoms. The promotion of resilience, self-efficacy, and cognitive self-regulation strategies may be key in preventing students' depression in the first semester of medical school.

[Prevention and Health Promotion during Studies: Suggestions for an Interdisciplinary Curriculum in Medicine and Educational Science]. / Prävention und Gesundheitsförderung im Studium: Vorschläge für ein interdisziplinäres Curriculum in den Studiengängen Humanmedizin und Erziehungswissenschaft.

In academic medicine, the growing importance of disease prevention and health promotion poses new challenges. Besides diseases, the focus must also be on health resources and competences in order to promote health and to prevent diseases or their prolonged manifestation. These aspects must already be integrated into medical education in order to equip future professionals. With the aim of integrating health promotion and disease prevention more strongly in the curriculum and strengthening the interdisciplinary collaboration between physicians and other health care professionals, a prototypical longitudinal model curriculum is being developed for students of medicine and educational science with a focus on health pedagogy at Augsburg University. Students learn about health promotion strategies in the University setting, gain initial interdisciplinary experience and then plan and implement health promotion initiatives for their fellow students in smaller projects as peers. The intention is to make the university setting more health-promoting for as well as by students.The model curriculum is intended to provide other university locations with "good practice" examples that can then be locally adapted and integrated into the respective curricula.

It does not have to be either or! Assessing competence in medicine should be a continuum between an analytic and a holistic approach.

Assessing competence is a tremendous challenge in medical education. There are two contrasting approaches in competence assessment: an analytic approach that aims to precisely measure observable constituents and facets of competence and a holistic approach that focuses on a comprehensive assessment of competences in complex real situations reflecting actual performance. We would like to contribute to the existing discourse about medical competence and its assessment by proposing an approach that can provide orientation for the development of competence-based assessment concepts in undergraduate and postgraduate medical education. The approach follows Kane's framework of an "argument-based approach" to validity and is based on insights into task complexity, testing and learning theories as well as the importance of the learning environment. It describes a continuum from analytic to holistic approaches to assess the constituents and facets of competence to performance. We conclude that the complexity of a task should determine the selection of the assessment and suggest to use this approach to reorganize and adapt competence assessment.

A longitudinal investigation of mental health, perceived learning environment and burdens in a cohort of first-year German medical students' before and during the COVID-19 'new normal'.

BACKGROUND: Medical students' propensity to develop mental morbidity has been described for decades but remains unresolved. To assess student mental health person-centred and longitudinally, we have been investigating a cohort of German students since October 2019. After their first semester under 'normal' conditions, rapid changes became necessary due to the COVID-19 situation. In line with the initial aim, we investigated students' change of mental health, perceived learning environment and burdens in the 'new normal'. METHODS: Students in a newly founded German medical study programme (n = 63) answered a questionnaire each semester (October 2019 = entering medical school; December 2019 = 'old normal'; June 2020 = 'new normal'; December 2020 = 'new normal') on their well-being (FAHW-12), burnout (Maslach Inventory), depression (PHQ-9), perception of the learning environment (DREEM), burdens and protective attitudes in the 'new normal' (items designed for the study). RESULTS: Friedman tests reveal overall significant differences (all p < .001) in depression and burnout (emotional exhaustion, depersonalisation, personal accomplishment); changes in well-being were identified as just non-significant (p = .05). The effects were explained by a significant increase in burnout and depression identified post-hoc from October 2019 to December 2019. No increase in severity was identified in the 'new normal' semesters. The learning environment was perceived positively even with a significant improvement for June 2020 (repeated measures ANOVA p < .001). Study-related burdens (e.g. procrastination of online-learning material) took on greater relevance than burdens related to physicians' occupation (e.g. potential for students' recruitment to the healthcare system during their studies). CONCLUSIONS: The 'new' when entering medical school had a greater impact on our students' mental health than the 'new normal'. The readiness for change in the context of a newly designed study programme may have been beneficial with regard to students' positively perceived learning environment during the virtual semesters. Monitoring medical students' mental health longitudinally should be a concern regardless of a pandemic.

"It is great what we have learned from each other!" - Bedside teaching in interprofessional small groups using the example of Parkinson's disease.

Background: While patient care often involves interprofessional collaboration, interprofessional teaching formats with participants from medical and physiotherapy fields are still rare. Furthermore, interprofessional education often takes place as separate courses and is not integrated into the clinical curriculum. Therefore, the goal of this project was to develop and implement interprofessional content into bedside teaching. Course development: The clinical subject of the course was "Parkinson's disease", as this condition allowed for the exemplary demonstration of interprofessional teamwork and different competencies. Through interprofessional bedside teaching and a specific clinical context, interprofessionalism was intended to be integrated and experienced as natural part of clinical practice. The bedside teaching was complemented with work in break-out groups and a lecture. Evaluation: The course was first conducted in the winter semester 2021/22. Participants were medical and physiotherapy students. Teaching teams were also interprofessional. A concurrent evaluation was carried out using the University of the West of England Interprofessional Questionnaire (UWE-IP) before and after course participation. UWE-IP scores in all sub-scales indicated a positive attitude, except for the "Interprofessional Learning" scale among physiotherapy students, which reflected a neutral attitude. Significant group differences were observed in the same scale at the pre-course time point between medical and physiotherapy students (p<0.01) and among medical students before and after course participation (p=0.02). Conclusion: The course proved to be well-suited for integrating interprofessional content into clinical education and can serve as a model for future teaching units. The evaluation reflected a positive attitude toward interprofessional learning.

Measuring teacher identity of physicians - a validation study of a questionnaire instrument.

BACKGROUND: Teacher identity is defined as a continuum of a person's self-conviction ('Identity is something I have') and a context-dependent action ('Identity is something I do in a context') (Lankveld et al. 2021). It has been identified a relevant contributor to physicians' teaching commitment. In this study, we further improve the currently only existing questionnaire instrument (37 items) measuring physicians' teacher identity. METHODS: Survey data on 147 clinicians at a German university hospital were (1) analyzed by confirmatory factor analysis (CFA). We tested (a) the model fits of the originally suggested scales and (b) potential for improvement of model fits by item reduction. As this could not reveal satisfactory fits for all scales, we (2) applied a principal axis factoring as an exploratory approach. Last, we combined findings from (1) and (2) with a theoretical item content discussion and suggest (3) reassembled scales which were again checked using CFA. FINDINGS: (1a) Two scales from the original instrument were successfully confirmed. (1b) Some scales benefited from item reduction. (2) The exploratory analysis identified three factors that explained at least 5% variance. (3) By integrating confirmatory and exploratory findings with a content analysis of the items, we propose a partially rearranged questionnaire instrument, comprising seven scales: (1) Feeling intrinsic satisfaction from teaching; (2) Feeling responsibility to teach; (3) Exchange of teaching experience; (4) Identification and enjoyment of the teaching role; (5) Development of teaching; (6) Teaching self-concept of ability; (7) Desired rewards for teaching. Four items were kept as single items. CONCLUSION: We suggest that when assessing teacher identity in physicians, all items should be constructed to allow for responses, even from physicians who are presently not actively involved in teaching. The scales benefited from categorizing items based on the continuum of teacher identity as outlined by van Lankveld et al. (2021).

Uncovering heterogeneity in mental health changes among first-year medical students.

INTRODUCTION: The initial year of medical school is linked to a decline in mental health. To assess mental health comprehensively, the dual-factor model posits the consideration of both psychopathology (e.g., depression) and positive mental health (e.g., well-being). Previous mental health research among medical students has primarily examined these two factors independently. This study uses the dual-factor approach for a deeper understanding of mental health changes during the first year of medical school. METHODS: Students from eight German medical schools (N = 450) were surveyed three times (T0 = entering medical school, T1 = end of the first semester, T2 = end of the second semester) regarding depression (PHQ-9), well-being (subscale of FAHW-12), and general life satisfaction (German Single-Item Scale L1). Latent profile analysis was used to identify distinct mental health groups based on their combinations of psychopathology and positive mental health. We then analysed trajectories descriptively by examining the longitudinal stability and dynamics of mental health group membership during the first year of medical school. RESULTS: We identified five mental health groups: (1) complete mental health, (2) moderately mentally healthy, (3) symptomatic but content, (4) vulnerable, and (5) troubled. The examination of change trajectories unveiled diverse paths pointing towards both recovery and deterioration. In comparison to the other groups, students belonging to the complete mental health group exhibited greater stability and a higher potential to recover after initial deteriorations in the first semester. CONCLUSIONS: Our study uncovers distinct mental health trajectories in the first year of medical school, emphasizing the crucial role of initial mental health status. Our findings stress the diverse nature of mental health changes in medical students, underscoring the need for tailored prevention strategies. The implications for research and practice are discussed.

Practical tips to improve bedside teaching using learning theories and clinical reasoning.

Bedside teaching strengthens the link between theory and practice. The tips given here, which were derived from various learning theories and models, aim to provide structure to bedside teaching and to make this format effective, even though empirical evidence is still missing for this specific setting. These 10 tips may not always be fully implemented in each bedside teaching, but they should be applied selectively for targeted students. In essence, they are more to be understood as a repertoire of effective methods and are intended to expand the literature and framework concepts already available.

Development and evaluation of a questionnaire to measure the perceived implementation of the mission statement of a competency based curriculum.

BACKGROUND: A mission statement (MS) sets out the long-term goals of an institution and is supposed to be suited for studying learning environments. Yet, hardly any study has tested this issue so far. The aim of the present study was the development and psychometric evaluation of an MS-Questionnaire (MSQ) focusing on explicit competencies. We investigated to what extent the MSQ captures the construct of learning environment and how well a faculty is following--in its perception--a competency orientation in a competency-based curriculum. METHODS: A questionnaire was derived from the MS "teaching" (Medical Faculty, Heinrich-Heine University Düsseldorf) which was based on (inter-) nationally accepted goals and recommendations for a competency based medical education. The MSQ was administered together with the Dundee Ready Education Environment Measure (DREEM) to 1119 students and 258 teachers. Cronbach's alpha was used to analyze the internal consistency of the items. Explorative factor analyses were performed to analyze homogeneity of the items within subscales and factorial validity of the MSQ. Item discrimination was assessed by means of part-whole corrected discrimination indices, and convergent validity was analyzed with respect to DREEM. Demographic variations of the respondents were used to analyze the inter-group variations in their responses. RESULTS: Students and teachers perceived the MS implementation as "moderate" and on average, students differed significantly in their perception of the MS. They thought implementation of the MS was less successful than faculty did. Women had a more positive perception of educational climate than their male colleagues and clinical students perceived the implementation of the MS on all dimensions significantly worse than preclinical students. The psychometric properties of the MSQ were very satisfactory: Item discrimination was high. Similarly to DREEM, the MSQ was highly reliable among students (α = 0.92) and teachers (α = 0.93). In both groups, the MSQ correlated highly positively with DREEM (r = 0.79 and 0.80, p < 0.001 each). Factor analyses did not reproduce the three areas of the MS perfectly. The subscales, however, could be identified as such both among teachers and students. CONCLUSIONS: The perceived implementation of faculty-specific goals can be measured in an institution to some considerable extent by means of a questionnaire developed on the basis of the institution's MS. Our MSQ provides a reliable instrument to measure the learning climate with a strong focus on competencies which are increasingly considered crucial in medical education. The questionnaire thus offers additional information beyond the DREEM. Our site-specific results imply that our own faculty is not yet fully living up to its competency-based MS. In general, the MSQ might prove useful for faculty development to the increasing number of faculties seeking to measure their perceived competency orientation in a competency-based curriculum.

Online programs to strengthen the mental health of medical students: A systematic review of the literature.

Medical students have been shown to be vulnerable to mental stress. Strengthening individual protective characteristics can be one cornerstone for promoting medical students' mental health and thereby preventing mental disorders. Online programs are an opportunity to provide appropriate options that have the advantage of being accessible from anywhere, at any time, and with a low entry threshold. This review provides a literature overview of current online programs for medical students. The findings can serve as a point of reference for designing effective online programs for mental health-promotion and mental disorder-prevention in medical curricula. We applied a systematic literature search in PubMed, ERIC, Cochrane, and Web of Science. Programs offered had to be web-based, and the addressed group had to be medical students. Protective individual characteristics for mental health and information on the programs' effectiveness were included in the search. As outcomes, we included mental health, burnout, symptoms of depression, anxiety, and well-being. The search yielded 723 articles; of them, 11 met the inclusion criteria. Programs found were grouped according to their focus: mental health literacy, mindfulness, based on Cognitive Behavioral Therapy, or peer support. Two studies showed significant reductions in perceived stress; one study indicated reduced burnout levels. One program had significant immediate effects on mindfulness, empathy, and resilience; two studies indicated strengthening coping strategies. Two programs were qualitatively assessed as helpful; two studies are ongoing. Nine studies lacked control groups; two randomized controlled trials were ongoing. Only a few online programs with limited evidence of effectiveness were found. They addressed protective individual characteristics, highlighting their importance for mental health. Thus, more health-promoting and mental disorder-preventing programs with high-quality effectiveness studies are necessary. An integration of such programs into curricula would allow for greater utilization and could give greater emphasis to and prioritize mental health in medical education.

Assessing the learning environment of a faculty: psychometric validation of the German version of the Dundee Ready Education Environment Measure with students and teachers.

AIMS: The teachers' perspectives of the educational environment have as yet only been sparsely considered. This study aimed at validating the first German version of the Dundee Ready Education Environment Measure (DREEM) from the points of view of both students and teachers. METHODS: Data from 1119 students and 258 teachers were available for analysis. Psychometric validation included the analysis of homogeneity and discrimination at item level as well as reliability (Cronbach's α), criterion and construct validity at test level. Effect sizes were calculated and the independent samples t-test was used for statistical inference testing of mean differences between two groups. RESULTS: Item characteristics were satisfactory in both samples. Reliability was high with α = 0.92 (students) and 0.94 (teachers), respectively. Factor analyses revealed five dimensions which slightly diverged from the five subscales postulated by the DREEM authors though. The environment was evaluated significantly (p < 0.001) more positively by teachers (M = 117.63) than by students (M = 109.75). Further significant differences were observed with regard to gender, mother language, stage of studies and previous professional training among others. CONCLUSIONS: With convincing psychometric properties at item and test levels, the suitability of DREEM not only for students but also for teachers to assess the educational environment has been demonstrated.

Academic-associated emotions before and during the COVID-19-related online semester - a longitudinal investigation of first-year medical students.

Background: Due to the COVID-19 pandemic, students have been confronted with an online semester. Because of the special requirements, online teaching can trigger negative emotions, which can have an unfavourable impact on the learning process and which therefore need to be regulated. This study investigates academic-associated emotions and the regulation of those emotions both before (December 2019) and during (June 2020) the online semester for first-year medical students. Methods: Questionnaire data (t1=Dec 2019; t2=Jun 2020) regarding academic-associated emotions and emotion regulation, taken from a longitudinal research project (Experienced Learning Medicine Augsburg; ELMA) at the University of Augsburg, was used. At t2, the students were also asked, as future physicians, to name their three most significant emotions regarding their studies, taking into account the COVID-19 situation. Results: Longitudinal analyses (Wilcoxon tests) showed few changes in academic-associated emotions. The emotions happy (r=.32) and proud (r=.33) increased significantly with moderate effects at the online semester. There also was an increased, but still low suppression of emotions (r=.22) at t2. The future physicians were most often curious, grateful and afraid about their medical studies with regard to the COVID-19 situation. Overall, medical studies were more often associated with positive than negative emotions during the online semester. Conclusions: The results show that the online semester did not have any worrying impacts on academic-associated emotions and emotion regulation. There was even some indication that students might benefit from online teaching formats.

Implementation of online peer feedback for student self-reflection - first steps on the development of a feedback culture at a medical faculty.

Objective: Acquisition and application of professional and personal competences is accompanied by the formation and consolidation of attitudes and values and is influenced by the norms and moods (trust and feedback culture) experienced in the learning environment in question [1]. In particular, feedback and peer feedback can have a positive influence on the learning progress and personal development of students [2], [3], [4]. The promotion of a culture of teaching and ultimately of trust or feedback, plays a special role in this [5]. The aim was therefore to structurally integrate feedback into the curriculum of a model study course in order to develop a feedback culture in which students can develop personally and professionally with the help of regular and constructive feedback. Methodology: Following an initial pilot phase in 2009, (peer) feedback was gradually integrated into the curriculum at the medical faculty, in the first instance through checklists and subsequently through an online questionnaire and direct interviews. The activities were regularly analyzed on the basis of student evaluations using the EvaSys evaluation software and semi-standardized questionnaire-based interviews with six students in 2009 and 13 students each in 2012 and 2013. Results: Initially, students felt that the trust and feedback culture at their location as being in need of improvement. There were uncertainties regarding the use of constructive feedback and making criticism but also trust issues regarding the expression of personal perceptions to faculty members. It was possible to document the increase in the acceptance of the offers in the course of their establishment by an improvement in student evaluation and an increase in the number of participants in the voluntary offers amongst others. Qualitative data showed that students had a more positive perception or assessment of the location's feedback concept as well as indications of improvements in the culture of trust at the location. The proportion of constructive free-text comments increased significantly by 11% to 99.4% compared to the previous year (t(3)=-3.79, p=0.04). Thus, in terms of the objective, an increase in feedback activities and their quality at the faculty was achieved. Conclusion: Feedback, its acceptance as well as the quality, can be positively influenced at a faculty. Change measures should be tested repeatedly in discussion with users regarding practicability in order to directly pick up implementation issues and obstacles so they can be remedied in the interests of the users. This can influence the development of a culture of trust and feedback and should promote the personal and professional development of students in the long term.

Interprofessional nutrition management - implementation and evaluation of a course for medical and nursing students using research-based learning method.

Objective: The aim of the teaching project "Interprofessional Nutrition Management in Inpatient and Home Care" of the Medical Faculty of the Heinrich Heine University (HHU) and the Fliedner University of Applied Sciences Düsseldorf (FFH) was to test an interprofessional training session on the topic of malnutrition using the method of research-based learning to evaluate feasibility. Method: In the teaching project for medical and nursing students, research-based learning was applied in a case-based cross-sector setting. The teaching project was assessed quantitatively by the participating students through questionnaires and four newly-developed scales. The modeling and reliability of the scales (from 1 to 5) was confirmed by an exploratory factor analysis and Cronbach's alpha. The scales were evaluated descriptively and through inferential statistics. Results: The medical (n=21) and nursing students (n=25) rated the teaching project positively. Across all professional groups, the social context between the students (M=4.6) and the relevance of the topic (M=4.47) were rated very highly. The use of research-based learning (M=3.9) and the final assessment of the training session (M=3.9) were rated as satisfactory. Conclusions: The method of research-based learning proved to be very suitable for interprofessional education, as it enabled situations which encouraged the health professionals to learn from one another, about one another and with one another. Through the interdisciplinary discussion of malnutrition, cooperation skills and initial competences in nutritional management can be cultivated in future doctors and nursing staff even during training.

Implementing a logbook on entrustable professional activities in the final year of undergraduate medical education in Germany - a multicentric pilot study.

Objectives: The final year of undergraduate medical education (practical year) should foster the transition from undergraduate medical education to graduate medical education. Medical students in the practical year should be able to assume professional tasks, and supervisors should assign these tasks to them. In this pilot study, a curriculum based on the concept of entrustable professional activities (EPAs) was implemented and evaluated in the disciplines of internal medicine, surgery and general practice at four university hospitals. Methods:n=37 medical students and n=17 supervising physicians at four German university hospitals participated in the implementation study for one trimester. For evaluation purposes, we conducted focus group discussions and telephone interviews and analyzed them following qualitative content analysis. Results: We identified five different aspects as important for implementing the EPA curriculum in undergraduate medical education in the German context: Implementation process of the EPA curriculum and required resources, Entrustment process, Feedback sessions with supervisors, Students' and supervisors' role perceptionOverall impact of EPAs on training conditions in the practical year. Conclusion: The study presents a practical implementation of the EPA curriculum in Germany's undergraduate medical education. Besides the need for time and resources, the concept shows good feasibility and fosters a competence-oriented undergraduate medical education in the practical year.

Impact of interprofessional education for medical and nursing students on the nutritional management of in-patients.

Introduction: Despite its frequency, malnutrition is underestimated in its importance for morbidity and mortality. Interprofessional nutrition management can improve patient safety and clinical outcomes. An interprofessional education is considered as the basis for good team cooperation. So far, little data is available on the effects of interprofessional education on measurable outcomes for patients. The objective is to determine to what extent student feedback leads to a change of in-patient nutritional management for a selected internal medical ward. Methodology: In a teaching project based on the method of research oriented learning, medical and nursing students conducted an analysis of the nutritional situation of patients and developed individual treatment plans. The students orally reported their findings to the care teams as well as via a poster presentation to decision-makers of the clinic. A prospective cohort intervention study was conducted to assess the nutritional status of patients before and after student interventions using established screening tools. Differences were tested using t-test and Fisher's exact test. Institutional consequences for nutrition management were recorded descriptively. The teaching unit was evaluated by the students before and after. Results: Malnutrition was found in 59% of patients. Inspired by student feedback, institutional consequences followed: a) routine inpatient screening using Nutritional Risk Screening; and b) the use of pie charts to estimate food intake. Conclusion: The feedback from the results of student interprofessional cooperation led to a sensitization of decision-makers and enabled new measures to improve nutritional management. These can increase patient safety.

Entrustable Professional Activities in final year undergraduate medical training - advancement of the final year training logbook in Germany.

Objective: Training in the final year (FY) of undergraduate medical training currently does not adequately prepare students for the independent performance of medical professional activities after graduation. The concept of Entrustable Professional Activities (EPA) offers the opportunity for a competency-based FY training with the focus on medical professional activities. Methodology: In regular meetings, the FY sub-working group of the German Medical Faculty Association (MFT), which includes representatives with clinical and didactic expertise of the Associations of Internal Medicine, Surgery and General Medicine, developed a concept for the competecy-orientated, EPA-based, FY model logbook 2.0. The selection of the units of practice was made in a cross-disciplinary, consensus-orientated discussion process based on the question which medical professional activities a young professional has to master in the inpatient or outpatient working environment. Results: For the FY electives internal medicine, surgery and general medicine, a blueprint of a total of 18 comprehensive, partially interdisciplinary EPAs relating to inpatient and outpatient care contexts were developed. Each EPA was operationalised by a short description, supervision levels were attributed, and the process of transparent entrustment was determined. Conclusions: The concept for a new FY model logbook 2.0 focuses on the interdisciplinary core medical professional activities in an inpatient and outpatient care context, in order to facilitate transition from undergraduate training to professional practice, and to help avoid overload, thus increasing patient safety.

[The quality of CME questions as a component part of continuing medical education--an empirical study]. / Die Qualität von CME-fragen in der arztlichen Fortbildung--eine empirische Studie.

INTRODUCTION: Changes in physician-training requirements have led to a significant increase in continuing medical education (CME) courses. Structured CME courses based on print media in combination with outcome evaluation offers one opportunity for earning credit points. On the international stage, CME courses are increasingly directed towards measurable patient benefit. Comparative assessment of quality and practical orientation in training courses is required. METHOD: Two hundred items in twenty training units from four established German medical journals were analysed for comparison-based evaluation. The criteria applied were training goals, as well as item construction, authors' requirements and question quality. The items were analyzed independently by two persons trained and experienced in preparing and reviewing items. The analyses from the two assessors were then compared, and any deviations were subjected to mutual consultation. RESULTS: Question formulation showed weaknesses in all the training units. In 52% of the items a clear question was lacking, and all of the training units contained items with concealed hints indicating the correct answer. Only 10% of the questions were preceded by a cameo case study presenting a clinical scenario, and only 14.5% of the items asked for a correct clinical decision. CONCLUSION: The CME questions from the medical journals selected show weaknesses in formulation, and mostly tested factual knowledge. Differences were revealed between publishing houses yielding insights into the requirements made of the authors by the publishers. The question preparation process is still deficient. Adherence to international standards in item construction may lead to an improvement in quality, which would also enhance the implicit transferability of content learned to actual clinical situations, thus improving the practical usefulness of training courses.

Examiner characteristics and interrater reliability in a communication OSCE.

OBJECTIVE: To identify inter-individual examiner factors associated with interrater reliability in a summative communication OSCE in the 4th study year. METHODS: The OSCE consists of 4 stations assessed with a 4-item 5-point global rating instrument. A bivariate secondary analysis of interrater reliability in relation to 4 examiner factors (gender, profession, OSCE experience, examiner training) was conducted. Intraclass correlation coefficients (ICC) were calculated and compared between examiner dyads of different similarity. RESULTS: 169 pairwise ratings from 19 different examiners in 16 dyads were analysed. Interrater reliability is significantly higher in examiner dyads of same vs. different gender (ICC=0.76 (95%CI=0.65-0.83) vs. ICC=0.41 (95%CI=0.21-0.57)), in dyads of two clinicians vs. non-clinical/mixed professions (ICC=0.72 (95%CI=0.56-0.83) vs. ICC=0.57 (95%CI=0.41-0.69)), and in dyads with high vs. low/mixed OSCE experience (ICC=0.73 (95%CI 0.50-0.87) vs. ICC=0.56 (95%CI=0.41-0.69)). Participation in recent examiner training had no influence on ICCs. CONCLUSION: Better concordance of ratings between clinically active examiners might be a hint for context specificity of good communication. Higher interrater reliability between examiners with same gender may indicate gender-specific communication concepts. PRACTICE IMPLICATIONS: Medical faculties introducing summative assessment of communication competence should focus the influence of examiner characteristics on interrater reliability.