Institutional strategies related to test-taking behavior in low stakes assessment.

Low stakes assessment without grading the performance of students in educational systems has received increasing attention in recent years. It is used in formative assessments to guide the learning process as well as in large-scales assessments to monitor educational programs. Yet, such assessments suffer from high variation in students' test-taking effort. We aimed to identify institutional strategies related to serious test-taking behavior in low stakes assessment to provide medical schools with practical recommendations on how test-taking effort might be increased. First, we identified strategies that were already used by medical schools to increase the serious test-taking behavior on the low stakes Berlin Progress Test (BPT). Strategies which could be assigned to self-determination theory of Ryan and Deci were chosen for analysis. We conducted the study at nine medical schools in Germany and Austria with a total of 108,140 observations in an established low stakes assessment. A generalized linear-mixed effects model was used to assess the association between institutional strategies and the odds that students will take the BPT seriously. Overall, two institutional strategies were found to be positively related to more serious test-taking behavior: discussing low test performance with the mentor and consequences for not participating. Giving choice was negatively related to more serious test-taking behavior. At medical schools that presented the BPT as evaluation, this effect was larger in comparison to medical schools that presented the BPT as assessment.

What works best in a general practice specific OSCE for medical students: Mini-CEX or content-related checklists?

Aim: To develop and pilot a General Practice (GPr) OSCE assessing medical students dealing with patient encounters, which are typical for GPr and to compare different measurement instruments (global ratings, content-specific checklists).Methods: A blueprint based on Entrusted Professional Activities was used to develop prototypical OSCE stations. Four stations were tested with voluntary medical students. Students were videotaped and assessed with self-developed content-specific checklists, a global rating for communication skills, and mini-CEX. Results were compared according to students' phases of studies.Results: All three measurements were able to discriminate between clinical and pre-clinical students. Clearest results were achieved by using mini-CEX. Content-specific checklists were not able to differentiate between those groups for the more difficult stations. Inter-station reliability for the global ratings was sufficient for high-stakes exams. Students enjoyed the OSCE-setting simulating GPr consultation hours. They would prefer feedback from GPs after the OSCE and from simulated patients after each encounter.Discussion and conclusion: Although the OSCE was short, results indicate advantages for using a global rating instead of checklists. Further research should include validating these results with a larger group of students and to find the threshold during the phases of education for switching from checklists to global ratings.

An explorative vs. traditional practical course: how to inspire scientific thinking in medical students.

Recently, medical students' scientific thinking skills have been identified as an important issue in medical education. Scientific thinking cannot be imparted in conventional lectures, but rather requires actively involving students. We modified a practical course in physiology. A study was designed to test whether the new course fosters scientific thinking without impairing the transfer of physiological knowledge. The study group consisted of 226 first-year medical students at the Medical Faculty Mannheim of Heidelberg University. Written consent to participate in the study was obtained from all participants. The group was then randomly divided into two groups (traditional vs. modified course). The subject of both courses was a laboratory experiment in skeletal muscle physiology. In the traditional course, the students addressed topics already presented in lectures. In the modified course, students dealt with the same topics as in the traditional course, but the experiment was expanded to include one issue not taught before. When working on this issue, the students were instructed in scientific thinking. All participants filled out a questionnaire with 15 multiple-choice questions addressing the physiological subject matter and four open-ended questions addressing the criteria of scientific methodology. Physiological knowledge in both groups did not differ [F(1) = 2.08, P = 0.15]. Scores in scientific thinking in the modified course were higher (mean = 4.20, SD = 1.89) than in the traditional course (mean = 2.04, SD = 1.91) with F(1) = 70.69, P < 0.001, η2 = 0.24 (large effect). Our study demonstrates that small adjustments to courses in medical education can promote scientific thinking without impairing knowledge transfer.

[Measuring Satisfaction with Deployment in the Final Year of Undergraduate Medical Study (Ma-FEZ-PJ) to Ensure the Quality of Training in the Final Year - Psychometrics of a Self-Evaluation Questionnaire]. / Erfassung der Zufriedenheit mit dem Einsatz im Praktischen Jahr (Ma-FEZ-PJ) zur Qualitätssicherung der Lehre im Praktischen Jahr ­ Psychometrie eines Selbsteinschätzungsfragebogens.

INTRODUCTION: One way to recruit junior physicians in surgery is to optimise the final year. Starting points for this can be gained through a standardised evaluation of the deployments in the final year. In this study, a questionnaire for the evaluation of the training conditions and satisfaction with the deployment in the final year (Ma-FEZ-PJ) underwent a test and item analysis. In addition, initial studies were carried out to analyse the construct validity of the two scales - final year training and individual attitude. A specific example will then be used to show how the Ma-FEZ-PJ can be used to optimise the final year. METHODS: 555 medical students from eight final year cohorts evaluated their deployments in the final year with the Ma-FEZ-PJ. The reliability of the two scales as well as item characteristics were calculated. To validate construct validity, a global satisfaction item was used to verify the convergent validity of the final year training scale, which captures training conditions and satisfaction with the final year, and the divergent validity of the individual attitude scale. Groups of students who voluntarily or involuntarily attended the mandatory subjects in the final year were then compared to show whether the individual attitude scale can differentiate between the two. RESULTS: The reliability of the scale final year training is very good, that of the scale individual attitude is in the acceptable range. The construct validity can be sufficiently confirmed. DISCUSSION: The Ma-FEZ-PJ can be used as a tool to evaluate training conditions and satisfaction with the final year's deployment. Comparisons with other surgical departments, oriented at the scale level and then in detail at the item level, identify deficits in final year training and therefore approaches to optimise it.

Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) - development and psychometrics.

BACKGROUND: Low-stakes tests are becoming increasingly important in international assessments of educational progress, and the validity of these results is essential especially as these results are often used for benchmarking. Test scores in these tests not only mirror students' ability but also depend on their test-taking effort. One way to obtain more valid scores from participating samples is to identify test-takers with low test-taking effort and to exclude them from further analyses. Self-assessment is a convenient and quick way of measuring test-taking effort. We present the newly developed Test-taking Effort Short Scale (TESS), which comprises three items measuring attainment value/intrinsic value, utility value, and perceived benefits, respectively. METHODS: In a multicenter validation study with N = 1837 medical students sitting a low-stakes progress test we analyzed item and test statistics including construct and external validity. RESULTS: TESS showed very good psychometric properties. We propose an approach using stanine norms to determine a cutoff value for identifying participants with low test-taking effort. CONCLUSION: With just three items, TESS is shorter than most established self-assessment scales; it is thus suited for administration after low-stakes progress testing. However, further studies are necessary to establish its suitability for routine usage in assessment outside progress testing.

Twelve tips for successfully implementing logbooks in clinical training.

BACKGROUND: Logbooks are widely used to set learning outcomes and to structure and standardize teaching in clinical settings. Experience shows that logbooks are not always optimally employed in clinical training. In this article, we have summarized our own experiences as well as results of studies into twelve tips on how to successfully implement logbooks into clinical settings. METHODS: We conducted both a workshop concerning the importance of logbook training to exchange experiences in teaching practice, organization, didactic knowledge and a literature research to compare our own experiences and add additional aspects. RESULTS: Tips include the process of developing the logbook itself, the change-management process, conditions of training and the integration of logbooks into the curriculum. CONCLUSIONS: Logbooks can be a valuable tool for training in clinical settings, especially when multiple sites are involved, when you take our tips into consideration.

Computer versus paper--does it make any difference in test performance?

UNLABELLED: CONSTRUCT: In this study, we examine the differences in test performance between the paper-based and the computer-based version of the Berlin formative Progress Test. In this context it is the first study that allows controlling for students' prior performance. BACKGROUND: Computer-based tests make possible a more efficient examination procedure for test administration and review. Although university staff will benefit largely from computer-based tests, the question arises if computer-based tests influence students' test performance. APPROACH: A total of 266 German students from the 9th and 10th semester of medicine (comparable with the 4th-year North American medical school schedule) participated in the study (paper = 132, computer = 134). The allocation of the test format was conducted as a randomized matched-pair design in which students were first sorted according to their prior test results. The organizational procedure, the examination conditions, the room, and seating arrangements, as well as the order of questions and answers, were identical in both groups. RESULTS: The sociodemographic variables and pretest scores of both groups were comparable. The test results from the paper and computer versions did not differ. The groups remained within the allotted time, but students using the computer version (particularly the high performers) needed significantly less time to complete the test. In addition, we found significant differences in guessing behavior. Low performers using the computer version guess significantly more than low-performing students in the paper-pencil version. CONCLUSIONS: Participants in computer-based tests are not at a disadvantage in terms of their test results. The computer-based test required less processing time. The reason for the longer processing time when using the paper-pencil version might be due to the time needed to write the answer down, controlling for transferring the answer correctly. It is still not known why students using the computer version (particularly low-performing students) guess at a higher rate. Further studies are necessary to understand this finding.

How professional and academic pre-qualifications relate to success in medical education: Results of a multicentre study in Germany.

OBJECTIVE: Every year, many applicants want to study medicine. Appropriate selection procedures are needed to identify suitable candidates for the demanding curriculum. Although research on medical school admissions has shown good predictive validity for cognitive selection methods (undergraduate GPA, aptitude tests), the literature on applicants with professional and/or academic experience prior to entering medical school remains slim. In our study, we therefore aimed to examine the association between academic success in medical school and having previously completed vocational training in the medical field, voluntary service (≥11 months) or an academic degree. METHODS: Data were collected in a multicentre, cross-sectional study at five medical schools in Germany (Baden-Wuerttemberg) from students during medical school (i.e. 3rd-, 6th-, and 10th-semester and final-year students). Academic success was assessed according to scores on the first and second state examinations, the total number of examinations repeated and the number of semesters beyond the standard period of study. For the analysis we calculated ordinal logistic regression models for each outcome variable of academic success. RESULTS: A total of N = 2,370 participants (response rate: RR = 47%) participated in the study. Having completed vocational training was associated with a higher amount of repeated examinations (small effect), while having an academic degree was associated with worse scores on the second state examination (medium effect). No significant association emerged between voluntary service and academic success. CONCLUSION: The results indicate that professional and academic pre-qualifications pose no advantage for academic success. Possible associations with the financing of study and living conditions of students with pre-qualifications were analysed and discussed in an exploratory manner. However, the operationalisation of academic success from objective and cognitive data should be critically discussed, as the benefits of prior experience may be captured by personal qualities rather than examination results.

Final-year information on didactic and organizational issues for students and supervising physicians - project report on the development and implementation of the cross-site website PJ-input.

Objective: Final-year training is becoming increasingly important in medical studies and requires a high degree of personal responsibility from students. It is the task of supervising physicians to make informal learning opportunities available to students when working with and on patients and to gradually transfer responsibility to them. Both students and physicians have a great need for information regarding the contextual conditions and didactic realization of this transfer of responsibility. Up to now, the faculties have only provided information and support in a sporadic manner and with little standardization. With MERLIN, the joint project undertaken by the Competence Network for Teaching Medicine in Baden-Württemberg, a platform for the final year was developed and released on the web. The aim was to bundle information in order to support students and supervising physicians in their teaching-learning process and to improve the quality of teaching in the final year. Project description: The development process of this platform took place in several steps across all faculties. Content and materials were compiled and structured based on a needs assessment. The first draft was evaluated by means of a simulation by students and then revised. A professional internet agency was involved for the technical implementation. The newly designed website PJ-input ("PJ" being the abbreviation for "Praktisches Jahr", the final year) contains areas for students and supervising physicians, as well as faculty-specific and general information about the final year. Faculty-specific content can be entered directly by the respective staff via an input mask and updated at any time. The provision of didactic materials can support competency-oriented teaching and learning in the final year. Here, for example, the concept of the Entrustable Professional Activities (EPA) was taken up, which gives students and supervising physicians orientation for the gradual assumption or transfer of responsibility. The platform was launched in spring 2021. Usage behavior is continuously recorded via the web application. Results and conclusion: The evaluation results show that the website is visited often and perceived as supportive. Increasing usage figures and the high frequency of use by students in the sections "im PJ" (during the final year) and "nach dem PJ" (after the final year) for the faculties involved in the MERLIN project confirm the target group-oriented design and use. The site should be promoted even more to pre-final-year students, as well as across state borders and to the target group of faculties. It is expected that nationwide faculty participation will make a significant contribution to the competency-based shift in teaching and the standardization of training during the final year of study under the new licensing regulations.

Development of knowledge in basic sciences: a comparison of two medical curricula.

CONTEXT: Basic medical sciences education differs among medicine courses, especially as traditional and integrated problem-based learning (PBL) curricula teach basic sciences in very different ways. The literature shows no clear differences in the performance of students of these different educational philosophies. The Charité Medical University of Berlin (Charité Universitätsmedizin Berlin) teaches both a traditional medical curriculum (TMC) and a PBL reformed medical curriculum (RMC). Both curricula conduct the Progress Test in Medicine (PTM), which examines competence in the basic and clinical sciences from the first to the last semester. OBJECTIVES: The aim of this study was to compare the development and retention of knowledge in the basic medical sciences between students on the traditional and reformed undergraduate medical curricula, respectively. METHODS: For each student and single PTM, relative frequencies of correct answers were computed for basic sciences items only and for the whole curriculum. Frequencies were averaged and grouped by semester and curriculum. Analyses of variance (anovas) were performed at all measurement points with a Bonferroni-corrected p-value at the level of p < 0.005. Eta-squared (η(2)) was used to classify effect size. RESULTS: In the first three semesters, RMC students slightly outperform TMC students in the basic sciences, although TMC students receive more systematic teaching. After this, TMC students develop a peak of knowledge in basic sciences and overtake RMC students. The knowledge of TMC students then decreases over time, but despite this, they perform better in the final semester. Students on the RMC show constant progress throughout their undergraduate studies. Overall, the development of medical knowledge is consistent in both curricula. There is no significant difference in this outcome between the traditional and PBL courses. CONCLUSIONS: Progress testing as a longitudinal method allows us to better understand the development of knowledge during formal undergraduate education. The main difference between traditional and problem-based medical education seems to be provoked by the high-stakes national examination undertaken in the traditional course (the Physikum).

How is the situation of women in leadership positions in medical education in Germany?

In Germany, about two thirds of students and doctoral candidates in medicine are female. The proportion is only about 35% for post-doctoral degrees and much lower for many leadership positions at medical schools and on medical education committees. Although reasons for this have long been known, changes are slow in coming. Therefore, with this commentary, we would like to shed light on the current situation regarding gender equality in Germany in medical education and identify and discuss measures. These include, for example, mentoring and networking programs as well as greater consideration of women in committees.

Comparison of the evaluation of formative assessment at two medical faculties with different conditions of undergraduate training, assessment and feedback.

Introduction: Both formative and summative assessments have their place in medical curricula: formative assessment to accompany the learning process and summative assessment to ensure that minimum standards are achieved. Depending on the conditions of undergraduate training, assessment and feedback, students place more or less importance on formative assessment, and thus the fulfilment of its function may be questionable. This study describes how the low-stakes formative Berlin Progress Test (BPT) is embedded at two medical faculties with partially different framework conditions and what effects these have on the students' testing efforts and the evaluation of the test, especially the perception of its benefits and (intangible) costs, such as non-participation in contemporaneous activities and emotional impairments. Methods: In this study, the proportion of non-serious BPT participants at two medical faculties (total sample: NF1=1,410, NF2=1,176) in winter term 2015/16 was determined both by the number of unanswered questions on the test itself and in a survey using a standardized instrument (NF1=415, NF2=234). Furthermore, open questions were asked in this survey about perceived benefits and perceived costs, which were analyzed with qualitative and quantitative methods. Results: The BPT is generally better accepted at Faculty 2. This can be seen in the higher proportion of serious test takers, the lower perceived costs and the higher reported benefit, as well as the higher proportion of constructive comments. Faculty 2 students better understood the principle of formative testing and used the results of the BPT as feedback on their own knowledge progress, motivation to learn and reduction of exam fear. Discussion: When medical faculties integrate formative assessments into the curriculum, they have to provide a framework in which these assessments are perceived as an important part of the curriculum. Otherwise, it is questionable whether they can fulfil their function of accompanying the learning process.

What reasons do final-year medical students give for choosing the hospitals for their clinical training phases? A quantitative content analysis.

Aim: In the final (practical) year (PY), students have the opportunity to become familiar with their potential future place of work. At the same time, university hospitals and teaching hospitals compete to recruit the best junior staff from this pool. The aim of this study is to present students' selection criteria for the location of the final year in detail. Methods: On the formal evaluation of the final year at the Mannheim Medical Faculty, students were asked after each training period which reasons led to the selection of the location. Thirty-one subcategories were formed from the free-text responses, sorted according to their controllability and then grouped into 11 main categories. The Mannheim University Hospital introduced an expense allowance in November 2015. The data from the period before and after its introduction, the reasons given for choosing the location for the compulsory and elective subjects, and the reasons given for choosing a teaching hospital or university hospital were evaluated and compared separately. Results: A total of 1,164 questionnaires were evaluated from the period before the introduction of the expense allowance, and 1,120 questionnaires were evaluated from the period after the introduction. Overall, Proximity (19%), Financial incentives (18%) and Subject (18%) were the most frequently cited reasons. The Financial incentives subcategory was the most frequent in period 1 (32%), but lost relevance in period 2 (6%). In contrast, Recommendation gained in importance (from 8% to 15%). A comparison of the lead categories shows that teaching hospitals benefit more from their public image and university hospitals more from the subjects they offer. Conclusion: Students primarily choose the location for their final year for pragmatic reasons, such as Incentives and Living environment, but the Public image of the hospitals also plays a significant role. The frequency of the reasons given differs between compulsory and elective subjects, as well as between university hospitals and teaching hospitals. The results can help to improve the attractiveness of the location in a targeted manner and to present a specific image to the public.

The frequency of using certain feedback methods in the teaching of medicine: a survey of teachers at the medical faculties in Baden-Wurttemberg.

Objectives: Feedback is one of the most important methods for competency-based teaching. A survey was conducted to learn more about the use of feedback methods at five medical faculties. Methods: In the 2017 summer semester, teachers at Baden-Wurttemberg's medical schools in Freiburg, Heidelberg, Mannheim, Tuebingen and Ulm were invited to participate in the survey. The link to the questionnaire was sent to the teaching coordinators at the various departments at each of the five medical schools. The teaching coordinators were asked to forward the link to the questionnaire to all instructors in their department. At one location, all instructors were directly addressed. The data were collected online. Results: A total of 464 instructors participated in the survey. Most consider feedback in medical education as important (23%) or very important (72%). However, some feedback methods are hardly used. The reason for this is, in particular, that some of the feedback methods are unfamiliar, e.g. checklists (56%), or not considered necessary by the instructors, e.g. written feedback (31%). Fifty-five percent of the instructors would like to receive further education or information on feedback. Conclusion: The results show that the use of feedback methods in medical teaching is expandable and that teachers find feedback to be important. Accordingly, nothing should stand in the way of a greater use of feedback methods in teaching. However, in order for this to happen, it is important that instructors are made more familiar with feedback methods.

Competency-based learning in an ambulatory care setting: Implementation of simulation training in the Ambulatory Care Rotation during the final year of the MaReCuM model curriculum.

Aim: As part of the MaReCuM model curriculum at Medical Faculty Mannheim Heidelberg University, a final year rotation in ambulatory care was implemented and augmented to include ambulatory care simulation. In this paper we describe this ambulatory care simulation, the designated competency-based learning objectives, and evaluate the educational effect of the ambulatory care simulation training. Method: Seventy-five final year medical students participated in the survey (response rate: 83%). The control group completed the ambulatory rotation prior to the implementation of the ambulatory care simulation. The experimental group was required to participate in the simulation at the beginning of the final year rotation in ambulatory care. A survey of both groups was conducted at the beginning and at the end of the rotation. The learning objectives were taken from the National Competency-based Catalogue of Learning Objectives for Undergraduate Medical Education (NKLM). Results: The ambulatory care simulation had no measurable influence on students' subjectively perceived learning progress, the evaluation of the ambulatory care rotation, or working in an ambulatory care setting. At the end of the rotation participants in both groups reported having gained better insight into treating outpatients. At the beginning of the rotation members of both groups assessed their competencies to be at the same level. The simulated ambulatory scenarios were evaluated by the participating students as being well structured and easy to understand. The scenarios successfully created a sense of time pressure for those confronted with them. The ability to correctly fill out a narcotic prescription form as required was rated significantly higher by those who participated in the simulation. Participation in the ambulatory care simulation had no effect on the other competencies covered by the survey. Discussion: The effect of the four instructional units comprising the ambulatory care simulation was not measurable due to the current form or the measurement point at the end of the 12-week rotation. The reasons for this could be the many and statistically elusive factors relevant to the individual and the wide variety among final year rotation placements, the late point in time of the final survey, and the selection of simulated scenarios. The course is slated to undergo specific further development and should be supplemented with additional learning opportunities to ensure that the main learning objectives are covered. The description of the teaching format is meant to contribute to the ongoing development of medical education with an emphasis on competency in the areas of ambulatory care, communication, prevention and health promotion.

Physicians' roles in competency-based teaching: Do students recognize them?

Introduction: Imparting the concept of physician's roles with the help of new teaching formats is becoming increasingly important in medical education. The "ambulatory care simulation" was developed at the Medical Faculty Mannheim as a format to teach the roles of "medical expert," "communicator", "health advocate", "manager", "team member" and "professional" in the practical year. During the "ambulatory care simulation", students work through case scenarios with simulated patients focusing on the physician's roles and subsequently discussing and reflecting on their experiences. Several measures are designated to ensure that each role is covered by the new teaching format. The present study investigates whether the physician's roles are actually addressed during the "ambulatory care simulation" and whether the competency-based learning objectives are recognized by the students. Methods: All participants in 12 of the 38 obligatory "ambulatory care simulations" signed informed consents to be filmed during the "ambulatory care simulation". These videos were categorized using previously defined observation criteria. A total of 211 out of 224 students completed and handed in a one-minute paper at the end of the "ambulatory care simulation". The answers to the question, "What have you learned?" have been assigned to competency-based learning objectives. Results: Although instructors and students adhered to the guidelines in the recorded "ambulatory care simulations", the most frequently addressed roles were "medical expert" and "communicator." Two-thirds of the participants indicate learning outcomes that do not correspond to the previously defined learning objectives of the "ambulatory care simulation". Discussion: To ensure a thorough understanding and long-lasting appreciation of the physician's roles, longitudinal integration of teaching interventions into the curriculum is to be favored over single teaching units. Instructors need intensive preparation for the unfamiliar construct of physician's roles. The learning objectives must also be made more transparent. Conclusion: Especially complex teaching formats need to be evaluated for success if they are to achieve their aims. Formative evaluations enable verification of whether the learning objectives are addressed, recognized and, finally, achieved.

The inventory as a core element in the further development of the science curriculum in the Mannheim Reformed Curriculum of Medicine.

Introduction: The German Council of Science and Humanities as well as a number of medical professional associations support the strengthening of scientific competences by developing longitudinal curricula for teaching scientific competences in the undergraduate medical education. The National Competence Based Catalogue of Learning Objectives for Undergraduate Medical Education (NKLM) has also defined medical scientific skills as learning objectives in addition to the role of the scholar. The development of the Mannheim science curriculum started with a systematic inventory of the teaching of scientific competences in the Mannheim Reformed Curriculum of Medicine (MaReCuM). Methods: The inventory is based on the analysis of module profiles, teaching materials, surveys among experts, and verbatims from memory. Furthermore, science learning objectives were defined and prioritized, thus enabling the contents of the various courses to be assigned to the top three learning objectives. Results: The learning objectives systematic collection of information regarding the current state of research, critical assessment of scientific information and data sources, as well as presentation and discussion of the results of scientific studies are facilitated by various teaching courses from the first to the fifth year of undergraduate training. The review reveals a longitudinal science curriculum that has emerged implicitly. Future efforts must aim at eliminating redundancies and closing gaps; in addition, courses must be more closely aligned with each other, regarding both their contents and their timing, by means of a central coordination unit. Conclusion: The teaching of scientific thinking and working is a central component in the MaReCuM. The inventory and prioritization of science learning objectives form the basis for a structured ongoing development of the curriculum. An essential aspect here is the establishment of a central project team responsible for the planning, coordination, and review of these measures.

Publication activity in medical education research: A descriptive analysis of submissions to the GMS Zeitschrift für Medizinische Ausbildung in 2007-2015.

Objectives: The significance of medical education research has increased internationally. In this context we investigated whether, and if so, how the quantity and quality of scientific papers reviewed and/or published by the GMS Zeitschrift für Medizinische Ausbildung (GMS Z Med Ausbild) changed. Methods: The quantity and ratio of original papers, project reports and reviews submitted to or published in the GMS Z Med Ausbild were analysed. Published scientific articles were investigated in regard to the quality features "study type" and "mode of data collection" as well as the background (university affiliation) of the last authors. The citation frequency within the first five years after PubMed listing was compared to the one of BMC Medical Education in the corresponding period. Results: The number of submitted scientific manuscripts increased steadily. Most of the submissions and publications are original papers. For publications explorative studies and prospective data collection are most common. A shift over time is not observed. 16% of the published works come from one and 36% from four of the in total 39 universities represented by the last authors. The development of the citation frequency of articles published in GMS Z Med Ausbild is similar to that of BMC Medical Education. Conclusion: The rising number of submissions indicates an increasing significance of medical education research in German-speaking countries. The development of the number of citations reflects the growing appreciation of GMS Z Med Ausbild also indicated by the increasing number of online accesses. Our findings that study type and mode of data collection did not change has to be interpreted with caution since among other things choice and correct application of adequate methods are crucial regarding a scientific work's quality, too. These aspects, however, were not investigated in this paper.