Defining a set of teaching EPAs tailored to an undergraduate medical curriculum using a modified Delphi approach.

BACKGROUND: The concept of entrustable professional activities (EPAs) has recently been extended to operationalize professional tasks in teacher training and faculty development in health professions education. The aim of this study is to report on the process and results of defining a set of teaching EPAs (t-EPAs) tailored to the local characteristics of a particular undergraduate medical program. METHODS: The undergraduate medical program at the Charité - Universitätsmedizin Berlin is competency-based, integrates thematic modules and spans 6 years. A writing team identified teaching EPAs based on the program's study regulations and drafted content descriptions with titles, specifications and knowledge, skills and attitudes. Content validation involved a modified Delphi procedure with a systematic, iterative interaction between a panel of content experts consisting of purposively selected educators and physicians from our faculty (n = 11) and the writing team. The threshold for a consensus was an agreement of 80% of the participants. RESULTS: After two Delphi rounds, a consensus was reached regarding the teaching activities to be included and their content descriptions. The response rate was 100% in both Delphi rounds. The Delphi results include the content descriptions of a total of 13 teaching EPAs, organized into the two overarching EPA domains of classroom-based (n = 10) and workplace-based (n = 3) activities. Tailoring the classroom EPAs to small group teaching and the workplace EPAs to supervising medical students led to several distinct EPAs. Another feature was the development of 2 teaching EPAs for interdisciplinary teaching. CONCLUSIONS: In systematic, Delphi-based process, we defined a set of 13 distinct teaching EPAs tailored to a specific undergraduate medical program that cover the core teaching tasks for faculty in this program. Our report on the principles of the process and the results may guide other medical schools and educators in defining and tailoring teaching EPAs according to their contexts.

Clinical reasoning for acute dyspnoea: comparison between final-year medical students from discipline- and competency-based undergraduate programmes.

Clinical reasoning for acute dyspnoea: Comparison of final-year medical students from discipline- and competency-based undergraduate programmes. BACKGROUND: The global shift to competency-based medical education aims to improve the performance of its trainees, including in the key competency domain of clinical reasoning. However, research on whether such education actually improves clinical reasoning is sparse. The purpose of this study is to compare assessed clinical reasoning performance in digitally presented cases of acute dyspnoea between final-year medical students from a traditional, discipline-based and those from an integrated, competency-based undergraduate programme. METHODS: A total of 60 medical students in their final-year clerkships participated in the study; 30 were from a discipline-based programme, and 30 were from a competency-based programme of the same faculty. The students completed a knowledge test consisting of 22 single choice items and a computer-based test of clinical reasoning with six video-based case scenarios with different underlying diseases leading to dyspnoea. The operationalized measures of clinical reasoning were the number and relevance of the diagnostic tests chosen, time to diagnosis and diagnostic accuracy. RESULTS: The two groups did not differ in their knowledge of the acute dyspnoea content domain. With regard to clinical reasoning, the selection of relevant tests, time required to make a diagnosis and accuracy of the diagnosis varied across the six case scenarios in both groups. However, the results from the measures of the clinical reasoning process did not differ between the students from the two types of undergraduate medical programmes. No significant differences were found with regard to the selection of relevant diagnostic tests (M = 63.8% vs. M = 62.8%), the time to a diagnosis (M = 128.7 s vs. M = 136.4 s) or the accuracy of diagnosis (M = 82.2% vs. M = 77.0%). CONCLUSIONS: Key indicators of the clinical reasoning process, when assessed with objectively measured parameters, did not differ between final-year medical students from a traditional, discipline-based and those from an integrated, competency-based undergraduate programme in the domain of acute dyspnoea. The results substantiate and expand those of previous studies based on subjective assessor ratings that showed limited change in the clinical reasoning performance of medical students with competency-based undergraduate education.

Student participation in the development of interprofessional education courses: Perceptions and experiences of faculty members and the students.

Introduction: Student participation has shown positive effects on the curriculum development process for a single health profession. This qualitative study explores faculty members' and students' perceptions and experiences regarding student participation in interprofessional course development.Methods: Interprofessional courses were developed and implemented by interprofessional teams of faculty members and students. Two focus group discussions were carried out: one with faculty members and one with students.Results: Students contributed to both the process and the results of interprofessional course development in a complementary manner. Student participation was facilitated via motivation for and through work on interprofessional education, a balance between clarity on tasks and students' autonomy, and a low-hierarchy team atmosphere. Students developed professionally, and faculty members saw them as future ambassadors for interprofessional collaboration.Conclusions: This study provides multiple qualitative evidence for a positive, complementary role of student participation in interprofessional course development. A number of factors were identified that should be nurtured to facilitate this effect. Our findings may stimulate and guide other schools to actively involve students in the development of interprofessional education.

Introducing an assessment tool based on a full set of end-of-training EPAs to capture the workplace performance of final-year medical students.

BACKGROUND: While literature on the theoretical value of entrustable professional activities (EPAs) for assessment is rapidly expanding, little experience exists on its application. The aims of this study are to develop and explore the utility of an EPA-based assessment tool for capturing the workplace performance of final-year medical students based on a full set of end-of-training EPAs. METHODS: The tool was developed in a systematic iterative process. Twelve 12 end-of-undergraduate medical training EPAs were nested into 72 smaller EPAs and cross-mapped onto a 6-point supervision level scale, both adjusted to the context of final-year clerkships. One version was created for students' self-assessment of their ability to carry out tasks and their history of carrying out tasks, and another version was created for supervisors' assessment of students' ability to carry out tasks. The tool was administered to final-year clerkship students and their clinical supervisors to explore its utility as an assessment approach. The results were analysed using descriptive and interferential statistics. RESULTS: We enrolled a total of 60 final-year medical students. For 33 students, ratings were provided from one supervisor and for 27 students from two supervisors. With regard to the reliability and validity of the tool, students' and supervisors' ratings showed an overall good internal consistency as well as variability between and within the EPAs. Over the full EPA range, students rated their ability to perform a task slightly higher than their task performance history and slightly lower than the supervisors' ratings. Students' self-ratings of their ability to perform a task correlated with their history in performing the task. Supervisors' ratings correlated among supervisors and not with students' ratings. Concerning educational outcomes, supervisors' average rating of students' ability to perform the EPAs without direct supervision was 64%, and key findings being double-checked. CONCLUSIONS: This study introduces a tool that is adjusted to the final-year clerkship context and can assess the workplace performance of trainees based on a full set of end-of-training EPAs. Its utility characteristics suggest that the tool may be employed as a formative and outcome-aligned approach to the assessment of final-year students before entering into residency.

Medical students' ratings of the relevance and actual implementation of interprofessional education and preferences for teaching formats: comparison by gender and prior education.

Objectives: Interprofessional education is becoming increasingly important for collaboration in patient care. In the national context, there are few empirical studies on the assessment of medical students as important stakeholders in their education. Method: Students (N=2,974) participated in a semester-wide online evaluation of the modular curriculum of medicine at the Charité Berlin. Socio-demographic data (including gender, completion of prior education/studies), assessments of the relevance and extent of interprofessional collaboration and preferences for interprofessional education in various teaching formats were collected. Results: In total, data from 1,019 students were included in the evaluation. The relevance of interprofessional collaboration was considered high by medical students. Female students rated the relevance higher than male students. The completion of pre-education (vocational training or study) had no additional influence. The actual implementation of interprofessional education was rated equally low by female and male students. Medical students rated patient-centred, interactive small group formats as particularly suitable for interprofessional education. There were no gender differences, but the effect was more pronounced among students with vocational training. Conclusion: The assessments of female and male students show a large difference between the perceived relevance and the actual implementation of interprofessional collaboration in the modular curriculum of medicine. This study provides an empirical basis for the actual implementation of interprofessional collaboration and students' views on suitable teaching formats for interprofessional education.

Patient safety during final-year clerkships: A qualitative study of possible error sources and of the potential of Entrustable Professional Activities.

Aim: In final-year clerkships, such as the Practical Year in Germany, students' workplace learning has to be balanced with the ensuring of patient safety. In this qualitative study, we investigated problems concerning patient safety as perceived from the perspective of supervising physicians, and whether and to what extent Entrustable Professional Activities (EPAs) can lead to an improvement in patient safety. Method: Data was collected through focus groups. Participants were specialist physicians with experience of final-year clerkship training (n=11). The analysis of problems influencing patient safety was carried out deductively with an existing system of categories (error factors in the clinic). To identify potential improvements through EPAs, an inductively developed category system on the influence of EPAs in final-year clerkships was used. Results: Supervising physicians perceive a variety of problems which affect patient safety. These can be found in the categories organization and management, individual factors, task factors and work environment. The physicians feel that EPAs may lead to an improvement in training and subsequently in patient safety. Their comments can be collated to the categories improvement in training, performance levels and supporting learning processes, transparency and minimizing uncertainty. Conclusions: Statements by supervising physicians indicate a variety of problems in patient safety during the training of final-year clerkship students, for instance the lack of structure to the training. In their view, the implementation of EPAs can substantially reduce such risks, as they provide better content and organizational structure to the final-year clerkship.