Feasibility and evaluation of high-fidelity simulation education for acute clinical toxicology.

To prepare medical students appropriately for the management of toxicological emergencies, we have developed a simulation-based medical education (SBME) training in acute clinical toxicology. Our aim is to report on the feasibility, evaluation and lessons learned of this training. Since 2019, each year approximately 180 fifth-year medical students are invited to participate in the SBME training. The training consists of an interactive lecture and two SBME stations. For each station, a team of students had to perform the primary assessment and management of an intoxicated patient. After the training, the students completed a questionnaire about their experiences and confidence in clinical toxicology. Overall, the vast majority of students agreed that the training provided a fun, interactive and stimulating way to teach about clinical toxicology. Additionally, they felt more confident regarding their skills in this area. Our pilot study shows that SBME training was well-evaluated and feasible over a longer period.

Quality indicators for appropriate in-hospital pharmacotherapeutic stewardship: An international modified Delphi study.

AIMS: In-hospital prescribing errors may result in patient harm, such as prolonged hospitalisation and hospital (re)admission, and may be an emotional burden for the prescribers and healthcare professionals involved. Despite efforts, in-hospital prescribing errors and related harm still occur, necessitating an innovative approach. We therefore propose a novel approach, in-hospital pharmacotherapeutic stewardship (IPS). The aim of this study was to reach consensus on a set of quality indicators (QIs) as a basis for IPS. METHODS: A three-round modified Delphi procedure was performed. Potential QIs were retrieved from two systematic searches of the literature, in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. In two written questionnaires and a focus meeting (held between the written questionnaire rounds), potential QIs were appraised by an international, multidisciplinary expert panel composed of members of the European Association for Clinical Pharmacology and Therapeutics (EACPT). RESULTS: The expert panel rated 59 QIs and four general statements, of which 35 QIs were accepted with consensus rates ranging between 79% and 97%. These QIs describe the activities of an IPS programme, the team delivering IPS, the patients eligible for the programme and the outcome measures that should be used to evaluate the care delivered. CONCLUSIONS: A framework of 35 QIs for an IPS programme was systematically developed. These QIs can guide hospitals in setting up a pharmacotherapeutic stewardship programme to reduce in-hospital prescribing errors and improve in-hospital medication safety.

The European List of Key Medicines for Medical Education: A Modified Delphi Study.

Rational prescribing is essential for the quality of health care. However, many final-year medical students and junior doctors lack prescribing competence to perform this task. The availability of a list of medicines that a junior doctor working in Europe should be able to independently prescribe safely and effectively without supervision could support and harmonize teaching and training in clinical pharmacology and therapeutics (CPT) in Europe. Therefore, our aim was to achieve consensus on such a list of medicines that are widely accessible in Europe. For this, we used a modified Delphi study method consisting of three parts. In part one, we created an initial list based on a literature search. In part two, a group of 64 coordinators in CPT education, selected via the Network of Teachers in Pharmacotherapy of the European Association for Clinical Pharmacology and Therapeutics, evaluated the accessibility of each medicine in his or her country, and provided a diverse group of experts willing to participate in the Delphi part. In part three, 463 experts from 24 European countries were invited to participate in a 2-round Delphi study. In total, 187 experts (40%) from 24 countries completed both rounds and evaluated 416 medicines, 98 of which were included in the final list. The top three Anatomical Therapeutic Chemical code groups were (1) cardiovascular system (n = 23), (2) anti-infective (n = 21), and (3) musculoskeletal system (n = 11). This European List of Key Medicines for Medical Education could be a starting point for country-specific lists and could be used for the training and assessment of CPT.

Using artificial intelligence to create diverse and inclusive medical case vignettes for education.

AIMS: Medical case vignettes play a crucial role in medical education, yet they often fail to authentically represent diverse patients. Moreover, these vignettes tend to oversimplify the complex relationship between patient characteristics and medical conditions, leading to biased and potentially harmful perspectives among students. Displaying aspects of patient diversity, such as ethnicity, in written cases proves challenging. Additionally, creating these cases places a significant burden on teachers in terms of labour and time. Our objective is to explore the potential of artificial intelligence (AI)-assisted computer-generated clinical cases to expedite case creation and enhance diversity, along with AI-generated patient photographs for more lifelike portrayal. METHODS: In this study, we employed ChatGPT (OpenAI, GPT 3.5) to develop diverse and inclusive medical case vignettes. We evaluated various approaches and identified a set of eight consecutive prompts that can be readily customized to accommodate local contexts and specific assignments. To enhance visual representation, we utilized Adobe Firefly beta for image generation. RESULTS: Using the described prompts, we consistently generated cases for various assignments, producing sets of 30 cases at a time. We ensured the inclusion of mandatory checks and formatting, completing the process within approximately 60 min per set. CONCLUSIONS: Our approach significantly accelerated case creation and improved diversity, although prioritizing maximum diversity compromised representativeness to some extent. While the optimized prompts are easily reusable, the process itself demands computer skills not all educators possess. To address this, we aim to share all created patients as open educational resources, empowering educators to create cases independently.

The impact of a summative national prescribing assessment and curriculum type on the development of the prescribing competence of junior doctors.

PURPOSE: The primary aim of this study was to investigate the effect of including the Dutch National Pharmacotherapy Assessment (DNPA) in the medical curriculum on the level and development of prescribing knowledge and skills of junior doctors. The secondary aim was to evaluate the relationship between the curriculum type and the prescribing competence of junior doctors. METHODS: We re-analysed the data of a longitudinal study conducted in 2016 involving recently graduated junior doctors from 11 medical schools across the Netherlands and Belgium. Participants completed three assessments during the first year after graduation (around graduation (+ / - 4 weeks), and 6 months, and 1 year after graduation), each of which contained 35 multiple choice questions (MCQs) assessing knowledge and three clinical case scenarios assessing skills. Only one medical school used the DNPA in its medical curriculum; the other medical schools used conventional means to assess prescribing knowledge and skills. Five medical schools were classified as providing solely theoretical clinical pharmacology and therapeutics (CPT) education; the others provided both theoretical and practical CPT education (mixed curriculum). RESULTS: Of the 1584 invited junior doctors, 556 (35.1%) participated, 326 (58.6%) completed the MCQs and 325 (58.5%) the clinical case scenarios in all three assessments. Junior doctors whose medical curriculum included the DNPA had higher knowledge scores than other junior doctors (76.7% [SD 12.5] vs. 67.8% [SD 12.6], 81.8% [SD 11.1] vs. 76.1% [SD 11.1], 77.0% [12.1] vs. 70.6% [SD 14.0], p < 0.05 for all three assessments, respectively). There was no difference in skills scores at the moment of graduation (p = 0.110), but after 6 and 12 months junior doctors whose medical curriculum included the DNPA had higher skills scores (both p < 0.001). Junior doctors educated with a mixed curriculum had significantly higher scores for both knowledge and skills than did junior doctors educated with a theoretical curriculum (p < 0.05 in all assessments). CONCLUSION: Our findings suggest that the inclusion of the knowledge focused DNPA in the medical curriculum improves the prescribing knowledge, but not the skills, of junior doctors at the moment of graduation. However, after 6 and 12 months, both the knowledge and skills were higher in the junior doctors whose medical curriculum included the DNPA. A curriculum that provides both theoretical and practical education seems to improve both prescribing knowledge and skills relative to a solely theoretical curriculum.

A comparison of the clinical pharmacotherapy knowledge of medical and surgical residents and consultants.

PURPOSE: Knowledge of clinical pharmacotherapy is essential for all who prescribe medication. The aims of this study were to investigate differences in the pharmacotherapy and polypharmacy knowledge of medical and surgical residents and consultants and whether this knowledge can be improved by following an online course. METHODS: Design: A before-and-after-measurement. SETTING: An online course available for Dutch residents and consultants working in hospitals. STUDY POPULATION: Dutch residents and consultants from different disciplines who voluntarily followed an online course on geriatric care. INTERVENTION: An online 6-week course on geriatric care, with 1 week dedicated to clinical pharmacotherapy and polypharmacy. Variables, such as medical vs surgical specialty, consultant vs resident, age, and sex, that could predict the level of knowledge. The effects of the online course were studied using repeated measures ANOVA. The study was approved by the National Ethics Review Board of Medical Education (NERB dossier number 996). RESULTS: A total of 394 residents and 270 consultants, 220 from surgical and 444 from medical specialties, completed the online course in 2016 and 2017. Residents had higher test scores than consultants for pharmacotherapy (73% vs 70%, p < 0.02) and polypharmacy (75% vs 72%, p < 0.02). The learning effect did not differ. Medical residents/consultants had a better knowledge of pharmacotherapy (74% vs 68%, p < 0.001) and polypharmacy (77% vs 66%, p < 0.001) than surgical residents/consultants, but the learning effect was the same. CONCLUSIONS: Residents and consultants had a similar learning curve for acquiring knowledge, but residents outperformed consultants on all measures. In addition, surgical and medical residents/consultants had similar learning curves, but medical residents/consultants had higher test scores on all measures.

Factors influencing in-hospital prescribing errors: A systematic review.

AIM: In-hospital prescribing errors (PEs) may result in patient harm, prolonged hospitalization and hospital (re)admission. These events are associated with pressure on healthcare services and significant healthcare costs. To develop targeted interventions to prevent or reduce in-hospital PEs, identification and understanding of facilitating and protective factors influencing in-hospital PEs in current daily practice is necessary, adopting a Safety-II perspective. The aim of this systematic review was to create an overview of all factors reported in the literature, both protective and facilitating, as influencing in-hospital PEs. METHODS: PubMed, EMBASE.com and the Cochrane Library (via Wiley) were searched, according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement, for studies that identified factors influencing in-hospital PEs. Both qualitative and quantitative study designs were included. RESULTS: Overall, 19 articles (6 qualitative and 13 quantitative studies) were included and 40 unique factors influencing in-hospital PEs were identified. These factors were categorized into five domains according to the Eindhoven classification ('organization-related', 'prescriber-related', 'prescription-related', 'technology-related' and 'unclassified') and visualized in an Ishikawa (Fishbone) diagram. Most of the identified factors (87.5%; n = 40) facilitated in-hospital PEs. The most frequently identified facilitating factor (39.6%; n = 19) was 'insufficient (drug) knowledge, prescribing skills and/or experience of prescribers'. CONCLUSION: The findings of this review could be used to identify points of engagement for future intervention studies and help hospitals determine how to optimize prescribing. A multifaceted intervention, targeting multiple factors might help to circumvent the complex challenge of in-hospital PEs.

The Dutch list of essential drugs for undergraduate medical education: A modified Delphi study.

AIMS: Prescribing errors among junior doctors are common in clinical practice because many lack prescribing competence after graduation. This is in part due to inadequate education in clinical pharmacology and therapeutics (CP&T) in the undergraduate medical curriculum. To support CP&T education, it is important to determine which drugs medical undergraduates should be able to prescribe safely and effectively without direct supervision by the time they graduate. Currently, there is no such list with broad-based consensus. Therefore, the aim was to reach consensus on a list of essential drugs for undergraduate medical education in the Netherlands. METHODS: A two-round modified Delphi study was conducted among pharmacists, medical specialists, junior doctors and pharmacotherapy teachers from all eight Dutch academic hospitals. Participants were asked to indicate whether it was essential that medical graduates could prescribe specific drugs included on a preliminary list. Drugs for which ≥80% of all respondents agreed or strongly agreed were included in the final list. RESULTS: In all, 42 (65%) participants completed the two Delphi rounds. A total of 132 drugs (39%) from the preliminary list and two (3%) newly proposed drugs were included. CONCLUSIONS: This is the first Delphi consensus study to identify the drugs that Dutch junior doctors should be able to prescribe safely and effectively without direct supervision. This list can be used to harmonize and support the teaching and assessment of CP&T. Moreover, this study shows that a Delphi method is suitable to reach consensus on such a list, and could be used for a European list.

A Clinical Pharmacology and Therapeutics Teacher's Guide to Race-Based Medicine, Inclusivity, and Diversity.

The relationship between race and biology is complex. In contemporary medical science, race is a social construct that is measured via self-identification of study participants. But even though race has no biological essence, it is often used as variable in medical guidelines (e.g., treatment recommendations specific for Black people with hypertension). Such recommendations are based on clinical trials in which there was a significant correlation between self-identified race and actual, but often unmeasured, health-related factors such as (pharmaco)genetics, diet, sun exposure, etc. Many teachers are insufficiently aware of this complexity. In their classes, they (unintentionally) portray self-reported race as having a biological essence. This may cause students to see people of shared race as biologically or genetically homogeneous, and believe that race-based recommendations are true for all individuals (rather than reflecting the average of a heterogeneous group). This medicalizes race and reinforces already existing healthcare disparities. Moreover, students may fail to learn that the relation between race and health is easily biased by factors such as socioeconomic status, racism, ancestry, and environment and that this limits the generalizability of race-based recommendations. We observed that the clinical case vignettes that we use in our teaching contain many stereotypes and biases, and do not generally reflect the diversity of actual patients. This guide, written by clinical pharmacology and therapeutics teachers, aims to help our colleagues and teachers in other health professions to reflect on and improve our teaching on race-based medical guidelines and to make our clinical case vignettes more inclusive and diverse.

Improving Appropriate Prescribing For Geriatric Patients Using a Clinical Decision Support System.

Purpose: Polypharmacy is a known risk factor for potentially inappropriate prescribing. Recently there is an increasing interest in clinical decision support systems (CDSS) to improve prescribing. The objective of this study was to evaluate the impact of a CDSS, with the START-STOPP criteria as main content in the setting of a geriatric ward. Endpoints were 1) appropriateness of prescribing and 2) acceptance rate of recommendations. Methods: This prospective study comparing the use of a CDSS with usual care involved patients admitted to geriatric wards in two teaching hospitals in the Netherlands. Patients were included from January to May 2017. The medications of 64 patients in the first six weeks was assessed according to the current standard, whereas the medications of 61 patients in the second six weeks were also assessed by using a CDSS. Medication appropriateness was assessed with the Medication Appropriateness Index (MAI). Results: The medications of 125 patients (median age 83 years) were reviewed. In both the usual care group and the intervention group MAI scores decreased significantly from admission to discharge (within group analyses, p<0.001). This effect was significantly larger in the intervention group (p<0.05). MAI scores at discharge in the usual care group and the intervention group were respectively 9.95±6.70 and 7.26±5.07. The CDSS generated 193 recommendations, of which 71 concerned START criteria, 45 STOPP criteria, and 77 potential interactions. Overall, 31.6% of the recommendations were accepted. Conclusion: This study shows that a CDSS to improve prescribing has additional value in the setting of a geriatric ward. Almost one third of the software-generated recommendations were interpreted as clinically relevant and accepted, on average one per patient.

Teaching resources for the European Open Platform for Prescribing Education (EurOP2E)-a nominal group technique study.

The European Open Platform for Prescribing Education (EurOP2E) seeks to improve and harmonize European clinical pharmacology and therapeutics (CPT) education by facilitating international collaboration and sharing problem-based, online, open educational resources. The COVID-19 pandemic forced teachers to switch to virtual modalities, highlighting the need for high-quality online teaching materials. The goal of this study was to establish the online problem-based teaching resources needed to sustain prescribing education during the pandemic and thereafter. A nominal group technique study was conducted with prescribing teachers from 15 European countries. Results were analyzed through thematic analysis. In four meetings, 20 teachers from 15 countries proposed and ranked 35 teaching materials. According to the participants, the most necessary problem-based-online teaching materials related to three overarching themes. Related to learning outcomes for CPT, participants proposed creating prescription scenarios, including materials focusing on background knowledge and resources on personalized medicine and topical/ethical issues such as the prescription's impact on planetary health. Second, related to teaching, they proposed online case discussions, gamification and decision support systems. Finally, in relation to faculty development, they recommend teacher courses, a repository of reusable exam questions and harmonized formularies. Future work will aim to collaboratively produce such materials.

Do we become better prescribers after graduation: A 1-year international follow-up study among junior doctors.

AIM: The aim of this study was to investigate how the prescribing knowledge and skills of junior doctors in the Netherlands and Belgium develop in the year after graduation. We also analysed differences in knowledge and skills between surgical and nonsurgical junior doctors. METHODS: This international, multicentre (n = 11), longitudinal study analysed the learning curves of junior doctors working in various specialties via three validated assessments at about the time of graduation, and 6 months and 1 year after graduation. Each assessment contained 35 multiple choice questions (MCQs) on medication safety (passing grade ≥85%) and three clinical scenarios. RESULTS: In total, 556 junior doctors participated, 326 (58.6%) of whom completed the MCQs and 325 (58.5%) the clinical case scenarios of all three assessments. Mean prescribing knowledge was stable in the year after graduation, with 69% (SD 13) correctly answering questions at assessment 1 and 71% (SD 14) at assessment 3, whereas prescribing skills decreased: 63% of treatment plans were considered adequate at assessment 1 but only 40% at assessment 3 (P < .001). While nonsurgical doctors had similar learning curves for knowledge and skills as surgical doctors (P = .53 and P = .56 respectively), their overall level was higher at all three assessments (all P < .05). CONCLUSION: These results show that junior doctors' prescribing knowledge and skills did not improve while they were working in clinical practice. Moreover, their level was under the predefined passing grade. As this might adversely affect patient safety, educational interventions should be introduced to improve the prescribing competence of junior doctors.

An inter-professional student-run medication review programme. Reducing adverse drug reactions in a memory outpatient clinic: a controlled clinical trial.

BACKGROUND: We investigated if the addition of an inter-professional student-led medication review team (ISP-team) to standard care can increase the number of detected ADRs and reduce the number of ADRs 3 months after an outpatient visit. RESEARCH DESIGN AND METHODS: In this controlled clinical trial, patients were allocated to standard care (control group) or standard care plus the ISP team (intervention group). The ISP team consisted of medical and pharmacy students and student nurse practitioners. The team performed a structured medication review and adjusted medication to reduce the number of ADRs. Three months after the outpatient visit, a clinical pharmacologist who was blinded for allocation performed a follow-up telephone interview to determine whether patients experienced ADRs. RESULTS: During the outpatient clinic visit, significantly more (p < 0.001) ADRs were detected in the intervention group (n = 48) than in the control group (n = 10). In both groups, 60-63% of all detected ADRs were managed. Three months after the outpatient visit, significantly fewer (predominantly mild and moderately severe) ADRs related to benzodiazepine derivatives and antihypertensive causing dizziness were detected in the patients of the intervention group. CONCLUSIONS: An ISP team in addition to standard care increases the detection and management of ADRs in elderly patients resulting in fewer mild and moderately severe ADRs.

Prescribing errors in post - COVID-19 patients: prevalence, severity, and risk factors in patients visiting a post - COVID-19 outpatient clinic.

BACKGROUND: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), which causes coronavirus disease 2019 (COVID-19), has challenged healthcare globally. An acute increase in the number of hospitalized patients has necessitated a rigorous reorganization of hospital care, thereby creating circumstances that previously have been identified as facilitating prescribing errors (PEs), e.g. a demanding work environment, a high turnover of doctors, and prescribing beyond expertise. Hospitalized COVID-19 patients may be at risk of PEs, potentially resulting in patient harm. We determined the prevalence, severity, and risk factors for PEs in post-COVID-19 patients, hospitalized during the first wave of COVID-19 in the Netherlands, 3 months after discharge. METHODS: This prospective observational cohort study recruited patients who visited a post-COVID-19 outpatient clinic of an academic hospital in the Netherlands, 3 months after COVID-19 hospitalization, between June 1 and October 1 2020. All patients with appointments were eligible for inclusion. The prevalence and severity of PEs were assessed in a multidisciplinary consensus meeting. Odds ratios (ORs) were calculated by univariate and multivariate analysis to identify independent risk factors for PEs. RESULTS: Ninety-eight patients were included, of whom 92% had ≥1 PE and 8% experienced medication-related harm requiring an immediate change in medication therapy to prevent detoriation. Overall, 68% of all identified PEs were made during or after the COVID-19 related hospitalization. Multivariate analyses identified ICU admission (OR 6.08, 95% CI 2.16-17.09) and a medical history of COPD / asthma (OR 5.36, 95% CI 1.34-21.5) as independent risk factors for PEs. CONCLUSIONS: PEs occurred frequently during the SARS-CoV-2 pandemic. Patients admitted to an ICU during COVID-19 hospitalization or who had a medical history of COPD / asthma were at risk of PEs. These risk factors can be used to identify high-risk patients and to implement targeted interventions. Awareness of prescribing safely is crucial to prevent harm in this new patient population.

An Interprofessional Student-Run Medication Review Program: The Clinical STOPP/START-Based Outcomes of a Controlled Clinical Trial in a Geriatric Outpatient Clinic.

As the population ages, more people will have comorbid disorders and polypharmacy. Medication should be reviewed regularly in order to avoid adverse drug reactions and medication-related hospital visits, but this is often not done. As part of our student-run clinic project, we investigated whether an interprofessional student-run medication review program (ISP) added to standard care at a geriatric outpatient clinic leads to better prescribing. In this controlled clinical trial, patients visiting a memory outpatient clinic were allocated to standard care (control group) or standard care plus the ISP team (intervention group). The medications of all patients were reviewed by a review panel ("gold standard"), resident, and in the intervention arm also by an ISP team consisting of a group of students from the medicine and pharmacy faculties and students from the higher education school of nursing for advanced nursing practice. For both groups, the number of STOPP/START-based medication changes mentioned in general practitioner (GP) correspondence and the implementation of these changes about 6 weeks after the outpatient visit were investigated. The data of 216 patients were analyzed (control group = 100, intervention group = 116). More recommendations for STOPP/START-based medication changes were made in the GP correspondence in the intervention group than in the control group (43% vs. 24%, P = < 0.001). After 6 weeks, a significantly higher proportion of these changes were implemented in the intervention group (19% vs. 9%, P = 0.001). The ISP team, in addition to standard care, is an effective intervention for optimizing pharmacotherapy and medication safety in a geriatric outpatient clinic.

Can Students Create Their Own Educational Escape Room? Lessons Learned from the Opioid Crisis Escape Room.

Educational escape rooms (EERs) are live-action, team-based games used to teach content-related and generic knowledge and skills. Instead of students just playing the EER, we believed that giving them the opportunity to create their own EERs would augment the learning effects of this teaching method. We report on the feasibility, evaluation, and lessons learned of our assignment on an opioid epidemic-based EER. This original teaching method appealed to most students, but the workload was evaluated to be too high. Our lessons learned include the need for sufficient (extrinsic) motivation, careful explanation of the assignment, and small group sizes.