Supporting Error Management and Safety Climate in Ambulatory Care Practices: The CIRSforte Study.

BACKGROUND: To improve patient safety, it is important that healthcare facilities learn from critical incidents. Tools such as reporting and learning systems and team meetings structure error management and promote learning from incidents. To enhance error management in ambulatory care practices, it is important to promote a climate of safety and ensure personnel share views on safety policies and procedures. In contrast to the hospital sector, little research has been dedicated to developing feasible approaches to supporting error management and safety climate in ambulatory care. In this study, we developed, implemented, and evaluated a multicomponent intervention to address how error management and safety climate can be improved in ambulatory care practices. METHODS: In a prospective 1-group pretest-posttest implementation study, we sought to encourage teams in German ambulatory practices to use proven methods such as guidelines, workshops, e-learning, (online) meetings, and e-mail newsletters. A pretest-posttest questionnaire was used to evaluate level and strength of safety climate and psychological behavioral determinants for systematic error management. Using 3 short surveys, we also assessed the state of error management in the participating practices. In semistructured interviews, we asked participants for their views on our intervention measures. RESULTS: Overall, 184 ambulatory care practices nationwide agreed to participate. Level of safety climate and safety climate strength (rwg) improved significantly. Of psychological behavioral determinants, significant improvements could be seen in "action/coping planning" and "action control." Seventy-six percent of practices implemented a new reporting and learning system or modified their existing system. The exchange of information between practices also increased over time. Interviews showed that the introductory workshop and provided materials such as report forms or instructions for team meetings were regarded as helpful. CONCLUSIONS: A significant improvement in safety climate level and strength, as well as participants' knowledge of how to analyze critical incidents, derive preventive measures and develop concrete plans suggest that it is important to train practice teams, to provide practical tips and tools, and to facilitate the exchange of information between practices. Future randomized and controlled intervention trials should confirm the effectiveness of our multicomponent intervention.Trial registration: Retrospectively registered on 18. November 2019 in German Clinical Trials Register No. DRKS00019053.

[17 years of the critical incident reporting and learning system "jeder-fehler-zaehlt.de" for primary care: Analysis of reports]. / 17 Jahre hausärztliches Fehlerberichts- und Lernsystem "jeder-fehler-zaehlt.de" ­ Analyse des Berichtsbestandes.

BACKGROUND: The topic of patient safety has been a subject of much discussion since the end of the last millennium. Ensuring patient safety is a central challenge in health care. An important tool to raise awareness for and learn from adverse events and thus promote patient safety are error-reporting and learning systems (Critical Incident Reporting System = CIRS). METHODS: More than 17 years after its establishment, the CIRS "jeder-fehler-zaehlt.de" (JFZ) for German primary care has undergone a revision in terms of content and technology. The revised web-based system can be used for reporting as well as for classifying and analyzing incident reports. During this process, a descriptive analysis of the current report inventory was carried out, with a focus on serious medication errors. This included all 781 valid incident reports received between September 2004 and December 2021. RESULTS: In 576 of the 781 reports (73.8%), the GP practice was directly involved in the critical incident. Among error types, process errors predominated (79.8% of the classifications, 99.1% of the reports) compared with knowledge and skills errors (20.2% of the classifications, 39.7% of the reports). Communication errors (63.0%) were the most common contributing factor to critical incidents, followed by flaws in tasks and measures (39.7%). Serious and permanent patient harm was rarely reported (8.3% of the reports), whereas temporary patient harm was more common (40.3% of the reports). Incident reports about medication errors with at least serious patient harm included, in particular, substances that affected blood clotting, corticosteroids, and opiates. DISCUSSION: Our results complement the rates that are reported internationally for error types, patient harm, and contributing factors. Serious but preventable adverse events, so-called never events, are frequently associated with the medication process in both JFZ reports and the literature. CONCLUSION: Critical incident reporting systems cannot provide accurate information about the frequency of errors in health care, but they can offer important insights into, for example, serious medication errors. Therefore, they offer both employees and healthcare institutions an opportunity for individual and institutional learning.

Strength of Safety Measures Introduced by Medical Practices to Prevent a Recurrence of Patient Safety Incidents: An Observational Study.

OBJECTIVE: The aim of this study was to analyze the strength of safety measures described in incident reports in outpatient care. METHODS: An incident reporting project in German outpatient care included 184 medical practices with differing fields of specialization. The practices were invited to submit anonymous incident reports to the project team 3 times for 17 months. Using a 14-item coding scheme based on international recommendations, we deductively coded the incident reports and safety measures. Safety measures were classified as "strong" (likely to be effective and sustainable), "intermediate" (possibly effective and sustainable), or "weak" (less likely to be effective and sustainable). RESULTS: The practices submitted 245 incident reports. In 160 of them, 243 preventive measures were described, or an average of 1.5 per report. The number of documented measures varied from 1 in 67% to 4 in 5% of them. Four preventive measures (2%) were classified as strong, 37 (15%) as intermediate, and 202 (83%) as weak. The most frequently mentioned measures were "new procedure/policy" (n = 121) and "information/notification/warning" (n = 45). CONCLUSIONS: The study provides examples of critical incidents in medical practices and for the first time examines the strength of ensuing measures introduced in outpatient care. Overall, the proportion of weak measures is (too) high, indicating that practices need more support in identifying strong measures.

Providing an interactive undergraduate elective on safety culture online - concept and evaluation.

BACKGROUND: The COVID-19 pandemic has made it more difficult to maintain high quality in medical education. As online formats are often considered unsuitable, interactive workshops and seminars have particularly often been postponed or cancelled. To meet the challenge, we converted an existing interactive undergraduate elective on safety culture into an online event. In this article, we describe the conceptualization and evaluation of the elective. METHODS: The learning objectives of the safety culture elective remained unchanged, but the teaching methods were thoroughly revised and adapted to suit an online setting. The online elective was offered as a synchronous two-day course in winter semester 2020/21 during the "second wave" of the COVID-19 pandemic in Germany. At the end of each day, participating students evaluated the elective by completing an online survey. Items were rated on a six-point Likert scale. We used SPSS for data analysis. RESULTS: Twenty medical undergraduates completed the elective and rated it extremely positively (1.1 ± 0.2). Students regard safety culture as very important and felt the learning objectives had been achieved. Moreover, they were very satisfied with the design and content of the elective, and especially with interactive elements like role-play. Around 55% of participants would recommend continuing to offer the online elective after the pandemic. CONCLUSIONS: It makes sense to offer undergraduate medical students online elective courses on safety culture, especially during a pandemic. The elective described here can serve as a best practice example of how to teach safety culture to undergraduates, especially when physical presence is unfeasible. Electives requiring a high degree of interaction can also function well online.

Characteristics of Critical Incident Reporting Systems in Primary Care: An International Survey.

OBJECTIVE: The aim of the study was to support the development of future critical incident reporting systems (CIRS) in primary care by collecting information on existing systems. Our focus was on processes used to report and analyze incidents, as well as strategies used to overcome difficulties. METHODS: Based on literature from throughout the world, we identified existing CIRS in primary care. We developed a questionnaire and sent it to operators of a purposeful sample of 17 CIRS in primary care. We used cross-case analysis to compare the answers and pinpoint important similarities and differences in the CIRS in our sample. RESULTS: Ten CIRS operators filled out the questionnaire, and 9 systems met our inclusion criteria. The sample of CIRS came from 8 different countries and was rather heterogeneous. The reporting systems invited a broad range of professions to report, with some also including reports by patients. In most cases, reporting was voluntary and conducted via an online reporting form. Reports were analyzed locally, centrally, or both. The various CIRS used interesting ideas to deal with barriers. Some, for example, used confidential reporting modes as a compromise between anonymity and the need for follow-up investigations, whereas others used smartphone applications and call centers to speed up the reporting process. CONCLUSIONS: We found multiple CIRS that have operated in primary care for many years and have received a high number of reports. They were largely developed in accordance with recommendations found in literature. Developers of future systems may find this overview useful.

[Design and evaluation of a preclinical medical elective titled "Safety culture in healthcare: Every error counts!"] / Konzeption und Evaluation eines vorklinischen medizinischen Wahlpflichtfaches "Sicherheitskultur in der Medizin: Jeder Fehler zählt!".

INTRODUCTION: The World Health Organization has called for more importance to be attached to the subject of patient safety in medical studies. However, teaching staff are unsure when the right time is to include this topic in existing medical school curricula. The aim of this article is to present the learning objectives, design and evaluation of a two-day elective on patient safety offered in the preclinical phase of medical studies at the Faculty of Medicine, University of Frankfurt am Main. To the best of our knowledge, no existing elective on safety culture has been provided at such an early stage of medical studies in Germany. METHODS: After defining learning objectives and teaching methods, the safety culture elective was offered in the winter term 2019/20. Based on a questionnaire, a quantitative and qualitative evaluation of the students' acceptance of the elective was carried out. We also sought to investigate whether group role-play was considered an effective means of communicating the teaching content. Acceptance and rejection of the elective were evaluated on a six-point Likert scale. RESULTS: The resulting elective, consisting of topical input via film, an introductory speech, role-play and discussions, is presented. Nineteen students in the preclinical phase of their medical studies took part. Overall, the quantitative and qualitative evaluation delivered positive results (1.2±0.5), and the topic was perceived to very important. The students considered the didactic implementation and the learning objectives to be very good, and they became acquainted with different sources of error. DISCUSSION: The preclinical elective would appear to be suitable for demonstrating the importance of medical safety to medical students and teaching them how to deal with the topic constructively. It can be viewed as a best-practice example for the development of comparable learning formats at medical faculties. CONCLUSION: The results show that the preclinical phase is a suitable time to illustrate the importance of the subject of patient safety during medical studies.

Improving critical incident reporting in primary care through education and involvement.

BACKGROUND: Critical incident reporting systems (CIRS) can be an important tool for the identification of organisational safety needs and thus to improve patient safety. In German primary care, CIRS use is obligatory but remains rare. Studies on CIRS implementation in primary care are lacking, but those from secondary care recommend involving management personnel. OBJECTIVE: This project aimed to increase CIRS use in 69 practices belonging to a local practice network. METHODS: The intervention consisted of the provision of a web-based CIRS, accompanying measures to train practice teams in error management and CIRS, and the involvement of the network's management. Three measurements were used: (1) number of incident reports and user access rates to the web-based CIRS were recorded, (2) staff were given a questionnaire addressing incident reporting, error management and safety climate and (3) qualitative reflection conferences were held with network management. RESULTS: Over 20 months, 17 critical incidents were reported to the web-based CIRS. The number of staff intending to report the next incident online decreased from 42% to 20% of participants. In contrast, the number of practices using an offline CIRS (eg, incident book) increased from 23% to 49% of practices. Practices also began proactively approaching network management for help with incidents. After project completion, participants scored higher in the patient safety climate factor 'perception of causes of errors'. For many practices, the project provided the first contact with structured error management. CONCLUSION: Specific measures to improve the use of CIRS in primary care should focus on network management and practice owners. Practices need basic training on safety culture and error management. Continuing, practices should implement an offline CIRS, before they can profit from the exchange of reports via web-based CIRS. It is crucial that practices receive feedback on incidents, and trained network management personnel can provide such support.

[jeder-fehler-zaehlt.de: Content of and prospective benefits from a critical incident reporting and learning system (CIRS) for primary care]. / Das hausärztliche Fehlerberichts- und Lernsystem 'jeder-fehler-zaehlt.de' - Berichtsbestand und Nutzungsperspektiven.

Critical incident reporting and learning systems (CIRS) have been recommended as an instrument to promote patient safety for a long time. However, both their scientific value and their actual impact have been disputed. The nationwide German CIRS for primary care has been in operation since September 2004. Incident reports are available online, and the question is how to make use of this large database to promote patient safety. A descriptive analysis of the content was performed, classifying, in particular, types of error and contributing factors. Its usage is presented for the period from 2004 to 2013 where a total of 483 complete reports have been recorded. Their severity ranges from 35.6 % with no tangible harm to patients to 14.6 % with important harm (or errors contributing to mortality). The majority of them (74.2 %) were process errors, compared to 25.8 % knowledge/skills errors. The main areas involved were treatment/medication (54.2 %) and diagnosis/tests (16.4 %). The results of the analysis of the CIRS cannot be used as an epidemiological data source. And yet they will generate hypotheses for further research in the field of patient safety. Moreover, they will enable practice teams to make themselves familiar with and learn from critical incident analysis. In spite of the specific difficulties in ambulatory care, CIRS should be promoted in this sector to enable learning. Participation in CIRS can be increased by enhanced feedback.