Development of a survey to support assessment of safety learning systems.

BACKGROUND: Patient safety learning systems play a critical role in supporting safety culture in healthcare organisations. A lack of explicit standards leads to inconsistent implementation across organisations, causing uncertainty about their roles and impact. Organisations can address inconsistent implementation by using a self-assessment tool based on agreed-on best practices. Therefore, we aimed to create a survey instrument to assess an organisation's approach to learning from safety events. METHODS: The foundation for this work was a recent systematic review that defined features associated with the performance of a safety learning system. We organised features into themes and rephrased them into questions (items). Face validity was checked, which included independent pre-testing to ensure comprehensibility and parsimony. It also included clinical sensibility testing in which a representative sample of leaders in quality at a large teaching hospital (The Ottawa Hospital) answered two questions to judge each item for clarity and necessity. If more than 20% of respondents judged a question unclear or unnecessary, we modified or removed that question accordingly. Finally, we checked the internal consistency of the questionnaire using Cronbach's alpha. RESULTS: We initially developed a 47-item questionnaire based on a prior systematic review. Pre-testing resulted in the modification of 15 of the questions, 2 were removed and 2 questions were added to ensure comprehensiveness and relevance. Face validity was assessed through yes/no responses, with over 80% of respondents confirming the clarity and 85% the necessity of each question, leading to the retention of all 47 questions. Data collected from the five-point responses (strongly disagree to strongly agree) for each question were used to assess the questionnaire's internal consistency. The Cronbach's alpha was 0.94, indicating a high internal consistency. CONCLUSION: This self-assessment questionnaire is evidence-based and on preliminary testing is deemed valid, comprehensible and reliable. Future work should assess the range of survey responses in a large sample of respondents from different hospitals.

Barriers and facilitators to improving patient safety learning systems: a systematic review of qualitative studies and meta-synthesis.

BACKGROUND: The implementation and continuous improvement of patient safety learning systems (PSLS) is a principal strategy for mitigating preventable harm to patients. Although substantial efforts have sought to improve these systems, there is a need to more comprehensively understand critical success factors. This study aims to summarise the barriers and facilitators perceived by hospital staff and physicians to influence the reporting, analysis, learning and feedback within PSLS in hospitals. METHODS: We performed a systematic review and meta-synthesis by searching MEDLINE (Ovid), EMBASE (Ovid), CINAHL, Scopus and Web of Science. We included English-language manuscripts of qualitative studies evaluating effectiveness of the PSLS and excluded studies evaluating specific individual adverse events, such as systems for tracking only medication side effects, for example. We followed the Joanna Briggs Institute methodology for qualitative systematic reviews. RESULTS: We extracted data from 22 studies, after screening 2475 for inclusion/exclusion criteria. The included studies focused on reporting aspects of the PSLS, however, there were important barriers and facilitators across the analysis, learning and feedback phases. We identified the following barriers for effective use of PSLS: inadequate organisational support with shortage of resources, lack of training, weak safety culture, lack of accountability, defective policies, blame and a punitive environment, complex system, lack of experience and lack of feedback. We identified the following enabling factors: continuous training, a balance between accountability and responsibility, leaders as role models, anonymous reporting, user-friendly systems, well-structured analysis teams, tangible improvement. CONCLUSION: Multiple barriers and facilitators to uptake of PSLS exist. These factors should be considered by decision makers seeking to enhance the impact of PSLS. ETHICS AND DISSEMINATION: No formal ethical approval or consent were required as no primary data were collected.