Surgical Checklist Implementation Project: The Impact of Variable WHO Checklist Compliance on Risk-adjusted Clinical Outcomes After National Implementation: A Longitudinal Study.

OBJECTIVE: To evaluate impact of WHO checklist compliance on risk-adjusted clinical outcomes, including the influence of checklist components (Sign-in, Time-out, Sign-out) on outcomes. BACKGROUND: There remain unanswered questions surrounding surgical checklists as a quality and safety tool, such as the impact in cases of differing complexity and the extent of checklist implementation. METHODS: Data were collected from surgical admissions (6714 patients) from March 2010 to June 2011 at 5 academic and community hospitals. The primary endpoint was any complication, including mortality, occurring before hospital discharge. Checklist usage was recorded as checklist completed in full/partly. Multilevel modeling was performed to investigate the association between complications/mortality and checklist completion. RESULTS: Significant variability in checklist usage was found: although at least 1 of the 3 components was completed in 96.7% of cases, the entire checklist was only completed in 62.1% of cases. Checklist completion did not affect mortality reduction, but significantly lowered risk of postoperative complication (16.9% vs. 11.2%), and was largely noticed when all 3 components of the checklist had been completed (odds ratio = 0.57, 95% confidence interval: 0.37-0.87, P < 0.01). Calculated population-attributable fractions showed that 14% (95% confidence interval: 7%-21%) of the complications could be prevented if full completion of the checklist was implemented. CONCLUSIONS: Checklist implementation was associated with reduced case-mix-adjusted complications after surgery and was most significant when all 3 components of the checklist were completed. Full, as opposed to partial, checklist completion provides a health policy opportunity to improve checklist impact on surgical safety and quality of care.

A qualitative evaluation of the barriers and facilitators toward implementation of the WHO surgical safety checklist across hospitals in England: lessons from the "Surgical Checklist Implementation Project".

OBJECTIVES: To evaluate how the World Health Organization (WHO) surgical safety checklist was implemented across hospitals in England; to identify barriers and facilitators toward implementation; and to draw out lessons for implementing improvement initiatives in surgery/health care more generally. BACKGROUND: The WHO checklist has been linked to improved surgical outcomes and teamwork, yet we know little about the factors affecting its successful uptake. METHODS: A longitudinal interview study with operating room personnel was conducted across a representative sample of 10 hospitals in England between March 2010 and March 2011. Interviews were audio recorded over the phone. Interviewees were asked about their experience of how the checklist was introduced and the factors that hindered or aided this process. Transcripts were submitted to thematic analysis. RESULTS: A total of 119 interviews were completed. Checklist implementation varied greatly between and within hospitals, ranging from preplanned/phased approaches to the checklist simply "appearing" in operating rooms, or staff feeling it had been imposed. Most barriers to implementation were specific to the checklist itself (eg, perceived design issues) but also included problematic integration into preexisting processes. The most common barrier was resistance from senior clinicians. The facilitators revealed some positive steps that can been taken to prevent/address these barriers, for example, modifying the checklist, providing education/training, feeding-back local data, fostering strong leadership (particularly at attending level), and instilling accountability. CONCLUSIONS: We identified common themes that have aided or hindered the introduction of the WHO checklist in England and have translated these into recommendations to guide the implementation of improvement initiatives in surgery and wider health care systems.

Measuring variation in use of the WHO surgical safety checklist in the operating room: a multicenter prospective cross-sectional study.

BACKGROUND: Full implementation of safety checklists in surgery has been linked to improved outcomes and team effectiveness; however, reliable and standardized tools for assessing the quality of their use, which is likely to moderate their impact, are required. STUDY DESIGN: This was a multicenter prospective study. A standardized observational instrument, the "Checklist Usability Tool" (CUT), was developed to record precise characteristics relating to the use of the WHO's surgical safety checklist (SSC) at "time-out" and "sign-out" in a representative sample of 5 English hospitals. The CUT was used in real-time by trained assessors across general surgery, urology, and orthopaedic cases, including elective and emergency procedures. RESULTS: We conducted 565 and 309 observations of the time-out and sign-out, respectively. On average, two-thirds of the items were checked, team members were absent in more than 40% of cases, and they failed to pause or focus on the checks in more than 70% of cases. Information sharing could be improved across the entire operating room (OR) team. Sign-out was not completed in 39% of cases, largely due to uncertainty about when to conduct it. Large variation in checklist use existed between hospitals, but not between surgical specialties or between elective and emergency procedures. Surgical safety checklist performance was better when surgeons led and when all team members were present and paused. CONCLUSIONS: We found large variation in WHO checklist use in a representative sample of English ORs. Measures sensitive to checklist practice quality, like CUT, will help identify areas for improvement in implementation and enable provision of comprehensive feedback to OR teams.