A pilot study to determine the incidence, type, and severity of non-routine events in neonates undergoing gastrostomy tube placement.

BACKGROUND: Non-routine events (NRE) are defined as any suboptimal occurrences in a process being measured in the opinion of the reporter and comes from the field of human factors engineering. These typically occur well up-stream of an adverse event and NRE measurement has not been applied to the complex context of neonatal surgery. We sought to apply this novel safety event measurement methodology to neonates in the NICU undergoing gastrostomy tube placement. METHODS: A prospective pilot study was conducted between November 2016 and August 2020 in the Level IV NICU and the pediatric operating rooms of an urban academic children's hospital to determine the incidence, severity, impact, and contributory factors of clinician-reported non-routine events (NREs, i.e., deviations from optimal care) and 30-day NSQIP occurrences in neonates receiving a G-tube. RESULTS: Clinicians reported at least one NRE in 32 of 36 (89%) G-tube cases, averaging 3.0 (Standard deviation: 2.5) NRE reports per case. NSQIP-P review identified 7 cases (19%) with NSQIP-P occurrences and each of these cases had multiple reported NREs. One case in which NREs were not reported was without NSQIP-P occurrences. The odds ratio of having a NSQIP-P occurrence with the presence of an NRE was 0.695 (95% CI 0.06-17.04). CONCLUSION: Despite being considered a "simple" operation, >80% of neonatal G-tube placement operations had at least one reported NRE by an operative team member. In this pilot study, NRE occurrence was not significantly associated with the subsequent reporting of an NSQIP-P occurrence. Understanding contributory factors of NREs that occur in neonatal surgery may promote surgical safety efforts and should be evaluated in larger and more diverse populations. LEVEL OF EVIDENCE: IV.

Defining the Epidemiology of Safety Risks in Neonatal Intensive Care Unit Patients Requiring Surgery.

OBJECTIVE: The aim of the study was to determine the incidence, type, severity, preventability, and contributing factors of nonroutine events (NREs)-events perceived by care providers or skilled observers as a deviations from optimal care based on the clinical situation-in the perioperative (i.e., preoperative, operative, and postoperative) care of surgical neonates in the neonatal intensive care unit and operating room. METHODS: A prospective observational study of noncardiac surgical neonates, who received preoperative and postoperative neonatal intensive care unit care, was conducted at an urban academic children's hospital between November 1, 2016, and March 31, 2018. One hundred twenty-nine surgical cases in 109 neonates were observed. The incidence and description of NREs were collected via structured researcher-administered survey tool of involved clinicians. Primary measurements included clinicians' ratings of NRE severity and contributory factors and trained research assistants' ratings of preventability. RESULTS: One or more NREs were reported in 101 (78%) of 129 observed cases for 247 total NREs. Clinicians reported 2 (2) (median, interquartile range) NREs per NRE case with a maximum severity of 3 (1) (possible range = 1-5). Trained research assistants rated 47% of NREs as preventable and 11% as severe and preventable. The relative risks for National Surgical Quality Improvement Program - pediatric major morbidity and 30-day mortality were 1.17 (95% confidence interval = 0.92-1.48) and 1.04 (95% confidence interval = 1.00-1.08) in NRE cases versus non-NRE cases. CONCLUSIONS: The incidence of NREs in neonatal perioperative care at an academic children's hospital was high and of variable severity with a myriad of contributory factors.

Factors Influencing Time-Dependent Quality Indicators for Patients With Suspected Acute Coronary Syndrome.

OBJECTIVES: Rapid risk stratification and timely treatment are critical to favorable outcomes for patients with acute coronary syndrome (ACS). Our objective was to identify patient and system factors that influence time-dependent quality indicators (QIs) for patients with unstable angina/non-ST elevation myocardial infarction (NSTEMI) in the emergency department (ED). METHODS: A retrospective, cohort study was conducted during a 42-month period of all patients 24 years or older suspected of having ACS as defined by receiving an electrocardiogram and at least 1 cardiac biomarker test. Cox regression was used to model the effects of patient characteristics, ancillary service use, staffing provisions, equipment availability, and ED and hospital crowding on ACS QIs. RESULTS: Emergency department adherence rates to national standards for electrocardiogram readout time and biomarker turnaround time were 42% and 37%, respectively. Cox regression models revealed that chief complaints without chest pain and the timing of stress testing and medication administration were associated with the most significant delays. CONCLUSIONS: Patient and system factors both significantly influenced QI times in this cohort with unstable angina/NSTEMI. These results illustrate both the complexity of diagnosing patients with NSTEMI and the competing effects of clinical and system factors on patient flow through the ED.

Improving the Effectiveness of Health Information Technology: The Case for Situational Analytics.

Health information technology has contributed to improvements in quality and safety in clinical settings. However, the implementation of new technologies in health care has also been associated with the introduction of new sociotechnical hazards, produced through a range of complex interactions that vary with social, physical, temporal, and technological context. Other industries have been confronted with this problem and have developed advanced analytics to examine context-specific activities of workers and related outcomes. The skills and data exist in health care to develop similar insights through situational analytics, defined as the application of analytic methods to characterize human activity in situations and identify patterns in activity and outcomes that are influenced by contextual factors. This article describes the approach of situational analytics and potentially useful data sources, including trace data from electronic health record activity, reports from users, qualitative field data, and locational data. Key implementation requirements are discussed, including the need for collaboration among qualitative researchers and data scientists, organizational and federal level infrastructure requirements, and the need to implement a parallel research program in ethics to understand how the data are being used by organizations and policy makers.

Provider Networks in the Neonatal Intensive Care Unit Associate with Length of Stay.

We strive to understand care coordination structures of multidisciplinary teams and to evaluate their effect on post-surgical length of stay (PSLOS) in the Neonatal Intensive Care Unit (NICU). Electronic health record (EHR) data were extracted for 18 neonates, who underwent gastrostomy tube placement surgery at the Vanderbilt University Medical Center NICU. Based on providers' interactions with the EHR (e.g. viewing, documenting, ordering), provider-provider relations were learned and used to build patient-specific provider networks representing the care coordination structure. We quantified the networks using standard network analysis metrics (e.g., in-degree, out-degree, betweenness centrality, and closeness centrality). Coordination structure effectiveness was measured as the association between the network metrics and PSLOS, as modeled by a proportional-odds, logistical regression model. The 18 provider networks exhibited various team compositions and various levels of structural complexity. Providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those, who treated higher PSLOS patients (P = 0.0294). In the NICU, improved dissemination of information may be linked to reduced PSLOS. EHR data provides an efficient, accessible, and resource-friendly way to study care coordination using network analysis tools. This novel methodology offers an objective way to identify key performance and safety indicators of care coordination and to study dissemination of patient-related information within care provider networks and its effect on care. Findings should guide improvements in the EHR system design to facilitate effective clinical communications among providers.

Modeling Care Team Structures in the Neonatal Intensive Care Unit through Network Analysis of EHR Audit Logs.

BACKGROUND: In the neonatal intensive care unit (NICU), predefined acuity-based team care models are restricted to core roles and neglect interactions with providers outside of the team, such as interactions that transpire via electronic health record (EHR) systems. These unaccounted interactions may be related to the efficiency of resource allocation, information flow, communication, and thus impact patient outcomes. This study applied network analysis methods to EHR audit logs to model the interactions of providers beyond their core roles to better understand the interaction network patterns of acuity-based teams and relationships of the network structures with postsurgical length of stay (PSLOS). METHODS: The study used the EHR log data of surgical neonates from a large academic medical center. The study included 104 surgical neonates, for whom 9,206 unique actions were performed by 457 providers in their EHRs. We applied network analysis methods to model EHR provider interaction networks of acuity-based teams in NICU postoperative care. We partitioned each EHR network into three subnetworks based on interaction types: (1) interactions between known core providers who were documented in scheduling records (core subnetwork); (2) interactions between core and noncore providers (extended subnetwork); and (3) interactions between noncore providers (extended subnetwork). For each core subnetwork, we assessed its capability to replicate predefined core-provider relations as documented in scheduling records. We further compared each EHR network, as well as its subnetworks, using standard network measures to determine its differences in network topologies. We conducted a case study to learn provider interaction networks taking care of 15 neonates who underwent gastrostomy tube placement surgery from EHR log data and measure the effectiveness of the interaction networks on PSLOS by the proportional-odds model. RESULTS: The provider networks of four acuity-based teams (two high and two low acuity), along with their subnetworks, were discovered. We found that beyond capturing the predefined core-provider relations, EHR audit logs can also learn a large number of relations between core and noncore providers or among noncore providers. Providers in the core subnetwork exhibited a greater number of connections with each other than with providers in the extended subnetworks. Many more providers in the core subnetwork serve as a hub than those in the other types of subnetworks. We also found that high-acuity teams exhibited more complex network structures than low-acuity teams, with high-acuity team generating 6,416 interactions between 407 providers compared with 931 interactions between 124 providers, respectively. In addition, we discovered that high-acuity and low-acuity teams shared more than 33 and 25% of providers with each other, respectively, but exhibited different collaborative structures demonstrating that NICU providers shift across different acuity teams and exhibit different network characteristics. Results of case study show that providers, whose patients had lower PSLOS, tended to disperse patient-related information to more colleagues within their network than those who treated higher PSLOS patients (p = 0.03). CONCLUSION: Network analysis can be applied to EHR log data to model acuity-based NICU teams capturing interactions between providers within the predesigned core team as well as those outside of the core team. In the NICU, dissemination of information may be linked to reduced PSLOS. EHR log data provide an efficient, accessible, and research-friendly way to study provider interaction networks. Findings should guide improvements in the EHR system design to facilitate effective interactions between providers.

Implementing Strategies to Identify and Mitigate Adverse Safety Events: A Case Study with Unplanned Extubations.

BACKGROUND: Patient safety events result from failures in complex health care delivery processes. To ensure safety, teams must implement ways to identify events that occur in a nonrandom fashion and respond in a timely manner. To illustrate this, one children's hospital's experience with an outbreak of unplanned extubations (UEs) in the neonatal ICU (NICU) is described. METHODS: The quality improvement team measured UEs using three complementary data streams. Interventions to decrease the rate of UE were tested with success. Three statistical process control (SPC) charts (u-chart, g-chart, and an exponentially weighted moving average [EWMA] chart) were used for real-time monitoring. RESULTS: From July 2015 to May 2016, the UE rate was stable at 1.1 UE/100 ventilator days. In early June 2016, a cluster of UEs, including four events within one week, was observed. Two of three SPC charts showed special cause variation, although at different time points. The EWMA chart alerted the team more than two weeks earlier than the u-chart. Within days of discovering the outbreak, the team identified that the hospital had replaced the tape used to secure endotracheal tubes with a nearly identical product. After multiple tape products were tested over the next month, the team selected one that returned the system to a state of stability. CONCLUSION: Ongoing monitoring using SPC charts allowed early detection and rapid mitigation of an outbreak of UEs in the NICU. This highlights the importance of continuous monitoring using tools such as SPC charts that can alert teams to both improvement and worsening of processes.

Meta-analysis of surgeon-performed central line placement: Real-time ultrasound versus landmark technique.

BACKGROUND: Major health care agencies recommend real-time ultrasound (RTUS) guidance during insertion of percutaneous central venous catheters (CVC) based on studies in which CVCs were placed by nonsurgeons. We conducted a meta-analysis to compare outcomes for surgeon-performed RTUS-guided CVC insertion versus traditional landmark technique. METHODS: A systematic review of the literature was performed, identifying randomized controlled trials (RCT) and prospective "safety studies" of surgeon-performed CVC insertions comparing landmark to RTUS techniques. Searches were conducted in MEDLINE, Cochrane, and Web of Science, with additional relevant articles identified through examination of the bibliographies and citations of the included studies. Two independent reviewers selected relevant studies that matched inclusion criteria, and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed. A meta-analysis was conducted using random effects models to compare success and complication rates. RESULTS: Three RCTs were identified totaling 456 patients. The RTUS guidance was associated with better first attempt success (odds ratio [OR], 4.7; 95% confidence interval [CI], 1.5-14.7, p = 0.008) and overall success (OR 6.5, 95% CI: 2.7-15.7, p < 0.0001). However, there were no differences in overall complication (OR 1.9 (95% CI, 0.8-4.4, p = 0.14)) or arterial puncture (OR 2.0 (95% CI, 0.7-5.6, p = 0.18) rates between the two methods. CONCLUSION: Despite many studies involving nonsurgeons, there are only three RCTs comparing RTUS versus landmark technique for surgeon-performed CVC placement. The RTUS guidance is associated with better success than landmark technique, but no difference in complication rates. No study evaluated how RTUS was implemented. Larger studies examining RTUS use during surgeon-performed CVC placements are needed. LEVEL OF EVIDENCE: Systematic review and meta-analysis, level III.

Understanding Emergency Care Delivery Through Computer Simulation Modeling.

In 2017, Academic Emergency Medicine convened a consensus conference entitled, "Catalyzing System Change through Health Care Simulation: Systems, Competency, and Outcomes." This article, a product of the breakout session on "understanding complex interactions through systems modeling," explores the role that computer simulation modeling can and should play in research and development of emergency care delivery systems. This article discusses areas central to the use of computer simulation modeling in emergency care research. The four central approaches to computer simulation modeling are described (Monte Carlo simulation, system dynamics modeling, discrete-event simulation, and agent-based simulation), along with problems amenable to their use and relevant examples to emergency care. Also discussed is an introduction to available software modeling platforms and how to explore their use for research, along with a research agenda for computer simulation modeling. Through this article, our goal is to enhance adoption of computer simulation, a set of methods that hold great promise in addressing emergency care organization and design challenges.

Cry presence and amplitude do not reflect cortical processing of painful stimuli in newborns with distinct responses to touch or cold.

OBJECTIVE: Newborns requiring hospitalisation frequently undergo painful procedures. Prevention of pain in infants is of prime concern because of adverse associations with physiological and neurological development. However, pain mitigation is currently guided by behavioural observation assessments that have not been validated against direct evidence of pain processing in the brain. The aim of this study was to determine whether cry presence or amplitude is a valid indicator of pain processing in newborns. DESIGN: Prospective observational cohort. SETTING: Newborn nursery. PATIENTS: Healthy infants born at >37 weeks and <42 weeks gestation. INTERVENTIONS: We prospectively studied newborn cortical responses to light touch, cold and heel stick, and the amplitude of associated infant vocalisations using our previously published paradigms of time-locked electroencephalogram (EEG) with simultaneous audio recordings. RESULTS: Latencies of cortical peak responses to each of the three stimuli type were significantly different from each other. Of 54 infants, 13 (24%), 19 (35%) and 35 (65%) had cries in response to light touch, cold and heel stick, respectively. Cry in response to non-painful stimuli did not predict cry in response to heel stick. All infants with EEG data had measurable pain responses to heel stick, whether they cried or not. There was no association between presence or amplitude of cries and cortical nociceptive amplitudes. CONCLUSIONS: In newborns with distinct brain responses to light touch, cold and pain, cry presence or amplitude characteristics do not provide adequate behavioural markers of pain signalling in the brain. New bedside assessments of newborn pain may need to be developed using brain-based methodologies as benchmarks in order to provide optimal pain mitigation.

Evaluation of Voice Acoustics as Predictors of Clinical Depression Scores.

OBJECTIVE: The aim of the present study was to determine if acoustic measures of voice, characterizing specific spectral and timing properties, predict clinical ratings of depression severity measured in a sample of patients using the Hamilton Depression Rating Scale (HAMD) and Beck Depression Inventory (BDI-II). STUDY DESIGN: This is a prospective study. METHODS: Voice samples and clinical depression scores were collected prospectively from consenting adult patients who were referred to psychiatry from the adult emergency department or primary care clinics. The patients were audio-recorded as they read a standardized passage in a nearly closed-room environment. Mean Absolute Error (MAE) between actual and predicted depression scores was used as the primary outcome measure. RESULTS: The average MAE between predicted and actual HAMD scores was approximately two scores for both men and women, and the MAE for the BDI-II scores was approximately one score for men and eight scores for women. Timing features were predictive of HAMD scores in female patients while a combination of timing features and spectral features was predictive of scores in male patients. Timing features were predictive of BDI-II scores in male patients. CONCLUSION: Voice acoustic features extracted from read speech demonstrated variable effectiveness in predicting clinical depression scores in men and women. Voice features were highly predictive of HAMD scores in men and women, and BDI-II scores in men, respectively. The methodology is feasible for diagnostic applications in diverse clinical settings as it can be implemented during a standard clinical interview in a normal closed room and without strict control on the recording environment.

A simulation-based curriculum to introduce key teamwork principles to entering medical students.

BACKGROUND: Failures of teamwork and interpersonal communication have been cited as a major patient safety issue. Although healthcare is increasingly being provided in interdisciplinary teams, medical school curricula have traditionally not explicitly included the specific knowledge, skills, attitudes, and behaviors required to function effectively as part of such teams. METHODS: As part of a new "Foundations" core course for beginning medical students that provided a two-week introduction to the most important themes in modern healthcare, a multidisciplinary team, in collaboration with the Center for Experiential Learning and Assessment, was asked to create an experiential introduction to teamwork and interpersonal communication. We designed and implemented a novel, all-day course to teach second-week medical students basic teamwork and interpersonal principles and skills using immersive simulation methods. Students' anonymous comprehensive course evaluations were collected at the end of the day. Through four years of iterative refinement based on students' course evaluations, faculty reflection, and debriefing, the course changed and matured. RESULTS: Four hundred twenty evaluations were collected. Course evaluations were positive with almost all questions having means and medians greater than 5 out of 7 across all 4 years. Sequential year comparisons were of greatest interest for examining the effects of year-to-year curricular improvements. Differences were not detected among any of the course evaluation questions between 2007 and 2008 except that more students in 2008 felt that the course further developed their "Decision Making Abilities" (OR 1.69, 95% CI 1.07-2.67). With extensive changes to the syllabus and debriefer selection/assignment, concomitant improvements were observed in these aspects between 2008 and 2009 (OR = 2.11, 95% CI: 1.28-3.50). Substantive improvements in specific exercises also yielded significant improvements in the evaluations of those exercises. CONCLUSIONS: This curriculum could be valuable to other medical schools seeking to inculcate teamwork foundations in their medical school's preclinical curricula. Moreover, this curriculum can be used to facilitate teamwork principles important to inter-disciplinary, as well as uni-disciplinary, collaboration.

Does the American College of Surgeons National Surgical Quality Improvement Program pediatric provide actionable quality improvement data for surgical neonates?

BACKGROUND/PURPOSE: The purpose of this project was to examine the American College of Surgeons National Surgical Quality Improvement Program Pediatric (ACSNSQIP-P) Participant Use File (PUF) to compare risk-adjusted outcomes of neonates versus other pediatric surgical patients. METHODS: In the ACS-NSQIP-P 2012-2013 PUF, patients were classified as preterm neonate, term neonate, or nonneonate at the time of surgery. The primary outcomes were 30-day mortality and composite morbidity. Patient characteristics significantly associated with the primary outcomes were used to build a multivariate logistic regression model. RESULTS: The overall 30-day mortality rate for preterm neonates, term neonate, and nonneonates was 4.9%, 2.0%, 0.1%, respectively (p<0.0001). The overall 30-day morbidity rate for preterm neonates, term neonates, and nonneonates was 27.0%, 17.4%, 6.4%, respectively (p<0.0001). After adjustment for preoperative and operative risk factors, both preterm (adjusted odds ratio, 95% CI: 2.0, 1.4-3.0) and term neonates (aOR, 95% CI: 1.9, 1.2-3.1) had a significantly increased odds of 30-day mortality compared to nonneonates. CONCLUSION: Surgical neonates are a cohort who are particularity susceptible to postoperative morbidity and mortality after adjusting for preoperative and operative risk factors. Collaborative efforts focusing on surgical neonates are needed to understand the unique characteristics of this cohort and identify the areas where the morbidity and mortality can be improved.

Reducing intraoperative red blood cell unit wastage in a large academic medical center.

BACKGROUND: The wastage of red blood cell (RBC) units within the operative setting results in significant direct costs to health care organizations. Previous education-based efforts to reduce wastage were unsuccessful at our institution. We hypothesized that a quality and process improvement approach would result in sustained reductions in intraoperative RBC wastage in a large academic medical center. STUDY DESIGN AND METHODS: Utilizing a failure mode and effects analysis supplemented with time and temperature data, key drivers of perioperative RBC wastage were identified and targeted for process improvement. RESULTS: Multiple contributing factors, including improper storage and transport and lack of accurate, locally relevant RBC wastage event data were identified as significant contributors to ongoing intraoperative RBC unit wastage. Testing and implementation of improvements to the process of transport and storage of RBC units occurred in liver transplant and adult cardiac surgical areas due to their history of disproportionately high RBC wastage rates. Process interventions targeting local drivers of RBC wastage resulted in a significant reduction in RBC wastage (p < 0.0001; adjusted odds ratio, 0.24; 95% confidence interval, 0.15-0.39), despite an increase in operative case volume over the period of the study. Studied process interventions were then introduced incrementally in the remainder of the perioperative areas. CONCLUSIONS: These results show that a multidisciplinary team focused on the process of blood product ordering, transport, and storage was able to significantly reduce operative RBC wastage and its associated costs using quality and process improvement methods.

A Multimodal Intervention Improves Postanesthesia Care Unit Handovers.

BACKGROUND: Failures of communication are a major contributor to perioperative adverse events. Transitions of care may be particularly vulnerable. We sought to improve postoperative handovers. METHODS: We introduced a multimodal intervention in an adult and a pediatric postanesthesia care unit (PACU) to improve postoperative handovers between anesthesia providers (APs) and PACU registered nurses (RNs). The intervention included a standardized electronic handover report form, a didactic webinar, mandatory simulation training focused on improving interprofessional communication, and post-training performance feedback. Trained, blinded nurse observers scored PACU handovers during 17 months using a structured tool consisting of 8 subscales and a global score (1-5 scale). Multivariate logistic regression assessed the effect of the intervention on the proportion of observed handovers receiving a global effectiveness rating of ≥3. RESULTS: Four hundred fifty-two clinicians received the simulation-based training, and 981 handovers were observed and rated. In the adult PACU, the estimated percentages of acceptable handovers (global ratings ≥3) among AP-RN pairs, where neither received simulation-based training (untrained dyads), was 3% (95% confidence interval, 1%-11%) at day 0, 10% (5%-19%) at training initiation (day 40), and 57% (33%-78%) at 1-year post-training initiation (day 405). For AP-RN pairs where at least one received the simulation-based training (trained dyads), these percentages were estimated to be 18% (11%-28%) and 68% (57%-76%) on days 40 and 405, respectively. The percentage of acceptable handovers was significantly greater on day 405 than it was on day 40 for both untrained (P < 0.001) and trained dyads (P < 0.001). Similar patterns were observed in the pediatric PACU. Three years later, the unadjusted estimate of the probability of an acceptable handover was 87% (72%-95%) in the adult PACU and 56% (40%-72%) in the pediatric PACU. CONCLUSIONS: A multimodal intervention substantially improved interprofessional PACU handovers, including those by clinicians who had not undergone formal simulation training. An effect appeared to be present >3 years later.

Methodology and bias in assessing compliance with a surgical safety checklist.

BACKGROUND: Surgical safety checklists, such as the perioperative time-out, have been shown to improve performance on a variety of patient safety measures. A variety of methods have been used to assess compliance with the perioperative time-out, but no standardized methodology with a reliable observer group currently exists. An observation-based methodology was used to assess time-out compliance at an academic medical center. METHODS: A single observer group made up of medical students and nurses recorded compliance with each of the 11 standardized items of the time-out. A total of 193 time-out procedures were observed, 48 by medical students and 145 by nurses. RESULTS: One item (procedure to be performed) achieved > 95% compliance. Three items (surgical site; availability of necessary blood products, implants, devices; and start of antibiotics) achieved 80%-95% compliance. Seven items achieved < 80% compliance (presence of required members of procedure team, presence of person who marked patient, patient identity, side marking, relevant images, allergies, and discussion of relevant special considerations). Compliance with the four core time-out items was 78.2%. Of the 11 items on the time-out being evaluated, there was a statistically significant difference between medical student and nursing observations for 10 items (p < .05). CONCLUSIONS: In our cohort of observed time-outs, the compliance rate was low, calling into question time-out quality, and, more importantly, patient safety. Measures must be taken by large hospitals to regularly audit time-out compliance and create effective programming to improve performance. Although observational assessment is an effective method to assess compliance with surgical safety checklists, observer group bias has the potential to skew results.

Surgical debriefing: a reliable roadmap to completing the patient safety cycle.

Morbidity and mortality due to preventable medical errors are a disastrous reality in medicine. Debriefing, a process that allows individuals to discuss team performance in a constructive, supportive environment, has been linked to improved performance in various medical and surgical fields, including improvements in specific procedures, teamwork and communication, and error identification. However, the neurosurgical literature on this topic is limited. The authors review the debriefing literature in the field of medicine, with a specific emphasis on the operating room, and they report their own institutional experience with a debriefing module, from invention to pilot implementation, at Vanderbilt University Medical Center. The authors share the challenges and lessons learned from their quality improvement project. The field of neurosurgery would undoubtedly benefit from embracing debriefing, as its potential has been established in other medical specialties and can serve as a valuable role in immediately learning from mistakes. The authors hope that their colleagues can learn from this experience and improve their own.

Novel use of electronic whiteboard in the operating room increases surgical team compliance with pre-incision safety practices.

BACKGROUND: Despite evidence that use of a checklist during the pre-incision time out improves patient morbidity and mortality, compliance with performing the required elements of the checklist has been low. In an effort to improve compliance, a standardized time out interactive Electronic Checklist System [iECS] was implemented in all hospital operating room (OR) suites at 1 institution. The purpose of this 12-month prospective observational study was to assess whether an iECS in the OR improves and sustains improved surgical team compliance with the pre-incision time out. METHODS: Direct observational analyses of preprocedural time outs were performed on 80 cases 1 month before, and 1 and 9 months after implementation of the iECS, for a total of 240 observed cases. Three observers, who achieved high interrater reliability (kappa = 0.83), recorded a compliance score (yes, 1; no, 0) on each element of the time out. An element was scored as compliant if it was clearly verbalized by the surgical team. RESULTS: Pre-intervention observations indicated that surgical staff verbally communicated the core elements of the time out procedure 49.7 ± 12.9% of the time. After implementation of the iECS, direct observation of 80 surgical cases at 1 and 9 months indicated that surgical staff verbally communicated the core elements of the time out procedure 81.6 ± 11.4% and 85.8 ± 6.8% of the time, respectively, resulting in a statistically significant (P < .0001) increase in time out procedural compliance. CONCLUSION: Implementation of a standardized, iECS can dramatically increase compliance with preprocedural time outs in the OR, an important and necessary step in improving patient outcomes and reducing preventable complications and deaths.

Quality improvement projects targeting health care-associated infections: comparing Virtual Collaborative and Toolkit approaches.

BACKGROUND: Collaborative and toolkit approaches have gained traction for improving quality in health care. OBJECTIVE: To determine if a quality improvement virtual collaborative intervention would perform better than a toolkit-only approach at preventing central line-associated bloodstream infections (CLABSIs) and ventilator-associated pneumonias (VAPs). DESIGN AND SETTING: Cluster randomized trial with the Intensive Care Units (ICUs) of 60 hospitals assigned to the Toolkit (n=29) or Virtual Collaborative (n=31) group from January 2006 through September 2007. MEASUREMENT: CLABSI and VAP rates. Follow-up survey on improvement interventions, toolkit utilization, and strategies for implementing improvement. RESULTS: A total of 83% of the Collaborative ICUs implemented all CLABSI interventions compared to 64% of those in the Toolkit group (P = 0.13), implemented daily catheter reviews more often (P = 0.04), and began this intervention sooner (P < 0.01). Eighty-six percent of the Collaborative group implemented the VAP bundle compared to 64% of the Toolkit group (P = 0.06). The CLABSI rate was 2.42 infections per 1000 catheter days at baseline and 2.73 at 18 months (P = 0.59). The VAP rate was 3.97 per 1000 ventilator days at baseline and 4.61 at 18 months (P = 0.50). Neither group improved outcomes over time; there was no differential performance between the 2 groups for either CLABSI rates (P = 0.71) or VAP rates (P = 0.80). CONCLUSION: The intensive collaborative approach outpaced the simpler toolkit approach in changing processes of care, but neither approach improved outcomes. Incorporating quality improvement methods, such as ICU checklists, into routine care processes is complex, highly context-dependent, and may take longer than 18 months to achieve.

Measuring and comparing safety climate in intensive care units.

BACKGROUND: Learning about the factors that influence safety climate and improving the methods for assessing relative performance among hospital or units would improve decision-making for clinical improvement. OBJECTIVES: To measure safety climate in intensive care units (ICU) owned by a large for-profit integrated health delivery systems; identify specific provider, ICU, and hospital factors that influence safety climate; and improve the reporting of safety climate data for comparison and benchmarking. RESEARCH DESIGN: We administered the Safety Attitudes Questionnaire (SAQ) to clinicians, staff, and administrators in 110 ICUs from 61 hospitals. SUBJECTS: A total of 1502 surveys (43% response) from physicians, nurses, respiratory therapists, pharmacists, mangers, and other ancillary providers. MEASURES: The survey measured safety climate across 6 domains: teamwork climate; safety climate; perceptions of management; job satisfaction; working conditions; and stress recognition. Percentage of positive scores, mean scores, unadjusted random effects, and covariate-adjusted random effect were used to rank ICU performance. RESULTS: The cohort was characterized by a positive safety climate. Respondents scored perceptions of management and working conditions significantly lower than the other domains of safety climate. Respondent job type was significantly associated with safety climate and domain scores. There was modest agreement between ranking methodologies using raw scores and random effects. CONCLUSIONS: The relative proportion of job type must be considered before comparing safety climate results across organizational units. Ranking methodologies based on raw scores and random effects are viable for feedback reports. The use of covariate-adjusted random effects is recommended for hospital decision-making.