Design of a Novel Multifunction Decision Support Display for Anesthesia Care: AlertWatch® OR.

BACKGROUND: This paper describes the design of a multifunction alerting display for intraoperative anesthetic care. The design was inspired by the multifunction primary flight display used in modern aviation. RESULTS: The display retrieves live data from multiple sources; the physiologic monitors, the anesthesia information management system, the laboratory values and comorbidities from patient's problem summary list, medical history or history & physical. This information is integrated into a display composed of readily identifiable icons of organ systems, which are color coded to signify normal range, marginal range, abnormal range (by green, yellow, red respectively) and orange outlines for comorbidities/risk factors. There are dozens of text alerts, which can be presented as black text (informational), red text (important information) and red scrolling text (highest importance information). The alerts are derived from current standards in the literature and some involve complex calculations being conducted in the background. CONCLUSIONS: The goal of such a system is to improve the quality and safety of anesthetic care by providing enhanced situational awareness in a fashion analogous to the "glass cockpit" and its primary flight display which has improved aviation safety.

Development, implementation and evaluation of a patient handoff tool to improve safety in orthopaedic surgery.

OBJECTIVE: To develop, implement and test the effect of a handoff tool for orthopaedic trauma residents that reduces adverse events associated with the omission of critical information and the transfer of erroneous information. DESIGN: Components of this project included a literature review, resident surveys and observations, checklist development and refinement, implementation and evaluation of impact on adverse events through a chart review of a prospective cohort compared with a historical control group. SETTING: Large teaching hospital. PARTICIPANTS: Findings of a literature review were presented to orthopaedic residents, epidemiologists, orthopaedic surgeons and patient safety experts in face-to-face meetings, during which we developed and refined the contents of a resident handoff tool. The tool was tested in an orthopaedic trauma service and its impact on adverse events was evaluated through a chart review. The handoff tool was developed and refined during the face-to-face meetings and a pilot implementation. Adverse event data were collected on 127 patients (n = 67 baseline period; n = 60 test period). INTERVENTION: A handoff tool for use by orthopaedic residents. MAIN OUTCOME MEASUREMENTS: Adverse events in patients handed off by orthopaedic trauma residents. RESULTS: After controlling for age, gender and comorbidities, testing resulted in fewer events per person (25-27% reduction; P < 0.10). CONCLUSIONS: Preliminary evidence suggests that our resident handoff tool may contribute to a decrease in adverse events in orthopaedic patients.

Developing surgical and anesthesia resident patient safety competencies through systems-based event analysis. Guide to curricular development and evaluation of longer-term resident perceptions.

Previous studies have demonstrated that residents participating in patient safety event investigations become more engaged in future patient safety activities. Currently, there is a gap in resident participation in patient safety event analyses. The objective was to develop and implement a sustainable, faculty-led curriculum for resident participation in patient safety event investigations and to evaluate resident perceptions of the training at least one year following completion of the training. One hundred sixty-five residents from three specialties participated in a formal RCA2 training curriculum from 2013 to 2019. In November 2019, the same residents were asked to complete a survey which examined their perception of the training including the tools and techniques such as event mapping, cause-and-effect diagramming, and developing action plans for solving problems and unsafe conditions. The survey response rate was 36 % (60/165). Sixty-three percent (38/60) of the residents responding to the survey believed that RCA2 training should be provided to all residents. Former residents rated the RCA2 training tools and skills favorably, 3.6 median score (3.5-3.7, 95 % C.I.). Forty-eight percent of responding residents (29/60) believed that the previous RCA2 training improved the way they identify and solve problems. The curriculum and faculty development program provides an effective intervention to address the current, identified gaps in patient safety in graduate medical education.

The Pursuing Excellence Collaborative: Engaging First-Year Residents and Fellows in Patient Safety Event Investigations.

OBJECTIVES: Resident and fellow engagement in patient safety event investigations (PSEIs) can benefit both the clinical learning environment's ability to improve patient care and learners' problem-solving skills. The goals of this collaborative were to increase resident and fellow participation in these investigations and improve PSEI quality. METHODS: This collaborative involved 18 sites-8 sites that had participated in a similar previous collaborative (cohort I) and 10 "new" sites (cohort II). The 18-month collaborative included face-to-face and virtual learning sessions, check-ins, and coaching calls. A validated assessment tool measured PSEI quality, and sites tracked the percentage of first-year residents and fellows included in a PSEI. RESULTS: Sixteen of the 18 sites completed the 18-month collaborative. Baseline was no first-year resident or fellow participation in a PSEI. Among these 16 clinical learning environments, 1237 early learners participated in a PSEI by the end of the collaborative. Six of these 16 sites (38%) reached the goal of 100% participation of first-year residents and fellows. As a percentage of total first-year residents and fellows, larger institutions had less resident and fellow participation. Six of the 9 cohort II sites submitted PSEIs for independent review at 6 months and again at the end of the collaborative. The PSEI quality scores increased from 5.9 ± 1.8 to 8.2 ± 0.8 ( P ≤ 0.05). CONCLUSIONS: It is possible to include all residents and fellows in PSEIs. Patient safety event investigation quality can improve through resident and fellow participation, use of standardized processes during training and investigations, and review of PSEI quality scores with a validated tool.

Suicide attempts and completions in the emergency department in Veterans Affairs Hospitals.

BACKGROUND: This is the first study of suicide attempts and completions in the emergency department (ED) in a large national medical system. METHODS: All root cause analysis (RCA) reports completed of suicides and suicide attempts that occurred in ED in the Veterans Health Administration between 1 December 1999 and 31 December 2009 were reviewed. The method, location, anchor point for hanging and implement for cutting as well as the root causes were categorised. RESULTS: Ten per cent of all RCA reports of suicides and suicide attempts that occur within the hospital occur in the ED. Hanging, cutting and strangulation were the most common methods. The most common anchor point for hanging was doors, and the most common implement for cutting was a razor blade. In eight of the 10 cases of cutting, the implement was brought into the ED. The most common root causes were problems communicating risk and being short-staffed. CONCLUSIONS: Based on these results the following recommendations are made for helping to reduce suicide attempts in the ED: (1) use a systematic protocol and checklist to review mental health holding areas periodically in the ED for suicidal hazards; (2) develop and implement specialised protocols for suicidal patients that include continuous observation when possible; (3) conduct thorough contraband searches with suicidal patients; (4) designate specialised holding areas, when practically possible, for suicidal patients that are free of anchor points for hanging, sharps and medications, and medical equipment; and are isolated from exits to reduce the risk of elopement.

Comparing the variability of ingredient, strength, and dose form information from electronic prescriptions with RxNorm drug product descriptions.

OBJECTIVE: To determine the variability of ingredient, strength, and dose form information from drug product descriptions in real-world electronic prescription (e-prescription) data. MATERIALS AND METHODS: A sample of 10 399 324 e-prescriptions from 2019 to 2021 were obtained. Drug product descriptions were analyzed with a named entity extraction model and National Drug Codes (NDCs) were used to get RxNorm Concept Unique Identifiers (RxCUI) via RxNorm. The number of drug product description variants for each RxCUI was determined. Variants identified were compared to RxNorm to determine the extent of matching terminology used. RESULTS: A total of 353 002 unique pairs of drug product descriptions and NDCs were analyzed. The median (1st-3rd quartile) number of variants extracted for each standardized expression in RxNorm, was 3 (2-7) for ingredients, 4 (2-8) for strength, and 41 (11-122) for dosage forms. Of the pairs, 42.35% of ingredients (n = 328 032), 51.23% of strengths (n = 321 706), and 10.60% of dose forms (n = 326 653) used matching terminology, while 16.31%, 24.85%, and 13.05% contained nonmatching terminology, respectively. DISCUSSION: A wide variety of drug product descriptions makes it difficult to determine whether 2 drug product descriptions describe the same drug product (eg, using abbreviations to describe an active ingredient or using different units to represent a concentration). This results in patient safety risks that lead to incorrect drug products being ordered, dispensed, and used by patients. Implementation and use of standardized terminology may reduce these risks. CONCLUSION: Drug product descriptions on real-world e-prescriptions exhibit large variation resulting in unnecessary ambiguity and potential patient safety risks.

Implementation outcomes of the Structured and Codified SIG format in electronic prescription directions.

OBJECTIVE: To determine the extent of implementation, completeness, and accuracy of Structured and Codified SIG (S&C SIG) directions on electronic prescriptions (e-prescriptions). MATERIALS AND METHODS: A retrospective analysis of a random sample of 3.8 million e-prescriptions sent from electronic prescribing (e-prescribing) software to outpatient pharmacies in the United States between 2019 and 2021. Natural language processing was used to identify direction components, including action verb, dose, frequency, route, duration, and indication from free-text directions and were compared to the S&C SIG format. Inductive qualitative analysis of S&C direction identified error types and frequencies for each component. RESULTS: Implementation of the S&C SIG format in e-prescribing software resulted in 32.4% of e-prescriptions transmitted with these standardized directions. Directions using the S&C SIG format contained a greater percentage of each direction component compared to free-text directions, except for the indication component. Structured and codified directions contained quality issues in 10.3% of cases. DISCUSSION: Expanding adoption of more diverse direction terminology for the S&C SIG formats can improve the coverage of directions using the S&C SIG format. Building out e-prescribing software interfaces to include more direction components can improve patient medication use and safety. Quality improvement efforts, such as improving the design of e-prescribing software and auditing for discrepancies, are needed to identify and eliminate implementation-related issues with direction information from the S&C SIG format so that e-prescription directions are always accurately represented. CONCLUSION: Although directions using the S&C SIG format may result in more complete directions, greater adoption of the format and best practices for preventing its incorrect use are necessary.

Counterheroism, common knowledge, and ergonomics: concepts from aviation that could improve patient safety.

CONTEXT: Many safety initiatives have been transferred successfully from commercial aviation to health care. This article develops a typology of aviation safety initiatives, applies this to health care, and proposes safety measures that might be adopted more widely. It then presents an economic framework for determining the likely costs and benefits of different patient safety initiatives. METHODS: This article describes fifteen examples of error countermeasures that are used in public transport aviation, many of which are not routinely used in health care at present. Examples are the sterile cockpit rule, flight envelope protection, the first-names-only rule, and incentivized no-fault reporting. It develops a conceptual schema that is then used to argue why analogous initiatives might be usefully applied to health care and why physicians may resist them. Each example is measured against a set of economic criteria adopted from the taxation literature. FINDINGS: The initiatives considered in the article fall into three themes: safety concepts that seek to downplay the role of heroic individuals and instead emphasize the importance of teams and whole organizations; concepts that seek to increase and apply group knowledge of safety information and values; and concepts that promote safety by design. The salient costs to be considered by organizations wishing to adopt these suggestions are the compliance costs to clinicians, the administration costs to the organization, and the costs of behavioral distortions. CONCLUSIONS: This article concludes that there is a range of safety initiatives used in commercial aviation that could have a positive impact on patient safety, and that adopting such initiatives may alter the safety culture of health care teams. The desirability of implementing each initiative, however, depends on the projected costs and benefits, which must be assessed for each situation.

An examination of mortality and other adverse events related to electroconvulsive therapy using a national adverse event report system.

BACKGROUND: : There is currently an incomplete understanding of adverse events related to electroconvulsive therapy (ECT) treatments. Much of the published literature is based either on a limited number of ECT providers or reports not representative of modern ECT practice. METHODS: : We searched the Veterans Affairs (VA) National Center for Patient Safety database for reports of adverse events related to ECT. The type and the cause of the events were determined and aggregated. The number of ECT treatments given in the VA was used to develop estimated rates of mortality associated with ECT. RESULTS: : There were no deaths associated with ECT reported in any VA hospital between 1999 and 2010. Based on the number of treatments given, we estimate the mortality rate associated with ECT as less than 1 death per 73,440 treatments. The most common reported adverse events related to ECT were injury to the mouth (including dental and tongue injury) and problems related to paralysis. CONCLUSIONS: : Based on this VA data, ECT may be safer than is widely reported. The reported adverse events were generally rare and typically minor in severity. Simple steps may possibly result in further enhancements to ECT safety.

A checklist to identify inpatient suicide hazards in veterans affairs hospitals.

BACKGROUND: Approximately 1,500 suicides take place in inpatient hospital units in the United States each year. This study, the first of its kind, examines the implementation and effectiveness of using a standardized checklist for mental health units to improve patient safety in a large health care system. METHODS: In 2006 a Department of Veterans Affairs (VA) committee was charged with developing a checklist to explicitly identify environmental hazards on acute mental health units treating suicidal patients. The committee developed both general guidelines to be applied to all areas of the psychiatric unit and detailed guidelines for specific rooms, such as bathrooms, bedrooms, and seclusion rooms. RESULTS: Some 113 VA facilities used the Mental Health Environment of Care Checklist to evaluate their mental health units, identifying and rating 7,642 hazards. At the end of the first year of the project, because of the checklist, 5,834 (76.3%) of these hazards had been abated by facilities; approximately 2% were identified as critical hazards, and another 27% were rated as serious. The most common hazard was anchor points for hanging, followed by material that could be used as a weapon against staff or other patients and problems keeping patients in the secured unit environment. Anchor points had the greatest risk-level classification, followed by suffocation risk and poison risk. High-risk locations included bedrooms and bathrooms. DISCUSSION: Anchor points represented almost 44% of the total number of identified hazards, and materials that could be used as weapons comprised nearly 14% of the total. It is critical to review the mental health environment of care with an eye for these potential weapons. The checklist and resulting mitigations of hazards represent steps toward the overall goal of preventing inpatient suicides.

Association between implementation of a medical team training program and surgical mortality.

CONTEXT: There is insufficient information about the effectiveness of medical team training on surgical outcomes. The Veterans Health Administration (VHA) implemented a formalized medical team training program for operating room personnel on a national level. OBJECTIVE: To determine whether an association existed between the VHA Medical Team Training program and surgical outcomes. DESIGN, SETTING, AND PARTICIPANTS: A retrospective health services study with a contemporaneous control group was conducted. Outcome data were obtained from the VHA Surgical Quality Improvement Program (VASQIP) and from structured interviews in fiscal years 2006 to 2008. The analysis included 182,409 sampled procedures from 108 VHA facilities that provided care to veterans. The VHA's nationwide training program required briefings and debriefings in the operating room and included checklists as an integral part of this process. The training included 2 months of preparation, a 1-day conference, and 1 year of quarterly coaching interviews MAIN OUTCOME MEASURE: The rate of change in the mortality rate 1 year after facilities enrolled in the training program compared with the year before and with nontraining sites. RESULTS: The 74 facilities in the training program experienced an 18% reduction in annual mortality (rate ratio [RR], 0.82; 95% confidence interval [CI], 0.76-0.91; P = .01) compared with a 7% decrease among the 34 facilities that had not yet undergone training (RR, 0.93; 95% CI, 0.80-1.06; P = .59). The risk-adjusted mortality rates at baseline were 17 per 1000 procedures per year for the trained facilities and 15 per 1000 procedures per year for the nontrained facilities. At the end of the study, the rates were 14 per 1000 procedures per year for both groups. Propensity matching of the trained and nontrained groups demonstrated that the decline in the risk-adjusted surgical mortality rate was about 50% greater in the training group (RR,1.49; 95% CI, 1.10-2.07; P = .01) than in the nontraining group. A dose-response relationship for additional quarters of the training program was also demonstrated: for every quarter of the training program, a reduction of 0.5 deaths per 1000 procedures occurred (95% CI, 0.2-1.0; P = .001). CONCLUSION: Participation in the VHA Medical Team Training program was associated with lower surgical mortality.

The role of the operating room nurse manager in the successful implementation of preoperative briefings and postoperative debriefings in the VHA Medical Team Training Program.

To improve communication within surgical teams, Veterans Health Administration (VHA) implemented a Medical Team Training Program (MTT) based on the principles of crew resource management. One hundred two VHA facilities were analyzed. Nursing leadership participation in the planning stages of the program was compared with outcomes at follow-up. Nurse manager participation in planning was associated with higher rates of implementation of preoperative briefing and postoperative debriefing. Nurse managers are a critical component in the planning phase of team training programs focused on OR clinical staff.

Using Proactive Risk Assessment (HFMEA) to Improve Patient Safety and Quality Associated with Intraocular Lens Selection and Implantation in Cataract Surgery.

BACKGROUND: A proactive risk assessment using the Healthcare Failure Mode and Effect Analysis (HFMEA) process was completed on the intraocular lens (IOL) selection and implantation process to analyze system vulnerabilities that could cause patient harm. The three largest ophthalmology clinics based on patient surgical volume were studied in the analysis. The analysis included in-clinic eye measurements needed for IOL selection through the actual implantation of the lens in the operating room. METHODS: The HFMEA process was used for the analysis. A detailed process and subprocess diagram was created through interviews and observations. A multidisciplinary team met 12 times over a 14-week period, evaluating 170 discrete process and subprocess steps and identifying 177 failure modes and 75 failure mode causes for analysis. RESULTS: A high degree of process variability and lack of a robust quality assurance process was found. Areas for improvement included reducing variability between and within clinics, reducing variability in processes used by surgeons, modifying equipment and software to better support the work processes, and implementing a quality assurance program requiring observation of staff performing their routine work as opposed to relying on self-reports of quality metrics. CONCLUSION: The HFMEA process provided a more complete understanding of all of the processes associated with cataract surgery. This allowed for the identification of a variety of risk factors to patient safety that had not previously been identified by the more traditional reactive analysis methods, which tend to focus only on vulnerabilities identified by a specific event.

Rare adverse medical events in VA inpatient care: reliability limits to using patient safety indicators as performance measures.

OBJECTIVE: To assess Agency for Healthcare Research and Quality's Patient Safety Indicators (PSIs) as performance measures using Veterans Administration hospitalization data. DATA SOURCES STUDY SETTING: Nine years (1997-2005) of all Veterans Health Administration (VA) administrative hospital discharge data. STUDY DESIGN: Retrospective analysis using diagnoses and procedures to derive annual rates and standard errors for 13 PSIs. DATA COLLECTION/EXTRACTION METHODS: For either hospitals or hospital networks (Veterans Integrated Service Networks [VISNs]), we calculated the percentages whose PSI rates were consistently high or low across years, as well as 1-year lagged correlations, for each PSI. We related our findings to the average annual number of adverse events that each PSI represents. We also assessed time trends for the entire VA, by VISN, and by hospital. PRINCIPAL FINDINGS: PSI rates are more stable for VISNs than for individual hospitals, but only for those PSIs that reflect the most frequent adverse events. Only the most frequent PSIs yield significant time trends, and only for larger systems. CONCLUSIONS: Because they are so rare, PSIs are not reliable performance measures to compare individual hospitals. The most frequent PSIs are more stable when applied to hospital networks, but needing large patient samples nullifies their potential value to managers seeking to improve quality locally or to patients seeking optimal care.

Inpatient suicide and suicide attempts in Veterans Affairs hospitals.

BACKGROUND: Suicide is the eleventh leading cause of death in the United States. Approximately 1,500 suicides occur in inpatient hospital units in the United States each year. In an attempt to determine the methods and environmental factors involved in inpatient suicide and suicide attempts in Department of Veterans Affairs (VA) hospitals, all root cause analysis (RCA) reports of inpatient suicides and suicide attempts submitted to the VA National Center for Patient Safety (NCPS) before June 2006 were reviewed. METHODS: VA medical centers are required to conduct RCAs on all inpatient suicides and report all suicides and serious suicide attempts to the NCPS. All reports of inpatient suicide and suicide attempts submitted between December 1999 and June 2006 were reviewed, including methods and environmental factors involved in the events. RESULTS: A total of 185 inpatient suicide and suicide attempts were reported; 42 were completed suicides and 143 were suicide attempts. Approximately 52% of the total number of events occurred while the patient was on an inpatient psychiatry unit. Three methods of self harm--intentional drug overdose, cutting with a sharp object, and hanging--accounted for 71% of the total number of events. Doors and wardrobe cabinets accounted for 41% of the anchor points when hanging was the method of self-harm. For suicide attempts involving cutting behaviors, razor blades accounted for 37% of the total number of events; 57% of jumping-related events occurred from balconies and walkways. CONCLUSIONS: Careful review of RCA reports of inpatient suicide has resulted in focused interventions to improve patient care and patient safety in VA medical centers, including a comprehensive environment-of-care checklist for reviewing inpatient psychiatry units.

Reducing avoidable deaths among veterans: directing private-sector surgical care to high-performance hospitals.

OBJECTIVES: We quantified older (65 years and older) Veterans Health Administration (VHA) patients' use of the private sector to obtain 14 surgical procedures and assessed the potential impact of directing that care to high-performance hospitals. METHODS: Using a merged VHA-Medicare inpatient database for 2000 and 2001, we determined where older VHA enrollees obtained 6 cardiovascular surgeries and 8 cancer resections and whether private-sector care was obtained in high- or low-performance hospitals (based on historical performance and determined 2 years in advance of the service year). We then modeled the mortality and travel burden effect of directing private-sector care to high-performance hospitals. RESULTS: Older veterans obtained most of their procedures in the private sector, but that care was equally distributed across high- and low-performance hospitals. Directing private-sector care to high-performance hospitals could have led to the avoidance of 376 to 584 deaths, most through improved cardiovascular care outcomes. Using historical mortality to define performance would produce better outcomes with lower travel time. CONCLUSIONS: Policy that directs older VHA enrollees' private-sector care to high-performance hospitals promises to reduce mortality for VHA's service population and warrants further exploration.

Awareness and use of a cognitive aid for anesthesiology.

BACKGROUND: The Veterans Health Administration's (VHA's) National Center for Patient Safety developed a cognitive aid to help anesthesiologists manage rare, high-mortality adverse events. METHODS: Six months after the aids were sent to VHA facilities with anesthesia machines, anesthesia providers were surveyed about their knowledge and use of the aid. RESULTS: Seven percent of respondents had used the cognitive aid in an emergency ("emergent users"). Most (87%) of respondents were aware of the aid. Half used it only as a reference ("reference users"), 30% were nonusers, and 13% of respondents were unaware of the aid. User groups did not differ regarding exposure to emergencies. All emergent users reported that it helped during an emergency, and 93% reported that it was well designed and easy to use. Emergent users were more likely than other groups to have first found out about it through formal orientation (53%; p < .001). Nonusers (46%) and reference users (38%) were more likely than emergent users (30%) and those who never saw it (5%) to have first found out about it through informal communication with a colleague (p = < 0.001). The majority of those who never saw the aid first became aware of it through this survey (71%; p < .001). The aid was used most commonly for difficult airway. DISCUSSION: A cognitive aid for use in rare emergencies proved clinically useful to anesthesia providers.