ACM BCB 2023: Predicting Postoperative Pain and Opioid Use with Machine Learning Applied to Longitudinal Electronic Health Record and Wearable Data.

BACKGROUND: Managing acute postoperative pain and minimizing chronic opioid use is crucial for patient recovery and long-term well-being. OBJECTIVE: This study explored using preoperative electronic health records (EHR) and wearable device data for machine-learning models that predict postoperative acute pain and chronic opioid use. METHODS: The study cohort consisted of ~347 All of Us Research Program participants who underwent one of eight surgical procedures and shared EHR and wearable device data. We developed four machine learning models and used the Shapley additive explanations (SHAP) technique to identify the most relevant predictors of acute pain and chronic opioid use. RESULTS: The stacking ensemble model achieved the highest accuracy in predicting acute pain (0.68) and chronic opioid use (0.89). The area under the curve (AUC) score for severe pain vs. other pain was highest (0.88) when predicting acute post-operative pain. Values of logistic regression, random forest, extreme gradient boosting, and stacking ensemble ranged from 0.74 to 0.90 when predicting postoperative chronic opioid use. Variables from wearable devices played a prominent role in predicting both outcomes. CONCLUSIONS: SHAP detection of individual risk factors for severe pain can help healthcare providers tailor pain management plans. Accurate prediction of postoperative chronic opioid use before surgery can help mitigate the risk for the outcomes we studied. Prediction can also reduce the chances of opioid overuse and dependence. Such mitigation can promote safer and more effective pain control for patients during their recovery.

Environmental cleaning and disinfection in the operating room: a systematic scoping review through a human factors and systems engineering lens.

OBJECTIVE: To synthesize evidence and identify gaps in the literature on environmental cleaning and disinfection in the operating room based on a human factors and systems engineering approach guided by the Systems Engineering Initiative for Patient Safety (SEIPS) model. DESIGN: A systematic scoping review. METHODS: Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we searched 4 databases (ie, PubMed, EMBASE, OVID, CINAHL) for empirical studies on operating-room cleaning and disinfection. Studies were categorized based on their objectives and designs and were coded using the SEIPS model. The quality of randomized controlled trials and quasi-experimental studies with a nonequivalent groups design was assessed using version 2 of the Cochrane risk-of-bias tool for randomized trials. RESULTS: In total, 40 studies were reviewed and categorized into 3 groups: observational studies examining the effectiveness of operating-room cleaning and disinfections (11 studies), observational study assessing compliance with operating-room cleaning and disinfection (1 study), and interventional studies to improve operating-room cleaning and disinfection (28 studies). The SEIPS-based analysis only identified 3 observational studies examining individual work-system components influencing the effectiveness of operating-room cleaning and disinfection. Furthermore, most interventional studies addressed single work-system components, including tools and technologies (20 studies), tasks (3 studies), and organization (3 studies). Only 2 studies implemented interventions targeting multiple work-system components. CONCLUSIONS: The existing literature shows suboptimal compliance and inconsistent effectiveness of operating-room cleaning and disinfection. Improvement efforts have been largely focused on cleaning and disinfection tools and technologies and staff monitoring and training. Future research is needed (1) to systematically examine work-system factors influencing operating-room cleaning and disinfection and (2) to redesign the entire work system to optimize operating-room cleaning and disinfection.

A Survey of PICU Clinician Practices and Perceptions regarding Respiratory Cultures in the Evaluation of Ventilator-Associated Infections in the BrighT STAR Collaborative.

OBJECTIVES: To characterize respiratory culture practices for mechanically ventilated patients, and to identify drivers of culture use and potential barriers to changing practices across PICUs. DESIGN: Cross-sectional survey conducted May 2021-January 2022. SETTING: Sixteen academic pediatric hospitals across the United States participating in the BrighT STAR Collaborative. SUBJECTS: Pediatric critical care medicine physicians, advanced practice providers, respiratory therapists, and nurses. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: We summarized the proportion of positive responses for each question within a hospital and calculated the median proportion and IQR across hospitals. We correlated responses with culture rates and compared responses by role. Sixteen invited institutions participated (100%). Five hundred sixty-eight of 1,301 (44%) e-mailed individuals completed the survey (median hospital response rate 60%). Saline lavage was common, but no PICUs had a standardized approach. There was the highest variability in perceived likelihood (median, IQR) to obtain cultures for isolated fever (49%, 38-61%), isolated laboratory changes (49%, 38-57%), fever and laboratory changes without respiratory symptoms (68%, 54-79%), isolated change in secretion characteristics (67%, 54-78%), and isolated increased secretions (55%, 40-65%). Respiratory cultures were likely to be obtained as a "pan culture" (75%, 70-86%). There was a significant correlation between higher culture rates and likelihood to obtain cultures for isolated fever, persistent fever, isolated hypotension, fever, and laboratory changes without respiratory symptoms, and "pan cultures." Respondents across hospitals would find clinical decision support (CDS) helpful (79%) and thought that CDS would help align ICU and/or consulting teams (82%). Anticipated barriers to change included reluctance to change (70%), opinion of consultants (64%), and concern for missing a diagnosis of ventilator-associated infections (62%). CONCLUSIONS: Respiratory culture collection and ordering practices were inconsistent, revealing opportunities for diagnostic stewardship. CDS would be generally well received; however, anticipated conceptual and psychologic barriers to change must be considered.

Scaling a behavioral weight-loss intervention for individuals with serious mental illness using the enhanced replicating effective programs framework: A preconditions phase proof-of-concept study.

Background: Given the obesity's high prevalence among individuals with serious mental illness (SMI), translating weight-loss interventions with demonstrated effectiveness is needed. This study describes the initial translation phase of such an intervention using the Enhanced Replicating Effective Programs (REP) Framework for delivery by mental health program staff. Methods: The Achieving Healthy Lifestyles in Psychiatric Rehabilitation (Achieving Healthy Lifestyles in Psychiatric Rehabilitation) trial intervention was preliminarily adapted to create the ACHIEVE-Dissemination (ACHIEVE-D) curriculum. A treatment-only study was conducted to rapidly evaluate the curriculum using a mixed-methods approach including surveys and focus groups. A study coach delivered an abbreviated curriculum to individuals with SMI from a single psychiatric program. Among all participants with SMI (n = 17), outcomes were attendance and satisfaction; 14 participated in a focus group. The program staff observed curriculum delivery and participated in a focus group (n = 3). Results: Overall, 23 group sessions were delivered. Median attendance was 78.6% across participants with SMI; 92.9% would recommend ACHIEVE-D to others. The staff found the curriculum acceptable, particularly its structured nature, inclusion of weight management and exercise, and integrated goal setting and tracking. These improvements recommended by participants and/or staff were to assess participant readiness-to-change prior to enrollment, change the frequency of weigh-ins, and train staff coaches on anticipated challenges (e.g., exercise engagement, weight fluctuations). Conclusions: During this first REP phase, individuals with SMI and program staff were satisfied with ACHIEVE-D. Additional refinements will aid future implementation and improve participant experience.

Sustainability of the Bright STAR Diagnostic Stewardship Program to Reduce Blood Culture Rates Among Critically Ill Children.

This quality improvement study evaluates whether pediatric intensive care units sustained reduced blood culture rates after participation in the Bright STAR collaborative from 2017 to 2020.

Application of Participatory Ergonomics to the Dissemination of a Quality Improvement Program for Optimizing Blood Culture Use.

BACKGROUND: Blood cultures are overused in pediatric ICUs (PICUs), which may lead to unnecessary antibiotic use and antibiotic resistance. Using a participatory ergonomics (PE) approach, the authors disseminated a quality improvement (QI) program for optimizing blood culture use in PICUs to a national 14-hospital collaborative. The objective of this study was to evaluate the dissemination process and its impact on blood culture reduction. METHODS: The PE approach emphasized three key principles (stakeholder participation, application of human factors and ergonomics knowledge and tools, and cross-site collaboration) with a six-step dissemination process. Data on interactions between sites and the coordinating team and site experiences with the dissemination process were collected using site diaries and semiannual surveys with local QI teams, respectively, and correlated with the site-specific change in blood culture rates. RESULTS: Overall, participating sites were able to successfully implement the program and reduced their blood culture rates from 149.4 blood cultures per 1,000 patient-days/month before implementation to 100.5 blood cultures per 1,000 patient-days/month after implementation, corresponding to a 32.7% relative reduction (p < 0.001). Variations in the dissemination process, as well as in local interventions and implementation strategies, were observed across sites. Site-specific changes in blood culture rates were weakly negatively correlated with the number of preintervention interactions with the coordinating team (p = 0.057) but not correlated with their experiences with the six domains of the dissemination process or their interventions. CONCLUSIONS: The authors applied a PE approach to disseminate a QI program for optimizing PICU blood culture use to a multisite collaborative. Working with local stakeholders, participating sites tailored their interventions and implementation processes and achieved the goal of reducing blood culture use.

The use of telemedicine for perioperative pain management during the COVID-19 pandemic.

INTRODUCTION: Using a human factors engineering approach, the Johns Hopkins Personalized Pain Program adopted telemedicine for perioperative pain management in response to the COVID-19 pandemic. This study examines the impact of telemedicine adoption on the quality and outcomes of perioperative pain management. METHODS: A mixed-methods study with a convergent parallel design was conducted. From June 2017 to December 2021, 902 patients participated in the Personalized Pain Program. Quantitative data on daily opioid consumption, pain severity and interference, physical and mental health status, and patient satisfaction and engagement were continuously collected with all patients using chart review and patient surveys. Beginning 23 March 2020, the Personalized Pain Program transitioned to telemedicine. A pre-post quasi-experimental design was used to examine the impact of telemedicine. In addition, qualitative interviews were conducted with 3 clinicians and 17 patients to explore their experience with telemedicine visits. RESULTS: The monthly number of new patients seen in the Personalized Pain Program did not significantly change before and after telemedicine adoption. Compared to patients having in-person visits before the pandemic, patients having telemedicine visits during the pandemic achieved comparable improvements in daily opioid consumption, pain severity and interference, and physical health status. While telemedicine helped overcome many challenges faced by the patients, the limitations of telemedicine were also discussed. CONCLUSION: The COVID-19 pandemic stimulated the use of telemedicine. To facilitate telemedicine adoption beyond the pandemic, future research is needed to examine best practices for telemedicine adoption and provide additional evidence on the effectiveness of telemedicine.

A multidisciplinary transitional pain service to improve pain outcomes following trauma surgery: a preliminary report.

OBJECTIVES: Trauma (i.e., musculoskeletal injury from a blunt or penetrating force) can change the trajectory of a person's life. Patients often experience chronic pain, reduced quality of life, long-term opioid therapy, and psychiatric comorbidities after trauma surgery. This case report presents clinical outcomes of four patients who received postsurgical pain care in a transitional pain service (TPS) that provides long-term coordinated multimodal pain care, opioid tapering plans, and psychiatric care. METHODS: The Personalized Pain Program (PPP) measures prescription opioid use and patient-reported outcomes: pain severity and pain interference (Brief Pain Inventory), pain catastrophizing (Pain Catastrophizing Scale), insomnia severity (Insomnia Severity Index), physical and mental health functioning (SF-12 pre-COVID-19; SF-36 during COVID-19 pandemic) at initial and subsequent clinic visits. RESULTS: All four patients reduced their postsurgical opioid use with concurrent reductions in pain and improved functioning while receiving postoperative care in the PPP (average length of treatment: 2.8 years). Psychiatric co-treatment addressed the onset or exacerbation of mental health comorbidities following trauma. CONCLUSIONS: Long-term multidisciplinary pain care may improve post-trauma recovery and reduce risks of long-term opioid therapy and disability. Prospective studies are needed to evaluate the effectiveness of TPSs for patients undergoing trauma surgery.

Patient Experiences and Clinical Outcomes in a Multidisciplinary Perioperative Transitional Pain Service.

Siloed pain management across the perioperative period increases the risk of chronic opioid use and impedes postoperative recovery. Transitional perioperative pain services (TPSs) are innovative care models that coordinate multidisciplinary perioperative pain management to mitigate risks of chronic postoperative pain and opioid use. The objective of this study was to examine patients' experiences with and quality of recovery after participation in a TPS. Qualitative interviews were conducted with 26 patients from The Johns Hopkins Personalized Pain Program (PPP) an average of 33 months after their first PPP visit. A qualitative content analysis of the interview data showed that participants (1) valued pain expectation setting, individualized care, a trusting patient-physician relationship, and shared decision-making; (2) perceived psychiatric treatment of co-occurring depression, anxiety, and maladaptive behaviors as critical to recovery; and (3) successfully sustained opioid tapers and experienced improved functioning after PPP discharge. Areas for improved patient-centered care included increased patient education, specifically about the program, continuity of care with pain specialists while tapering opioids, and addressing the health determinants that impede access to pain care. The positive patient experiences and sustained clinical benefits for high-risk complex surgical patient support further efforts to implement and adapt similar models of perioperative pain care.

Patient engagement and prescription opioid use in perioperative pain management.

OBJECTIVE: To examine (1) patient perceptions regarding their engagement and the engagement of their families in perioperative pain management, (2) demographic and clinical characteristics associated with perceived patient and family engagement, and (3) the association between perceived patient and family engagement and patient outcomes. DESIGN: A prospective, observational study. SETTING: The Personalized Pain Program (PPP) at the Johns Hopkins Hospital in Baltimore, Maryland. PARTICIPANTS: Patients having more than one visit to the PPP. INTERVENTIONS: n/a. MAIN OUTCOME MEASURES: Since the inception of the PPP, patients were surveyed prior to each clinic visit to assess their pain severity and interference using the Brief Pain Inventory. Starting August 22, 2018, two additional questions were added to the survey to assess patient perceptions of their engagement and the engagement of their families in perioperative pain management. In addition, electronic medical records were reviewed to collect data on daily opioid consumption during the first and last PPP visits presurgery and post-surgery. RESULTS: The final analysis included 511 survey responses from 155 patients. Perceived engagement of the patient in perioperative pain management improved over time (p < .001) and was significantly associated with reduction in prescription opioid consumption after surgery (coef = 12.7, SE = 5.8, p = .031). CONCLUSIONS: Surgical patients and their family members should be actively engaged in perioperative pain management to improve prescription opioid use and the quality and safety of perioperative care.

Association of Diagnostic Stewardship for Blood Cultures in Critically Ill Children With Culture Rates, Antibiotic Use, and Patient Outcomes: Results of the Bright STAR Collaborative.

Importance: Blood culture overuse in the pediatric intensive care unit (PICU) can lead to unnecessary antibiotic use and contribute to antibiotic resistance. Optimizing blood culture practices through diagnostic stewardship may reduce unnecessary blood cultures and antibiotics. Objective: To evaluate the association of a 14-site multidisciplinary PICU blood culture collaborative with culture rates, antibiotic use, and patient outcomes. Design, Setting, and Participants: This prospective quality improvement (QI) collaborative involved 14 PICUs across the United States from 2017 to 2020 for the Bright STAR (Testing Stewardship for Antibiotic Reduction) collaborative. Data were collected from each participating PICU and from the Children's Hospital Association Pediatric Health Information System for prespecified primary and secondary outcomes. Exposures: A local QI program focusing on blood culture practices in the PICU (facilitated by a larger QI collaborative). Main Outcomes and Measures: The primary outcome was blood culture rates (per 1000 patient-days/mo). Secondary outcomes included broad-spectrum antibiotic use (total days of therapy and new initiations of broad-spectrum antibiotics ≥3 days after PICU admission) and PICU rates of central line-associated bloodstream infection (CLABSI), Clostridioides difficile infection, mortality, readmission, length of stay, sepsis, and severe sepsis/septic shock. Results: Across the 14 PICUs, the blood culture rate was 149.4 per 1000 patient-days/mo preimplementation and 100.5 per 1000 patient-days/mo postimplementation, for a 33% relative reduction (95% CI, 26%-39%). Comparing the periods before and after implementation, the rate of broad-spectrum antibiotic use decreased from 506 days to 440 days per 1000 patient-days/mo, respectively, a 13% relative reduction (95% CI, 7%-19%). The broad-spectrum antibiotic initiation rate decreased from 58.1 to 53.6 initiations/1000 patient-days/mo, an 8% relative reduction (95% CI, 4%-11%). Rates of CLABSI decreased from 1.8 to 1.1 per 1000 central venous line days/mo, a 36% relative reduction (95% CI, 20%-49%). Mortality, length of stay, readmission, sepsis, and severe sepsis/septic shock were similar before and after implementation. Conclusions and Relevance: Multidisciplinary diagnostic stewardship interventions can reduce blood culture and antibiotic use in the PICU. Future work will determine optimal strategies for wider-scale dissemination of diagnostic stewardship in this setting while monitoring patient safety and balancing measures.

Human Factors and Ergonomics (HFE) applications in responses to the COVID-19 pandemic: Lessons learned and considerations for methods.

Human Factors and Ergonomics (HFE), with the goal to support humans through system design, can contribute to responses to emergencies and crises, like the COVID-19 pandemic. In this paper, we describe three cases presented at the 21st Triennial Congress of the International Ergonomics Association to demonstrate how HFE has been applied during the COVID-19 pandemic, namely to (1) develop a mobile diagnostic testing system, (2) understand the changes within physiotherapy services, and (3) guide the transition of a perioperative pain program to telemedicine. We reflect on methodological choices and lessons learned from each case and discuss opportunities to expand the impact of HFE in responses to future emergencies. The HFE discipline should develop faster, less resource intensive but still rigorous, methods, increase available HFE expertise by growing the field, and proactively enhance individual and public perception of the importance of HFE in crisis response.

Numbers and narratives: how qualitative methods can strengthen the science of paediatric antimicrobial stewardship.

Antimicrobial and diagnostic stewardship initiatives have become increasingly important in paediatric settings. The value of qualitative approaches to conduct stewardship work in paediatric patients is being increasingly recognized. This article seeks to provide an introduction to basic elements of qualitative study designs and provide an overview of how these methods have successfully been applied to both antimicrobial and diagnostic stewardship work in paediatric patients. A multidisciplinary team of experts in paediatric infectious diseases, paediatric critical care and qualitative methods has written a perspective piece introducing readers to qualitative stewardship work in children, intended as an overview to highlight the importance of such methods and as a starting point for further work. We describe key differences between qualitative and quantitative methods, and the potential benefits of qualitative approaches. We present examples of qualitative research in five discrete topic areas of high relevance for paediatric stewardship work: provider attitudes; provider prescribing behaviours; stewardship in low-resource settings; parents' perspectives on stewardship; and stewardship work focusing on select high-risk patients. Finally, we explore the opportunities for multidisciplinary academic collaboration, incorporation of innovative scientific disciplines and young investigator growth through the use of qualitative research in paediatric stewardship. Qualitative approaches can bring rich insights and critically needed new information to antimicrobial and diagnostic stewardship efforts in children. Such methods are an important tool in the armamentarium against worsening antimicrobial resistance, and a major opportunity for investigators interested in moving the needle forward for stewardship in paediatric patients.

Consensus Recommendations for Blood Culture Use in Critically Ill Children Using a Modified Delphi Approach.

OBJECTIVES: Blood cultures are fundamental in evaluating for sepsis, but excessive cultures can lead to false-positive results and unnecessary antibiotics. Our objective was to create consensus recommendations focusing on when to safely avoid blood cultures in PICU patients. DESIGN: A panel of 29 multidisciplinary experts engaged in a two-part modified Delphi process. Round 1 consisted of a literature summary and an electronic survey sent to invited participants. In the survey, participants rated a series of recommendations about when to avoid blood cultures on five-point Likert scale. Consensus was achieved for the recommendation(s) if 75% of respondents chose a score of 4 or 5, and these were included in the final recommendations. Any recommendations that did not meet these a priori criteria for consensus were discussed during the in-person expert panel review (Round 2). Round 2 was facilitated by an independent expert in consensus methodology. After a review of the survey results, comments from round 1, and group discussion, the panelists voted on these recommendations in real-time. SETTING: Experts' institutions; in-person discussion in Baltimore, MD. SUBJECTS: Experts in pediatric critical care, infectious diseases, nephrology, oncology, and laboratory medicine. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: Of the 27 original recommendations, 18 met criteria for achieving consensus in Round 1; some were modified for clarity or condensed from multiple into single recommendations during Round 2. The remaining nine recommendations were discussed and modified until consensus was achieved during Round 2, which had 26 real-time voting participants. The final document contains 19 recommendations. CONCLUSIONS: Using a modified Delphi process, we created consensus recommendations on when to avoid blood cultures and prevent overuse in the PICU. These recommendations are a critical step in disseminating diagnostic stewardship on a wider scale in critically ill children.

Survey-based Work System Assessment to Facilitate Large-scale Dissemination of Healthcare Quality Improvement Programs.

INTRODUCTION: The dissemination of quality improvement (QI) interventions to a broader range of healthcare settings requires a proactive assessment of local work systems and processes. The objective of this study was to examine the feasibility of using a survey-based work system assessment (WSA) tool to facilitate the dissemination of a program for optimizing blood culture (BC) use. METHODS: Informed by findings from an onsite, interview-based WSA at 2 hospitals, a 50-item WSA survey was devised and administrated to 15 hospitals participating in a QI collaborative. WSA survey data were summarized, shared, and discussed with individual hospitals to inform the adaptation and implementation of the BC program. Physician champions leading the local QI team assessed the use of the WSA survey by completing an 8-item survey. RESULTS: A total of 347 clinicians completed the WSA survey, and physician champions at 12 hospitals evaluated the use of the WSA survey. Both the WSA survey data and the evaluation of the WSA survey showed that the survey-based WSA tool could help participating hospitals understand their current BC ordering practices and identify potential barriers to implementing the program from the perspectives of different clinicians. CONCLUSIONS: We demonstrated how a survey-based tool could be used to facilitate WSA in the dissemination of a program for improving BC use to a multisite collaborative. A survey-based WSA tool can be used to facilitate future large-scale intervention dissemination efforts.

A novel amino acid site closely associated with the neurovirulence of live, attenuated Japanese encephalitis vaccine (SA14-14-2 strain).

Japanese encephalitis (JE) poses a serious threat to the world's public health yet without a cure, the only way to prevent Japanese encephalitis virus (JEV) infection is vaccination. Live attenuated vaccine (SA14-14-2 strain) is the most widely used JE vaccine, and clinical data have confirmed its safety and effectiveness. Eight sitesassociated with virulence in the Envelope (E) protein are often the focus of quality control of JE vaccine. However, sequences retrieved from NCBI, as well as our previous results showed that the wild strain SA14 may harbor two different amino acids at amino acid residue 244 of the E glycoprotein (E244), and it may be related to virulence. In this study, we introduced a single mutation at nt1708 (G â†’ A) in the full-length cDNA clone of SA14-14-2, replacing a Gly with Glu at amino acid residue 244 of the E glycoprotein, and successfully constructed the mutant virus (JEV E244). JEV E244 exhibited a similar plaque morphology and growth characteristics to JEV SA14-14-2 in cell culture. However, it had lethal neurovirulence in mice and could enter the brain following intraperitoneal inoculation. Moreover, the virulence of JEV E244 in the context of vaccine in mice is significantly different from that of the JEV E244 alone. These results suggested that E244 site should be included in the assessment of the genetic stability of the attenuated JE vaccine. The detection of minor mutations in vaccine population and influence on the safety of vaccine is discussed.

Reducing Three Infections Across Cardiac Surgery Programs: A Multisite Cross-Unit Collaboration.

Using a pre-post design, this study examined the impact of a multifaceted program to simultaneously improve 3 health care-associated infections and patient safety culture throughout the cardiac surgery service line in 11 hospitals. Interventions included the Comprehensive Unit-based Safety Program to improve safety culture and evidence-based bundles to prevent central line-associated bloodstream infection (CLABSI), surgical site infection (SSI), and ventilator-associated pneumonia (VAP). CLABSIs and SSIs showed a downward trend over 2 years, then the rates returned to levels similar to baseline in the third year. VAP rate changes were difficult to interpret because of the VAP definition change. Patient safety culture domain "hospital management support" showed significant improvement, but feedback and communication about errors and staffing declined. Simultaneous implementation of multiple interventions across units is challenging. The findings highlight the importance of sustainment efforts and suggest future work should anticipate both positive and negative change in safety culture dimensions.