What Went Right? A Mixed-Methods Study of Positive Feedback Data in a Hospital-Wide Mortality Review Survey.

BACKGROUND: Toxic work culture contributes to healthcare worker burnout and attrition, but little is known about how healthcare organizations can systematically create and promote a culture of civility and collegiality. OBJECTIVE: To analyze peer-to-peer positive feedback collected as part of a systematized mortality review survey to identify themes and recognition dynamics that can inform positive organizational culture change. DESIGN: Convergent mixed-methods study design. PARTICIPANTS: A total of 388 physicians, 212 registered nurses, 64 advanced practice providers, and 1 respiratory therapist at four non-profit hospitals (2 academic and 2 community). INTERVENTION: Providing optional positive feedback in the mortality review survey. MAIN MEASURES: Key themes and subthemes that emerged from positive feedback data, associations between key themes and positive feedback respondent characteristics, and recognition dynamics between positive feedback respondents and recipients. KEY RESULTS: Approximately 20% of healthcare workers provided positive feedback. Three key themes emerged among responses with free text comments: (1) providing extraordinary patient and family-centered care; (2) demonstrating self-possession and mastery; and (3) exhibiting empathic peer support and effective team collaboration. Compared to other specialties, most positive feedback from medicine (70.2%), neurology (65.2%), hospice and palliative medicine (64.3%), and surgery (58.8%) focused on providing extraordinary patient and family-centered care (p = 0.02), whereas emergency medicine (59.1%) comments predominantly focused on demonstrating self-possession and mastery (p = 0.06). Registered nurses (40.2%) provided multidirectional positive feedback more often than other clinician types in the hospital hierarchy (p < 0.001). CONCLUSIONS: Analysis of positive feedback from a mortality review survey provided meaningful insights into a health system's culture of teamwork and values related to civility and collegiality when providing end-of-life care. Systematic collection and sharing of positive feedback is feasible and has the potential to promote positive culture change and improve healthcare worker well-being.

Harnessing the Power of Generative AI for Clinical Summaries: Perspectives From Emergency Physicians.

STUDY OBJECTIVE: The workload of clinical documentation contributes to health care costs and professional burnout. The advent of generative artificial intelligence language models presents a promising solution. The perspective of clinicians may contribute to effective and responsible implementation of such tools. This study sought to evaluate 3 uses for generative artificial intelligence for clinical documentation in pediatric emergency medicine, measuring time savings, effort reduction, and physician attitudes and identifying potential risks and barriers. METHODS: This mixed-methods study was performed with 10 pediatric emergency medicine attending physicians from a single pediatric emergency department. Participants were asked to write a supervisory note for 4 clinical scenarios, with varying levels of complexity, twice without any assistance and twice with the assistance of ChatGPT Version 4.0. Participants evaluated 2 additional ChatGPT-generated clinical summaries: a structured handoff and a visit summary for a family written at an 8th grade reading level. Finally, a semistructured interview was performed to assess physicians' perspective on the use of ChatGPT in pediatric emergency medicine. Main outcomes and measures included between subjects' comparisons of the effort and time taken to complete the supervisory note with and without ChatGPT assistance. Effort was measured using a self-reported Likert scale of 0 to 10. Physicians' scoring of and attitude toward the ChatGPT-generated summaries were measured using a 0 to 10 Likert scale and open-ended questions. Summaries were scored for completeness, accuracy, efficiency, readability, and overall satisfaction. A thematic analysis was performed to analyze the content of the open-ended questions and to identify key themes. RESULTS: ChatGPT yielded a 40% reduction in time and a 33% decrease in effort for supervisory notes in intricate cases, with no discernible effect on simpler notes. ChatGPT-generated summaries for structured handoffs and family letters were highly rated, ranging from 7.0 to 9.0 out of 10, and most participants favored their inclusion in clinical practice. However, there were several critical reservations, out of which a set of general recommendations for applying ChatGPT to clinical summaries was formulated. CONCLUSION: Pediatric emergency medicine attendings in our study perceived that ChatGPT can deliver high-quality summaries while saving time and effort in many scenarios, but not all.

Evaluating the Balance Between Privacy and Access in Digital Information Sharing.

OBJECTIVES: Access to personal health records in an ICU by persons involved in the patient's care (referred to broadly as "family members" below) has the potential to increase engagement and reduce the negative psychologic sequelae of such hospitalizations. Currently, little is known about patient preferences for information sharing with a designated family member in the ICU. We sought to understand the information-sharing preferences of former ICU patients and their family members and to identify predictors of information-sharing preferences. DESIGN: We performed an internet survey that was developed by a broad, multidisciplinary team of stakeholders. Formal pilot testing of the survey was conducted prior to internet survey administration to study subjects. SETTING: Internet survey. SUBJECTS: Subjects included English-speaking adults who had an ICU experience or a family member with ICU experience between 2013 and 2016. We used panel sampling to ensure an ethnically representative sample of the U.S. population. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: One thousand five hundred twenty surveys were submitted, and 1,470 were included in analysis. The majority of respondents (93.6%) stated that they would want to share present and past medical history, either all or that related to their ICU stay, with a designated family member of their choosing. The majority (79%) would also want their designated family member to be able to access that information from a home computer. Although most respondents preferred to share all types of information, they indicated varying levels of willingness to share specific types of more sensitive information. Information-sharing preferences did not differ by age, sex, ethnicity, or type of prior experience in the ICU (i.e., patient or family member). CONCLUSIONS: In the context of an ICU admission, sharing personal health information with a person of the patient's choosing appears desirable for most patients and family members. Policies and implementation of regulations should take this into consideration.

Understanding Perceived Appreciation to Create a Culture of Wellness.

OBJECTIVE: To fully address physician burnout, academic medical centers need cultures that promote well-being. One observed driver of a culture of wellness is perceived appreciation. The authors identified several contributors to perceived appreciation among faculty at a large, metropolitan academic institution through use of a novel survey. METHODS: The authors surveyed clinical faculty in five departments: psychiatry, emergency medicine, internal medicine, thoracic surgery, and radiology. Two open-ended response questions assessed sources of perceived and lack of perceived appreciation in narrative form. The authors also collected data on gender and department identity. Grounded theory methodology was used to analyze the narrative responses and design thinking to brainstorm specific recommendations based on the main themes identified. RESULTS: A total of 179 faculty respondents filled out the survey for an overall response rate of 29%. Major drivers of perceived appreciation were patient and families (42%); physician, trainee and non-physician colleagues (32.7%); chairs (10%); and compensation (3.3%). Major drivers of perceived lack of appreciation were disrespect for time and skill level, including inadequate staffing (30%); devaluation by a physician colleague, chief of one's service or the chair (29%); poor communication and transparency (13%); and patient and family anger (6%). CONCLUSIONS: Opportunities to improve perceived appreciation include structured communication of patient gratitude, community building programs, top of licensure initiatives and accountability for physician wellness, and inclusivity efforts from organizational leaders.

Effect of an Online Weight Management Program Integrated With Population Health Management on Weight Change: A Randomized Clinical Trial.

Importance: Online programs may help with weight loss but have not been widely implemented in routine primary care. Objective: To compare the effectiveness of a combined intervention, including an online weight management program plus population health management, with the online program only and with usual care. Design, Setting, and Participants: Cluster randomized trial with enrollment from July 19, 2016, through August 10, 2017, at 15 primary care practices in the US. Eligible participants had a scheduled primary care visit and were aged 20 to 70 years, had a body mass index between 27 and less than 40, and had a diagnosis of hypertension or type 2 diabetes. Follow-up ended on May 8, 2019. Interventions: Participants in the usual care group (n = 326) were mailed general information about weight management. Participants in the online program only group (n = 216) and the combined intervention group (n = 298) were registered for the online program. The participants in the combined intervention group also received weight-related population health management, which included additional support from nonclinical staff who monitored their progress in the online program and conducted periodic outreach. Main Outcomes and Measures: The primary outcome was weight change at 12 months based on measured weights recorded in the electronic health record. Weight change at 18 months was a secondary outcome. Results: Among the 840 participants who enrolled (mean age, 59.3 years [SD, 8.6 years]; 60% female; 76.8% White), 732 (87.1%) had a recorded weight at 12 months and the missing weights for the remaining participants were imputed. There was a significant difference in weight change at 12 months by group with a mean weight change of -1.2 kg (95% CI, -2.1 to -0.3 kg) in the usual care group, -1.9 kg (95% CI, -2.6 to -1.1 kg) in the online program only group, and -3.1 kg (95% CI, -3.7 to -2.5 kg) in the combined intervention group (P < .001). The difference in weight change between the combined intervention group and the usual care group was -1.9 kg (97.5% CI, -2.9 to -0.9 kg; P < .001) and the difference between the combined intervention group and the online program only group was -1.2 kg (95% CI, -2.2 to -0.3 kg; P = .01). At 18 months, the mean weight change was -1.9 kg (95% CI, -2.8 to -1.0 kg) in the usual care group, -1.1 kg (95% CI, -2.0 to -0.3 kg) in the online program only group, and -2.8 kg (95% CI, -3.5 to -2.0 kg) in the combined intervention group (P < .001). Conclusions and Relevance: Among primary care patients with overweight or obesity and hypertension or type 2 diabetes, combining population health management with an online program resulted in a small but statistically significant greater weight loss at 12 months compared with usual care or the online program only. Further research is needed to understand the generalizability, scalability, and durability of these findings. Trial Registration: ClinicalTrials.gov Identifier: NCT02656693.

Primary Care Patients' and Providers' Perspectives about an Online Weight Management Program: a Qualitative Study.

BACKGROUND: Primary care providers (PCPs) often take the lead role in caring for patients with overweight and obesity; however, few PCPs counsel patients about weight loss. Online weight management programs that are integrated within primary care may help address this gap in care. OBJECTIVE: To identify perceptions of and experience with online weight management programs in general and with a proposed online program, to identify barriers to use, and to improve the design and content of our intervention, which included an online program plus population health management (PHM) support from primary care practices. DESIGN: A mixed qualitative methods study including three patient focus groups and seven semi-structured interviews with healthcare providers. PARTICIPANTS: A total of 13 adult patients (age range, 20-70) with body mass index (BMI) 27-35 kg/m2 attended the focus groups. In-person semi-structured interviews were conducted with seven healthcare providers (three PCPs, two population health managers, one primary care nurse, and one registered dietitian). MAIN MEASURES: We developed and used semi-structured focus groups and interview guides. The focus group and interviews were recorded and transcribed. Using grounded theory, we analyzed the transcripts to identify and extract common concepts and themes. KEY RESULTS: Although patients and healthcare providers expressed positive opinions about online weight management programs, few patients had experience with them, and providers stated that such programs are not being widely implemented in primary care settings. Some participants highlighted the flexibility and low cost as strengths of online weight management tools compared with in-person programs. All participants had favorable opinions about our proposed intervention and were overwhelmingly positive about the combination of an online program and PHM support. CONCLUSIONS: This study highlights the potential value of online weight management programs and PHM support in primary care. CLINICAL TRIALS REGISTRATION: NCT02656693.

The Practice of Respect in the ICU.

Although "respect" and "dignity" are intuitive concepts, little formal work has addressed their systematic application in the ICU setting. After convening a multidisciplinary group of relevant experts, we undertook a review of relevant literature and collaborative discussions focused on the practice of respect in the ICU. We report the output of this process, including a summary of current knowledge, a conceptual framework, and a research program for understanding and improving the practice of respect and dignity in the ICU. We separate our report into findings and proposals. Findings include the following: 1) dignity and respect are interrelated; 2) ICU patients and families are vulnerable to disrespect; 3) violations of respect and dignity appear to be common in the ICU and overlap substantially with dehumanization; 4) disrespect may be associated with both primary and secondary harms; and 5) systemic barriers complicate understanding and the reliable practice of respect in the ICU. Proposals include: 1) initiating and/or expanding a field of research on the practice of respect in the ICU; 2) treating "failures of respect" as analogous to patient safety events and using existing quality and safety mechanisms for improvement; and 3) identifying both benefits and potential unintended consequences of efforts to improve the practice of respect. Respect and dignity are important considerations in the ICU, even as substantial additional research remains to be done.

Oversight of Patient-Centered Outcomes Research: Recommendations From a Delphi Panel.

A key aim of patient-centered outcomes research (PCOR) is to generate data that are important to patients by deliberately and extensively involving them in all aspects of research, from design to dissemination. However, certain elements of PCOR raise challenging and potentially novel ethical and regulatory issues for institutional review boards and oversight bodies. These challenges stem primarily from the engagement of patients in roles other than research subject, such as advisors, study personnel, and co-investigators, which gives rise to questions about appropriate levels of protection, training, and education, as well as identifying and managing conflicts of interest. This article presents and discusses recommendations from a Delphi expert panel that was convened to address these and other PCOR-related oversight challenges.

A Clinician's Guide to Privacy and Communication in the ICU.

OBJECTIVE: To review the legal issues concerning family members' access to information when patients are in the ICU. DATA SOURCES: U.S. Code, U.S. Code of Federal Regulations, and state legislative codes. DATA EXTRACTION: Relevant legal statutes and regulations were identified and reviewed by the two attorney authors (L. F., M. A. V.). STUDY SELECTION: Not applicable. DATA SYNTHESIS: Review by all coauthors. CONCLUSIONS: The Health Insurance Portability and Accountability Act and related laws should not be viewed as barriers to clinicians sharing information with ICU patients and their loved ones. Generally, under Health Insurance Portability and Accountability Act, personal representatives have the same authority to receive information that patients would otherwise have. Persons involved in the patient's care also may be given information relevant to the episode of care unless the patient objects. ICUs should develop policies for handling the issues we identify about such information sharing, including policies for responding to telephone inquiries and methods for giving patients the opportunity to object to sharing information with individuals involved in their care. ICU clinicians also should be knowledgeable of their state's laws about how to identify patients' personal representatives and the authority of those representatives. Finally, ICU clinicians should be aware of any special restrictions their state places on medical information. In aggregate, these strategies should help ICU managers and clinicians facilitate robust communication with patients and their loved ones.

Prospective Evaluation of a Multifaceted Intervention to Improve Outcomes in Intensive Care: The Promoting Respect and Ongoing Safety Through Patient Engagement Communication and Technology Study.

OBJECTIVES: Studies comprehensively assessing interventions to improve team communication and to engage patients and care partners in ICUs are lacking. This study examines the effectiveness of a patient-centered care and engagement program in the medical ICU. DESIGN: Prospective intervention study. SETTING: Medical ICUs at large tertiary care center. PATIENTS: Two thousand one hundred five patient admissions (1,030 before and 1,075 during the intervention) from July 2013 to May 2014 and July 2014 to May 2015. INTERVENTIONS: Structured patient-centered care and engagement training program and web-based technology including ICU safety checklist, tools to develop shared care plan, and messaging platform. Patient and care partner access to online portal to view health information, participate in the care plan, and communicate with providers. MEASUREMENTS AND MAIN RESULTS: Primary outcome was aggregate adverse event rate. Secondary outcomes included patient and care partner satisfaction, care plan concordance, and resource utilization. We included 2,105 patient admissions, (1,030 baseline and 1,075 during intervention periods). The aggregate rate of adverse events fell 29%, from 59.0 per 1,000 patient days (95% CI, 51.8-67.2) to 41.9 per 1,000 patient days (95% CI, 36.3-48.3; p < 0.001), during the intervention period. Satisfaction improved markedly from an overall hospital rating of 71.8 (95% CI, 61.1-82.6) to 93.3 (95% CI, 88.2-98.4; p < 0.001) for patients and from 84.3 (95% CI, 81.3-87.3) to 90.0 (95% CI, 88.1-91.9; p < 0.001) for care partners. No change in care plan concordance or resource utilization. CONCLUSIONS: Implementation of a structured team communication and patient engagement program in the ICU was associated with a reduction in adverse events and improved patient and care partner satisfaction.

Developing a Framework for Evaluating the Patient Engagement, Quality, and Safety of Mobile Health Applications.

Rising ownership of smartphones and tablets across social and demographic groups has made mobile applications, or apps, a potentially promising tool for engaging patients in their health care, particularly those with high health care needs. Through a systematic search of iOS (Apple) and Android app stores and an analysis of apps targeting individuals with chronic illnesses, we assessed the degree to which apps are likely to be useful in patient engagement efforts. Usefulness was determined based on the following criteria: description of engagement, relevance to the targeted patient population, consumer ratings and reviews, and most recent app update. Among the 1,046 health care-related, patient-facing applications identified by our search, 43 percent of iOS apps and 27 percent of Android apps appeared likely to be useful. We also developed criteria for evaluating the patient engagement, quality, and safety of mobile apps.

Nurses' Perspectives on Patient Satisfaction and Expectations: An International Cross-Sectional Multicenter Study With Implications for Evidence-Based Practice.

BACKGROUND: Addressing patient expectations is necessary to achieve high satisfaction. However, few data are available on nurses' perceptions and performance with respect to patient expectations and satisfaction. OBJECTIVES: This international multicenter study aimed to: (a) evaluate nurses' attitudes and performance with respect to patient satisfaction and expectations, and (b) identify predictors of nurses' inquiry of patients' satisfaction at the point of discharge. METHODS: A questionnaire examining attitudes and performance toward patient satisfaction and expectations was developed and validated. Nurses at four academic hospitals in the United States, the United Kingdom, Israel, and Denmark were surveyed. RESULTS: A total of 536 nurses participated in the study (response rate 85.3%). Nurses expressed positive attitudes toward activities related to patient satisfaction and expectations, endorsing the importance of talking with patients about their satisfaction status (91.6%) and their expectations (93.2%). More than half of the responders (51.8%) claimed to have responded to the status of patient satisfaction or dissatisfaction (Israel: 25%; United States: 54.9%; United Kingdom: 61.7%; Denmark: 69.9%; p < .001). However, only 12.1% stated that they routinely ask patients about their level of satisfaction, with nurses in the United States (18.3%) and Denmark (17.5%) more likely to ask compared to nurses in the United Kingdom (7.4%) and Israel (6.3%; p = .001). Adjusted logistic regression identified four significant predictors (p < .05) of nurses' inquiry about patients' satisfaction: "Responding to patient's satisfaction status" (OR: 3.1; 95% CI: 1.7-5.8); "Documenting patient's satisfaction status" (OR: 2.8; 95% CI: 1.6-5.1); "Asking routinely about expectations" (OR: 5.4; 95% CI: 3-9.7); and "Responded to expectations during the past month" (OR: 4.3; 95% CI: 1.9-9.4). LINKING EVIDENCE TO ACTION: These findings warrant further investigation, potentially into the nurses' work environments or educational programs, to better understand why nurses' positive attitudes toward patient satisfaction and expectations do not result in actively asking patients about their satisfaction level and what should be done to improve nurses' performance. Healthcare organizations and policy makers should develop and support structured programs to address patient expectations and improve patient satisfaction during hospitalization.

Influence of shared medical appointments on patient satisfaction: a retrospective 3-year study.

PURPOSE: Shared medical appointments (SMAs) are becoming popular, but little is known about their association with patient experience in primary care. We performed an exploratory analysis examining overall satisfaction and patient-centered care experiences across key domains of the patient-centered medical home among patients attending SMAs vs usual care appointments. METHODS: We undertook a cross-sectional study using a mailed questionnaire measuring levels of patient satisfaction and other indicators of patient-centered care among 921 SMA and 921 usual care patients between 2008 and 2010. Propensity scores adjusted for potential case mix differences between the groups. Multivariate logistic regression assessed propensity-matched patients' ratings of care. Generalized estimating equations accounted for physician-level clustering. RESULTS: A total of 40% of SMA patients and 31% of usual care patients responded. In adjusted analyses, SMA patients were more likely to rate their overall satisfaction with care as "very good" when compared with usual care counterparts (odds ratio=1.26; 95% CI, 1.05-1.52). In the analysis of patient-centered medical home elements, SMA patients rated their care as more accessible and more sensitive to their needs, whereas usual care patients reported greater satisfaction with physician communication and time spent during their appointment. CONCLUSIONS: Overall, SMA patients appear more satisfied with their care relative to patients receiving usual care. SMAs may also improve access to care and deliver care that patients find to be sensitive to their needs. Further research should focus on enhancing patient-clinician communication within an SMA as this model of care becomes more widely adopted.

Patient-Clinician Diagnostic Concordance upon Hospital Admission.

OBJECTIVES: This study aimed to pilot an application-based patient diagnostic questionnaire (PDQ) and assess the concordance of the admission diagnosis reported by the patient and entered by the clinician. METHODS: Eligible patients completed the PDQ assessing patients' understanding of and confidence in the diagnosis 24 hours into hospitalization either independently or with assistance. Demographic data, the hospital principal problem upon admission, and International Classification of Diseases 10th Revision (ICD-10) codes were retrieved from the electronic health record (EHR). Two physicians independently rated concordance between patient-reported diagnosis and clinician-entered principal problem as full, partial, or no. Discrepancies were resolved by consensus. Descriptive statistics were used to report demographics for concordant (full) and nonconcordant (partial or no) outcome groups. Multivariable logistic regressions of PDQ questions and a priori selected EHR data as independent variables were conducted to predict nonconcordance. RESULTS: A total of 157 (77.7%) questionnaires were completed by 202 participants; 77 (49.0%), 46 (29.3%), and 34 (21.7%) were rated fully concordant, partially concordant, and not concordant, respectively. Cohen's kappa for agreement on preconsensus ratings by independent reviewers was 0.81 (0.74, 0.88). In multivariable analyses, patient-reported lack of confidence and undifferentiated symptoms (ICD-10 "R-code") for the principal problem were significantly associated with nonconcordance (partial or no concordance ratings) after adjusting for other PDQ questions (3.43 [1.30, 10.39], p = 0.02) and in a model using selected variables (4.02 [1.80, 9.55], p < 0.01), respectively. CONCLUSION: About one-half of patient-reported diagnoses were concordant with the clinician-entered diagnosis on admission. An ICD-10 "R-code" entered as the principal problem and patient-reported lack of confidence may predict patient-clinician nonconcordance early during hospitalization via this approach.

Development of MyREADY Transition BBD Mobile App, a Health Intervention Technology Platform, to Improve Care Transition for Youth With Brain-Based Disabilities: User-Centered Design Approach.

BACKGROUND: Transition from pediatric to adult health care varies and is resource intensive. Patient-centered health information technology (HIT) interventions are increasingly being developed in partnership with patients. OBJECTIVE: This study aims to develop an internet-based mobile app intervention for patients with brain-based disabilities to improve transition in care readiness. METHODS: The app was designed for patients aged 15 to 17 years with brain-based disabilities having the ability to use a mobile app. A multidisciplinary team, an industry partner, and a patient and family advisory council was assembled. We hypothesized that existing tools could be migrated into the app to address education, empowerment, and navigation. We used cognitive learning theory to support chapters targeting transition in care skill sets. We used the agile iterative methodology to engage stakeholders. RESULTS: We developed a novel MyREADY Transition HIT platform. An electronic mentor supported cognitive learning with messaging, quizzes, rewards, and videos. We used gaming to guide navigation through a fictitious health care city. Adapting existing tools was achieved by the patient and family advisory council requesting personalization. Our iterative design required time-consuming back-end technology management. Developing the platform took 24 months instead of our grant-approved 12 months, impacting the onset of the planned trial within the allotted budget. CONCLUSIONS: A novel patient-centered HIT platform to improve health care transition was successfully developed in partnership with patients and industry. Careful resource management was needed to achieve timely delivery of the end product, flagging the cautious planning required to deliver HIT tools in time for the much-needed trials informing their clinical application. TRIAL REGISTRATION: ClinicalTrials.gov NCT03852550; https://clinicaltrials.gov/study/NCT03852550.

A Machine Learning Application to Classify Patients at Differing Levels of Risk of Opioid Use Disorder: Clinician-Based Validation Study.

Background: Despite restrictive opioid management guidelines, opioid use disorder (OUD) remains a major public health concern. Machine learning (ML) offers a promising avenue for identifying and alerting clinicians about OUD, thus supporting better clinical decision-making regarding treatment. Objective: This study aimed to assess the clinical validity of an ML application designed to identify and alert clinicians of different levels of OUD risk by comparing it to a structured review of medical records by clinicians. Methods: The ML application generated OUD risk alerts on outpatient data for 649,504 patients from 2 medical centers between 2010 and 2013. A random sample of 60 patients was selected from 3 OUD risk level categories (n=180). An OUD risk classification scheme and standardized data extraction tool were developed to evaluate the validity of the alerts. Clinicians independently conducted a systematic and structured review of medical records and reached a consensus on a patient's OUD risk level, which was then compared to the ML application's risk assignments. Results: A total of 78,587 patients without cancer with at least 1 opioid prescription were identified as follows: not high risk (n=50,405, 64.1%), high risk (n=16,636, 21.2%), and suspected OUD or OUD (n=11,546, 14.7%). The sample of 180 patients was representative of the total population in terms of age, sex, and race. The interrater reliability between the ML application and clinicians had a weighted kappa coefficient of 0.62 (95% CI 0.53-0.71), indicating good agreement. Combining the high risk and suspected OUD or OUD categories and using the review of medical records as a gold standard, the ML application had a corrected sensitivity of 56.6% (95% CI 48.7%-64.5%) and a corrected specificity of 94.2% (95% CI 90.3%-98.1%). The positive and negative predictive values were 93.3% (95% CI 88.2%-96.3%) and 60.0% (95% CI 50.4%-68.9%), respectively. Key themes for disagreements between the ML application and clinician reviews were identified. Conclusions: A systematic comparison was conducted between an ML application and clinicians for identifying OUD risk. The ML application generated clinically valid and useful alerts about patients' different OUD risk levels. ML applications hold promise for identifying patients at differing levels of OUD risk and will likely complement traditional rule-based approaches to generating alerts about opioid safety issues.

Navigating meaningful engagement: lessons from partnering with youth and families in brain-based disability research.

BACKGROUND: While patient and family engagement in research has become a widespread practice, meaningful and authentic engagement remains a challenge. In the READYorNot™ Brain-Based Disabilities Study, we developed the MyREADY Transition™ Brain-Based Disabilities App to promote education, empowerment, and navigation for the transition from pediatric to adult care among youth with brain-based disabilities, aged 15-17 years old. Our research team created a Patient and Family Advisory Council (PFAC) to engage adolescents, young adults, and parent caregivers as partners throughout our multi-year and multi-stage project. MAIN BODY: This commentary, initiated and co-authored by members of our PFAC, researchers, staff, and a trainee, describes how we corrected the course of our partnership in response to critical feedback from partners. We begin by highlighting an email testimonial from a young adult PFAC member, which constituted a "critical turning point," that unveiled feelings of unclear expectations, lack of appreciation, and imbalanced relationships among PFAC members. As a team, we reflected on our partnership experiences and reviewed documentation of PFAC activities. This process allowed us to set three intentions to create a collective goal of authentic and meaningful engagement and to chart the course to get us there: (1) offering clarity and flexibility around participation; (2) valuing and acknowledging partners and their contributions; and (3) providing choice and leveraging individual interests and strengths. Our key recommendations include: (1) charting the course with a plan to guide our work; (2) learning the ropes by developing capacity for patient-oriented research; (3) all hands on deck by building a community of engagement; and (4) making course corrections and being prepared to weather the storms by remaining open to reflection, re-evaluation, and adjustment as necessary. CONCLUSIONS: We share key recommendations and lessons learned from our experiences alongside examples from the literature to offer guidance for multi-stage research projects partnering with adolescents, young adults, and family partners. We hope that by sharing challenges and lessons learned, we can help advance patient and family engagement in research.

Adverse diagnostic events in hospitalised patients: a single-centre, retrospective cohort study.

BACKGROUND: Adverse event surveillance approaches underestimate the prevalence of harmful diagnostic errors (DEs) related to hospital care. METHODS: We conducted a single-centre, retrospective cohort study of a stratified sample of patients hospitalised on general medicine using four criteria: transfer to intensive care unit (ICU), death within 90 days, complex clinical events, and none of the aforementioned high-risk criteria. Cases in higher-risk subgroups were over-sampled in predefined percentages. Each case was reviewed by two adjudicators trained to judge the likelihood of DE using the Safer Dx instrument; characterise harm, preventability and severity; and identify associated process failures using the Diagnostic Error Evaluation and Research Taxonomy modified for acute care. Cases with discrepancies or uncertainty about DE or impact were reviewed by an expert panel. We used descriptive statistics to report population estimates of harmful, preventable and severely harmful DEs by demographic variables based on the weighted sample, and characteristics of harmful DEs. Multivariable models were used to adjust association of process failures with harmful DEs. RESULTS: Of 9147 eligible cases, 675 were randomly sampled within each subgroup: 100% of ICU transfers, 38.5% of deaths within 90 days, 7% of cases with complex clinical events and 2.4% of cases without high-risk criteria. Based on the weighted sample, the population estimates of harmful, preventable and severely harmful DEs were 7.2% (95% CI 4.66 to 9.80), 6.1% (95% CI 3.79 to 8.50) and 1.1% (95% CI 0.55 to 1.68), respectively. Harmful DEs were frequently characterised as delays (61.9%). Severely harmful DEs were frequent in high-risk cases (55.1%). In multivariable models, process failures in assessment, diagnostic testing, subspecialty consultation, patient experience, and history were significantly associated with harmful DEs. CONCLUSIONS: We estimate that a harmful DE occurred in 1 of every 14 patients hospitalised on general medicine, the majority of which were preventable. Our findings underscore the need for novel approaches for adverse DE surveillance.

Using Failure Mode and Effect Analysis to Identify Potential Failures in a Psychiatric Hospital Emergency Department.

OBJECTIVES: Failure mode and effect analysis (FMEA) is a powerful tool for accessing potential failures, but the participants are limited. It has not been used in psychiatric hospitals. Objectives were to implement FMEA in a psychiatric hospital and determine whether the FMEA process can be expanded by including participants who are familiar with the emergency department (ED) admission process and those who are not. METHODS: In this prospective, questionnaire-based study, a multidisciplinary team experienced in ED admissions was trained in FMEA and determined potential failures in the process. They developed a questionnaire regarding the failures, which were ranked by 17 ED and 28 non-ED healthcare providers. Risk priority numbers were calculated for each. RESULTS: By applying FMEA, we found 6 steps of the ED admission process, with 32 potential failures. Risk priority numbers ranged from 91 to 225. The most notable potential failure identified was during a patient's initial telephone call to the ED, before arrival. Emergency department and non-ED workers ranked 94% of the potential failures similarly. CONCLUSIONS: Failure mode and effect analysis can be implemented in psychiatric hospitals and can be a useful tool for anticipating potential failures. The number of participants in an FMEA can be increased to include those who are not directly involved in the process and should involve several specialists from diverse fields. Increasing the number of participants allows more detailed analyses. A checklist detailing the actions to take when processing a patient's initial phone call should be implemented to decrease hazards related to ED admissions.

Providers' and Patients' Perspectives on Diagnostic Errors in the Acute Care Setting.

BACKGROUND: Diagnostic errors (DEs) have been studied extensively in ambulatory care, but less work has been done in the acute care setting. In this study, the authors examined health care providers' and patients' perspectives about the classification of DEs, the main causes and scope of DEs in acute care, the main gaps in current systems, and the need for innovative solutions. METHODS: A qualitative mixed methods study was conducted, including semistructured interviews with health care providers and focus groups with patient advisors. Using grounded theory approach, thematic categories were derived from the interviews and focus groups. RESULTS: The research team conducted interviews with 17 providers and two focus groups with seven patient advisors. Both providers and patient advisors struggled to define and describe DEs in acute care settings. Although participants agreed that DEs pose a significant risk to patient safety, their perception of the frequency of DEs was mixed. Most participants identified communication failures, lack of comfort with diagnostic uncertainty, incorrect clinical evaluation, and cognitive load as key causes of DEs. Most respondents believed that non-information technology (IT) tools and processes (for example, communication improvement strategies) could significantly reduce DEs. CONCLUSION: The study findings represent an important supplement to our understanding of DEs in acute care settings and the advancement of a culture of patient safety in the context of patient-centered care and patient engagement. Health care organizations should consider the key factors identified in this study when trying to create a culture that engages clinicians and patients in reducing DEs.