Development and Evaluation of Patient Safety Interventions: Perspectives of Operational Safety Leaders and Patient Safety Organizations.

OBJECTIVES: The purpose of this study is to understand how patient safety professionals from healthcare facilities and patient safety organizations develop patient safety interventions and the resources used to support intervention development. METHODS: Semistructured interviews were conducted with patient safety professionals at nine healthcare facilities and nine patient safety organizations. Interview data were qualitatively analyzed, and findings were organized by the following: patient safety solutions and interventions, use of external databases, and evaluation of patient safety solutions. RESULTS: Development of patient safety interventions across healthcare facilities and patient safety organizations was similar and included literature searches, internal brainstorming, and interviews. Nearly all patient safety professionals at healthcare facilities reported contacting colleagues at other healthcare facilities to learn about similar safety issues and potential interventions. Additionally, less than half of patient safety professionals at healthcare facilities and patient safety organizations interviewed report data to publicly available patient safety databases. Finally, most patient safety professionals at healthcare facilities and patient safety organizations stated that they evaluate the effectiveness of patient safety interventions; however, they mentioned methods that may be less rigorous including audits, self-reporting, and subjective judgment. CONCLUSIONS: Patient safety professionals often utilize similar methods and resources to develop and evaluate patient safety interventions; however, many of these efforts are not coordinated across healthcare organizations and could benefit from working collectively in a systematic fashion. Additionally, healthcare facilities and patient safety organizations face similar challenges and there are several opportunities for optimization on a national level that may improve patient safety.

Safe and Equitable Pediatric Clinical Use of AI.

This Viewpoint provides recommendations and stakeholder actions to support safe and equitable use of artificial intelligence (AI) in pediatric clinical settings.

Telemedicine and In-Person Visit Modality Mix and Electronic Health Record Use in Primary Care.

This cross-sectional study investigates the association between day-to-day changes in telemedicine share and clinician time spent on electronic health record (EHR) use.

Reading Room Interruptions are Less Disruptive When Using Asynchronous Communication Methods.

Radiologist interruptions, though often necessary, can be disruptive. Prior literature has shown interruptions to be frequent, occurring during cases, and predominantly through synchronous communication methods such as phone or in person causing significant disengagement from the study being read. Asynchronous communication methods are now more widely available in hospital systems such as ours. Considering the increasing use of asynchronous communication methods, we conducted an observational study to understand the evolving nature of radiology interruptions. We hypothesize that compared to interruptions occurring through synchronous methods, interruptions via asynchronous methods reduce the disruptive nature of interruptions by occurring between cases, being shorter, and less severe. During standard weekday hours, 30 radiologists (14 attendings, 12 residents, and 4 fellows) were directly observed for approximately 90-min sessions across three different reading rooms (body, neuroradiology, general). The frequency of interruptions was documented including characteristics such as timing, severity, method, and length. Two hundred twenty-five interruptions (43 Teams, 47 phone, 89 in-person, 46 other) occurred, averaging 2 min and 5 s with 5.2 interruptions per hour. Microsoft Teams interruptions averaged 1 min 12 s with only 60.5% during cases. In-person interruptions averaged 2 min 12 s with 82% during cases. Phone interruptions averaged 2 min and 48 s with 97.9% during cases. A substantial portion of reading room interruptions occur via predominantly asynchronous communication tools, a new development compared to prior literature. Interruptions via predominantly asynchronous communications tools are shorter and less likely to occur during cases. In our practice, we are developing tools and mechanisms to promote asynchronous communication to harness these benefits.

Patient Safety and Artificial Intelligence in Clinical Care.

This Viewpoint offers 3 recommendations for health care organizations and other stakeholders to consider as part of the Health and Human Services' artificial intelligence safety program.

A text mining approach to categorize patient safety event reports by medication error type.

Patient safety reporting systems give healthcare provider staff the ability to report medication related safety events and errors; however, many of these reports go unanalyzed and safety hazards go undetected. The objective of this study is to examine whether natural language processing can be used to better categorize medication related patient safety event reports. 3,861 medication related patient safety event reports that were previously annotated using a consolidated medication error taxonomy were used to develop three models using the following algorithms: (1) logistic regression, (2) elastic net, and (3) XGBoost. After development, models were tested, and model performance was analyzed. We found the XGBoost model performed best across all medication error categories. 'Wrong Drug', 'Wrong Dosage Form or Technique or Route', and 'Improper Dose/Dose Omission' categories performed best across the three models. In addition, we identified five words most closely associated with each medication error category and which medication error categories were most likely to co-occur. Machine learning techniques offer a semi-automated method for identifying specific medication error types from the free text of patient safety event reports. These algorithms have the potential to improve the categorization of medication related patient safety event reports which may lead to better identification of important medication safety patterns and trends.

Variations in Physician Telemedicine Provision.

This cross-sectional study assesses variation in the provision of telemedicine services among primary care physicians and quantifies the extent to which this variation may be explained by the individual physician vs temporal, patient, or visit factors.

Electronic health record "gag clauses" and the prevalence of screenshots in peer-reviewed literature.

OBJECTIVE: To determine whether the Office of the National Coordinator's policy change restricting the use of "gag clauses" in contracts between electronic health record (EHR) vendors and healthcare facilities increased the prevalence of screenshots in peer-reviewed literature. MATERIALS AND METHODS: We reviewed EHR usability and safety-related peer-reviewed journal articles from 2015 to 2023 and quantified the number of articles containing screenshots. For those that did not contain screenshots, we identified whether they would have benefited from screenshots. RESULTS: When gag clauses were permitted 6 of 79 (7.6%) of articles contained screenshots and 8 (10.1%) would have benefited from screenshots. When gag clauses were restricted 3 of 40 (7.5%) contained screenshots and 8 (20%) would have benefited from screenshots. DISCUSSION: The policy change does not appear to have an impact on the prevalence of screenshots in peer-reviewed literature. CONCLUSIONS: Additional steps are necessary to promote the use of screenshots in peer-reviewed literature.

The impact of COVID-19 on primary care accessibility and the role of telehealth for patients with chronic conditions.

Objectives: The objective of this study is to quantify how long patients took to complete their rescheduled primary care appointment pre-pandemic (2019) and during an initial pandemic period (2020). In doing so, the study evaluates telehealth's role in helping primary care patients - particularly in patients with chronic conditions - withstand COVID's significant disruption in care. Methods: Cancelled and completed primary care appointments for adult patients were extracted from the beginning of the pandemic (March 1 to July 31, 2020) and a similar period pre-pandemic (March 1 to July 31, 2019). Days to the subsequent completed visit after cancellation (through June 30, 2021) and appointment modality (in-person, phone, video) were examined. Statistical testing was done to determine statistical significance, and a linear regression was run to control for effects of other study variables. Results: Pre-pandemic patients with chronic conditions needed 52.3 days on average to reschedule their cancelled in-person appointment. During the early pandemic period, chronic condition patients who saw their provider in-person took on average 78.8 days. During the same pre-pandemic period, patients with chronic conditions had their average wait time decrease to 51.5 days when rescheduling via telehealth. These differences were similar for patients without chronic conditions. Conclusions: This analysis shows that telehealth created return to care timelines comparable to the pre-pandemic period which is especially important for patients with chronic conditions. Public interest summary: Telehealth visits (i.e., talking with a physician via phone or video call) help patients continue to receive the medical care they need - especially during disruptive periods such as the COVID pandemic. Access to telehealth is the strongest predictor in determining how soon a patient will complete their reschedule primary care appointment. Because telehealth is so important, health care providers and systems need to continue to offer patients the ability to talk with their physician via phone or video call.

Identifying Electronic Health Record Contributions to Diagnostic Error in Ambulatory Settings Through Legal Claims Analysis.

This qualitative study analyzes closed legal claims data to determine whether problems with electronic health records are associated with diagnostic errors, in which part of the diagnostic process errors occur, and the specific types of errors that occur.

"Are we there yet?" Ten persistent hazards and inefficiencies with the use of medication administration technology from the perspective of practicing nurses.

OBJECTIVES: (1) Characterize persistent hazards and inefficiencies in inpatient medication administration; (2) Explore cognitive attributes of medication administration tasks; and (3) Discuss strategies to reduce medication administration technology-related hazards. MATERIALS AND METHODS: Interviews were conducted with 32 nurses practicing at 2 urban, eastern and western US health systems. Qualitative analysis using inductive and deductive coding included consensus discussion, iterative review, and coding structure revision. We abstracted hazards and inefficiencies through the lens of risks to patient safety and the cognitive perception-action cycle (PAC). RESULTS: Persistent safety hazards and inefficiencies related to MAT organized around the PAC cycle included: (1) Compatibility constraints create information silos; (2) Missing action cues; (3) Intermittent communication flow between safety monitoring systems and nurses; (4) Occlusion of important alerts by other, less helpful alerts; (5) Dispersed information: Information required for tasks is not collocated; (6) Inconsistent data organization: Mismatch of the display and the user's mental model; (7) Hidden medication administration technologies (MAT) limitations: Inaccurate beliefs about MAT functionality contribute to overreliance on the technology; (8) Software rigidity causes workarounds; (9) Cumbersome dependencies between technology and the physical environment; and (10) Technology breakdowns require adaptive actions. DISCUSSION: Errors might persist in medication administration despite successful Bar Code Medication Administration and Electronic Medication Administration Record deployment for reducing errors. Opportunities to improve MAT require a deeper understanding of high-level reasoning in medication administration, including control over the information space, collaboration tools, and decision support. CONCLUSION: Future medication administration technology should consider a deeper understanding of nursing knowledge work for medication administration.

Electronic Health Record Use Issues and Diagnostic Error: A Scoping Review and Framework.

BACKGROUND: Diagnostic errors are a major source of patient harm, most of which are caused by cognitive errors and biases. Despite research showing the relationship between software systems and cognitive processes, the impact of the electronic health record (EHR) on diagnostic error remains unknown. METHODS: We conducted a scoping review of the scientific literature to (1) survey the association between aspects of the EHR and diagnostic error, and (2) through a human-systems integration lens, identify the types of EHR issues and their impact on the stages of the diagnostic process. RESULTS: We analyzed 11 research articles for the relationship between EHR use and diagnostic error. These articles highlight specific technical, usability, and workflow issues with the EHR that pose risks for diagnostic error at every stage of the diagnostic process. DISCUSSION: Although technical problems such as EHR interoperability and data integrity pose critical issues for the diagnostic process, usability and workflow issues such as poor display design, and inability to track test results also hamper clinicians' ability to track, process, and act in the diagnostic process. Current research methods have limited coverage over clinical settings, are not standardized, and rarely include measures of patient harm. CONCLUSIONS: The available evidence shows that EHRs pose risks for diagnostic error throughout the diagnostic process, with most issues involving their incompatibility with providers' cognitive processing. A structured and systematic model of collecting and reporting on these errors is needed to understand how the EHR shapes the diagnostic process and improve diagnostic accuracy.

Pilot assessment of an on-demand telehealth 'left without being seen' follow-up programme.

INTRODUCTION: On-demand telehealth can have a high rate of patients requesting visits and dropping off without being seen by a provider, especially during the COVID-19 pandemic. METHODS: On-demand telehealth requests made to a large healthcare system in the USA between 15 March 2020 and 31 May 2020 were included for analysis with a focus on patients who were defined as left without being seen (LWBS). As part of a pilot program a registered nurse attempted to call LWBS patients within 24 hours of their telehealth request and asked if they were ok, if they sought care for their original visit reason, what that care was, or if they still needed guidance. This information and patient demographics were analyzed. RESULTS: During the study period there were 21,610 completed on-demand telehealth visits and 1852 patients for whom there were LWBS attempted follow-ups. Most patients LWBS for a reason that originated from the patient and not associated with the provider or telehealth platform. The mean wait time for LWBS patients was 12.4 min compared to patients waiting 15.1 min before engaging with a provider to complete a visit. Of the 1852 total LWBS patients in the follow-up programme, 819 (44.2%) were successfully contacted with a follow-up phone call. Most of these patients (63.2%) already completed or planned to complete a telehealth visit, 13.6% indicated they no longer needed to see a provider, and 12.8% planned or already completed an in-person visit. Only 2.2% went to an emergency department. DISCUSSION: Results suggest patients can effectively self-manage their care needs.

Electronic Health Record Legal Settlements in the US Since the 2009 Health Information Technology for Economic and Clinical Health Act.

This cross-sectional study describes allegations of misconduct by electronic health record vendors.

The impact of expanded telehealth availability on primary care utilization.

The expanded availability of telehealth due to the COVID-19 pandemic presents a concern that telehealth may result in an unnecessary increase in utilization. We analyzed 4,114,651 primary care encounters (939,134 unique patients) from three healthcare systems between 2019 and 2021 and found little change in utilization as telehealth became widely available. Results suggest telehealth availability is not resulting in additional primary care visits and federal policies should support telehealth use.

Free-Text Computerized Provider Order Entry Orders Used as Workaround for Communicating Medication Information.

OBJECTIVES: Medication information is frequently communicated via free-text computerized provider order entry (CPOE) orders in electronic health records. When such information is transmitted separately from a structured CPOE medication order, there is a significant risk of medication error. Although prior studies have described the frequency of using free-text CPOE orders for communicating medication information, there is a gap in understanding the nature of the medication information contained in the free-text CPOE orders. The aims of this study are to (1) identify the most common medication names communicated in free-text CPOE orders and their risk levels and (2) identify what actions physicians expect that nurses will complete when they place free-text CPOE orders, and (3) describe differences in these patterns across hospitals. METHODS: This study was a retrospective analysis of a sample of 26,524 free-text CPOE orders from 6 hospitals in the mid-Atlantic U.S. region. RESULTS: Free-text CPOE orders contained in the sample mentioned 193 medication names. Free-text CPOE orders were used frequently to communicate information about naloxone, heparin, flumazenil, and dextrose. Twenty-two percent of the free-text CPOE orders related to discontinuing medication(s), whereas 7% of the free-text CPOE orders relate to giving medication(s). There was high variation across hospitals both in the percentage of free-text CPOE orders mentioning medication information and in the proportion of those that referred to high-risk medications. CONCLUSIONS: The prevalence of medication information in free-text CPOE orders may suggest specific communication challenges in respect to urgency, uncertainty, planning, and other aspects of communication and clinical needs. Understanding and addressing communication challenges around commonly mentioned medication names and actions, especially those that are high risk, can help reduce the risk of medication errors.

Development and pilot evaluation of an electronic health record usability and safety self-assessment tool.

Objective: Poor electronic health record (EHR) usability contributes to clinician burnout and poses patent safety risks. Site-specific customization and configuration of EHRs require individual EHR system usability and safety testing which is resource intensive. We developed and pilot-tested a self-administered EHR usability and safety assessment tool, focused on computerized provider order entry (CPOE), which can be used by any facility to identify specific issues. In addition, the tool provides recommendations for improvement. Materials and Methods: An assessment tool consisting of 104 questions was developed and pilot-tested at 2 hospitals, one using a Cerner EHR and the other using Epic. Five physicians at each site participated in and completed the assessment. Participant response accuracy compared to actual EHR interactions, consistency across participants, and usability issues identified through the tool were measured at each site. Results: Across sites, participants answered an average of 46 questions in 23 min with 89.9% of responses either correct or partially correct. The tool identified 8 usability and safety issues at one site and 7 at the other site across medication, laboratory, and radiology CPOE functions. Discussion: The tool shows promise as a method to rapidly evaluate EHR usability and safety and provide guidance on specific areas for improvement. Important improvements to the evaluation tool were identified including the need to clarify certain questions and provide definitions for usability terminology. Conclusion: A self-administered usability and safety assessment tool can serve to identify specific usability and safety issues in the EHR and provide guidance for improvements.

Evaluation of a Text Message-Based COVID-19 Vaccine Outreach Program Among Older Patients: Cross-sectional Study.

BACKGROUND: COVID-19 vaccines are vital tools in the defense against infection and serious disease due to SARS-CoV-2. There are many challenges to implementing mass vaccination campaigns for large, diverse populations from crafting vaccine promotion messages to reaching individuals in a timely and effective manner. During this unprecedented period, with COVID-19 mass vaccination campaigns essential for protecting vulnerable patient populations and attaining herd immunity, health care systems were faced with the dual challenges of vaccine outreach and distribution. OBJECTIVE: The aim of this cross-sectional study was to assess the effectiveness of a COVID-19 vaccine text outreach approach for patients aged 65 years and older. Our goal was to determine whether this approach was successful in scheduling patients for COVID-19 vaccine appointments. METHODS: We developed SMS text messages using the Tavoca platform. These messages informed patients of their vaccine eligibility and allowed them to indicate their interest in scheduling an appointment via a specific method (email or phone) or indicate their lack of interest in the vaccine. We tracked the status of these messages and how patients responded. Messages were sent to patients aged 65 years and older (N=30,826) at a nonprofit health care system in Washington, DC. Data were collected and examined from January 14 to May 10, 2021. Data were analyzed using multivariate multinomial and binary logistic regression models in SAS (version 9.4; SAS Institute Inc). RESULTS: Approximately 57% of text messages were delivered to patients, but many messages received no response from patients (40%). Additionally, 42.1% (12,978/30,826) of messages were not delivered. Of the patients who expressed interest in the vaccine (2938/30,826, 9.5%), Black or African American patients preferred a phone call rather than an email for scheduling their appointment (odds ratio [OR] 1.69, 95% CI 1.29-2.21) compared to White patients. Patients aged 70-74 years were more likely to schedule an appointment (OR 1.38, 95% CI 1.01-1.89) than those aged 65-69 years, and Black or African American patients were more likely to schedule an appointment (OR 2.90, 95% CI 1.72-4.91) than White patients. CONCLUSIONS: This study provides insights into some advantages and challenges of using a text messaging vaccine outreach for patients aged 65 years and older. Lessons learned from this vaccine campaign underscore the importance of using multiple outreach methods and sharing of patient vaccination status between health systems, along with a patient-centered approach to address vaccine hesitancy and access issues.

Usability and Accessibility of Publicly Available Patient Safety Databases.

OBJECTIVES: The aims of the study were to identify publicly available patient safety report databases and to determine whether these databases support safety analyst and data scientist use to identify patterns and trends. METHODS: An Internet search was conducted to identify publicly available patient safety databases that contained patient safety reports. Each database was analyzed to identify features that enable patient safety analyst and data scientist use of these databases. RESULTS: Seven databases (6 hosted by federal agencies, 1 hosted by a nonprofit organization) containing more than 28.3 million safety reports were identified. Some, but not all, databases contained features to support patient safety analyst use: 57.1% provided the ability to sort/compare/filter data, 42.9% provided data visualization, and 85.7% enabled free-text search. None of the databases provided regular updates or monitoring and only one database suggested solutions to patient safety reports. Analysis of features to support data scientist use showed that only 42.9% provided an application programing interface, most (85.7%) provided batch downloading, all provided documentation about the database, and 71.4% provided a data dictionary. All databases provided open access. Only 28.6% provided a data diagram. CONCLUSIONS: Patient safety databases should be improved to support patient safety analyst use by, at a minimum, allowing for data to be sorted/compared/filtered, providing data visualization, and enabling free-text search. Databases should also enable data scientist use by, at a minimum, providing an application programing interface, batch downloading, and a data dictionary.