One Health: Insights from Organizational & Social, Technology Assessment and Human Factors Perspectives.

OBJECTIVES: To offer diverse but complementary perspectives on how biomedical and health informatics can be informed by and help to achieve the vision of One Health. METHODS: Overview of key considerations and critical discussion of common themes, barriers and opportunities, based on collaborative review by International Medical Informatics Association (IMIA) working group members active in related fields. RESULTS: Health and care systems are complex sociotechnical systems that need explicit design and implementation strategies to align with the goals of One Health. The evidence-based health informatics paradigm and associated frameworks for evaluation of digital health technologies need to broaden their scope to take full account of the One Health approach. Informatics has specific contributions to make to One Health, for example by improved user experience reducing energy consumption and effective app design enhancing medication adherence. CONCLUSIONS: One Health is inherently intertwined with ergonomic, sociotechnical and evaluation perspectives in biomedical and health informatics. Health is a planetary issue that requires interdisciplinary collaborative action. The theories and principles of biomedical and health informatics offer many opportunities to transform digital health technology to better serve the One Health agenda.

The need to strengthen the evaluation of the impact of Artificial Intelligence-based decision support systems on healthcare provision.

Despite the renewed interest in Artificial Intelligence-based clinical decision support systems (AI-CDS), there is still a lack of empirical evidence supporting their effectiveness. This underscores the need for rigorous and continuous evaluation and monitoring of processes and outcomes associated with the introduction of health information technology. We illustrate how the emergence of AI-CDS has helped to bring to the fore the critical importance of evaluation principles and action regarding all health information technology applications, as these hitherto have received limited attention. Key aspects include assessment of design, implementation and adoption contexts; ensuring systems support and optimise human performance (which in turn requires understanding clinical and system logics); and ensuring that design of systems prioritises ethics, equity, effectiveness, and outcomes. Going forward, information technology strategy, implementation and assessment need to actively incorporate these dimensions. International policy makers, regulators and strategic decision makers in implementing organisations therefore need to be cognisant of these aspects and incorporate them in decision-making and in prioritising investment. In particular, the emphasis needs to be on stronger and more evidence-based evaluation surrounding system limitations and risks as well as optimisation of outcomes, whilst ensuring learning and contextual review. Otherwise, there is a risk that applications will be sub-optimally embodied in health systems with unintended consequences and without yielding intended benefits.

Electronic Health Record-Integrated Clinical Decision Support for Clinicians Serving Populations Facing Health Care Disparities: Literature Review.

OBJECTIVES: To review current studies about designing and implementing clinician-facing clinical decision support (CDS) integrated or interoperable with an electronic health record (EHR) to improve health care for populations facing disparities. METHODS: We searched PubMed to identify studies published between January 1, 2011 and October 22, 2021 about clinician-facing CDS integrated or interoperable with an EHR. We screened abstracts and titles and extracted study data from articles using a protocol developed by team consensus. Extracted data included patient population characteristics, clinical specialty, setting, EHR, clinical problem, CDS type, reported user-centered design, implementation strategies, and outcomes. RESULTS: There were 28 studies (36 articles) included. Most studies were performed at safety net institutions (14 studies) or Indian Health Service sites (6 studies). CDS tools were implemented in primary care outpatient settings in 24 studies (86%) for screening or treatment. CDS included point-of-care alerts (93%), order facilitators (46%), workflow support (39%), relevant information display (36%), expert systems (11%), and medication dosing support (7%). Successful outcomes were reported in 19 of 26 studies that reported outcomes (73%). User-centered design was reported during CDS planning (39%), development (32%), and implementation phase (25%). Most frequent implementation strategies were education (89%) and consensus facilitation (50%). CONCLUSIONS: CDS tools may improve health equity and outcomes for patients who face disparities. The present review underscores the need for high-quality analyses of CDS-associated health outcomes, reporting of user-centered design and implementation strategies used in low-resource settings, and methods to disseminate CDS created to improve health equity.

The Role of Formative Evaluation in Promoting Digitally-based Health Equity and Reducing Bias for Resilient Health Systems: The Case of Patient Portals.

OBJECTIVES: Patient portals are increasingly implemented to improve patient involvement and engagement. We here seek to provide an overview of ways to mitigate existing concerns that these technologies increase inequity and bias and do not reach those who could benefit most from them. METHODS: Based on the current literature, we review the limitations of existing evaluations of patient portals in relation to addressing health equity, literacy and bias; outline challenges evaluators face when conducting such evaluations; and suggest methodological approaches that may address existing shortcomings. RESULTS: Various stakeholder needs should be addressed before deploying patient portals, involving vulnerable groups in user-centred design, and studying unanticipated consequences and impacts of information systems in use over time. CONCLUSIONS: Formative approaches to evaluation can help to address existing shortcomings and facilitate the development and implementation of patient portals in an equitable way thereby promoting the creation of resilient health systems.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

Implementing lung cancer screening in primary care: needs assessment and implementation strategy design.

Lung cancer screening with low-dose computed tomography (CT) could help avert thousands of deaths each year. Since the implementation of screening is complex and underspecified, there is a need for systematic and theory-based strategies. Explore the implementation of lung cancer screening in primary care, in the context of integrating a decision aid into the electronic health record. Design implementation strategies that target hypothesized mechanisms of change and context-specific barriers. The study had two phases. The Qualitative Analysis phase included semi-structured interviews with primary care physicians to elicit key task behaviors (e.g., ordering a low-dose CT) and understand the underlying behavioral determinants (e.g., social influence). The Implementation Strategy Design phase consisted of defining implementation strategies and hypothesizing causal pathways to improve screening with a decision aid. Three key task behaviors and four behavioral determinants emerged from 14 interviews. Implementation strategies were designed to target multiple levels of influence. Strategies included increasing provider self-efficacy toward performing shared decision making and using the decision aid, improving provider performance expectancy toward ordering a low-dose CT, increasing social influence toward performing shared decision making and using the decision aid, and addressing key facilitators to using the decision aid. This study contributes knowledge about theoretical determinants of key task behaviors associated with lung cancer screening. We designed implementation strategies according to causal pathways that can be replicated and tested at other institutions. Future research is needed to evaluate the effectiveness of these strategies and to determine the contexts in which they can be effectively applied.

A Pathway for Community-Acquired Pneumonia With Rapid Conversion to Oral Therapy Improves Health Care Value.

BACKGROUND: Evidence supports streamlined approaches for inpatients with community-acquired pneumonia (CAP) including early transition to oral antibiotics and shorter therapy. Uptake of these approaches is variable, and the best approaches to local implementation of infection-specific guidelines are unknown. Our objective was to evaluate the impact of a clinical decision support (CDS) tool linked with a clinical pathway on CAP care. METHODS: This is a retrospective, observational pre-post intervention study of inpatients with pneumonia admitted to a single academic medical center. Interventions were introduced in 3 sequential 6-month phases; Phase 1: education alone; Phase 2: education and a CDS-driven CAP pathway coupled with active antimicrobial stewardship and provider feedback; and Phase 3: education and a CDS-driven CAP pathway without active stewardship. The 12 months preceding the intervention were used as a baseline. Primary outcomes were length of intravenous antibiotic therapy and total length of antibiotic therapy. Clinical, process, and cost outcomes were also measured. RESULTS: The study included 1021 visits. Phase 2 was associated with significantly lower length of intravenous and total antibiotic therapy, higher procalcitonin lab utilization, and a 20% cost reduction compared with baseline. Phase 3 was associated with significantly lower length of intravenous antibiotic therapy and higher procalcitonin lab utilization compared with baseline. CONCLUSIONS: A CDS-driven CAP pathway supplemented by active antimicrobial stewardship review led to the most robust improvements in antibiotic use and decreased costs with similar clinical outcomes.

Modified early warning score-based clinical decision support: cost impact and clinical outcomes in sepsis.

OBJECTIVE: The objective of this study was to assess the clinical and financial impact of a quality improvement project that utilized a modified Early Warning Score (mEWS)-based clinical decision support intervention targeting early recognition of sepsis decompensation. MATERIALS AND METHODS: We conducted a retrospective, interrupted time series study on all adult patients who received a diagnosis of sepsis and were exposed to an acute care floor with the intervention. Primary outcomes (total direct cost, length of stay [LOS], and mortality) were aggregated for each study month for the post-intervention period (March 1, 2016-February 28, 2017, n = 2118 visits) and compared to the pre-intervention period (November 1, 2014-October 31, 2015, n = 1546 visits). RESULTS: The intervention was associated with a decrease in median total direct cost and hospital LOS by 23% (P = .047) and .63 days (P = .059), respectively. There was no significant change in mortality. DISCUSSION: The implementation of an mEWS-based clinical decision support system in eight acute care floors at an academic medical center was associated with reduced total direct cost and LOS for patients hospitalized with sepsis. This was seen without an associated increase in intensive care unit utilization or broad-spectrum antibiotic use. CONCLUSION: An automated sepsis decompensation detection system has the potential to improve clinical and financial outcomes such as LOS and total direct cost. Further evaluation is needed to validate generalizability and to understand the relative importance of individual elements of the intervention.

Decrease in Inpatient Telemetry Utilization Through a System-Wide Electronic Health Record Change and a Multifaceted Hospitalist Intervention.

BACKGROUND: Unnecessary telemetry monitoring contributes to healthcare waste. OBJECTIVE: To evaluate the impact of 2 interventions to reduce telemetry utilization. DESIGN, SETTING, PATIENTS: A 2-group retrospective, observational pre- to postintervention study of 35,871 nonintensive care unit (ICU) patients admitted to 1 academic medical center. INTERVENTION: On the hospitalist service, we implemented a telemetry reduction intervention including education, process change, routine feedback, and a financial incentive between January 2015 and June 2015. In July 2015, a system-wide change to the telemetry ordering process was introduced. MEASUREMENTS: The primary outcome was telemetry utilization, measured as the percentage of daily room charges for telemetry. Secondary outcomes were mortality, escalation of care, code event rate, and appropriateness of telemetry utilization. Generalized linear models were used to evaluate changes in outcomes while adjusting for patient factors. RESULTS: Among hospitalist service patients, telemetry utilization was reduced by 69% (95% confidence interval [CI], -72% to -64%; P < .001), whereas on other services the reduction was a less marked 22% (95% CI, -27% to -16%; P < .001). There were no significant increases in mortality, code event rates, or care escalation, and there was a trend toward improved utilization appropriateness. CONCLUSIONS: Although electronic telemetry ordering changes can produce decreases in hospital-wide telemetry monitoring, a multifaceted intervention may lead to an even larger decline in utilization rates. Whether these changes are durable cannot be ascertained from our study.

Multifaceted intervention including education, rounding checklist implementation, cost feedback, and financial incentives reduces inpatient laboratory costs.

BACKGROUND: Inappropriate laboratory testing is a contributor to waste in healthcare. OBJECTIVE: To evaluate the impact of a multifaceted laboratory reduction intervention on laboratory costs. DESIGN: A retrospective, controlled, interrupted time series (ITS) study. SETTING: University of Utah Health Care, a 500-bed academic medical center in Salt Lake City, Utah. POPULATION: All patients 18 years or older admitted to the hospital to a service other than obstetrics, rehabilitation, or psychiatry. INTERVENTION: Multifaceted quality-improvement initiative in a hospitalist service including education, process change, cost feedback, and financial incentive. MEASUREMENTS: Primary outcomes of lab cost per day and per visit. Secondary outcomes of number of basic metabolic panel (BMP), comprehensive metabolic panel (CMP), complete blood count (CBC), and prothrombin time/international normalized ratio tests per day; length of stay (LOS); and 30-day readmissions. RESULTS: A total of 6310 hospitalist patient visits (intervention group) were compared to 25,586 nonhospitalist visits (control group). Among the intervention group, the unadjusted mean cost per day was reduced from $138 before the intervention to $123 after the intervention (P < 0.001), and the unadjusted mean cost per visit decreased from $618 to $558 (P = 0.005). The ITS analysis showed significant reductions in cost per day, cost per visit, and the number of BMP, CMP, and CBC tests per day (P = 0.034, 0.02, <0.001, 0.004, and <0.001). LOS was unchanged and 30-day readmissions decreased in the intervention group. CONCLUSION: A multifaceted approach to laboratory reduction demonstrated a significant reduction in laboratory cost per day and per visit, as well as common tests per day at a major academic medical center. Journal of Hospital Medicine 2016;11:348-354. © 2016 Society of Hospital Medicine.

Evidence-based care pathway for cellulitis improves process, clinical, and cost outcomes.

BACKGROUND: Cellulitis is a common infection with wide variation of clinical care. OBJECTIVE: To implement an evidence-based care pathway and evaluate changes in process metrics, clinical outcomes, and cost for cellulitis. DESIGN: A retrospective observational pre-/postintervention study was performed. SETTING: University of Utah Health Care, a 500-bed academic medical center in Salt Lake City, Utah. PATIENTS: All patients 18 years or older admitted to the emergency department observation unit or hospital with a primary diagnosis of cellulitis. INTERVENTION: Development of an evidence-based care pathway for cellulitis embedded into the electronic medical record with education for all emergency and internal medicine physicians. MEASUREMENTS: Primary outcome of broad-spectrum antibiotic use. Secondary outcomes of computed tomography/magnetic resonance imaging orders, length of stay (LOS), 30-day readmission, and pharmacy, lab, imaging, and total facility costs. RESULTS: A total of 677 visits occurred, including 370 visits where order sets were used. Among all patients, there was a 59% decrease in the odds of ordering broad-spectrum antibiotics (P < 0.001), 23% decrease in pharmacy cost (P = 0.002), and 13% decrease in total facility cost (P = 0.006). Compared to patients for whom order sets were not used, patients for whom order sets were used had a 75%, 13%, and 25% greater decrease in the odds of ordering broad-spectrum antibiotics (P < 0.001), clinical LOS (P = 0.041), and pharmacy costs (P = 0.074), respectively. CONCLUSION: The evidence-based care pathway for cellulitis improved care at an academic medical center by reducing broad-spectrum antibiotic use, pharmacy costs, and total facility costs without an adverse change in LOS or 30-day readmissions.