Design and implementation of electronic health record-based tools to support a weight management program in primary care.

Objectives: This paper reports on a mixed methods formative evaluation to support the design and implementation of information technology (IT) tools for a primary care weight management intervention delivered through the patient portal using primary care staff as coaches. Methods: We performed a qualitative needs assessment, designed the IT tools to support the weight management program, and developed implementation tracking metrics. Implementation tracking metrics were designed to use real world electronic health record (EHR) data. Results: The needs assessment revealed IT requirements as well as barriers and facilitators to implementation of EHR-based weight management interventions in primary care. We developed implementation metrics for the IT tools. These metrics were used in weekly project team calls to make sure that project resources were allocated to areas of need. Conclusion: This study identifies the important role of IT in supporting weight management through patient identification, weight and activity tracking in the patient portal, and the use of the EHR as a population management tool. An intensive multi-level implementation approach is required for successful primary care-based weight management interventions including well-designed IT tools, comprehensive involvement of clinic leadership, and implementation tracking metrics to guide the process of workflow integration. This study helps to bridge the gap between informatics and implementation by using socio-technical formative evaluation methods early in order to support the implementation of IT tools. Trial registration: clinicaltrials.gov, NCT04420936. Registered June 9, 2020.

Artificial intelligence predictive analytics in heart failure: results of the pilot phase of a pragmatic randomized clinical trial.

OBJECTIVES: We conducted an implementation planning process during the pilot phase of a pragmatic trial, which tests an intervention guided by artificial intelligence (AI) analytics sourced from noninvasive monitoring data in heart failure patients (LINK-HF2). MATERIALS AND METHODS: A mixed-method analysis was conducted at 2 pilot sites. Interviews were conducted with 12 of 27 enrolled patients and with 13 participating clinicians. iPARIHS constructs were used for interview construction to identify workflow, communication patterns, and clinician's beliefs. Interviews were transcribed and analyzed using inductive coding protocols to identify key themes. Behavioral response data from the AI-generated notifications were collected. RESULTS: Clinicians responded to notifications within 24 hours in 95% of instances, with 26.7% resulting in clinical action. Four implementation themes emerged: (1) High anticipatory expectations for reliable patient communications, reduced patient burden, and less proactive provider monitoring. (2) The AI notifications required a differential and tailored balance of trust and action advice related to role. (3) Clinic experience with other home-based programs influenced utilization. (4) Responding to notifications involved significant effort, including electronic health record (EHR) review, patient contact, and consultation with other clinicians. DISCUSSION: Clinician's use of AI data is a function of beliefs regarding the trustworthiness and usefulness of the data, the degree of autonomy in professional roles, and the cognitive effort involved. CONCLUSION: The implementation planning analysis guided development of strategies that addressed communication technology, patient education, and EHR integration to reduce clinician and patient burden in the subsequent main randomized phase of the trial. Our results provide important insights into the unique implications of implementing AI analytics into clinical workflow.

Implementation barriers and considerations for recommending and administering the human papillomavirus (HPV) vaccination in oncology settings.

BACKGROUND: Survivors of childhood and adolescent cancer experience low human papillomavirus (HPV) vaccination rates-a crucial form of cancer prevention. Oncology provider recommendations may increase young survivors HPV vaccine intent, but HPV vaccination is not typically provided in the oncology setting. Thus, we explored the implementation barriers of providing the HPV vaccine in oncology. METHODS: We interviewed oncology providers in a variety of specialty areas about their perceptions of the HPV vaccine and to explore barriers to recommending and administering the vaccine in their clinics. Interviews were audio recorded, quality checked, and thematically analyzed. Emergent themes were then mapped onto the Capability, Opportunity, Motivation, and Behavior (COM-B) Model and the Theoretical Domains Framework. RESULTS: A total of N=24 oncology providers were interviewed. Most provided direct clinical care (87.5%) and most commonly specialized in pediatric oncology (20.8%), medical oncology (16.7%), bone marrow transplant (16.7%), and nurse coordination (16.7%). Two themes emerged within each COM-B domain. Capability: 1) educational barriers to HPV vaccination and 2) complicated post treatment HPV vaccination guidelines. MOTIVATION: 1) perceived importance of HPV vaccine and 2) concern about blurred scope of practice. OPPORTUNITY:  1) hospital administration and time concern barriers and 2) clinical workflow integration concerns. CONCLUSION: Implementing HPV vaccination in the oncology setting has the potential to increase HPV vaccination rates among young survivors. Multi-level barriers to providing the HPV vaccine in the oncology setting were identified by participants. Leveraging existing implementation strategies may be an effective way to mitigate provider identified barriers and increase vaccination rates.

A Systematic Review of Quantitative Methods for Evaluating Electronic Medication Administration Record and Bar-Coded Medication Administration Usability.

BACKGROUND: Although electronic medication administration records (eMARs) and bar-coded medication administration (BCMA) have improved medication safety, poor usability of these technologies can increase patient safety risks. OBJECTIVES: The objective of our systematic review was to identify the impact of eMAR and BCMA design on usability, operationalized as efficiency, effectiveness, and satisfaction. METHODS: We retrieved peer-reviewed journal articles on BCMA and eMAR quantitative usability measures from PsycInfo and MEDLINE (1946-August 20, 2019), and EMBASE (1976-October 23, 2019). Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we screened articles, extracted and categorized data into the usability categories of effectiveness, efficiency, and satisfaction, and evaluated article quality. RESULTS: We identified 1,922 articles and extracted data from 41 articles. Twenty-four articles (58.5%) investigated BCMA only, 10 (24.4%) eMAR only, and seven (17.1%) both BCMA and eMAR. Twenty-four articles (58.5%) measured effectiveness, 8 (19.5%) efficiency, and 17 (41.5%) satisfaction. Study designs included randomized controlled trial (n = 1; 2.4%), interrupted time series (n = 1; 2.4%), pretest/posttest (n = 21; 51.2%), posttest only (n = 14; 34.1%), and pretest/posttest and posttest only for different dependent variables (n = 4; 9.8%). Data collection occurred through observations (n = 19, 46.3%), surveys (n = 17, 41.5%), patient safety event reports (n = 9, 22.0%), surveillance (n = 6, 14.6%), and audits (n = 3, 7.3%). CONCLUSION: Of the 100 measures across the 41 articles, implementing BCMA and/or eMAR broadly resulted in an increase in measures of effectiveness (n = 23, 52.3%) and satisfaction (n = 28, 62.2%) compared to measures of efficiency (n = 3, 27.3%). Future research should focus on eMAR efficiency measures, utilize rigorous study designs, and generate specific design requirements.

Systematic User-centered Design of a Prototype Clinical Decision Support System for Glaucoma.

Purpose: To rigorously develop a prototype clinical decision support (CDS) system to help clinicians determine the appropriate timing for follow-up visual field testing for patients with glaucoma and to identify themes regarding the context of use for glaucoma CDS systems, design requirements, and design solutions to meet these requirements. Design: Semistructured qualitative interviews and iterative design cycles. Participants: Clinicians who care for patients with glaucoma, purposefully sampled to ensure a representation of a range of clinical specialties (glaucoma specialist, general ophthalmologist, optometrist) and years in clinical practice. Methods: Using the established User-Centered Design Process framework, we conducted semistructured interviews with 5 clinicians that addressed the context of use and design requirements for a glaucoma CDS system. We analyzed the interviews using inductive thematic analysis and grounded theory to generate themes regarding the context of use and design requirements. We created design solutions to address these requirements and used iterative design cycles with the clinicians to refine the CDS prototype. Main Outcome Measures: Themes regarding decision support for determining the timing of visual field testing for patients with glaucoma, CDS design requirements, and CDS design features. Results: We identified 9 themes that addressed the context of use for the CDS system, 9 design requirements for the prototype CDS system, and 9 design features intended to address these design requirements. Key design requirements included the preservation of clinician autonomy, incorporation of currently used heuristics, compilation of data, and increasing and communicating the level of certainty regarding the decision. After completing 3 iterative design cycles using this preliminary CDS system design solution, the design was satisfactory to the clinicians and was accepted as our prototype glaucoma CDS system. Conclusions: We used a systematic design process based on the established User-Centered Design Process to rigorously develop a prototype glaucoma CDS system, which will be used as a starting point for a future, large-scale iterative refinement and implementation process. Clinicians who care for patients with glaucoma need CDS systems that preserve clinician autonomy, compile and present data, incorporate currently used heuristics, and increase and communicate the level of certainty regarding the decision. Financial Disclosures: Proprietary or commercial disclosure may be found after the references.

"Are we there yet?" Ten persistent hazards and inefficiencies with the use of medication administration technology from the perspective of practicing nurses.

OBJECTIVES: (1) Characterize persistent hazards and inefficiencies in inpatient medication administration; (2) Explore cognitive attributes of medication administration tasks; and (3) Discuss strategies to reduce medication administration technology-related hazards. MATERIALS AND METHODS: Interviews were conducted with 32 nurses practicing at 2 urban, eastern and western US health systems. Qualitative analysis using inductive and deductive coding included consensus discussion, iterative review, and coding structure revision. We abstracted hazards and inefficiencies through the lens of risks to patient safety and the cognitive perception-action cycle (PAC). RESULTS: Persistent safety hazards and inefficiencies related to MAT organized around the PAC cycle included: (1) Compatibility constraints create information silos; (2) Missing action cues; (3) Intermittent communication flow between safety monitoring systems and nurses; (4) Occlusion of important alerts by other, less helpful alerts; (5) Dispersed information: Information required for tasks is not collocated; (6) Inconsistent data organization: Mismatch of the display and the user's mental model; (7) Hidden medication administration technologies (MAT) limitations: Inaccurate beliefs about MAT functionality contribute to overreliance on the technology; (8) Software rigidity causes workarounds; (9) Cumbersome dependencies between technology and the physical environment; and (10) Technology breakdowns require adaptive actions. DISCUSSION: Errors might persist in medication administration despite successful Bar Code Medication Administration and Electronic Medication Administration Record deployment for reducing errors. Opportunities to improve MAT require a deeper understanding of high-level reasoning in medication administration, including control over the information space, collaboration tools, and decision support. CONCLUSION: Future medication administration technology should consider a deeper understanding of nursing knowledge work for medication administration.

Pediatric Septic Shock Care Pathways in General Emergency Departments: A Qualitative Study Targeting How to Really Make it Work.

OBJECTIVES: Many academic pediatric emergency departments (PEDs) have successfully implemented pediatric septic shock care pathways. However, many general emergency departments (GEDs), who see the majority of pediatric ED visits, have not. This study aims to compare the workflow, resources, communication, and decision making across these 2 settings to inform the future implementation of a standardized care pathway for children with septic shock in the GED. METHODS: We used the critical incident technique to conduct semistructured interviews with 24 ED physicians, nurses, and technicians at one PED and 2 GEDs regarding pediatric septic shock care. We performed a thematic analysis using the Framework Method to develop our coding schema through inductive and deductive analyses. We continued an iterative process of revising the schema until we reached consensus agreement and thematic saturation. RESULTS: We identified the following 6 themes: (1) functioning like a "well-oiled machine" may be key to high performance; (2) experiencing the sequence of care for children with sepsis as invariant and predictable may be essential to high-quality performance; (3) resilience and flexibility are characteristic of high levels of performance; (4) believing that "the buck stops here" may contribute to more accountability; (5) continuous system learning is essential; and (6) computerized clinical decision support may not be optimized to drive decision-making at the point of care. Commentary from GED and PED participants differed across the 6 themes, providing insight into the approach for standardized care pathway implementation in GEDs. CONCLUSIONS: Pediatric septic shock workflow, decision making, and system performance differ between the PED and GEDs. Implementation of a standardized care pathway in GEDs will require a tailored approach. Specific recommendations include (1) improving shared situation awareness; (2) simulation for knowledge, skill, and team-based training; and (3) promoting a culture of continuous learning.

Clinical trial recruitment in primary care: exploratory factor analysis of a questionnaire to measure barriers and facilitators to primary care providers' involvement.

BACKGROUND: Recruitment of sufficient participants for clinical trials remains challenging. Primary care is an important avenue for patient recruitment but is underutilized. We developed and pilot tested a questionnaire to measure relevant barriers and facilitators to primary care providers' involvement in recruiting patients for clinical trials. METHODS: Prior research informed the development of the questionnaire. The initial instrument was revised using feedback obtained from cognitive interviews. We invited all primary care providers practicing within the University of Utah Health system to complete the revised questionnaire. We used a mixed-mode design to collect paper responses via in-person recruitment and email contacts to collect responses online. Descriptive statistics, exploratory factor analysis, Cronbach's alpha, and multivariable regression analyses were conducted. RESULTS: Sixty-seven primary care providers participated in the survey. Exploratory factor analysis suggested retaining five factors, representing the importance of clinical trial recruitment in providers' professional identity, clinic-level interventions to facilitate referral, patient-related barriers, concerns about patient health management, and knowledge gaps. The five factors exhibited good or high internal consistency reliability. Professional identity and clinic-level intervention factors were significant predictors of providers' intention to participate in clinical trial recruitment activities. CONCLUSIONS: Results of this exploratory analysis provide preliminary evidence of the internal structure, internal consistency reliability, and predictive validity of the questionnaire to measure factors relevant to primary care providers' involvement in clinical trial recruitment.

Computer clinical decision support that automates personalized clinical care: a challenging but needed healthcare delivery strategy.

How to deliver best care in various clinical settings remains a vexing problem. All pertinent healthcare-related questions have not, cannot, and will not be addressable with costly time- and resource-consuming controlled clinical trials. At present, evidence-based guidelines can address only a small fraction of the types of care that clinicians deliver. Furthermore, underserved areas rarely can access state-of-the-art evidence-based guidelines in real-time, and often lack the wherewithal to implement advanced guidelines. Care providers in such settings frequently do not have sufficient training to undertake advanced guideline implementation. Nevertheless, in advanced modern healthcare delivery environments, use of eActions (validated clinical decision support systems) could help overcome the cognitive limitations of overburdened clinicians. Widespread use of eActions will require surmounting current healthcare technical and cultural barriers and installing clinical evidence/data curation systems. The authors expect that increased numbers of evidence-based guidelines will result from future comparative effectiveness clinical research carried out during routine healthcare delivery within learning healthcare systems.

A qualitative analysis of physician decision making in the use of extracorporeal cardiopulmonary resuscitation for refractory cardiac arrest.

Aim of Study: To prepare for the design of future randomized clinical trials of extracorporeal cardioupulmonary resuscitation (ECPR), we sought to understand physician beliefs regarding the use of ECPR and subsequent management, among physicians who already perform ECPR, as these physicians would be likely to be involved in many planned ECPR trials. Methods: We performed 12 semi-structured interviews of physicians who already perform ECPR across a variety of medical specialties, centers and geographic regions, but all with 10-50+ cases of ECPR experience. We qualitatively analyzed these interview to identify key characteristics of their experience using ECPR, the tensions involved in patient identification, the complications of subsequent management, and their willingness to enroll potential ECPR patients in randomized trials of ECPR. Results: Physicians who routinely perform ECPR have strong beliefs regarding the use of ECPR, and typically have protocols they follow, though they are willing to break these protocols to cannulate young or healthy patients, or patients with immediate pre-hospital CPR and shockable rhythms. We found that physicians lacked equipoise to randomize these types of patients to continued conventional CPR. Future RCTs might be successful in enrolling older patients, younger patients without immediate pre-hospital care/bystander CPR, or patients with obvious comorbidities. Conclusions: RCTs for ECPR will need to avoid targeting patients in whom physicians feel strongly compelled to do ECPR or not do ECPR, instead identifying the middle range of patients in whom the physicians consider ECPR reasonable, but not required or contraindicated.

Accuracies of Training Labels and Machine Learning Models: Experiments on Delirium and Simulated Data.

Supervised predictive models require labeled data for training purposes. Complete and accurate labeled data is not always available, and imperfectly labeled data may need to serve as an alternative. An important question is if the accuracy of the labeled data creates a performance ceiling for the trained model. In this study, we trained several models to recognize the presence of delirium in clinical documents using data with annotations that are not completely accurate. In the external evaluation, the support vector machine model with a linear kernel performed best, achieving an area under the curve of 89.3% and accuracy of 88%, surpassing the 80% accuracy of the training sample. We then generated a set of simulated data and carried out a series of experiments which demonstrated that models trained on imperfect data can (but do not always) outperform the accuracy of the training data.

Through the Narrative Looking Glass: Commentary on "Impact of Electronic Health Records on Information Practices in Mental Health Contexts: Scoping Review".

The authors of "Impact of Electronic Health Records on Information Practices in Mental Health Contexts: Scoping Review" have effectively brought to our attention the failure of the electronic health record (EHR) to represent the human context. Because mental health or behavioral disorders (and functional status in general) emerge from an interaction between the individual's characteristics and the social context, it is essentially a failure to represent the human context. The assessment and treatment of these disorders must reflect how the person lives, their degree of social connectedness, their personal motivation, and their cultural background. This type of information is best communicated both through narrative and in collaboration with other providers and the patient-largely because human social memory is organized around situation models and natural episodes. Neither functionality is currently available in most EHRs. Narrative communication is effective for several reasons: (1) it supports the communication of goals between providers; (2) it allows the author to express their belief in others' perspectives (theory of mind), for example, those who will be reading these notes; and (3) it supports the incorporation of the patient's personal perspective. The failure of the EHR to support mental health information data and information practices is, therefore, essentially a failure to support the basic communication functions necessary for the narrative. The authors have rightly noted the problems of the EHR in this domain, but perhaps they did not completely link the problems to the lack of functionality to support narrative communication. Suggestions for adding design elements are discussed.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

The potential for leveraging machine learning to filter medication alerts.

OBJECTIVE: To evaluate the potential for machine learning to predict medication alerts that might be ignored by a user, and intelligently filter out those alerts from the user's view. MATERIALS AND METHODS: We identified features (eg, patient and provider characteristics) proposed to modulate user responses to medication alerts through the literature; these features were then refined through expert review. Models were developed using rule-based and machine learning techniques (logistic regression, random forest, support vector machine, neural network, and LightGBM). We collected log data on alerts shown to users throughout 2019 at University of Utah Health. We sought to maximize precision while maintaining a false-negative rate <0.01, a threshold predefined through discussion with physicians and pharmacists. We developed models while maintaining a sensitivity of 0.99. Two null hypotheses were developed: H1-there is no difference in precision among prediction models; and H2-the removal of any feature category does not change precision. RESULTS: A total of 3,481,634 medication alerts with 751 features were evaluated. With sensitivity fixed at 0.99, LightGBM achieved the highest precision of 0.192 and less than 0.01 for the pre-defined maximal false-negative rate by subject-matter experts (H1) (P < 0.001). This model could reduce alert volume by 54.1%. We removed different combinations of features (H2) and found that not all features significantly contributed to precision. Removing medication order features (eg, dosage) most significantly decreased precision (-0.147, P = 0.001). CONCLUSIONS: Machine learning potentially enables the intelligent filtering of medication alerts.

Implementing lung cancer screening in primary care: needs assessment and implementation strategy design.

Lung cancer screening with low-dose computed tomography (CT) could help avert thousands of deaths each year. Since the implementation of screening is complex and underspecified, there is a need for systematic and theory-based strategies. Explore the implementation of lung cancer screening in primary care, in the context of integrating a decision aid into the electronic health record. Design implementation strategies that target hypothesized mechanisms of change and context-specific barriers. The study had two phases. The Qualitative Analysis phase included semi-structured interviews with primary care physicians to elicit key task behaviors (e.g., ordering a low-dose CT) and understand the underlying behavioral determinants (e.g., social influence). The Implementation Strategy Design phase consisted of defining implementation strategies and hypothesizing causal pathways to improve screening with a decision aid. Three key task behaviors and four behavioral determinants emerged from 14 interviews. Implementation strategies were designed to target multiple levels of influence. Strategies included increasing provider self-efficacy toward performing shared decision making and using the decision aid, improving provider performance expectancy toward ordering a low-dose CT, increasing social influence toward performing shared decision making and using the decision aid, and addressing key facilitators to using the decision aid. This study contributes knowledge about theoretical determinants of key task behaviors associated with lung cancer screening. We designed implementation strategies according to causal pathways that can be replicated and tested at other institutions. Future research is needed to evaluate the effectiveness of these strategies and to determine the contexts in which they can be effectively applied.

Workflow analysis for design of an electronic health record-based tobacco cessation intervention in community health centers.

OBJECTIVE: Tobacco use is the leading cause of preventable morbidity and mortality in the United States. Quitlines are effective telephone-based tobacco cessation services but are underutilized. The goal of this project was to describe current clinical workflows for Quitline referral and design an optimal electronic health record (EHR)-based workflow for Ask-Advice-Connect (AAC), an evidence-based intervention to increase Quitline referrals. MATERIALS AND METHODS: Ten Community Health Center systems (CHC), which use three different EHRs, participated in this study. Methods included: 9 group discussions with CHC leaders; 33 observations/interviews of clinical teams' workflow; surveys with 57 clinical staff; and assessment of the EHR ecosystem in each CHC. Data across these methods were integrated and coded according to the Fit between Individual, Task, Technology and Environment (FITTE) framework. The current and optimal workflow were notated using Business Process Modelling Notation. We compared the requirements of the optimal workflow with EHR capabilities. RESULTS: Current workflows are inefficient in data collection, variable in who, how, and when tobacco cessation advice and referral are enacted, and lack communication between referring clinics and the Quitline. In the optimal workflow, medical assistants deliver a standardized AAC intervention during the visit intake. Referrals are submitted electronically, and there is bidirectional communication between the clinic and Quitline. We implemented AAC within all three EHRs; however, deviations from the optimal workflow were necessary. CONCLUSION: Current workflows for Quitline referral are inefficient and ineffective. We propose an optimal workflow and discuss improvements in EHR capabilities that would improve the implementation of AAC.

A theory-based meta-regression of factors influencing clinical decision support adoption and implementation.

OBJECTIVE: The purpose of the study was to explore the theoretical underpinnings of effective clinical decision support (CDS) factors using the comparative effectiveness results. MATERIALS AND METHODS: We leveraged search results from a previous systematic literature review and updated the search to screen articles published from January 2017 to January 2020. We included randomized controlled trials and cluster randomized controlled trials that compared a CDS intervention with and without specific factors. We used random effects meta-regression procedures to analyze clinician behavior for the aggregate effects. The theoretical model was the Unified Theory of Acceptance and Use of Technology (UTAUT) model with motivational control. RESULTS: Thirty-four studies were included. The meta-regression models identified the importance of effort expectancy (estimated coefficient = -0.162; P = .0003); facilitating conditions (estimated coefficient = 0.094; P = .013); and performance expectancy with motivational control (estimated coefficient = 1.029; P = .022). Each of these factors created a significant impact on clinician behavior. The meta-regression model with the multivariate analysis explained a large amount of the heterogeneity across studies (R2 = 88.32%). DISCUSSION: Three positive factors were identified: low effort to use, low controllability, and providing more infrastructure and implementation strategies to support the CDS. The multivariate analysis suggests that passive CDS could be effective if users believe the CDS is useful and/or social expectations to use the CDS intervention exist. CONCLUSIONS: Overall, a modified UTAUT model that includes motivational control is an appropriate model to understand psychological factors associated with CDS effectiveness and to guide CDS design, implementation, and optimization.

Establishing a multidisciplinary initiative for interoperable electronic health record innovations at an academic medical center.

OBJECTIVE: To establish an enterprise initiative for improving health and health care through interoperable electronic health record (EHR) innovations. MATERIALS AND METHODS: We developed a unifying mission and vision, established multidisciplinary governance, and formulated a strategic plan. Key elements of our strategy include establishing a world-class team; creating shared infrastructure to support individual innovations; developing and implementing innovations with high anticipated impact and a clear path to adoption; incorporating best practices such as the use of Fast Healthcare Interoperability Resources (FHIR) and related interoperability standards; and maximizing synergies across research and operations and with partner organizations. RESULTS: University of Utah Health launched the ReImagine EHR initiative in 2016. Supportive infrastructure developed by the initiative include various FHIR-related tooling and a systematic evaluation framework. More than 10 EHR-integrated digital innovations have been implemented to support preventive care, shared decision-making, chronic disease management, and acute clinical care. Initial evaluations of these innovations have demonstrated positive impact on user satisfaction, provider efficiency, and compliance with evidence-based guidelines. Return on investment has included improvements in care; over $35 million in external grant funding; commercial opportunities; and increased ability to adapt to a changing healthcare landscape. DISCUSSION: Key lessons learned include the value of investing in digital innovation initiatives leveraging FHIR; the importance of supportive infrastructure for accelerating innovation; and the critical role of user-centered design, implementation science, and evaluation. CONCLUSION: EHR-integrated digital innovation initiatives can be key assets for enhancing the EHR user experience, improving patient care, and reducing provider burnout.

Provider Preferences for Patient-Generated Health Data Displays in Pediatric Asthma: A Participatory Design Approach.

OBJECTIVE: There is a lack of evidence on how to best integrate patient-generated health data (PGHD) into electronic health record (EHR) systems in a way that supports provider needs, preferences, and workflows. The purpose of this study was to investigate provider preferences for the graphical display of pediatric asthma PGHD to support decisions and information needs in the outpatient setting. METHODS: In December 2019, we conducted a formative evaluation of information display prototypes using an iterative, participatory design process. Using multiple types of PGHD, we created two case-based vignettes for pediatric asthma and designed accompanying displays to support treatment decisions. Semi-structured interviews and questionnaires with six participants were used to evaluate the display usability and determine provider preferences. RESULTS: We identified provider preferences for display features, such as the use of color to indicate different levels of abnormality, the use of patterns to trend PGHD over time, and the display of environmental data. Preferences for display content included the amount of information and the relationship between data elements. CONCLUSION: Overall, provider preferences for PGHD include a desire for greater detail, additional sources, and visual integration with relevant EHR data. In the design of PGHD displays, it appears that the visual synthesis of multiple PGHD elements facilitates the interpretation of the PGHD. Clinicians likely need more information to make treatment decisions when PGHD displays are introduced into practice. Future work should include the development of interactive interface displays with full integration of PGHD into EHR systems.

Leveraging Artificial Intelligence to Improve Chronic Disease Care: Methods and Application to Pharmacotherapy Decision Support for Type-2 Diabetes Mellitus.

OBJECTIVES: Artificial intelligence (AI), including predictive analytics, has great potential to improve the care of common chronic conditions with high morbidity and mortality. However, there are still many challenges to achieving this vision. The goal of this project was to develop and apply methods for enhancing chronic disease care using AI. METHODS: Using a dataset of 27,904 patients with diabetes, an analytical method was developed and validated for generating a treatment pathway graph which consists of models that predict the likelihood of alternate treatment strategies achieving care goals. An AI-driven clinical decision support system (CDSS) integrated with the electronic health record (EHR) was developed by encapsulating the prediction models in an OpenCDS Web service module and delivering the model outputs through a SMART on FHIR (Substitutable Medical Applications and Reusable Technologies on Fast Healthcare Interoperability Resources) web-based dashboard. This CDSS enables clinicians and patients to review relevant patient parameters, select treatment goals, and review alternate treatment strategies based on prediction results. RESULTS: The proposed analytical method outperformed previous machine-learning algorithms on prediction accuracy. The CDSS was successfully integrated with the Epic EHR at the University of Utah. CONCLUSION: A predictive analytics-based CDSS was developed and successfully integrated with the EHR through standards-based interoperability frameworks. The approach used could potentially be applied to many other chronic conditions to bring AI-driven CDSS to the point of care.