Patient and Caregiver Perceptions of an Interface Design to Communicate Artificial Intelligence-Based Prognosis for Patients With Advanced Solid Tumors.

PURPOSE: Use of artificial intelligence (AI) in cancer care is increasing. What remains unclear is how best to design patient-facing systems that communicate AI output. With oncologist input, we designed an interface that presents patient-specific, machine learning-based 6-month survival prognosis information designed to aid oncology providers in preparing for and discussing prognosis with patients with advanced solid tumors and their caregivers. The primary purpose of this study was to assess patient and caregiver perceptions and identify enhancements of the interface for communicating 6-month survival and other prognosis information when making treatment decisions concerning anticancer and supportive therapy. METHODS: This qualitative study included interviews and focus groups conducted between November and December 2022. Purposive sampling was used to recruit former patients with cancer and/or former caregivers of patients with cancer who had participated in cancer treatment decisions from Utah or elsewhere in the United States. Categories and themes related to perceptions of the interface were identified. RESULTS: We received feedback from 20 participants during eight individual interviews and two focus groups, including four cancer survivors, 13 caregivers, and three representing both. Overall, most participants expressed positive perceptions about the tool and identified its value for supporting decision making, feeling less alone, and supporting communication among oncologists, patients, and their caregivers. Participants identified areas for improvement and implementation considerations, particularly that oncologists should share the tool and guide discussions about prognosis with patients who want to receive the information. CONCLUSION: This study revealed important patient and caregiver perceptions of and enhancements for the proposed interface. Originally designed with input from oncology providers, patient and caregiver participants identified additional interface design recommendations and implementation considerations to support communication about prognosis.

An economic evaluation of the expansion of electronic case reporting in an academic healthcare setting.

Objectives: Determine the economic cost or benefit of expanding electronic case reporting (eCR) for 29 reportable conditions beyond the initial eCR implementation for COVID-19 at an academic health center. Materials and methods: The return on investment (ROI) framework was used to quantify the economic impact of the expansion of eCR from the perspective of an academic health system over a 5-year time horizon. Sensitivity analyses were performed to assess key factors such as personnel cost, inflation, and number of expanded conditions. Results: The total implementation costs for the implementation year were estimated to be $5031.46. The 5-year ROI for the expansion of eCR for the 29 conditions is expected to be 142% (net present value of savings: $7166). Based on the annual ROI, estimates suggest that the savings from the expansion of eCR will cover implementation costs in approximately 4.8 years. All sensitivity analyses yielded a strong ROI for the expansion of eCR. Discussion and conclusion: Our findings suggest a strong ROI for the expansion of eCR at UHealth, with the most significant cost savings observed implementing eCR for all reportable conditions. An early effort to ensure data quality is recommended to expedite the transition from parallel reporting to production to improve the ROI for healthcare organizations. This study demonstrates a positive ROI for the expansion of eCR to additional reportable conditions beyond COVID-19 in an academic health setting, such as UHealth. While this evaluation focuses on the 5-year time horizon, the potential benefit could extend further.

Navigating the Landscape: Barriers and Facilitators in Electronic Case Reporting Implementation Across Public Health Agencies.

OBJECTIVE: The objectives were to identify barriers and facilitators for electronic case reporting (eCR) implementation associated with "organizational" and "people"-based knowledge/processes and to identify patterns across implementation stages to guide best practices for eCR implementation at public health agencies. DESIGN: This qualitative study uses semistructured interviews with key stakeholders across 6 public health agencies. This study leveraged 2 conceptual frameworks for the development of the interview guide and initial codebook and the organization of the findings of thematic analysis. SETTING: Interviews were conducted virtually with informants from public health agencies at varying stages of eCR implementation. PARTICIPANTS: Investigators aimed to enroll 3 participants from each participating public health agency, including an eCR lead, a technical lead, and a leadership informant. MAIN OUTCOME MEASURES: Patterns associated with barriers and facilitators across the eCR implementation stage. RESULTS: Twenty-eight themes were identified throughout interviews with 16 informants representing 6 public health agencies at varying stages of implementation. While there was variation across these levels, 3 distinct patterns were identified, including themes that were described (1) solely as a barrier or facilitator for eCR implementation regardless of implementation stages, (2) as a barrier for those in the early stages but evolved into a facilitator for those in later stages, and (3) as facilitators that were unique to the late-stage implementation. CONCLUSION: This study elucidated critical national, organizational, and person-centric best practices for public health agencies. These included the importance of engagement with the national eCR team, integrated development teams, cross-pollination, and developing solutions with the broader public health mission in mind. While the implementation of eCR was the focus of this study, the findings are generalizable to the broader data modernization efforts within public health agencies.

Design of an interface to communicate artificial intelligence-based prognosis for patients with advanced solid tumors: a user-centered approach.

OBJECTIVES: To design an interface to support communication of machine learning (ML)-based prognosis for patients with advanced solid tumors, incorporating oncologists' needs and feedback throughout design. MATERIALS AND METHODS: Using an interdisciplinary user-centered design approach, we performed 5 rounds of iterative design to refine an interface, involving expert review based on usability heuristics, input from a color-blind adult, and 13 individual semi-structured interviews with oncologists. Individual interviews included patient vignettes and a series of interfaces populated with representative patient data and predicted survival for each treatment decision point when a new line of therapy (LoT) was being considered. Ongoing feedback informed design decisions, and directed qualitative content analysis of interview transcripts was used to evaluate usability and identify enhancement requirements. RESULTS: Design processes resulted in an interface with 7 sections, each addressing user-focused questions, supporting oncologists to "tell a story" as they discuss prognosis during a clinical encounter. The iteratively enhanced interface both triggered and reflected design decisions relevant when attempting to communicate ML-based prognosis, and exposed misassumptions. Clinicians requested enhancements that emphasized interpretability over explainability. Qualitative findings confirmed that previously identified issues were resolved and clarified necessary enhancements (eg, use months not days) and concerns about usability and trust (eg, address LoT received elsewhere). Appropriate use should be in the context of a conversation with an oncologist. CONCLUSION: User-centered design, ongoing clinical input, and a visualization to communicate ML-related outcomes are important elements for designing any decision support tool enabled by artificial intelligence, particularly when communicating prognosis risk.

External Validation of a Machine Learning Model to Predict 6-Month Mortality for Patients With Advanced Solid Tumors.

This prognostic study performed external validation of a machine learning model to predict 6-month mortality among patients with advanced solid tumors.

Strengths, weaknesses, opportunities, and threats for the nation's public health information systems infrastructure: synthesis of discussions from the 2022 ACMI Symposium.

OBJECTIVE: The annual American College of Medical Informatics (ACMI) symposium focused discussion on the national public health information systems (PHIS) infrastructure to support public health goals. The objective of this article is to present the strengths, weaknesses, threats, and opportunities (SWOT) identified by public health and informatics leaders in attendance. MATERIALS AND METHODS: The Symposium provided a venue for experts in biomedical informatics and public health to brainstorm, identify, and discuss top PHIS challenges. Two conceptual frameworks, SWOT and the Informatics Stack, guided discussion and were used to organize factors and themes identified through a qualitative approach. RESULTS: A total of 57 unique factors related to the current PHIS were identified, including 9 strengths, 22 weaknesses, 14 opportunities, and 14 threats, which were consolidated into 22 themes according to the Stack. Most themes (68%) clustered at the top of the Stack. Three overarching opportunities were especially prominent: (1) addressing the needs for sustainable funding, (2) leveraging existing infrastructure and processes for information exchange and system development that meets public health goals, and (3) preparing the public health workforce to benefit from available resources. DISCUSSION: The PHIS is unarguably overdue for a strategically designed, technology-enabled, information infrastructure for delivering day-to-day essential public health services and to respond effectively to public health emergencies. CONCLUSION: Most of the themes identified concerned context, people, and processes rather than technical elements. We recommend that public health leadership consider the possible actions and leverage informatics expertise as we collectively prepare for the future.

Enhancing the nation's public health information infrastructure: a report from the ACMI symposium.

The COVID-19 pandemic exposed multiple weaknesses in the nation's public health system. Therefore, the American College of Medical Informatics selected "Rebuilding the Nation's Public Health Informatics Infrastructure" as the theme for its annual symposium. Experts in biomedical informatics and public health discussed strategies to strengthen the US public health information infrastructure through policy, education, research, and development. This article summarizes policy recommendations for the biomedical informatics community postpandemic. First, the nation must perceive the health data infrastructure to be a matter of national security. The nation must further invest significantly more in its health data infrastructure. Investments should include the education and training of the public health workforce as informaticians in this domain are currently limited. Finally, investments should strengthen and expand health data utilities that increasingly play a critical role in exchanging information across public health and healthcare organizations.

Safety risks and workflow implications associated with nursing-related free-text communication orders.

OBJECTIVE: We evaluated nursing-related free-text communication orders to identify potential safety hazards and describe patterns and scope of care domains addressed that may reveal preventable workarounds and potential gaps in electronic health record (EHR) functionality. MATERIALS AND METHODS: A retrospective analysis of free-text EHR-based communication orders sent to or by nurses providing inpatient care at a major academic health system. Using built-in EHR tools and selection criteria, 13 193 orders were extracted, including 1373 unique orders. Using the Clinical Care Classification system standardized framework, we classified content by care domain and identified unique requests within each order. We reviewed each order for error-prone textual features based on standard patient safety guidance. We describe the distribution of domains, co-occurrence when 2 domains were present, and common patterns. RESULTS: The 1373 unique orders included a single request (65.3%), 2 requests related to 1 or 2 domains (19%), or 3 or more requests (15.7%). No orders included terms on the Joint Commission's "Do Not Use" list. However, 13.6% of unique orders, and 16.7% of those related to medications, included error-prone symbols or abbreviations according to Institute for Safe Medication Practices guidance. Order content spanned 20 different care components but physical regulation, fluid volume, nutritional, safety, and medication were most frequently identified as single or co-occurring topics. Patterns were heterogenous. DISCUSSION: Free-text communication orders reveal workarounds, responses to upstream workarounds, and design constraints that should be further investigated. Remediation strategies are needed to reduce safety hazards and workflow impediments. CONCLUSIONS: Analysis of free-text communication orders revealed opportunities for improvement.

Development of a Machine Learning Model Using Limited Features to Predict 6-Month Mortality at Treatment Decision Points for Patients With Advanced Solid Tumors.

PURPOSE: Patients with advanced solid tumors may receive intensive treatments near the end of life. This study aimed to create a machine learning (ML) model using limited features to predict 6-month mortality at treatment decision points (TDPs). METHODS: We identified a cohort of adults with advanced solid tumors receiving care at a major cancer center from 2014 to 2020. We identified TDPs for new lines of therapy (LoTs) and confirmed mortality at 6 months after a TDP. Using extreme gradient boosting, ML models were developed, which used or derived features from a limited set of electronic health record data considering the literature, clinical relevance, variability, availability, and predictive importance using Shapley additive explanations scores. We predicted and observed 6-month mortality after a TDP and assessed a risk stratification strategy with different risk thresholds to support communication of chance of survival. RESULTS: Four thousand one hundred ninety-two patients were included. Patients had 7,056 TDPs, for which the 6-month mortality increased from 17.9% to 46.7% after starting first to sixth LoT, respectively. On the basis of internal validation, models using both 111 (Full) or 45 (Limited-45) features accurately predicted 6-month mortality (area under the curve ≥ 0.80). Using a 0.3 risk threshold in the Limited-45 model, the observed 6-month survival was 34% (95% CI, 28 to 40) versus 81% (95% CI, 81 to 82) among those classified with low or higher chance of survival, respectively. The positive predictive value of the Limited-45 model was 0.66 (95% CI, 0.60 to 0.72). CONCLUSION: We developed and validated a ML model using a limited set of 45 features readily derived from electronic health record data to predict 6-month prognosis in patients with advanced solid tumors. The model output may support shared decision making as patients consider the next LoT.

Research outcomes of linked prescription drug monitoring program data: a scoping review protocol.

INTRODUCTION: The objective of this scoping review is to describe the extent and nature of research studies based on linked prescription drug monitoring program (PDMP) data; defined as PDMP data linked to other clinical, administrative or public health data sets. The population is prescribed and dispensed controlled substances. The concept is analysis of linked PDMP data to other clinical, administrative or public health data sets. The context is the USA. METHODS AND ANALYSIS: The scoping review will be conducted with guidance from the latest version of the JBI Manual for Evidence Synthesis, using the framework as outlined by Arksey and O'Malley. Search strategies will be peer-reviewed according to the Peer Review of Electronic Search Strategies (PRESS) guidelines. For transparency and reproducibility, we will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews reporting guidelines in reporting results. Two reviewers will independently screen titles and abstracts, then independently review full text to select papers or studies for inclusion. When consensus cannot be reached with discussion, a third reviewer will resolve the conflicts. From our included studies, we will extract variables describing aspects of population, concept and context (USA). ETHICS AND DISSEMINATION: Ethical approval was not required for this review. This scoping review entails analysis of previously published, peer-reviewed research. We intend to publish findings in a peer-reviewed journal.

Utility of Poison Control Center Data for Automated Opioid Overdose Surveillance.

CONTEXT: Overdosing on opioids is a national epidemic and the number one cause of death from unintentional injury in the United States. Poison control centers (PCCs) may be a source of timely data that can track opioid exposure cases, identify clusters of opioid exposure cases by geographic region, and capture opioid exposure cases that may not seek medical attention from health care facilities. OBJECTIVE: The objectives were to (a) identify data requirements for opioid overdose case ascertainment and classification and visualization in a dashboard, and (b) assess the availability and quality of the relevant PCC data for state-based opioid overdose surveillance. DESIGN: We identified types of opioid exposure, demographic characteristics, and other features that may be relevant for public health officials to monitor and respond to opioid overdose events in the community. We operationalized case definitions for an opioid overdose event based on the Centers for Disease Control and Prevention case classification definitions. We assessed the PCC database for concepts and metrics needed to operationalize case definitions for opioid overdose events to determine the feasibility of using the PCC for automated surveillance. MAIN OUTCOME MEASURE: Quality and availability of required concepts to operationalize metrics and case definitions using PCC data. RESULTS: A subset of the probable case definition may be used for automated surveillance with available structured PCC data. In contrast, logic for confirmed, suspected, and part of the probable case definitions requires additional structured data or analysis of narrative text, which may not contain needed concepts. For example, the confirmed case definition currently requires evidence from narrative text of laboratory confirmation of an opioid in a clinical specimen or diagnosis of opioid overdose in a health care record. CONCLUSION: PCC data are a timely and potentially useful source for automated surveillance of a subset of opioid overdose events, but additional structured and/or coded data are required.

Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation.

OBJECTIVE: Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODS: The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTS: The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSION: Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSION: As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.

New Standards for Clinical Decision Support: A Survey of The State of Implementation.

OBJECTIVES: To review the current state of research on designing and implementing clinical decision support (CDS) using four current interoperability standards: Fast Healthcare Interoperability Resources (FHIR); Substitutable Medical Applications and Reusable Technologies (SMART); Clinical Quality Language (CQL); and CDS Hooks. METHODS: We conducted a review of original studies describing development of specific CDS tools or infrastructures using one of the four targeted standards, regardless of implementation stage. Citations published any time before the literature search was executed on October 21, 2020 were retrieved from PubMed. Two reviewers independently screened articles and abstracted data according to a protocol designed by team consensus. RESULTS: Of 290 articles identified via PubMed search, 44 were included in this study. More than three quarters were published since 2018. Forty-three (98%) used FHIR; 22 (50%) used SMART; two (5%) used CQL; and eight (18%) used CDS Hooks. Twenty-four (55%) were in the design stage, 15 (34%) in the piloting stage, and five (11%) were deployed in a real-world setting. Only 12 (27%) of the articles reported an evaluation of the technology under development. Three of the four articles describing a deployed technology reported an evaluation. Only two evaluations with randomized study components were identified. CONCLUSION: The diversity of topics and approaches identified in the literature highlights the utility of these standards. The infrequency of reported evaluations, as well as the high number of studies in the design or piloting stage, indicate that these technologies are still early in their life cycles. Informaticists will require a stronger evidence base to understand the implications of using these standards in CDS design and implementation.

A Conceptual Framework of Data Readiness: The Contextual Intersection of Quality, Availability, Interoperability, and Provenance.

BACKGROUND: Data readiness is a concept often used when referring to health information technology applications in the informatics disciplines, but it is not clearly defined in the literature. To avoid misinterpretations in research and implementation, a formal definition should be developed. OBJECTIVES: The objective of this research is to provide a conceptual definition and framework for the term data readiness that can be used to guide research and development related to data-based applications in health care. METHODS: PubMed, the National Institutes of Health RePORTER, Scopus, the Cochrane Library, and Duke University Library databases for business and information sciences were queried for formal mentions of the term "data readiness." Manuscripts found in the search were reviewed, and relevant information was extracted, evaluated, and assimilated into a framework for data readiness. RESULTS: Of the 264 manuscripts found in the database searches, 20 were included in the final synthesis to define data readiness. In these 20 manuscripts, the term data readiness was revealed to encompass the constructs of data quality, data availability, interoperability, and data provenance. DISCUSSION: Based upon our review of the literature, we define data readiness as the application-specific intersection of data quality, data availability, interoperability, and data provenance. While these concepts are not new, the combination of these factors in a novel data readiness model may help guide future informatics research and implementation science. CONCLUSION: This analysis provides a definition to guide research and development related to data-based applications in health care. Future work should be done to validate this definition, and to apply the components of data readiness to real-world applications so that specific metrics may be developed and disseminated.

Provider Preferences for Patient-Generated Health Data Displays in Pediatric Asthma: A Participatory Design Approach.

OBJECTIVE: There is a lack of evidence on how to best integrate patient-generated health data (PGHD) into electronic health record (EHR) systems in a way that supports provider needs, preferences, and workflows. The purpose of this study was to investigate provider preferences for the graphical display of pediatric asthma PGHD to support decisions and information needs in the outpatient setting. METHODS: In December 2019, we conducted a formative evaluation of information display prototypes using an iterative, participatory design process. Using multiple types of PGHD, we created two case-based vignettes for pediatric asthma and designed accompanying displays to support treatment decisions. Semi-structured interviews and questionnaires with six participants were used to evaluate the display usability and determine provider preferences. RESULTS: We identified provider preferences for display features, such as the use of color to indicate different levels of abnormality, the use of patterns to trend PGHD over time, and the display of environmental data. Preferences for display content included the amount of information and the relationship between data elements. CONCLUSION: Overall, provider preferences for PGHD include a desire for greater detail, additional sources, and visual integration with relevant EHR data. In the design of PGHD displays, it appears that the visual synthesis of multiple PGHD elements facilitates the interpretation of the PGHD. Clinicians likely need more information to make treatment decisions when PGHD displays are introduced into practice. Future work should include the development of interactive interface displays with full integration of PGHD into EHR systems.

Developing a sampling method and preliminary taxonomy for classifying COVID-19 public health guidance for healthcare organizations and the general public.

BACKGROUND: Development and dissemination of public health (PH) guidance to healthcare organizations and the general public (e.g., businesses, schools, individuals) during emergencies like the COVID-19 pandemic is vital for policy, clinical, and public decision-making. Yet, the rapidly evolving nature of these events poses significant challenges for guidance development and dissemination strategies predicated on well-understood concepts and clearly defined access and distribution pathways. Taxonomies are an important but underutilized tool for guidance authoring, dissemination and updating in such dynamic scenarios. OBJECTIVE: To design a rapid, semi-automated method for sampling and developing a PH guidance taxonomy using widely available Web crawling tools and streamlined manual content analysis. METHODS: Iterative samples of guidance documents were taken from four state PH agency websites, the US Center for Disease Control and Prevention, and the World Health Organization. Documents were used to derive and refine a preliminary taxonomy of COVID-19 PH guidance via content analysis. RESULTS: Eight iterations of guidance document sampling and taxonomy revisions were performed, with a final corpus of 226 documents. The preliminary taxonomy contains 110 branches distributed between three major domains: stakeholders (24 branches), settings (25 branches) and topics (61 branches). Thematic saturation measures indicated rapid saturation (≤5% change) for the domains of "stakeholders" and "settings", and "topic"-related branches for clinical decision-making. Branches related to business reopening and economic consequences remained dynamic throughout sampling iterations. CONCLUSION: The PH guidance taxonomy can support public health agencies by aligning guidance development with curation and indexing strategies; supporting targeted dissemination; increasing the speed of updates; and enhancing public-facing guidance repositories and information retrieval tools. Taxonomies are essential to support knowledge management activities during rapidly evolving scenarios such as disease outbreaks and natural disasters.

A thematic analysis to examine the feasibility of EHR-based clinical decision support for implementing Choosing Wisely ® guidelines.

OBJECTIVE: To identify important barriers and facilitators relating to the feasibility of implementing clinical practice guidelines (CPGs) as clinical decision support (CDS). MATERIALS AND METHODS: We conducted a qualitative, thematic analysis of interviews from seven interviews with dyads (one clinical expert and one systems analyst) who discussed the feasibility of implementing 10 Choosing Wisely® guidelines at their institutions. We conducted a content analysis to extract salient themes describing facilitators, challenges, and other feasibility considerations regarding implementing CPGs as CDS. RESULTS: We identified five themes: concern about data quality impacts implementation planning; the availability of data in a computable format is a primary factor for implementation feasibility; customized strategies are needed to mitigate uncertainty and ambiguity when translating CPGs to an electronic health record-based tool; misalignment of expected CDS with pre-existing clinical workflows impact implementation; and individual level factors of end-users must be considered when selecting and implementing CDS tools. DISCUSSION: The themes reveal several considerations for CPG as CDS implementations regarding data quality, knowledge representation, and sociotechnical issues. Guideline authors should be aware that using CDS to implement CPGs is becoming increasingly popular and should consider providing clear guidelines to aid implementation. The complex nature of CPG as CDS implementation necessitates a unified effort to overcome these challenges. CONCLUSION: Our analysis highlights the importance of cooperation and co-development of standards, strategies, and infrastructure to address the difficulties of implementing CPGs as CDS. The complex interactions between the concepts revealed in the interviews necessitates the need that such work should not be conducted in silos. We also implore that implementers disseminate their experiences.

Patient-Generated Health Data in Pediatric Asthma: Exploratory Study of Providers' Information Needs.

BACKGROUND: Adolescents are using mobile health apps as a form of self-management to collect data on symptoms, medication adherence, and activity. Adding functionality to an electronic health record (EHR) to accommodate disease-specific patient-generated health data (PGHD) may support clinical care. However, little is known on how to incorporate PGHD in a way that informs care for patients. Pediatric asthma, a prevalent health issue in the United States with 6 million children diagnosed, serves as an exemplar condition to examine information needs related to PGHD. OBJECTIVE: In this study we aimed to identify and prioritize asthma care tasks and decisions based on pediatric asthma guidelines and identify types of PGHD that might support the activities associated with the decisions. The purpose of this work is to provide guidance to mobile health app developers and EHR integration. METHODS: We searched the literature for exemplar asthma mobile apps and examined the types of PGHD collected. We identified the information needs associated with each decision in accordance with consensus-based guidelines, assessed the suitability of PGHD to meet those needs, and validated our findings with expert asthma providers. RESULTS: We mapped guideline-derived information needs to potential PGHD types and found PGHD that may be useful in meeting information needs. Information needs included types of symptoms, symptom triggers, medication adherence, and inhaler technique. Examples of suitable types of PGHD were Asthma Control Test calculations, exposures, and inhaler use. Providers suggested uncontrolled asthma as a place to focus PGHD efforts, indicating that they preferred to review PGHD at the time of the visit. CONCLUSIONS: We identified a manageable list of information requirements derived from clinical guidelines that can be used to guide the design and integration of PGHD into EHRs to support pediatric asthma management and advance mobile health app development. Mobile health app developers should examine PGHD information needs to inform EHR integration efforts.

Measuring implementation feasibility of clinical decision support alerts for clinical practice recommendations.

OBJECTIVE: The study sought to describe key features of clinical concepts and data required to implement clinical practice recommendations as clinical decision support (CDS) tools in electronic health record systems and to identify recommendation features that predict feasibility of implementation. MATERIALS AND METHODS: Using semistructured interviews, CDS implementers and clinician subject matter experts from 7 academic medical centers rated the feasibility of implementing 10 American College of Emergency Physicians Choosing Wisely Recommendations as electronic health record-embedded CDS and estimated the need for additional data collection. Ratings were combined with objective features of the guidelines to develop a predictive model for technical implementation feasibility. RESULTS: A linear mixed model showed that the need for new data collection was predictive of lower implementation feasibility. The number of clinical concepts in each recommendation, need for historical data, and ambiguity of clinical concepts were not predictive of implementation feasibility. CONCLUSIONS: The availability of data and need for additional data collection are essential to assess the feasibility of CDS implementation. Authors of practice recommendations and guidelines can enable organizations to more rapidly assess data availability and feasibility of implementation by including operational definitions for required data.