PGS: a tool for association study of high-dimensional microRNA expression data with repeated measures.

MOTIVATION: MicroRNAs (miRNAs) are short single-stranded non-coding molecules that usually function as negative regulators to silence or suppress gene expression. Owning to the dynamic nature of miRNA and reduced microarray and sequencing costs, a growing number of researchers are now measuring high-dimensional miRNA expression data using repeated or multiple measures in which each individual has more than one sample collected and measured over time. However, the commonly used univariate association testing or the site-by-site (SBS) testing may underutilize the longitudinal feature of the data, leading to underpowered results and less biologically meaningful results. RESULTS: We propose a penalized regression model incorporating grid search method (PGS), for analyzing associations of high-dimensional miRNA expression data with repeated measures. The development of this analytical framework was motivated by a real-world miRNA dataset. Comparisons between PGS and the SBS testing revealed that PGS provided smaller phenotype prediction errors and higher enrichment of phenotype-related biological pathways than the SBS testing. Our extensive simulations showed that PGS provided more accurate estimates and higher sensitivity than the SBS testing with comparable specificities. AVAILABILITY AND IMPLEMENTATION: R source code for PGS algorithm, implementation example and simulation study are available for download at https://github.com/feizhe/PGS.

Design patterns for the development of electronic health record-driven phenotype extraction algorithms.

BACKGROUND: Design patterns, in the context of software development and ontologies, provide generalized approaches and guidance to solving commonly occurring problems, or addressing common situations typically informed by intuition, heuristics and experience. While the biomedical literature contains broad coverage of specific phenotype algorithm implementations, no work to date has attempted to generalize common approaches into design patterns, which may then be distributed to the informatics community to efficiently develop more accurate phenotype algorithms. METHODS: Using phenotyping algorithms stored in the Phenotype KnowledgeBase (PheKB), we conducted an independent iterative review to identify recurrent elements within the algorithm definitions. We extracted and generalized recurrent elements in these algorithms into candidate patterns. The authors then assessed the candidate patterns for validity by group consensus, and annotated them with attributes. RESULTS: A total of 24 electronic Medical Records and Genomics (eMERGE) phenotypes available in PheKB as of 1/25/2013 were downloaded and reviewed. From these, a total of 21 phenotyping patterns were identified, which are available as an online data supplement. CONCLUSIONS: Repeatable patterns within phenotyping algorithms exist, and when codified and cataloged may help to educate both experienced and novice algorithm developers. The dissemination and application of these patterns has the potential to decrease the time to develop algorithms, while improving portability and accuracy.

The role of artificial intelligence for the application of integrating electronic health records and patient-generated data in clinical decision support.

This narrative review aims to identify and understand the role of artificial intelligence in the application of integrated electronic health records (EHRs) and patient-generated health data (PGHD) in clinical decision support. We focused on integrated data that combined PGHD and EHR data, and we investigated the role of artificial intelligence (AI) in the application. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to search articles in six databases: PubMed, Embase, Web of Science, Scopus, ACM Digital Library, and IEEE Computer Society Digital Library. In addition, we also synthesized seminal sources, including other systematic reviews, reports, and white papers, to inform the context, history, and development of this field. Twenty-six publications met the review criteria after screening. The EHR-integrated PGHD introduces benefits to health care, including empowering patients and families to engage via shared decision-making, improving the patient-provider relationship, and reducing the time and cost of clinical visits. AI's roles include cleaning and management of heterogeneous datasets, assisting in identifying dynamic patterns to improve clinical care processes, and providing more sophisticated algorithms to better predict outcomes and propose precise recommendations based on the integrated data. Challenges mainly stem from the large volume of integrated data, data standards, data exchange and interoperability, security and privacy, interpretation, and meaningful use. The use of PGHD in health care is at a promising stage but needs further work for widespread adoption and seamless integration into health care systems. AI-driven, EHR-integrated PGHD systems can greatly improve clinicians' abilities to diagnose patients' health issues, classify risks at the patient level by drawing on the power of integrated data, and provide much-needed support to clinics and hospitals. With EHR-integrated PGHD, AI can help transform health care by improving diagnosis, treatment, and the delivery of clinical care, thus improving clinical decision support.

Seamless Integration of Computer-Adaptive Patient Reported Outcomes into an Electronic Health Record.

BACKGROUND: Patient-reported outcome (PRO) measures have become an essential component of quality measurement, quality improvement, and capturing the voice of the patient in clinical care. In 2004, the National Institutes of Health endorsed the importance of PROs by initiating the Patient-Reported Outcomes Measurement Information System (PROMIS), which leverages computer-adaptive tests (CATs) to reduce patient burden while maintaining measurement precision. Historically, PROMIS CATs have been used in a large number of research studies outside the electronic health record (EHR), but growing demand for clinical use of PROs requires creative information technology solutions for integration into the EHR. OBJECTIVES: This paper describes the introduction of PROMIS CATs into the Epic Systems EHR at a large academic medical center using a tight integration; we describe the process of creating a secure, automatic connection between the application programming interface (API) which scores and selects CAT items and Epic. METHODS: The overarching strategy was to make CATs appear indistinguishable from conventional measures to clinical users, patients, and the EHR software itself. We implemented CATs in Epic without compromising patient data security by creating custom middleware software within the organization's existing middleware framework. This software communicated between the Assessment Center API for item selection and scoring and Epic for item presentation and results. The middleware software seamlessly administered CATs alongside fixed-length, conventional PROs while maintaining the display characteristics and functions of other Epic measures, including automatic display of PROMIS scores in the patient's chart. Pilot implementation revealed differing workflows for clinicians using the software. RESULTS: The middleware software was adopted in 27 clinics across the hospital system. In the first 2 years of hospital-wide implementation, 793 providers collected 70,446 PROs from patients using this system. CONCLUSION: This project demonstrated the importance of regular communication across interdisciplinary teams in the design and development of clinical software. It also demonstrated that implementation relies on buy-in from clinical partners as they integrate new tools into their existing clinical workflow.

Practical challenges in integrating genomic data into the electronic health record.

Genetic testing has had limited impact on routine clinical care. Widespread adoption of electronic health records presents a promising means of disseminating genetic testing into diverse care settings. Practical challenges to integration of genomic data into electronic health records include size and complexity of genetic test results, inadequate use of standards for clinical and genetic data, and limitations in electronic health record capacity to store and analyze genetic data. Related challenges include uncertainty in the interpretation of regulatory requirements for return of results, and privacy concerns specific to genetic testing. Successful integration of genomic data may require significant redesign of existing electronic health record systems.

Development of a social and environmental determinants of health informatics maturity model.

Introduction: Integrating social and environmental determinants of health (SEDoH) into enterprise-wide clinical workflows and decision-making is one of the most important and challenging aspects of improving health equity. We engaged domain experts to develop a SEDoH informatics maturity model (SIMM) to help guide organizations to address technical, operational, and policy gaps. Methods: We established a core expert group consisting of developers, informaticists, and subject matter experts to identify different SIMM domains and define maturity levels. The candidate model (v0.9) was evaluated by 15 informaticists at a Center for Data to Health community meeting. After incorporating feedback, a second evaluation round for v1.0 collected feedback and self-assessments from 35 respondents from the National COVID Cohort Collaborative, the Center for Leading Innovation and Collaboration's Informatics Enterprise Committee, and a publicly available online self-assessment tool. Results: We developed a SIMM comprising seven maturity levels across five domains: data collection policies, data collection methods and technologies, technology platforms for analysis and visualization, analytics capacity, and operational and strategic impact. The evaluation demonstrated relatively high maturity in analytics and technological capacity, but more moderate maturity in operational and strategic impact among academic medical centers. Changes made to the tool in between rounds improved its ability to discriminate between intermediate maturity levels. Conclusion: The SIMM can help organizations identify current gaps and next steps in improving SEDoH informatics. Improving the collection and use of SEDoH data is one important component of addressing health inequities.

Developing a standardized but extendable framework to increase the findability of infectious disease datasets.

Biomedical datasets are increasing in size, stored in many repositories, and face challenges in FAIRness (findability, accessibility, interoperability, reusability). As a Consortium of infectious disease researchers from 15 Centers, we aim to adopt open science practices to promote transparency, encourage reproducibility, and accelerate research advances through data reuse. To improve FAIRness of our datasets and computational tools, we evaluated metadata standards across established biomedical data repositories. The vast majority do not adhere to a single standard, such as Schema.org, which is widely-adopted by generalist repositories. Consequently, datasets in these repositories are not findable in aggregation projects like Google Dataset Search. We alleviated this gap by creating a reusable metadata schema based on Schema.org and catalogued nearly 400 datasets and computational tools we collected. The approach is easily reusable to create schemas interoperable with community standards, but customized to a particular context. Our approach enabled data discovery, increased the reusability of datasets from a large research consortium, and accelerated research. Lastly, we discuss ongoing challenges with FAIRness beyond discoverability.

Accelerating Food Allergy Research: Need for a Data Commons.

Food allergy is a significant health problem affecting approximately 8% of children and 11% of adults in the United States. It exhibits all the characteristics of a "complex" genetic trait; therefore, it is necessary to look at very large numbers of patients, far more than exist at any single organization, to eliminate gaps in the current understanding of this complex chronic disorder. Advances may be achieved by bringing together food allergy data from large numbers of patients into a Data Commons, a secure and efficient platform for researchers, comprising standardized data, available in a common interface for download and/or analysis, in accordance with the FAIR (Findable, Accessible, Interoperable, and Reusable) principles. Prior data commons initiatives indicate that research community consensus and support, formal food allergy ontology, data standards, an accepted platform and data management tools, an agreed upon infrastructure, and trusted governance are the foundation of any successful data commons. In this article, we will present the justification for the creation of a food allergy data commons and describe the core principles that can make it successful and sustainable.

Characterizing variability of electronic health record-driven phenotype definitions.

OBJECTIVE: The aim of this study was to analyze a publicly available sample of rule-based phenotype definitions to characterize and evaluate the variability of logical constructs used. MATERIALS AND METHODS: A sample of 33 preexisting phenotype definitions used in research that are represented using Fast Healthcare Interoperability Resources and Clinical Quality Language (CQL) was analyzed using automated analysis of the computable representation of the CQL libraries. RESULTS: Most of the phenotype definitions include narrative descriptions and flowcharts, while few provide pseudocode or executable artifacts. Most use 4 or fewer medical terminologies. The number of codes used ranges from 5 to 6865, and value sets from 1 to 19. We found that the most common expressions used were literal, data, and logical expressions. Aggregate and arithmetic expressions are the least common. Expression depth ranges from 4 to 27. DISCUSSION: Despite the range of conditions, we found that all of the phenotype definitions consisted of logical criteria, representing both clinical and operational logic, and tabular data, consisting of codes from standard terminologies and keywords for natural language processing. The total number and variety of expressions are low, which may be to simplify implementation, or authors may limit complexity due to data availability constraints. CONCLUSIONS: The phenotype definitions analyzed show significant variation in specific logical, arithmetic, and other operators but are all composed of the same high-level components, namely tabular data and logical expressions. A standard representation for phenotype definitions should support these formats and be modular to support localization and shared logic.

Machine learning links unresolving secondary pneumonia to mortality in patients with severe pneumonia, including COVID-19.

BACKGROUNDDespite guidelines promoting the prevention and aggressive treatment of ventilator-associated pneumonia (VAP), the importance of VAP as a driver of outcomes in mechanically ventilated patients, including patients with severe COVID-19, remains unclear. We aimed to determine the contribution of unsuccessful treatment of VAP to mortality for patients with severe pneumonia.METHODSWe performed a single-center, prospective cohort study of 585 mechanically ventilated patients with severe pneumonia and respiratory failure, 190 of whom had COVID-19, who underwent at least 1 bronchoalveolar lavage. A panel of intensive care unit (ICU) physicians adjudicated the pneumonia episodes and endpoints on the basis of clinical and microbiological data. Given the relatively long ICU length of stay (LOS) among patients with COVID-19, we developed a machine-learning approach called CarpeDiem, which grouped similar ICU patient-days into clinical states based on electronic health record data.RESULTSCarpeDiem revealed that the long ICU LOS among patients with COVID-19 was attributable to long stays in clinical states characterized primarily by respiratory failure. While VAP was not associated with mortality overall, the mortality rate was higher for patients with 1 episode of unsuccessfully treated VAP compared with those with successfully treated VAP (76.4% versus 17.6%, P < 0.001). For all patients, including those with COVID-19, CarpeDiem demonstrated that unresolving VAP was associated with a transitions to clinical states associated with higher mortality.CONCLUSIONSUnsuccessful treatment of VAP is associated with higher mortality. The relatively long LOS for patients with COVID-19 was primarily due to prolonged respiratory failure, placing them at higher risk of VAP.FUNDINGNational Institute of Allergy and Infectious Diseases (NIAID), NIH grant U19AI135964; National Heart, Lung, and Blood Institute (NHLBI), NIH grants R01HL147575, R01HL149883, R01HL153122, R01HL153312, R01HL154686, R01HL158139, P01HL071643, and P01HL154998; National Heart, Lung, and Blood Institute (NHLBI), NIH training grants T32HL076139 and F32HL162377; National Institute on Aging (NIA), NIH grants K99AG068544, R21AG075423, and P01AG049665; National Library of Medicine (NLM), NIH grant R01LM013337; National Center for Advancing Translational Sciences (NCATS), NIH grant U01TR003528; Veterans Affairs grant I01CX001777; Chicago Biomedical Consortium grant; Northwestern University Dixon Translational Science Award; Simpson Querrey Lung Institute for Translational Science (SQLIFTS); Canning Thoracic Institute of Northwestern Medicine.

Examining perspectives on the adoption and use of computer-based patient-reported outcomes among clinicians and health professionals: a Q methodology study.

OBJECTIVE: To determine factors that influence the adoption and use of patient-reported outcomes (PROs) in the electronic health record (EHR) among users. MATERIALS AND METHODS: Q methodology, supported by focus groups, semistructured interviews, and a review of the literature was used for data collection about opinions on PROs in the EHR. An iterative thematic analysis resulted in 49 statements that study participants sorted, from most unimportant to most important, under the following condition of instruction: "What issues are most important or most unimportant to you when you think about the adoption and use of patient-reported outcomes within the electronic health record in routine clinical care?" Using purposive sampling, 50 participants were recruited to rank and sort the 49 statements online, using HTMLQ software. Principal component analysis and Varimax rotation were used for data analysis using the PQMethod software. RESULTS: Participants were mostly physicians (24%) or physician/researchers (20%). Eight factors were identified. Factors included the ability of PROs in the EHR to enable: efficient and reliable use; care process improvement and accountability; effective and better symptom assessment; patient involvement for care quality; actionable and practical clinical decisions; graphical review and interpretation of results; use for holistic care planning to reflect patients' needs; and seamless use for all users. DISCUSSION: The success of PROs in the EHR in clinical settings is not dependent on a "one size fits all" strategy, demonstrated by the diversity of viewpoints identified in this study. A sociotechnical approach for implementing PROs in the EHR may help improve its success and sustainability. CONCLUSIONS: PROs in the EHR are most important to users when the technology is used to improve patient outcomes. Future research must focus on the impact of embedding this EHR functionality on care processes.

Development of Food Allergy Data Dictionary: Toward a Food Allergy Data Commons.

BACKGROUND: Food allergy (FA) data lacks a common base of terminology and hinders data exchange among institutions. OBJECTIVE: To examine the current FA concept coverage by clinical terminologies and to develop and evaluate a Food Allergy Data Dictionary (FADD). METHODS: Allergy/immunology templates and patient intake forms from 4 academic medical centers with expertise in FA were systematically reviewed, and in-depth discussions with a panel of FA experts were conducted to identify important FA clinical concepts and data elements. The candidate ontology was iteratively refined through a series of virtual meetings. The concepts were mapped to existing clinical terminologies manually with the ATHENA vocabulary browser. Finally, the revised dictionary document was vetted with experts across 22 academic FA centers and 3 industry partners. RESULTS: A consensus version 1.0 FADD was finalized in November 2020. The FADD v1.0 contained 936 discrete FA concepts that were grouped into 14 categories. The categories included both FA-specific concepts, such as foods triggering reactions, and general health care categories, such as medications. Although many FA concepts are included in existing clinical terminologies, some critical concepts are missing. CONCLUSIONS: The FADD provides a pragmatic tool that can enable improved structured coding of FA data for both research and clinical uses, as well as lay the foundation for the development of standardized FA structured data entry forms.

Implementation of workflow engine technology to deliver basic clinical decision support functionality.

BACKGROUND: Workflow engine technology represents a new class of software with the ability to graphically model step-based knowledge. We present application of this novel technology to the domain of clinical decision support. Successful implementation of decision support within an electronic health record (EHR) remains an unsolved research challenge. Previous research efforts were mostly based on healthcare-specific representation standards and execution engines and did not reach wide adoption. We focus on two challenges in decision support systems: the ability to test decision logic on retrospective data prior prospective deployment and the challenge of user-friendly representation of clinical logic. RESULTS: We present our implementation of a workflow engine technology that addresses the two above-described challenges in delivering clinical decision support. Our system is based on a cross-industry standard of XML (extensible markup language) process definition language (XPDL). The core components of the system are a workflow editor for modeling clinical scenarios and a workflow engine for execution of those scenarios. We demonstrate, with an open-source and publicly available workflow suite, that clinical decision support logic can be executed on retrospective data. The same flowchart-based representation can also function in a prospective mode where the system can be integrated with an EHR system and respond to real-time clinical events. We limit the scope of our implementation to decision support content generation (which can be EHR system vendor independent). We do not focus on supporting complex decision support content delivery mechanisms due to lack of standardization of EHR systems in this area. We present results of our evaluation of the flowchart-based graphical notation as well as architectural evaluation of our implementation using an established evaluation framework for clinical decision support architecture. CONCLUSIONS: We describe an implementation of a free workflow technology software suite (available at http://code.google.com/p/healthflow) and its application in the domain of clinical decision support. Our implementation seamlessly supports clinical logic testing on retrospective data and offers a user-friendly knowledge representation paradigm. With the presented software implementation, we demonstrate that workflow engine technology can provide a decision support platform which evaluates well against an established clinical decision support architecture evaluation framework. Due to cross-industry usage of workflow engine technology, we can expect significant future functionality enhancements that will further improve the technology's capacity to serve as a clinical decision support platform.

Medical providers' dental information needs: a baseline survey.

Articulation of medical and dental practices has been strongly called for based on the many oral-systemic connections. With the rapid development and adoption of electronic health records, the feasibility of integrating medical and dental patient data should be strongly considered. The objective of this study was to develop an initial understanding of the medical providers' core dental information needs and opinion of integrated medical-dental electronic health record (iEHR) environment in their workflow. This was achieved by administering a 13 question survey to a group of 1,197 medical care providers employed by Marshfield Clinic in Wisconsin, United States. The survey received a response rate of 35%. The responses were analyzed based on provider 'Role' and 'Specialty'. The majority of the respondents felt the need for patient's dental information to coordinate or provide effective medical care. An integrated electronic health record environment could facilitate this holistic patient care approach.

A retrospective look at the predictions and recommendations from the 2009 AMIA policy meeting: did we see EHR-related clinician burnout coming?

Clinicians often attribute much of their burnout experience to use of the electronic health record, the adoption of which was greatly accelerated by the Health Information Technology for Economic and Clinical Health Act of 2009. That same year, AMIA's Policy Meeting focused on possible unintended consequences associated with rapid implementation of electronic health records, generating 17 potential consequences and 15 recommendations to address them. At the 2020 annual meeting of the American College of Medical Informatics (ACMI), ACMI fellows participated in a modified Delphi process to assess the accuracy of the 2009 predictions and the response to the recommendations. Among the findings, the fellows concluded that the degree of clinician burnout and its contributing factors, such as increased documentation requirements, were significantly underestimated. Conversely, problems related to identify theft and fraud were overestimated. Only 3 of the 15 recommendations were adjudged more than half-addressed.

Infobuttons for Genomic Medicine: Requirements and Barriers.

OBJECTIVES: The study aimed to understand potential barriers to the adoption of health information technology projects that are released as free and open source software (FOSS). METHODS: We conducted a survey of research consortia participants engaged in genomic medicine implementation to assess perceived institutional barriers to the adoption of three systems: ClinGen electronic health record (EHR) Toolkit, DocUBuild, and MyResults.org. The survey included eight barriers from the Consolidated Framework for Implementation Research (CFIR), with additional barriers identified from a qualitative analysis of open-ended responses. RESULTS: We analyzed responses from 24 research consortia participants from 18 institutions. In total, 14 categories of perceived barriers were evaluated, which were consistent with other observed barriers to FOSS adoption. The most frequent perceived barriers included lack of adaptability of the system, lack of institutional priority to implement, lack of trialability, lack of advantage of alternative systems, and complexity. CONCLUSION: In addition to understanding potential barriers, we recommend some strategies to address them (where possible), including considerations for genomic medicine. Overall, FOSS developers need to ensure systems are easy to trial and implement and need to clearly articulate benefits of their systems, especially when alternatives exist. Institutional champions will remain a critical component to prioritizing genomic medicine projects.

Parental perceptions toward digital imaging and telemedicine for retinopathy of prematurity management.

BACKGROUND: Telemedicine is an emerging technology with potential to improve care for retinopathy of prematurity (ROP). This study evaluates parental perceptions about digital imaging and telemedicine for ROP care. METHODS: During a 1-year period, one parent of each infant who underwent wide-field retinal imaging for ROP was given a questionnaire designed to evaluate parental perceptions using a 5-point Likert-type scale. Five items assessed perceptions toward digital retinal imaging, and ten items assessed attitudes toward telemedicine. Construct validity of the questionnaire was examined using factor analysis. Responses were summarized using descriptive and correlational statistics. RESULTS: Forty-two parents participated. Factor analysis extracted two factors explaining 79% of the total variance in digital retinal imaging items (Cronbach's alpha = 0.843), and three factors explaining 63% of the total variance in telemedicine items (Cronbach's alpha = 0.631). Among digital imaging items, the highest mean (+/-SD) score was for "digital pictures of my child's retinopathy should be included in the permanent medical record" (4.4 +/- 0.6), and the lowest was for "digital cameras and computers are reliable" (3.8 +/- 0.8). Among telemedicine items, the highest mean (+/-SD) score was for "technology will improve the quality of medical care for my child" (4.3 +/- 0.6), and the lowest was for "technology will make it harder for a patient and doctor to establish a good relationship" (2.6 +/- 1.1). CONCLUSIONS: Parents reported positive perceptions about telemedical ROP diagnosis, but expressed some preference for face-to-face care. Telemedicine has potential to alter the nature of the patient-physician relationship.

Use of three computer training methods in elderly underserved rural patients enrolled in a diabetes telemedicine program.

A telephone survey of Medicare beneficiaries with diabetes living in rural underserved areas and enrolled in the Informatics for Diabetes Education and Telemedicine project identified 109 subjects who requested further training in functions of the home telemedicine unit after initial in-home training by regional nurse installers. The initial training provided the skills needed to videoconferences with nurse case managers and to transmit blood glucose and blood pressure readings, but further instruction was needed for access to Web-based education features and messaging. This study evaluated these elderly patients' perceptions of the helpfulness of three additional telemedicine training methods:in-home visit with an regional nurse installer referencing a user's manual, unassisted patient use of the user's manual, and telephone-based training not using regional nurse installers reinforcing the user's manual. Eligible subjects rated the helpfulness of the three computer training methods on a five-point Likert scale (1 = "not helpful at all," 5 = "very helpful"). Participants rated "in-home" training with an regional nurse installer significantly higher than they did for the user's manual alone (P < .01). In response to this finding and other companion usability studies, Informatics for Diabetes Education and Telemedicine deployed home telemedicine units with enhanced remote training capabilities to better emulate characteristics of in-person training.

The Implementation Chasm Hindering Genome-informed Health Care.

The promises of precision medicine are often heralded in the medical and lay literature, but routine integration of genomics in clinical practice is still limited. While the "last mile' infrastructure to bring genomics to the bedside has been demonstrated in some healthcare settings, a number of challenges remain - both in the receptivity of today's health system and in its technical and educational readiness to respond to this evolution in care. To improve the impact of genomics on health and disease management, we will need to integrate both new knowledge and new care processes into existing workflows. This change will be onerous and time-consuming, but hopefully valuable to the provision of high quality, economically feasible care worldwide.