A Modified Public Health Automated Case Event Reporting Platform for Enhancing Electronic Laboratory Reports With Clinical Data: Design and Implementation Study.

BACKGROUND: Public health reporting is the cornerstone of public health practices that inform prevention and control strategies. There is a need to leverage advances made in the past to implement an architecture that facilitates the timely and complete public health reporting of relevant case-related information that has previously not easily been available to the public health community. Electronic laboratory reporting (ELR) is a reliable method for reporting cases to public health authorities but contains very limited data. In an earlier pilot study, we designed the Public Health Automated Case Event Reporting (PACER) platform, which leverages existing ELR infrastructure as the trigger for creating an electronic case report. PACER is a FHIR (Fast Health Interoperability Resources)-based system that queries the electronic health record from where the laboratory test was requested to extract expanded additional information about a case. OBJECTIVE: This study aims to analyze the pilot implementation of a modified PACER system for electronic case reporting and describe how this FHIR-based, open-source, and interoperable system allows health systems to conduct public health reporting while maintaining the appropriate governance of the clinical data. METHODS: ELR to a simulated public health department was used as the trigger for a FHIR-based query. Predetermined queries were translated into Clinical Quality Language logics. Within the PACER environment, these Clinical Quality Language logical statements were managed and evaluated against the providers' FHIR servers. These predetermined logics were filtered, and only data relevant to that episode of the condition were extracted and sent to simulated public health agencies as an electronic case report. Design and testing were conducted at the Georgia Tech Research Institute, and the pilot was deployed at the Medical University of South Carolina. We evaluated this architecture by examining the completeness of additional information in the electronic case report, such as patient demographics, medications, symptoms, and diagnoses. This additional information is crucial for understanding disease epidemiology, but existing electronic case reporting and ELR architectures do not report them. Therefore, we used the completeness of these data fields as the metrics for enriching electronic case reports. RESULTS: During the 8-week study period, we identified 117 positive test results for chlamydia. PACER successfully created an electronic case report for all 117 patients. PACER extracted demographics, medications, symptoms, and diagnoses from 99.1% (116/117), 72.6% (85/117), 70.9% (83/117), and 65% (76/117) of the cases, respectively. CONCLUSIONS: PACER deployed in conjunction with electronic laboratory reports can enhance public health case reporting with additional relevant data. The architecture is modular in design, thereby allowing it to be used for any reportable condition, including evolving outbreaks. PACER allows for the creation of an enhanced and more complete case report that contains relevant case information that helps us to better understand the epidemiology of a disease.

Comprehensive comparative effectiveness and safety of first-line antihypertensive drug classes: a systematic, multinational, large-scale analysis.

BACKGROUND: Uncertainty remains about the optimal monotherapy for hypertension, with current guidelines recommending any primary agent among the first-line drug classes thiazide or thiazide-like diuretics, angiotensin-converting enzyme inhibitors, angiotensin receptor blockers, dihydropyridine calcium channel blockers, and non-dihydropyridine calcium channel blockers, in the absence of comorbid indications. Randomised trials have not further refined this choice. METHODS: We developed a comprehensive framework for real-world evidence that enables comparative effectiveness and safety evaluation across many drugs and outcomes from observational data encompassing millions of patients, while minimising inherent bias. Using this framework, we did a systematic, large-scale study under a new-user cohort design to estimate the relative risks of three primary (acute myocardial infarction, hospitalisation for heart failure, and stroke) and six secondary effectiveness and 46 safety outcomes comparing all first-line classes across a global network of six administrative claims and three electronic health record databases. The framework addressed residual confounding, publication bias, and p-hacking using large-scale propensity adjustment, a large set of control outcomes, and full disclosure of hypotheses tested. FINDINGS: Using 4·9 million patients, we generated 22 000 calibrated, propensity-score-adjusted hazard ratios (HRs) comparing all classes and outcomes across databases. Most estimates revealed no effectiveness differences between classes; however, thiazide or thiazide-like diuretics showed better primary effectiveness than angiotensin-converting enzyme inhibitors: acute myocardial infarction (HR 0·84, 95% CI 0·75-0·95), hospitalisation for heart failure (0·83, 0·74-0·95), and stroke (0·83, 0·74-0·95) risk while on initial treatment. Safety profiles also favoured thiazide or thiazide-like diuretics over angiotensin-converting enzyme inhibitors. The non-dihydropyridine calcium channel blockers were significantly inferior to the other four classes. INTERPRETATION: This comprehensive framework introduces a new way of doing observational health-care science at scale. The approach supports equivalence between drug classes for initiating monotherapy for hypertension-in keeping with current guidelines, with the exception of thiazide or thiazide-like diuretics superiority to angiotensin-converting enzyme inhibitors and the inferiority of non-dihydropyridine calcium channel blockers. FUNDING: US National Science Foundation, US National Institutes of Health, Janssen Research & Development, IQVIA, South Korean Ministry of Health & Welfare, Australian National Health and Medical Research Council.

Characterizing treatment pathways at scale using the OHDSI network.

Observational research promises to complement experimental research by providing large, diverse populations that would be infeasible for an experiment. Observational research can test its own clinical hypotheses, and observational studies also can contribute to the design of experiments and inform the generalizability of experimental research. Understanding the diversity of populations and the variance in care is one component. In this study, the Observational Health Data Sciences and Informatics (OHDSI) collaboration created an international data network with 11 data sources from four countries, including electronic health records and administrative claims data on 250 million patients. All data were mapped to common data standards, patient privacy was maintained by using a distributed model, and results were aggregated centrally. Treatment pathways were elucidated for type 2 diabetes mellitus, hypertension, and depression. The pathways revealed that the world is moving toward more consistent therapy over time across diseases and across locations, but significant heterogeneity remains among sources, pointing to challenges in generalizing clinical trial results. Diabetes favored a single first-line medication, metformin, to a much greater extent than hypertension or depression. About 10% of diabetes and depression patients and almost 25% of hypertension patients followed a treatment pathway that was unique within the cohort. Aside from factors such as sample size and underlying population (academic medical center versus general population), electronic health records data and administrative claims data revealed similar results. Large-scale international observational research is feasible.

Risk of angioedema associated with levetiracetam compared with phenytoin: Findings of the observational health data sciences and informatics research network.

Recent adverse event reports have raised the question of increased angioedema risk associated with exposure to levetiracetam. To help address this question, the Observational Health Data Sciences and Informatics research network conducted a retrospective observational new-user cohort study of seizure patients exposed to levetiracetam (n = 276,665) across 10 databases. With phenytoin users (n = 74,682) as a comparator group, propensity score-matching was conducted and hazard ratios computed for angioedema events by per-protocol and intent-to-treat analyses. Angioedema events were rare in both the levetiracetam and phenytoin groups (54 vs. 71 in per-protocol and 248 vs. 435 in intent-to-treat). No significant increase in angioedema risk with levetiracetam was seen in any individual database (hazard ratios ranging from 0.43 to 1.31). Meta-analysis showed a summary hazard ratio of 0.72 (95% confidence interval [CI] 0.39-1.31) and 0.64 (95% CI 0.52-0.79) for the per-protocol and intent-to-treat analyses, respectively. The results suggest that levetiracetam has the same or lower risk for angioedema than phenytoin, which does not currently carry a labeled warning for angioedema. Further studies are warranted to evaluate angioedema risk across all antiepileptic drugs.

Glucagon-like peptide 1-based therapies and risk of pancreatitis: a self-controlled case series analysis.

PURPOSE: Previous studies have suggested a link between glucagon-like peptide 1 (GLP-1)-based therapies and acute pancreatitis, while other studies have found no association. Because differences in diabetes severity may confound this relationship, a self-controlled case series (SCCS) analysis has been suggested as a means to control for individual-level confounding. METHODS: We evaluated the relationship between GLP-1-based therapies and pancreatitis by SCCS method using a large observational database. We calculated the incidence density ratio of pancreatitis for exposure versus non-exposure to each drug. To examine the robustness of our findings, we performed sensitivity analyses by varying risk windows, using two pancreatitis definitions and including incident pancreatitis or all occurrences. RESULTS: From dispensing data on 1.2 million patients, we found 7992 sitagliptin-exposed patients and 3552 exenatide-exposed patients between 2004 and 2009. Using an ICD9/CPT-based case definition of pancreatitis, we identified 207 sitagliptin and 82 exenatide cases. Augmenting this definition with laboratory criteria increased our cohort to 245 sitagliptin and 96 exenatide cases. For sitagliptin and exenatide cases, respectively, the mean duration of observation was 5.2 and 5.5 years, and the mean duration of drug exposure was 0.7 and 0.5 years. For all analyses (including different pancreatitis definitions, risk periods, and incident or recurrent events), the incidence density ratios for development of pancreatitis during exposure versus non-exposure ranged from 0.68 to 1.46, with all having 95% confidence intervals containing 1. CONCLUSIONS: We found no association between the use of GLP-1-based therapies and pancreatitis using SCCS analysis in a large observational database.

Literature based drug interaction prediction with clinical assessment using electronic medical records: novel myopathy associated drug interactions.

Drug-drug interactions (DDIs) are a common cause of adverse drug events. In this paper, we combined a literature discovery approach with analysis of a large electronic medical record database method to predict and evaluate novel DDIs. We predicted an initial set of 13197 potential DDIs based on substrates and inhibitors of cytochrome P450 (CYP) metabolism enzymes identified from published in vitro pharmacology experiments. Using a clinical repository of over 800,000 patients, we narrowed this theoretical set of DDIs to 3670 drug pairs actually taken by patients. Finally, we sought to identify novel combinations that synergistically increased the risk of myopathy. Five pairs were identified with their p-values less than 1E-06: loratadine and simvastatin (relative risk or RR = 1.69); loratadine and alprazolam (RR = 1.86); loratadine and duloxetine (RR = 1.94); loratadine and ropinirole (RR = 3.21); and promethazine and tegaserod (RR = 3.00). When taken together, each drug pair showed a significantly increased risk of myopathy when compared to the expected additive myopathy risk from taking either of the drugs alone. Based on additional literature data on in vitro drug metabolism and inhibition potency, loratadine and simvastatin and tegaserod and promethazine were predicted to have a strong DDI through the CYP3A4 and CYP2D6 enzymes, respectively. This new translational biomedical informatics approach supports not only detection of new clinically significant DDI signals, but also evaluation of their potential molecular mechanisms.

Consistency in the safety labeling of bioequivalent medications.

PURPOSE: Bioequivalent medications are required by the Food and Drug Administration to have identical warnings on their labels. This requirement has both clinical and legal importance, yet has never been validated. We sought to determine the real-world consistency of electronic labeling for bioequivalent drugs from different manufacturers. METHODS: Using natural language processing, we indexed the adverse drug reactions (ADRs) found in the Adverse Reactions and Post-Marketing sections of 9105 structured product labels. We calculated the standard deviation in ADR labeling for each bioequivalent drug and the percent deviation of each generic label from its corresponding brand. We also analyzed the performance of individual generic manufacturers. For the 25 drugs with the greatest discrepancy in labeled ADRs, we performed manual review to identify causes of inconsistency. RESULTS: 68% of multi-manufacturer drugs had discrepancies in ADR labeling. For a given drug, the mean deviation in number of labeled ADRs was 4.4, and the median was 0.8 (IQR 0 to 3.2). The mean range in number of labeled ADRs was 12 +/- 0.9, and the median was 2 (IQR 0 to 9). Overall, 77.9% of generic manufacturers produced labels differing from brand. Causes of inconsistency included missing tables, outdated post-marketing reports, and formatting issues. CONCLUSIONS: Despite FDA mandate, bioequivalent drugs often differ in their safety labeling. Physicians should be aware of such differences and regulators should consider new strategies for harmonizing bioequivalent labels.

Standardizing Multi-site Clinical Note Titles to LOINC Document Ontology: A Transformer-based Approach.

The types of clinical notes in electronic health records (EHRs) are diverse and it would be great to standardize them to ensure unified data retrieval, exchange, and integration. The LOINC Document Ontology (DO) is a subset of LOINC that is created specifically for naming and describing clinical documents. Despite the efforts of promoting and improving this ontology, how to efficiently deploy it in real-world clinical settings has yet to be explored. In this study we evaluated the utility of LOINC DO by mapping clinical note titles collected from five institutions to the LOINC DO and classifying the mapping into three classes based on semantic similarity between note titles and LOINC DO codes. Additionally, we developed a standardization pipeline that automatically maps clinical note titles from multiple sites to suitable LOINC DO codes, without accessing the content of clinical notes. The pipeline can be initialized with different large language models, and we compared the performances between them. The results showed that our automated pipeline achieved an accuracy of 0.90. By comparing the manual and automated mapping results, we analyzed the coverage of LOINC DO in describing multi-site clinical note titles and summarized the potential scope for extension.

Comparative First-Line Effectiveness and Safety of ACE (Angiotensin-Converting Enzyme) Inhibitors and Angiotensin Receptor Blockers: A Multinational Cohort Study.

[Figure: see text].

Comprehensive Comparative Effectiveness and Safety of First-Line ß-Blocker Monotherapy in Hypertensive Patients: A Large-Scale Multicenter Observational Study.

[Figure: see text].

Data visualization speeds review of potential adverse drug events in patients on multiple medications.

Patients on multiple medications are at increased risk for adverse drug events. While physicians can reduce this risk by regularly reviewing the side-effect profiles of their patients' medications, this process can be time-consuming. We created a decision support system designed to expedite reviewing potential adverse reactions through information visualization. The system includes a database containing 16,340 unique drug and side-effect pairs, representing 250 common medications. A numeric score is assigned to each pair reflecting the strength of association between drug and effect. Based on these scores, the system generates graphical adverse reaction maps for any user-selected combination of drugs. A study comparing speed and accuracy of retrieving side-effect data using this tool versus UpToDate demonstrated a 60% reduction in time to complete a query (61 s vs. 155 s, p < 0.0001) with no decrease in accuracy. These findings suggest that information visualization can significantly expedite review of potential adverse drug events.

Public health reporting and outbreak response: synergies with evolving clinical standards for interoperability.

Public health needs up-to-date information for surveillance and response. As healthcare application programming interfaces become widely available, a novel data gathering mechanism could provide public health with critical information in a timely fashion to respond to a fast-moving epidemic. In this article, we extrapolate from our experiences using a Fast Healthcare Interoperability Resource-based architecture for infectious disease surveillance for sexually transmitted diseases to its application to gather case information for an outbreak. One of the challenges with a fast-moving outbreak is to accurately assess its demand on healthcare resources, since information specific to comorbidities is often not available. These comorbidities are often associated with poor prognosis and higher resource utilization. If the comorbidity data and other clinical information were readily available to public health workers, they could better address community disruption and manage healthcare resources. The use of FHIR resources available through application programming and filtered through tools such as described herein will give public health the flexibility needed to investigate rapidly emerging disease while protecting patient privacy.

Extending an open-source tool to measure data quality: case report on Observational Health Data Science and Informatics (OHDSI).

INTRODUCTION: As the health system seeks to leverage large-scale data to inform population outcomes, the informatics community is developing tools for analysing these data. To support data quality assessment within such a tool, we extended the open-source software Observational Health Data Sciences and Informatics (OHDSI) to incorporate new functions useful for population health. METHODS: We developed and tested methods to measure the completeness, timeliness and entropy of information. The new data quality methods were applied to over 100 million clinical messages received from emergency department information systems for use in public health syndromic surveillance systems. DISCUSSION: While completeness and entropy methods were implemented by the OHDSI community, timeliness was not adopted as its context did not fit with the existing OHDSI domains. The case report examines the process and reasons for acceptance and rejection of ideas proposed to an open-source community like OHDSI.

Normalizing Clinical Document Titles to LOINC Document Ontology: an Initial Study.

The normalization of clinical documents is essential for health information management with the enormous amount of clinical documentation generated each year. The LOINC Document Ontology (DO) is a universal clinical document standard in a hierarchical structure. The objective of this study is to investigate the feasibility and generalizability of LOINC DO by mapping from clinical note titles across five institutions to five DO axes. We first developed an annotation framework based on the definition of LOINC DO axes and manually mapped 4,000 titles. Then we introduced a pre-trained deep learning model named Bidirectional Encoder Representations from Transformers (BERT) to enable automatic mapping from titles to LOINC DO axes. The results showed that the BERT-based automatic mapping achieved improved performance compared with the baseline model. By analyzing both manual annotations and predicted results, ambiguities in LOINC DO axes definition were discussed.

Comparative safety and effectiveness of alendronate versus raloxifene in women with osteoporosis.

Alendronate and raloxifene are among the most popular anti-osteoporosis medications. However, there is a lack of head-to-head comparative effectiveness studies comparing the two treatments. We conducted a retrospective large-scale multicenter study encompassing over 300 million patients across nine databases encoded in the Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM). The primary outcome was the incidence of osteoporotic hip fracture, while secondary outcomes were vertebral fracture, atypical femoral fracture (AFF), osteonecrosis of the jaw (ONJ), and esophageal cancer. We used propensity score trimming and stratification based on an expansive propensity score model with all pre-treatment patient characteritistcs. We accounted for unmeasured confounding using negative control outcomes to estimate and adjust for residual systematic bias in each data source. We identified 283,586 alendronate patients and 40,463 raloxifene patients. There were 7.48 hip fracture, 8.18 vertebral fracture, 1.14 AFF, 0.21 esophageal cancer and 0.09 ONJ events per 1,000 person-years in the alendronate cohort and 6.62, 7.36, 0.69, 0.22 and 0.06 events per 1,000 person-years, respectively, in the raloxifene cohort. Alendronate and raloxifene have a similar hip fracture risk (hazard ratio [HR] 1.03, 95% confidence interval [CI] 0.94-1.13), but alendronate users are more likely to have vertebral fractures (HR 1.07, 95% CI 1.01-1.14). Alendronate has higher risk for AFF (HR 1.51, 95% CI 1.23-1.84) but similar risk for esophageal cancer (HR 0.95, 95% CI 0.53-1.70), and ONJ (HR 1.62, 95% CI 0.78-3.34). We demonstrated substantial control of measured confounding by propensity score adjustment, and minimal residual systematic bias through negative control experiments, lending credibility to our effect estimates. Raloxifene is as effective as alendronate and may remain an option in the prevention of osteoporotic fracture.

Integration of FHIR to Facilitate Electronic Case Reporting: Results from a Pilot Study.

Current approaches to gathering sexually transmitted infection (STI) case information for surveillance efforts are inefficient and lead to underreporting of disease burden. Electronic health information systems offer an opportunity to improve how STI case information can be gathered and reported to public health authorities. To test the feasibility of a standards-based application designed to automate STI case information collection and reporting, we conducted a pilot study where electronic laboratory messages triggered a FHIR-based application to query a patient's electronic health record for details needed for an electronic case report (eCR). Out of 214 cases observed during a one week period, 181 (84.6%) could be successfully confirmed automatically using the FHIR-based application. Data quality and information representation challenges were identified that will require collaborative efforts to improve the structure of electronic clinical messages as well as the robustness of the FHIR application.

Predictive modeling of hypoglycemia for clinical decision support in evaluating outpatients with diabetes mellitus.

Objective: Hypoglycemia occurs in 20-60% of patients with diabetes mellitus. Identifying at-risk patients can facilitate interventions to lower risk. We sought to develop a hypoglycemia prediction model. Methods: In this retrospective cohort study, urban adults prescribed a diabetes drug between 2004 and 2013 were identified. Demographic and clinical data were extracted from an electronic medical record (EMR). Laboratory tests, diagnostic codes and natural language processing (NLP) identified hypoglycemia. We compared multiple logistic regression, classification and regression trees (CART), and random forest. Models were evaluated on an independent test set or through cross-validation. Results: The 38,780 patients had mean age 57 years; 56% were female, 40% African-American and 39% uninsured. Hypoglycemia occurred in 8128 (539 identified only by NLP). In logistic regression, factors positively associated with hypoglycemia included infection, non-long-acting insulin, dementia and recent hypoglycemia. Negatively associated factors included long-acting insulin plus sulfonylurea, and age 75 or older. The models' area under curve was similar (logistic regression, 89%; CART, 88%; random forest, 90%, with ten-fold cross-validation). Conclusions: NLP improved identification of hypoglycemia. Non-long-acting insulin was an important risk factor. Decreased risk with age may reflect treatment or diminished awareness of hypoglycemia. More complex models did not improve prediction.

A comparison between physicians and computer algorithms for form CMS-2728 data reporting.

INTRODUCTION: CMS-2728 form (Medical Evidence Report) assesses 23 comorbidities chosen to reflect poor outcomes and increased mortality risk. Previous studies questioned the validity of physician reporting on forms CMS-2728. We hypothesize that reporting of comorbidities by computer algorithms identifies more comorbidities than physician completion, and, therefore, is more reflective of underlying disease burden. METHODS: We collected data from CMS-2728 forms for all 296 patients who had incident ESRD diagnosis and received chronic dialysis from 2005 through 2014 at Indiana University outpatient dialysis centers. We analyzed patients' data from electronic medical records systems that collated information from multiple health care sources. Previously utilized algorithms or natural language processing was used to extract data on 10 comorbidities for a period of up to 10 years prior to ESRD incidence. These algorithms incorporate billing codes, prescriptions, and other relevant elements. We compared the presence or unchecked status of these comorbidities on the forms to the presence or absence according to the algorithms. FINDINGS: Computer algorithms had higher reporting of comorbidities compared to forms completion by physicians. This remained true when decreasing data span to one year and using only a single health center source. The algorithms determination was well accepted by a physician panel. Importantly, algorithms use significantly increased the expected deaths and lowered the standardized mortality ratios. DISCUSSION: Using computer algorithms showed superior identification of comorbidities for form CMS-2728 and altered standardized mortality ratios. Adapting similar algorithms in available EMR systems may offer more thorough evaluation of comorbidities and improve quality reporting.

Multisite Evaluation of a Data Quality Tool for Patient-Level Clinical Data Sets.

INTRODUCTION: Data quality and fitness for analysis are crucial if outputs of analyses of electronic health record data or administrative claims data should be trusted by the public and the research community. METHODS: We describe a data quality analysis tool (called Achilles Heel) developed by the Observational Health Data Sciences and Informatics Collaborative (OHDSI) and compare outputs from this tool as it was applied to 24 large healthcare datasets across seven different organizations. RESULTS: We highlight 12 data quality rules that identified issues in at least 10 of the 24 datasets and provide a full set of 71 rules identified in at least one dataset. Achilles Heel is a freely available software that provides a useful starter set of data quality rules with the ability to add additional rules. We also present results of a structured email-based interview of all participating sites that collected qualitative comments about the value of Achilles Heel for data quality evaluation. DISCUSSION: Our analysis represents the first comparison of outputs from a data quality tool that implements a fixed (but extensible) set of data quality rules. Thanks to a common data model, we were able to compare quickly multiple datasets originating from several countries in America, Europe and Asia.