Straight to the point: evaluation of a Point of Care Information (POCI) resource in answering disease-related questions.

Objective: To evaluate the ability of DynaMedex, an evidence-based drug and disease Point of Care Information (POCI) resource, in answering clinical queries using keyword searches. Methods: Real-world disease-related questions compiled from clinicians at an academic medical center, DynaMedex search query data, and medical board review resources were categorized into five clinical categories (complications & prognosis, diagnosis & clinical presentation, epidemiology, prevention & screening/monitoring, and treatment) and six specialties (cardiology, endocrinology, hematology-oncology, infectious disease, internal medicine, and neurology). A total of 265 disease-related questions were evaluated by pharmacist reviewers based on if an answer was found (yes, no), whether the answer was relevant (yes, no), difficulty in finding the answer (easy, not easy), cited best evidence available (yes, no), clinical practice guidelines included (yes, no), and level of detail provided (detailed, limited details). Results: An answer was found for 259/265 questions (98%). Both reviewers found an answer for 241 questions (91%), neither found the answer for 6 questions (2%), and only one reviewer found an answer for 18 questions (7%). Both reviewers found a relevant answer 97% of the time when an answer was found. Of all relevant answers found, 68% were easy to find, 97% cited best quality of evidence available, 72% included clinical guidelines, and 95% were detailed. Recommendations for areas of resource improvement were identified. Conclusions: The resource enabled reviewers to answer most questions easily with the best quality of evidence available, providing detailed answers and clinical guidelines, with a high level of replication of results across users.

Patient-centered Pharmacist Care in the Hemodialysis Unit: a quasi-experimental interrupted time series study.

BACKGROUND: Nonadherence to medications by patients requiring hemodialysis (HD) leads to unfavorable clinical outcomes. Limited data exist to demonstrate the effect of incorporating patient-centered interventions using concepts of medication therapy management and motivational interview by pharmacists on pharmacoadherence in patients requiring HD. Therefore, we assessed the impact of patient-centered pharmacist care on pharmacoadherence and its outcomes in patients requiring HD. METHODS: Adult patients who had received outpatient HD for at least 3 months were enrolled. The study was conducted from October 2016 to April 2017. Pharmacists interviewed the patients at month 1, 2, 4 and 6, and the intervention (comprehensive review) occurred at months 3 and 5. The primary outcome was the change in pharmacoadherence as assessed by pre-HD serum phosphate levels and the differences in the number of medications between patient' self-report and medications records at the electronic healthcare records (EHRs). The secondary outcomes included changes in systolic blood pressure (SBP), glycosylated hemoglobin levels, serum low-density lipoprotein (LDL) levels, and the prevalence and types of medication-related problems (MRPs). RESULTS: Seventy-two patients were enrolled. Their median age was 59 (interquartile range: 47-67.5) years, and 53% were men. Pre- and post-intervention pharmacoadherence, as indicated by serum phosphate levels and the differences in the number of medications between patient' self-report and the medication records at the EHRs, did not significantly differ (p = 0.682 and 0.348, respectively). Mean SBP and mean LDL did not significantly change post-intervention. The median number of MRPs declined between Months 3 and 5 (p = 0.002): the prevalence of MRPs at Month 3 was 44.9% (95 confidence interval [CI]: 40.4-49.3) and decreased to 29.8% (95 CI: 25.6-34.3) at Month 5. Drug use without indication was the most frequent MRP (23.9%). CONCLUSIONS: Patient-centered pharmacist care did not result in significant changes in pharmacoadherence. However, its clinical utility as a tool to identify and mitigate MRPs in patients requiring HD is indisputable. TRIAL REGISTRATION: ClinicalTrials.gov identifier: NCT03576404 (retrospectively registered on July 3rd, 2018).

Reduced Effectiveness of Interruptive Drug-Drug Interaction Alerts after Conversion to a Commercial Electronic Health Record.

BACKGROUND: Drug-drug interaction (DDI) alerts in electronic health records (EHRs) can help prevent adverse drug events, but such alerts are frequently overridden, raising concerns about their clinical usefulness and contribution to alert fatigue. OBJECTIVE: To study the effect of conversion to a commercial EHR on DDI alert and acceptance rates. DESIGN: Two before-and-after studies. PARTICIPANTS: 3277 clinicians who received a DDI alert in the outpatient setting. INTERVENTION: Introduction of a new, commercial EHR and subsequent adjustment of DDI alerting criteria. MAIN MEASURES: Alert burden and proportion of alerts accepted. KEY RESULTS: Overall interruptive DDI alert burden increased by a factor of 6 from the legacy EHR to the commercial EHR. The acceptance rate for the most severe alerts fell from 100 to 8.4%, and from 29.3 to 7.5% for medium severity alerts (P < 0.001). After disabling the least severe alerts, total DDI alert burden fell by 50.5%, and acceptance of Tier 1 alerts rose from 9.1 to 12.7% (P < 0.01). CONCLUSIONS: Changing from a highly tailored DDI alerting system to a more general one as part of an EHR conversion decreased acceptance of DDI alerts and increased alert burden on users. The decrease in acceptance rates cannot be fully explained by differences in the clinical knowledge base, nor can it be fully explained by alert fatigue associated with increased alert burden. Instead, workflow factors probably predominate, including timing of alerts in the prescribing process, lack of differentiation of more and less severe alerts, and features of how users interact with alerts.

Prevalence of food allergies and intolerances documented in electronic health records.

BACKGROUND: Food allergy prevalence is reported to be increasing, but epidemiological data using patients' electronic health records (EHRs) remain sparse. OBJECTIVE: We sought to determine the prevalence of food allergy and intolerance documented in the EHR allergy module. METHODS: Using allergy data from a large health care organization's EHR between 2000 and 2013, we determined the prevalence of food allergy and intolerance by sex, racial/ethnic group, and allergen group. We examined the prevalence of reactions that were potentially IgE-mediated and anaphylactic. Data were validated using radioallergosorbent test and ImmunoCAP results, when available, for patients with reported peanut allergy. RESULTS: Among 2.7 million patients, we identified 97,482 patients (3.6%) with 1 or more food allergies or intolerances (mean, 1.4 ± 0.1). The prevalence of food allergy and intolerance was higher in females (4.2% vs 2.9%; P < .001) and Asians (4.3% vs 3.6%; P < .001). The most common food allergen groups were shellfish (0.9%), fruit or vegetable (0.7%), dairy (0.5%), and peanut (0.5%). Of the 103,659 identified reactions to foods, 48.1% were potentially IgE-mediated (affecting 50.8% of food allergy or intolerance patients) and 15.9% were anaphylactic. About 20% of patients with reported peanut allergy had a radioallergosorbent test/ImmunoCAP performed, of which 57.3% had an IgE level of grade 3 or higher. CONCLUSIONS: Our findings are consistent with previously validated methods for studying food allergy, suggesting that the EHR's allergy module has the potential to be used for clinical and epidemiological research. The spectrum of severity observed with food allergy highlights the critical need for more allergy evaluations.

Review of Nonformulary Medication Approvals in an Academic Medical Center.

BACKGROUND: The Joint Commission requires hospitals to formally review formulary medications at least annually based on new clinical information. Although review of nonformulary medication (NFM) use is not required, frequent and inappropriate use of NFMs has the potential to increase hospital costs, negatively affect quality of care, and increase medication errors. Limited resources may restrict an institution's ability to review NFM use in addition to the required annual formulary review. NFM use at Brigham and Women's Hospital (BWH) was reviewed to provide insight on how to best direct an NFM review that is both effective and efficient. How an NFM review may negatively affect cost, quality of care, and medication errors is also inferred. METHODS: All approved NFM requests between 2009 and 2012 from Brigham and Women's Hospital's computerized provider order entry system were extracted and categorized according to the American Hospital Formulary Service (AHFS) Pharmacologic-Therapeutic Classification System. RESULTS: Of the 15,356,016 new medication orders, there were 223,266 NFM approvals for 433 unique NFMs. NFMs were categorized into 91 AHFS, 14 combination, and 4 "Others" classes. Twenty-five AHFS Classes accounted for approximately the top 90% of all NFM approvals, and the top 2 NFMs in each class accounted for a majority of the NFM approvals. CONCLUSION: Only a few classes of medications and a few medications within each class accounted for most of the NFM use at BWH. Targeting review of the most frequently used NFMs in each class may be a feasible strategy to reviewing NFMs annually that is both effective and efficient in optimizing formulary benefits.

Evaluation of Perioperative Medication Errors and Adverse Drug Events.

BACKGROUND: The purpose of this study is to assess the rates of perioperative medication errors (MEs) and adverse drug events (ADEs) as percentages of medication administrations, to evaluate their root causes, and to formulate targeted solutions to prevent them. METHODS: In this prospective observational study, anesthesia-trained study staff (anesthesiologists/nurse anesthetists) observed randomly selected operations at a 1,046-bed tertiary care academic medical center to identify MEs and ADEs over 8 months. Retrospective chart abstraction was performed to flag events that were missed by observation. All events subsequently underwent review by two independent reviewers. Primary outcomes were the incidence of MEs and ADEs. RESULTS: A total of 277 operations were observed with 3,671 medication administrations of which 193 (5.3%; 95% CI, 4.5 to 6.0) involved a ME and/or ADE. Of these, 153 (79.3%) were preventable and 40 (20.7%) were nonpreventable. The events included 153 (79.3%) errors and 91 (47.2%) ADEs. Although 32 (20.9%) of the errors had little potential for harm, 51 (33.3%) led to an observed ADE and an additional 70 (45.8%) had the potential for patient harm. Of the 153 errors, 99 (64.7%) were serious, 51 (33.3%) were significant, and 3 (2.0%) were life-threatening. CONCLUSIONS: One in 20 perioperative medication administrations included an ME and/or ADE. More than one third of the MEs led to observed ADEs, and the remaining two thirds had the potential for harm. These rates are markedly higher than those reported by retrospective surveys. Specific solutions exist that have the potential to decrease the incidence of perioperative MEs.

Understanding physicians' behavior toward alerts about nephrotoxic medications in outpatients: a cross-sectional analysis.

BACKGROUND: Although most outpatients are relatively healthy, many have chronic renal insufficiency, and high override rates for suggestions on renal dosing have been observed. To better understand the override of renal dosing alerts in an outpatient setting, we conducted a study to evaluate which patients were more frequently prescribed contraindicated medications, to assess providers' responses to suggestions, and to examine the drugs involved and the reasons for overrides. METHODS: We obtained data on renal alert overrides and the coded reasons for overrides cited by providers at the time of prescription from outpatient clinics and ambulatory hospital-based practices at a large academic health care center over a period of 3 years, from January 2009 to December 2011. For detailed chart review, a group of 6 trained clinicians developed the appropriateness criteria with excellent inter-rater reliability (κ=0.93). We stratified providers by override frequency and then drew samples from the high- and low-frequency groups. We measured the rate of total overrides, rate of appropriate overrides, medications overridden, and the reason(s) for override. RESULTS: A total of 4120 renal alerts were triggered by 584 prescribers in the study period, among which 78.2% (3,221) were overridden. Almost half of the alerts were triggered by 40 providers and one-third was triggered by high-frequency overriders. The appropriateness rates were fairly similar, at 28.4% and 31.6% for high- and low-frequency overriders, respectively. Metformin, glyburide, hydrochlorothiazide, and nitrofurantoin were the most common drugs overridden. Physicians' appropriateness rates were higher than the rates for nurse practitioners (32.9% vs. 22.1%). Physicians with low frequency override rates had higher levels of appropriateness for metformin than the high frequency overriders (P=0.005). CONCLUSION: A small number of providers accounted for a large fraction of overrides, as was the case with a small number of drugs. These data suggest that a focused intervention targeting primarily these providers and medications has the potential to improve medication safety.

Racial and ethnic associations with interstitial lung disease and healthcare utilization in patients with systemic sclerosis.

Rationale: Racial and ethnic differences in presentation and outcomes have been reported in systemic sclerosis (SSc) and SSc-interstitial lung disease (ILD). However, diverse cohorts and additional modeling can improve understanding of risk features and outcomes, which is important for reducing associated disparities. Objectives: To determine if there are racial/ethnic differences associated with SSc-ILD risk and age; time intervals between SSc and ILD, and with emergency department (ED) visit or hospitalization rates. Methods: A retrospective cohort study using electronic health record data from an integrated health system, over a 5.5 year period was conducted using clinical and sociodemographic variables, models were generated with sequential adjustments for these variables. Logistic regression models were used to examine the association of covariates with ILD and age at SSc-ILD. Healthcare outcomes were analyzed with complementary log-log regression models. Results: The cohort included 756 adults (83.6% female, 80.3% non-Hispanic White) with SSc with a mean age of 59 years. Overall, 33.7% of patients in the cohort had an ILD code, with increased odds for Asian (odds ratio [OR], 2.59; 95% confidence interval [CI], 1.29, 5.18; P =.007) compared to White patients. The age in years of patients with SSc-ILD was younger for Hispanic (mean difference, -6.5; 95% CI, -13, -0.21; P = 0.04) and Black/African American patients (-10; 95% CI -16, -4.9; P <0.001) compared to White patients. Black/African American patients were more likely to have an ILD code before an SSc code (59% compared to 20.6% of White patients), and had the shortest interval from SSc to ILD (3 months). Black/African American (HR, 2.59; 95% CI 1.47, 4.49; P =0.001) and Hispanic patients (HR 2.29; 95% CI 1.37, 3.82; P =0.002) had higher rates of an ED visit. Conclusion: In this study, SSc-ILD presentation and outcomes differed by racial/ethnic group (increased odds of SSc-ILD, younger age at SSc-ILD, and preceding diagnosis with respect to SSc, rates of ED visit), some of which was attenuated with adjustment for clinical and sociodemographic characteristics. Differing presentation may be driven by social drivers of health (SDOH), autoantibody profiles, or other key unmeasured factors contributing to susceptibility and severity.

Return on investment for vendor computerized physician order entry in four community hospitals: the importance of decision support.

BACKGROUND: In-hospital adverse events are a major cause of morbidity and mortality and represent a major cost burden to health care systems. A study was conducted to evaluate the return on investment (ROI) for the adoption of vendor-developed computerized physician oder entry (CPOE) systems in four community hospitals in Massachusetts. METHODS: Of the four hospitals, two were under one management structure and implemented the same vendor-developed CPOE system (Hospital Group A), while the other two were under a second management structure and implemented another vendor-developed CPOE system (Hospital Group B). Cost savings were calculated on the basis of reduction in preventable adverse drug event (ADE) rates as measured previously. ROI, net cash flow, and the breakeven point during a 10-year cost-and-benefit model were calculated. At the time of the study, none of the participating hospitals had implemented more than a rudimentary decision support system together with CPOE. RESULTS: Implementation costs were lower for Hospital Group A than B ($7,130,894 total or $83/admission versus $19,293,379 total or $113/admission, respectively), as were preventable ADE-related avoided costs ($7,937,651 and $16,557,056, respectively). A cost-benefit analysis demonstrated that Hospital Group A had an ROI of 11.3%, breaking even on the investment eight years following implementation. Hospital Group B showed a negative return, with an ROI of -3.1%. CONCLUSIONS: Adoption of vendor CPOE systems in community hospitals was associated with a modest ROI at best when applying cost savings attributable to prevention of ADEs only. The modest financial returns can beattributed to the lack of clinical decision support tools.

Development and validation of algorithms to build an electronic health record based cohort of patients with systemic sclerosis.

OBJECTIVES: To evaluate methods of identifying patients with systemic sclerosis (SSc) using International Classification of Diseases, Tenth Revision (ICD-10) codes (M34*), electronic health record (EHR) databases and organ involvement keywords, that result in a validated cohort comprised of true cases with high disease burden. METHODS: We retrospectively studied patients in a healthcare system likely to have SSc. Using structured EHR data from January 2016 to June 2021, we identified 955 adult patients with M34* documented 2 or more times during the study period. A random subset of 100 patients was selected to validate the ICD-10 code for its positive predictive value (PPV). The dataset was then divided into a training and validation sets for unstructured text processing (UTP) search algorithms, two of which were created using keywords for Raynaud's syndrome, and esophageal involvement/symptoms. RESULTS: Among 955 patients, the average age was 60. Most patients (84%) were female; 75% of patients were White, and 5.2% were Black. There were approximately 175 patients per year with the code newly documented, overall 24% had an ICD-10 code for esophageal disease, and 13.4% for pulmonary hypertension. The baseline PPV was 78%, which improved to 84% with UTP, identifying 788 patients likely to have SSc. After the ICD-10 code was placed, 63% of patients had a rheumatology office visit. Patients identified by the UTP search algorithm were more likely to have increased healthcare utilization (ICD-10 codes 4 or more times 84.1% vs 61.7%, p < .001), organ involvement (pulmonary hypertension 12.7% vs 6% p = .011) and medication use (mycophenolate use 28.7% vs 11.4%, p < .001) than those identified by the ICD codes alone. CONCLUSION: EHRs can be used to identify patients with SSc. Using unstructured text processing keyword searches for SSc clinical manifestations improved the PPV of ICD-10 codes alone and identified a group of patients most likely to have SSc and increased healthcare needs.

How Safe are Outpatient Electronic Health Records? An Evaluation of Medication-Related Decision Support using the Ambulatory Electronic Health Record Evaluation Tool.

BACKGROUND: The purpose of the Ambulatory Electronic Health Record (EHR) Evaluation Tool is to provide outpatient clinics with an assessment that they can use to measure the ability of the EHR system to detect and prevent common prescriber errors. The tool consists of a medication safety test and a medication reconciliation module. OBJECTIVES: The goal of this study was to perform a broad evaluation of outpatient medication-related decision support using the Ambulatory EHR Evaluation Tool. METHODS: We performed a cross-sectional study with 10 outpatient clinics using the Ambulatory EHR Evaluation Tool. For the medication safety test, clinics were provided test patients and associated medication test orders to enter in their EHR, where they recorded any advice or information they received. Once finished, clinics received an overall percentage score of unsafe orders detected and individual order category scores. For the medication reconciliation module, clinics were asked to electronically reconcile two medication lists, where modifications were made by adding and removing medications and changing the dosage of select medications. RESULTS: For the medication safety test, the mean overall score was 57%, with the highest score being 70%, and the lowest score being 40%. Clinics performed well in the drug allergy (100%), drug dose daily (85%), and inappropriate medication combinations (74%) order categories. Order categories with the lowest performance were drug laboratory (10%) and drug monitoring (3%). Most clinics (90%) scored a 0% in at least one order category. For the medication reconciliation module, only one clinic (10%) could reconcile medication lists electronically; however, there was no clinical decision support available that checked for drug interactions. CONCLUSION: We evaluated a sample of ambulatory practices around their medication-related decision support and found that advanced capabilities within these systems have yet to be widely implemented. The tool was practical to use and identified substantial opportunities for improvement in outpatient medication safety.

Dynamic reaction picklist for improving allergy reaction documentation: A usability study.

OBJECTIVE: To assess novel dynamic reaction picklists for improving allergy reaction documentation compared to a static reaction picklist. MATERIALS AND METHODS: We developed three web-based user interfaces (UIs) mimicking the Mass General Brigham's EHR allergy module: the first and second UIs (i.e., UI-1D, UI-2D) implemented two dynamic reaction picklists with different ranking algorithms and the third UI (UI-3S) implemented a static reaction picklist like the one used in the current EHR. We recruited 18 clinicians to perform allergy entry for 10 test cases each via UI-1D and UI-3S, and another 18 clinicians via UI-2D and UI-3S. Primary measures were the number of free-text entries and time to complete the allergy entry. Clinicians were also interviewed using 30 questions before and after the data entry. RESULTS AND DISCUSSIONS: Among 36 clinicians, less than half were satisfied with the current EHR reaction picklists, due to their incomprehensiveness, inefficiency, and lack of intuitiveness. The clinicians used significantly fewer free-text entries when using UI-1D or UI-2D compared to UI-3S (p < 0.05). The clinicians used on average 51 s (15 %) less time via UI-1D and 50 s (16 %) less time via UI-2D in completing the allergy entries versus UI-3S, and there was not a statistically significant difference in documentation time for either group between the dynamic and static UIs. Overall, 15-17 (83-94 %) clinicians rated UI-1D and 13-15 (72-83 %) clinicians rated UI-2D as efficient, easy to use, and useful, while less than half rated the same for UI-3S. Most clinicians reported that the dynamic reaction picklists always or often suggested appropriate reactions (n = 30, 83 %) and would decrease the free-text entries (n = 26, 72 %); nearly all preferred the dynamic picklist over the static picklist (n = 32, 89 %). CONCLUSION: We found that dynamic reaction picklists significantly reduced the number of free-text entries and could reduce the time for allergy documentation by 15%. Clinicians preferred the dynamic reaction picklist over the static picklist.

Performance of a Web-Based Reference Database With Natural Language Searching Capabilities: Usability Evaluation of DynaMed and Micromedex With Watson.

BACKGROUND: Evidence-based point-of-care information (POCI) tools can facilitate patient safety and care by helping clinicians to answer disease state and drug information questions in less time and with less effort. However, these tools may also be visually challenging to navigate or lack the comprehensiveness needed to sufficiently address a medical issue. OBJECTIVE: This study aimed to collect clinicians' feedback and directly observe their use of the combined POCI tool DynaMed and Micromedex with Watson, now known as DynaMedex. EBSCO partnered with IBM Watson Health, now known as Merative, to develop the combined tool as a resource for clinicians. We aimed to identify areas for refinement based on participant feedback and examine participant perceptions to inform further development. METHODS: Participants (N=43) within varying clinical roles and specialties were recruited from Brigham and Women's Hospital and Massachusetts General Hospital in Boston, Massachusetts, United States, between August 10, 2021, and December 16, 2021, to take part in usability sessions aimed at evaluating the efficiency and effectiveness of, as well as satisfaction with, the DynaMed and Micromedex with Watson tool. Usability testing methods, including think aloud and observations of user behavior, were used to identify challenges regarding the combined tool. Data collection included measurements of time on task; task ease; satisfaction with the answer; posttest feedback on likes, dislikes, and perceived reliability of the tool; and interest in recommending the tool to a colleague. RESULTS: On a 7-point Likert scale, pharmacists rated ease (mean 5.98, SD 1.38) and satisfaction (mean 6.31, SD 1.34) with the combined POCI tool higher than the physicians, nurse practitioner, and physician's assistants (ease: mean 5.57, SD 1.64, and satisfaction: mean 5.82, SD 1.60). Pharmacists spent longer (mean 2 minutes, 26 seconds, SD 1 minute, 41 seconds) on average finding an answer to their question than the physicians, nurse practitioner, and physician's assistants (mean 1 minute, 40 seconds, SD 1 minute, 23 seconds). CONCLUSIONS: Overall, the tool performed well, but this usability evaluation identified multiple opportunities for improvement that would help inexperienced users.

Correction: Performance of a Web-Based Reference Database With Natural Language Searching Capabilities: Usability Evaluation of DynaMed and Micromedex With Watson.

[This corrects the article DOI: 10.2196/43960.].

Impact of vendor computerized physician order entry in community hospitals.

BACKGROUND: It is uncertain if computerized physician order entry (CPOE) systems are effective at reducing adverse drug event (ADE) rates in community hospitals, where mainly vendor-developed applications are used. OBJECTIVE: To evaluate the impact of vendor CPOE systems on the frequency of ADEs. DESIGN AND PATIENTS: Prospective before-and-after study conducted from January 2005 to September 2010 at five Massachusetts community hospitals. Participants were adults admitted during the study period. A total of 2,000 charts were reviewed for orders, medication lists, laboratory reports, admission histories, notes, discharge summaries, and flow sheets. MAIN MEASURES: The primary outcome measure was the rate of preventable ADEs. Rates of potential ADEs and overall ADEs were secondary outcomes. KEY RESULTS: The rate of preventable ADEs decreased following implementation (10.6/100 vs. 7.0/100 admissions; p = 0.007) with a similar effect observed at each site. However, the associated decrease in preventable ADEs was balanced against an increase in potential ADEs (44.4/100 vs. 57.5/100 admissions; p < 0.001). We observed a reduction of 34.0% for preventable ADEs, but an increase of 29.5% in potential ADEs following implementation. The overall rate of ADEs increased (14.6/100 vs. 18.7/100 admissions; p = 0.03), which was driven by non-preventable events (4.0/100 vs. 11.7/100 admissions; p < 0.001). CONCLUSIONS: Adoption of vendor CPOE systems was associated with a decrease in the preventable ADE rate by a third, although the rates of potential ADEs and overall ADEs increased. Our findings support the use of vendor CPOE systems as a means to reduce drug-related injury and harm. The potential ADE rate could be reduced by making refinements to the vendor applications and their associated decision support.

The costs of adverse drug events in community hospitals.

BACKGROUND: Adverse drug events (ADEs) occur often in hospitals, causing high morbidity and a longer length of stay (LOS), and are costly. However, most studies on the impact of ADEs have been conducted in tertiary referral centers, which are systematically different than community hospitals, where the bulk of care is delivered, and most available data about ADE costs in any setting are dated. Costs in community settings are generally lower than in academic hospitals, and the costs of ADEs might be as well. To assess the additional costs and LOS associated with patients with ADEs, a multicenter retrospective cohort study was conducted in six community hospitals with 100 to 300 beds in Massachusetts during a 20-month observation period (January 2005-August 2006). METHODS: A random sample of 2,100 patients (350 patients per study site) was drawn from a pool of 109,641 patients treated within the 20-month observation period. Unadjusted and adjusted cost of ADEs as well as LOS were calculated. RESULTS: ADEs were associated with an increased adjusted cost of $3,420 and an adjusted increase in length of stay (LOS) of 3.15 days. For preventable ADEs, the respective figures were +$3,511 and +3.37 days. The severity of the ADE was also associated with higher costs--the costs were +$2,852 for significant ADEs (LOS +2.77 days), +$3,650 for serious ADEs (LOS +3.47 days), and +$8,116 for life-threatening ADEs (LOS +5.54 days, all p < .001). CONCLUSIONS: ADEs in community hospitals cost more than $3,000 dollars on average and an average increase of LOS of 3.1 days--increments that were similar to previous estimates from academic institutions. The LOS increase was actually greater. A number of approaches, including computerized provider order entry and bar coding, have the potential to improve medication safety.

Reconciling Allergy Information in the Electronic Health Record After a Drug Challenge Using Natural Language Processing.

Background: Drug challenge tests serve to evaluate whether a patient is allergic to a medication. However, the allergy list in the electronic health record (EHR) is not consistently updated to reflect the results of the challenge, affecting clinicians' prescription decisions and contributing to inaccurate allergy labels, inappropriate drug-allergy alerts, and potentially ineffective, more toxic, and/or costly care. In this study, we used natural language processing (NLP) to automatically detect discrepancies between the EHR allergy list and drug challenge test results and to inform the clinical recommendations provided in a real-time allergy reconciliation module. Methods: This study included patients who received drug challenge tests at the Mass General Brigham (MGB) Healthcare System between June 9, 2015 and January 5, 2022. At MGB, drug challenge tests are performed in allergy/immunology encounters with routine clinical documentation in notes and flowsheets. We developed a rule-based NLP tool to analyze and interpret the challenge test results. We compared these results against EHR allergy lists to detect potential discrepancies in allergy documentation and form a recommendation for reconciliation if a discrepancy was identified. To evaluate the capability of our tool in identifying discrepancies, we calculated the percentage of challenge test results that were not updated and the precision of the NLP algorithm for 200 randomly sampled encounters. Results: Among 200 samples from 5,312 drug challenge tests, 59% challenged penicillin reactivity and 99% were negative. 42.0%, 61.5%, and 76.0% of the results were confirmed by flowsheets, NLP, or both, respectively. The precision of the NLP algorithm was 96.1%. Seven percent of patient allergy lists were not updated based on drug challenge test results. Flowsheets alone were used to identify 2.0% of these discrepancies, and NLP alone detected 5.0% of these discrepancies. Because challenge test results can be recorded in both flowsheets and clinical notes, the combined use of NLP and flowsheets can reliably detect 5.5% of discrepancies. Conclusion: This NLP-based tool may be able to advance global delabeling efforts and the effectiveness of drug allergy assessments. In the real-time EHR environment, it can be used to examine patient allergy lists and identify drug allergy label discrepancies, mitigating patient risks.

Identifying and Reconciling Patients' Allergy Information Within the Electronic Health Record.

Allergy information is often documented in diverse sections of the electronic health record (EHR). Systematically reconciling allergy information across the EHR is critical to improve the accuracy and completeness of patients' allergy lists and ensure patient safety. In this retrospective cohort study, we examined the prevalence of incompleteness, inaccuracy, and redundancy of allergy information for patients with a clinical encounter at any Mass General Brigham facility between January 1, 2018 and December 31, 2018. We identified 4 key places in the EHR containing reconcilable allergy information: 1) allergy modules (including free text comments and duplicate allergen entries), 2) medication laboratory tests results, 3) oral medication allergy challenge tests, and 4) medication orders that have been discontinued due to adverse drug reactions (ADRs). Within our cohort, 718,315 (45.2% of the total 1,588,979) patients had an active allergy entry; of which, 266,275 (37.1%) patient's records indicated a need for reconciliation.

Heterogeneity of Drug Allergies and Reaction Lists in Two U.S. Health Care Systems' Electronic Health Records.

BACKGROUND: Health care institutions have their own "picklist" for clinicians to document adverse drug reactions (ADRs) into the electronic health record (EHR) allergy list. Whether the lack of a nationally standardized picklist impacts clinician data entries is unknown. OBJECTIVES: The objective of this study was to assess the impact of defined reaction picklists on clinical documentation and, therefore, downstream analytics and clinical research using these data at two institutions. METHODS: ADR data were obtained from the EHRs of patients who visited the emergency department or outpatient clinics at Brigham and Women's Hospital (BWH) and University of Colorado Hospital (UCH) from 2013 to 2018. Reported drug class ADR prevalences were calculated. We investigated the reactions on each picklist and compared the top 40 reactions at each institution, as well as the top 10 reactions within each drug class. RESULTS: Of 2,160,116 patients, 640,444 (30%) had 928,973 active drug allergies. The most commonly reported drug class allergens were similar between BWH and UCH. BWH's picklist had 48 reactions, and UCH's had 160 reactions; 29 reactions were shared by both picklists. While the top four reactions overall (rash, GI upset/nausea/vomiting, hives, itching) were identical between sites, reactions by drug class exhibited greater documentation diversity. For example, while the summed prevalence of swelling-related reactions to angiotensin-converting-enzyme inhibitors was comparable across sites, swelling was represented by two terms ("swelling," "angioedema") at BWH but 11 terms at UCH (e.g., "swelling," "edema," by body locality). CONCLUSION: The availability and granularity of reaction picklists impact ADR documentation in the EHR by health care providers; picklists may partially explain variations in reported ADRs across health care systems.

Key use cases for artificial intelligence to reduce the frequency of adverse drug events: a scoping review.

Adverse drug events (ADEs) represent one of the most prevalent types of health-care-related harm, and there is substantial room for improvement in the way that they are currently predicted and detected. We conducted a scoping review to identify key use cases in which artificial intelligence (AI) could be leveraged to reduce the frequency of ADEs. We focused on modern machine learning techniques and natural language processing. 78 articles were included in the scoping review. Studies were heterogeneous and applied various AI techniques covering a wide range of medications and ADEs. We identified several key use cases in which AI could contribute to reducing the frequency and consequences of ADEs, through prediction to prevent ADEs and early detection to mitigate the effects. Most studies (73 [94%] of 78) assessed technical algorithm performance, and few studies evaluated the use of AI in clinical settings. Most articles (58 [74%] of 78) were published within the past 5 years, highlighting an emerging area of study. Availability of new types of data, such as genetic information, and access to unstructured clinical notes might further advance the field.