RESUMO
Importance: The Sentinel System is a key component of the US Food and Drug Administration (FDA) postmarketing safety surveillance commitment and uses clinical health care data to conduct analyses to inform drug labeling and safety communications, FDA advisory committee meetings, and other regulatory decisions. However, observational data are frequently deemed insufficient for reliable evaluation of safety concerns owing to limitations in underlying data or methodology. Advances in large language models (LLMs) provide new opportunities to address some of these limitations. However, careful consideration is necessary for how and where LLMs can be effectively deployed for these purposes. Observations: LLMs may provide new avenues to support signal-identification activities to identify novel adverse event signals from narrative text of electronic health records. These algorithms may be used to support epidemiologic investigations examining the causal relationship between exposure to a medical product and an adverse event through development of probabilistic phenotyping of health outcomes of interest and extraction of information related to important confounding factors. LLMs may perform like traditional natural language processing tools by annotating text with controlled vocabularies with additional tailored training activities. LLMs offer opportunities for enhancing information extraction from adverse event reports, medical literature, and other biomedical knowledge sources. There are several challenges that must be considered when leveraging LLMs for postmarket surveillance. Prompt engineering is needed to ensure that LLM-extracted associations are accurate and specific. LLMs require extensive infrastructure to use, which many health care systems lack, and this can impact diversity, equity, and inclusion, and result in obscuring significant adverse event patterns in some populations. LLMs are known to generate nonfactual statements, which could lead to false positive signals and downstream evaluation activities by the FDA and other entities, incurring substantial cost. Conclusions and Relevance: LLMs represent a novel paradigm that may facilitate generation of information to support medical product postmarket surveillance activities that have not been possible. However, additional work is required to ensure LLMs can be used in a fair and equitable manner, minimize false positive findings, and support the necessary rigor of signal detection needed for regulatory activities.
Assuntos
Processamento de Linguagem Natural , Vigilância de Produtos Comercializados , United States Food and Drug Administration , Vigilância de Produtos Comercializados/métodos , Humanos , Estados Unidos , Registros Eletrônicos de SaúdeRESUMO
BACKGROUND: Despite efforts to enhance the quality of medication prescribing in outpatient settings, potentially inappropriate prescribing remains common, particularly in unscheduled settings where patients can present with infectious and pain-related complaints. Two of the most commonly prescribed medication classes in outpatient settings with frequent rates of potentially inappropriate prescribing include antibiotics and nonsteroidal anti-inflammatory drugs (NSAIDs). In the setting of persistent inappropriate prescribing, we sought to understand a diverse set of perspectives on the determinants of inappropriate prescribing of antibiotics and NSAIDs in the Veterans Health Administration. METHODS: We conducted a qualitative study guided by the Consolidated Framework for Implementation Research and Theory of Planned Behavior. Semi-structured interviews were conducted with clinicians, stakeholders, and Veterans from March 1, 2021 through December 31, 2021 within the Veteran Affairs Health System in unscheduled outpatient settings at the Tennessee Valley Healthcare System. Stakeholders included clinical operations leadership and methodological experts. Audio-recorded interviews were transcribed and de-identified. Data coding and analysis were conducted by experienced qualitative methodologists adhering to the Consolidated Criteria for Reporting Qualitative Studies guidelines. Analysis was conducted using an iterative inductive/deductive process. RESULTS: We conducted semi-structured interviews with 66 participants: clinicians (N = 25), stakeholders (N = 24), and Veterans (N = 17). We identified six themes contributing to potentially inappropriate prescribing of antibiotics and NSAIDs: 1) Perceived versus actual Veterans expectations about prescribing; 2) the influence of a time-pressured clinical environment on prescribing stewardship; 3) Limited clinician knowledge, awareness, and willingness to use evidence-based care; 4) Prescriber uncertainties about the Veteran condition at the time of the clinical encounter; 5) Limited communication; and 6) Technology barriers of the electronic health record and patient portal. CONCLUSIONS: The diverse perspectives on prescribing underscore the need for interventions that recognize the detrimental impact of high workload on prescribing stewardship and the need to design interventions with the end-user in mind. This study revealed actionable themes that could be addressed to improve guideline concordant prescribing to enhance the quality of prescribing and to reduce patient harm.
Assuntos
Antibacterianos , Anti-Inflamatórios não Esteroides , Prescrição Inadequada , Padrões de Prática Médica , Pesquisa Qualitativa , United States Department of Veterans Affairs , Humanos , Anti-Inflamatórios não Esteroides/uso terapêutico , Estados Unidos , Antibacterianos/uso terapêutico , Prescrição Inadequada/estatística & dados numéricos , Prescrição Inadequada/prevenção & controle , Padrões de Prática Médica/estatística & dados numéricos , Masculino , Feminino , Entrevistas como Assunto , Pessoa de Meia-Idade , Pacientes Ambulatoriais , TennesseeRESUMO
INTRODUCTION: Acute kidney injury (AKI) is associated with increased risk of heart failure (HF). Determining the type of HF experienced by AKI survivors (heart failure with preserved or reduced ejection fraction, HFpEF or HFrEF) could suggest potential mechanisms underlying the association and opportunities for improving post-AKI care. METHODS: In this retrospective study of adults within the Vanderbilt University health system with a diagnosis of HF, we tested whether AKI events in the two years preceding incident HF associated more with HFpEF or HFrEF while controlling for known predictors. HF outcomes were defined by administrative codes and classified as HFpEF or HFrEF by echocardiogram data. We used multivariable logistic regression models to estimate the effects of AKI on the odds of incident HFpEF versus HFrEF. RESULTS: AKI (all stages) trended towards a preferential association with HFpEF in adjusted analyses (adjusted OR 0.80, 95% CI 0.63 - 1.01). Stage 1 AKI was associated with higher odds of HFpEF that was statistically significant (adjusted OR 0.62, 95% CI 0.43 - 0.88), whereas stages 2-3 AKI showed a trend toward HFrEF that did not reach statistical significance (adjusted OR 1.11, 95% CI 0.76 - 1.63). CONCLUSIONS: AKI as a binary outcome trended towards a preferential association with HFpEF. Stage 1 AKI was associated with higher odds of HFpEF, whereas stage 2-3 trended towards an association with HFrEF that did not meet statistical significance. Different mechanisms may predominate in incident HF following mild versus more severe AKI. Close follow-up with particular attention to volume status and cardiac function after discharge is warranted after even mild AKI.
Assuntos
Injúria Renal Aguda , Insuficiência Cardíaca , Volume Sistólico , Humanos , Injúria Renal Aguda/epidemiologia , Injúria Renal Aguda/etiologia , Insuficiência Cardíaca/etiologia , Insuficiência Cardíaca/epidemiologia , Masculino , Feminino , Estudos Retrospectivos , Idoso , Pessoa de Meia-IdadeRESUMO
Acute kidney injury (AKI) is a common and devastating complication of hospitalization. Here, we identified genetic loci associated with AKI in patients hospitalized between 2002-2019 in the Million Veteran Program and data from Vanderbilt University Medical Center's BioVU. AKI was defined as meeting a modified KDIGO Stage 1 or more for two or more consecutive days or kidney replacement therapy. Control individuals were required to have one or more qualifying hospitalizations without AKI and no evidence of AKI during any other observed hospitalizations. Genome-wide association studies (GWAS), stratified by race, adjusting for sex, age, baseline estimated glomerular filtration rate (eGFR), and the top ten principal components of ancestry were conducted. Results were meta-analyzed using fixed effects models. In total, there were 54,488 patients with AKI and 138,051 non-AKI individuals included in the study. Two novel loci reached genome-wide significance in the meta-analysis: rs11642015 near the FTO locus on chromosome 16 (obesity traits) (odds ratio 1.07 (95% confidence interval, 1.05-1.09)) and rs4859682 near the SHROOM3 locus on chromosome 4 (glomerular filtration barrier integrity) (odds ratio 0.95 (95% confidence interval, 0.93-0.96)). These loci colocalized with previous studies of kidney function, and genetic correlation indicated significant shared genetic architecture between AKI and eGFR. Notably, the association at the FTO locus was attenuated after adjustment for BMI and diabetes, suggesting that this association may be partially driven by obesity. Both FTO and the SHROOM3 loci showed nominal evidence of replication from diagnostic-code-based summary statistics from UK Biobank, FinnGen, and Biobank Japan. Thus, our large GWA meta-analysis found two loci significantly associated with AKI suggesting genetics may explain some risk for AKI.
Assuntos
Injúria Renal Aguda , Estudo de Associação Genômica Ampla , Taxa de Filtração Glomerular , Hospitalização , Polimorfismo de Nucleotídeo Único , Humanos , Injúria Renal Aguda/genética , Injúria Renal Aguda/epidemiologia , Masculino , Feminino , Pessoa de Meia-Idade , Idoso , Taxa de Filtração Glomerular/genética , Hospitalização/estatística & dados numéricos , Predisposição Genética para Doença , Dioxigenase FTO Dependente de alfa-Cetoglutarato/genética , Fatores de Risco , Loci Gênicos , Estudos de Casos e ControlesRESUMO
Objective: Assigning outcome labels to large observational data sets in a timely and accurate manner, particularly when outcomes are rare or not directly ascertainable, remains a significant challenge within biomedical informatics. We examined whether noisy labels generated from subject matter experts' heuristics using heterogenous data types within a data programming paradigm could provide outcomes labels to a large, observational data set. We chose the clinical condition of opioid-induced respiratory depression for our use case because it is rare, has no administrative codes to easily identify the condition, and typically requires at least some unstructured text to ascertain its presence. Materials and methods: Using de-identified electronic health records of 52,861 post-operative encounters, we applied a data programming paradigm (implemented in the Snorkel software) for the development of a machine learning classifier for opioid-induced respiratory depression. Our approach included subject matter experts creating 14 labeling functions that served as noisy labels for developing a probabilistic Generative model. We used probabilistic labels from the Generative model as outcome labels for training a Discriminative model on the source data. We evaluated performance of the Discriminative model with a hold-out test set of 599 independently-reviewed patient records. Results: The final Discriminative classification model achieved an accuracy of 0.977, an F1 score of 0.417, a sensitivity of 1.0, and an AUC of 0.988 in the hold-out test set with a prevalence of 0.83% (5/599). Discussion: All of the confirmed Cases were identified by the classifier. For rare outcomes, this finding is encouraging because it reduces the number of manual reviews needed by excluding visits/patients with low probabilities. Conclusion: Application of a data programming paradigm with expert-informed labeling functions might have utility for phenotyping clinical phenomena that are not easily ascertainable from highly-structured data.
RESUMO
PURPOSE: To characterize the incidence of kidney failure associated with intravitreal anti-VEGF exposure; and compare the risk of kidney failure in patients treated with ranibizumab, aflibercept, or bevacizumab. DESIGN: Retrospective cohort study across 12 databases in the Observational Health Data Sciences and Informatics (OHDSI) network. SUBJECTS: Subjects aged ≥ 18 years with ≥ 3 monthly intravitreal anti-VEGF medications for a blinding disease (diabetic retinopathy, diabetic macular edema, exudative age-related macular degeneration, or retinal vein occlusion). METHODS: The standardized incidence proportions and rates of kidney failure while on treatment with anti-VEGF were calculated. For each comparison (e.g., aflibercept versus ranibizumab), patients from each group were matched 1:1 using propensity scores. Cox proportional hazards models were used to estimate the risk of kidney failure while on treatment. A random effects meta-analysis was performed to combine each database's hazard ratio (HR) estimate into a single network-wide estimate. MAIN OUTCOME MEASURES: Incidence of kidney failure while on anti-VEGF treatment, and time from cohort entry to kidney failure. RESULTS: Of the 6.1 million patients with blinding diseases, 37 189 who received ranibizumab, 39 447 aflibercept, and 163 611 bevacizumab were included; the total treatment exposure time was 161 724 person-years. The average standardized incidence proportion of kidney failure was 678 per 100 000 persons (range, 0-2389), and incidence rate 742 per 100 000 person-years (range, 0-2661). The meta-analysis HR of kidney failure comparing aflibercept with ranibizumab was 1.01 (95% confidence interval [CI], 0.70-1.47; P = 0.45), ranibizumab with bevacizumab 0.95 (95% CI, 0.68-1.32; P = 0.62), and aflibercept with bevacizumab 0.95 (95% CI, 0.65-1.39; P = 0.60). CONCLUSIONS: There was no substantially different relative risk of kidney failure between those who received ranibizumab, bevacizumab, or aflibercept. Practicing ophthalmologists and nephrologists should be aware of the risk of kidney failure among patients receiving intravitreal anti-VEGF medications and that there is little empirical evidence to preferentially choose among the specific intravitreal anti-VEGF agents. FINANCIAL DISCLOSURES: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Assuntos
Inibidores da Angiogênese , Bevacizumab , Injeções Intravítreas , Ranibizumab , Receptores de Fatores de Crescimento do Endotélio Vascular , Proteínas Recombinantes de Fusão , Insuficiência Renal , Fator A de Crescimento do Endotélio Vascular , Humanos , Receptores de Fatores de Crescimento do Endotélio Vascular/administração & dosagem , Proteínas Recombinantes de Fusão/administração & dosagem , Proteínas Recombinantes de Fusão/efeitos adversos , Ranibizumab/administração & dosagem , Ranibizumab/efeitos adversos , Bevacizumab/administração & dosagem , Bevacizumab/efeitos adversos , Inibidores da Angiogênese/administração & dosagem , Inibidores da Angiogênese/efeitos adversos , Estudos Retrospectivos , Masculino , Feminino , Insuficiência Renal/epidemiologia , Insuficiência Renal/complicações , Insuficiência Renal/induzido quimicamente , Incidência , Idoso , Pessoa de Meia-Idade , Fator A de Crescimento do Endotélio Vascular/antagonistas & inibidores , Retinopatia Diabética/tratamento farmacológico , Retinopatia Diabética/epidemiologia , Retinopatia Diabética/diagnóstico , Retinopatia Diabética/complicações , Seguimentos , Fatores de Risco , Edema Macular/tratamento farmacológico , Edema Macular/epidemiologia , Edema Macular/diagnóstico , Oclusão da Veia Retiniana/tratamento farmacológico , Oclusão da Veia Retiniana/diagnóstico , Oclusão da Veia Retiniana/complicações , Oclusão da Veia Retiniana/epidemiologia , Cegueira/epidemiologia , Cegueira/induzido quimicamente , Cegueira/prevenção & controle , Cegueira/diagnóstico , Cegueira/etiologiaRESUMO
Objective: Assigning outcome labels to large observational data sets in a timely and accurate manner, particularly when outcomes are rare or not directly ascertainable, remains a significant challenge within biomedical informatics. We examined whether noisy labels generated from subject matter experts' heuristics using heterogenous data types within a data programming paradigm could provide outcomes labels to a large, observational data set. We chose the clinical condition of opioid-induced respiratory depression for our use case because it is rare, has no administrative codes to easily identify the condition, and typically requires at least some unstructured text to ascertain its presence. Materials and Methods: Using de-identified electronic health records of 52,861 post-operative encounters, we applied a data programming paradigm (implemented in the Snorkel software) for the development of a machine learning classifier for opioid-induced respiratory depression. Our approach included subject matter experts creating 14 labeling functions that served as noisy labels for developing a probabilistic Generative model. We used probabilistic labels from the Generative model as outcome labels for training a Discriminative model on the source data. We evaluated performance of the Discriminative model with a hold-out test set of 599 independently-reviewed patient records. Results: The final Discriminative classification model achieved an accuracy of 0.977, an F1 score of 0.417, a sensitivity of 1.0, and an AUC of 0.988 in the hold-out test set with a prevalence of 0.83% (5/599). Discussion: All of the confirmed Cases were identified by the classifier. For rare outcomes, this finding is encouraging because it reduces the number of manual reviews needed by excluding visits/patients with low probabilities. Conclusion: Application of a data programming paradigm with expert-informed labeling functions might have utility for phenotyping clinical phenomena that are not easily ascertainable from highly-structured data.
RESUMO
BACKGROUND: As the enthusiasm for integrating artificial intelligence (AI) into clinical care grows, so has our understanding of the challenges associated with deploying impactful and sustainable clinical AI models. Complex dataset shifts resulting from evolving clinical environments strain the longevity of AI models as predictive accuracy and associated utility deteriorate over time. OBJECTIVE: Responsible practice thus necessitates the lifecycle of AI models be extended to include ongoing monitoring and maintenance strategies within health system algorithmovigilance programs. We describe a framework encompassing a 360° continuum of preventive, preemptive, responsive, and reactive approaches to address model monitoring and maintenance from critically different angles. DISCUSSION: We describe the complementary advantages and limitations of these four approaches and highlight the importance of such a coordinated strategy to help ensure the promise of clinical AI is not short-lived.
Assuntos
Inteligência Artificial , EmoçõesRESUMO
Background: SGLT2 inhibitors (SGLT2is) and GLP-1 receptor agonists (GLP1-RAs) reduce major adverse cardiovascular events (MACE) in patients with type 2 diabetes mellitus (T2DM). However, their effectiveness relative to each other and other second-line antihyperglycemic agents is unknown, without any major ongoing head-to-head trials. Methods: Across the LEGEND-T2DM network, we included ten federated international data sources, spanning 1992-2021. We identified 1,492,855 patients with T2DM and established cardiovascular disease (CVD) on metformin monotherapy who initiated one of four second-line agents (SGLT2is, GLP1-RAs, dipeptidyl peptidase 4 inhibitor [DPP4is], sulfonylureas [SUs]). We used large-scale propensity score models to conduct an active comparator, target trial emulation for pairwise comparisons. After evaluating empirical equipoise and population generalizability, we fit on-treatment Cox proportional hazard models for 3-point MACE (myocardial infarction, stroke, death) and 4-point MACE (3-point MACE + heart failure hospitalization) risk, and combined hazard ratio (HR) estimates in a random-effects meta-analysis. Findings: Across cohorts, 16·4%, 8·3%, 27·7%, and 47·6% of individuals with T2DM initiated SGLT2is, GLP1-RAs, DPP4is, and SUs, respectively. Over 5·2 million patient-years of follow-up and 489 million patient-days of time at-risk, there were 25,982 3-point MACE and 41,447 4-point MACE events. SGLT2is and GLP1-RAs were associated with a lower risk for 3-point MACE compared with DPP4is (HR 0·89 [95% CI, 0·79-1·00] and 0·83 [0·70-0·98]), and SUs (HR 0·76 [0·65-0·89] and 0·71 [0·59-0·86]). DPP4is were associated with a lower 3-point MACE risk versus SUs (HR 0·87 [0·79-0·95]). The pattern was consistent for 4-point MACE for the comparisons above. There were no significant differences between SGLT2is and GLP1-RAs for 3-point or 4-point MACE (HR 1·06 [0·96-1·17] and 1·05 [0·97-1·13]). Interpretation: In patients with T2DM and established CVD, we found comparable cardiovascular risk reduction with SGLT2is and GLP1-RAs, with both agents more effective than DPP4is, which in turn were more effective than SUs. These findings suggest that the use of GLP1-RAs and SGLT2is should be prioritized as second-line agents in those with established CVD. Funding: National Institutes of Health, United States Department of Veterans Affairs.
RESUMO
Standardized operational definitions are an important tool to improve reproducibility of research using secondary real-world healthcare data. This approach was leveraged for studies evaluating the effectiveness of AZD7442 as COVID-19 pre-exposure prophylaxis across multiple healthcare systems. Value sets were defined, grouped, and mapped. Results of this exercise were reviewed and recorded. Value sets were updated to reflect findings.
Assuntos
COVID-19 , Profilaxia Pré-Exposição , Humanos , Reprodutibilidade dos Testes , Exercício Físico , Instalações de SaúdeRESUMO
INTRODUCTION: Angiotensin-converting enzyme inhibitors (ACEIs) and angiotensin receptor blockers (ARBs) improve outcomes but are underutilized in patients with chronic kidney disease (CKD). Little is known about reasons for discontinuation and lack of reinitiating these medications. We aimed to explore clinicians' and patients' experiences and perceptions of ACEI/ARB use in CKD. METHODS: A multi-profession sample of health care clinicians and patients with documented ACEI/ARB-associated side effects in the past 6 months. Participants were recruited from 2 Veterans Affairs healthcare systems in Texas and Tennessee. A total of 15 clinicians and 10 patients completed interviews. We used inductive and deductive qualitative data analysis approaches to identify themes related to clinician and patient experiences with ACEI/ARB. Thematic analysis focused on prescribing decisions and practices, clinical guidelines, and perception of side effects. Data were analyzed as they amassed, and recruitment was stopped at the point of thematic saturation. RESULTS: Clinicians prescribe ACEI/ARB for blood pressure control and kidney protection and underscored the importance of these medications in patients with diabetes. While clinicians described providing comprehensive patient education about ACEI/ARB in CKD, patient interviews revealed significant knowledge gaps about CKD and ACEI/ARB use. Many patients were unaware of their CKD status, and some did not know why they were prescribed ACEI/ARB. Clinicians' drug management strategies varied widely, as did their understanding of prescribing guidelines. They identified structural and patient-level barriers to prescribing and many endorsed the development of a decision support tool to facilitate ACEI/ARB prescribing and management. DISCUSSION/CONCLUSION: Our qualitative study of clinicians and providers identified key target areas for improvement to increase ACEI/ARB utilization in patients with CKD with the goal to improve long-term outcomes in high-risk patients. These findings will also inform the development of a decision support tool to assist with prescribing ACEI/ARBs for patients with CKD.
Assuntos
Inibidores da Enzima Conversora de Angiotensina , Insuficiência Renal Crônica , Humanos , Inibidores da Enzima Conversora de Angiotensina/efeitos adversos , Antagonistas de Receptores de Angiotensina/uso terapêutico , Antagonistas de Receptores de Angiotensina/farmacologia , Sistema Renina-Angiotensina , Insuficiência Renal Crônica/complicações , Insuficiência Renal Crônica/tratamento farmacológico , Anti-Hipertensivos/uso terapêutico , Avaliação de Resultados da Assistência ao PacienteRESUMO
Several studies have found associations between air pollution and respiratory disease outcomes. However, there is minimal prognostic research exploring whether integrating air quality into clinical prediction models can improve accuracy and utility. In this study, we built models using both logistic regression and random forests to determine the benefits of including air quality data with meteorological and clinical data in prediction of COPD exacerbations requiring medical care. Logistic models were not improved by inclusion of air quality. However, the net benefit curves of random forest models showed greater clinical utility with the addition of air quality data. These models demonstrate a practical and relatively low-cost way to include environmental information into clinical prediction tools to improve the clinical utility of COPD prediction. Findings could be used to provide population level health warnings as well as individual-patient risk assessments.