ABSTRACT
BACKGROUND: Many individuals eligible for statin therapy decline treatment, often due to fear of adverse effects. Misinformation about statins is common and drives statin reluctance, but its prevalence on social media platforms, such as Twitter (now X) remains unclear. Social media bots are known to proliferate medical misinformation, but their involvement in statin-related discourse is unknown. This study examined temporal trends in volume, author type (bot or human), and sentiment of statin-related Twitter posts (tweets). METHODS AND RESULTS: We analyzed original tweets with statin-related terms from 2010 to 2022 using a machine learning-derived classifier to determine the author's bot probability, natural language processing to assign each tweet a negative or positive sentiment, and manual qualitative analysis to identify statin skepticism in a random sample of all tweets and in highly influential tweets. We identified 1 155 735 original statin-related tweets. Bots produced 333 689 (28.9%), humans produced 699 876 (60.6%), and intermediate probability accounts produced 104 966 (9.1%). Over time, the proportion of bot tweets decreased from 47.8% to 11.3%, and human tweets increased from 43.6% to 79.8%. The proportion of negative-sentiment tweets increased from 27.8% to 43.4% for bots and 30.9% to 38.4% for humans. Manually coded statin skepticism increased from 8.0% to 19.0% for bots and from 26.0% to 40.0% for humans. CONCLUSIONS: Over the past decade, humans have overtaken bots as generators of statin-related content on Twitter. Negative sentiment and statin skepticism have increased across all user types. Twitter may be an important forum to combat statin-related misinformation.
Subject(s)
Hydroxymethylglutaryl-CoA Reductase Inhibitors , Social Media , Humans , Hydroxymethylglutaryl-CoA Reductase Inhibitors/adverse effects , Software , Communication , Natural Language ProcessingABSTRACT
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77-94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Subject(s)
Artificial Intelligence , Randomized Controlled Trials as Topic , Randomized Controlled Trials as Topic/standards , Humans , Guidelines as Topic , Research Design/standards , Research Report/standards , ChinaABSTRACT
Artificial intelligence (AI) has the potential to revolutionize the neonatal intensive care unit (NICU) care by leveraging the large-scale, high-dimensional data that are generated by NICU patients. There is an emerging recognition that the confluence of technological progress, commercialization pathways, and rich data sets provides a unique opportunity for AI to make a lasting impact on the NICU. In this perspective article, we discuss four broad categories of AI applications in the NICU: imaging interpretation, prediction modeling of electronic health record data, integration of real-time monitoring data, and documentation and billing. By enhancing decision-making, streamlining processes, and improving patient outcomes, AI holds the potential to transform the quality of care for vulnerable newborns, making the excitement surrounding AI advancements well-founded and the potential for significant positive change stronger than ever before.
Subject(s)
Artificial Intelligence , Intensive Care Units, Neonatal , Humans , Infant, NewbornABSTRACT
resumen está disponible en el texto completo
ABSTRACT The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.
RESUMO A declaração CONSORT 2010 apresenta diretrizes mínimas para relatórios de ensaios clínicos randomizados. Seu uso generalizado tem sido fundamental para garantir a transparência na avaliação de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence) é uma nova diretriz para relatórios de ensaios clínicos que avaliam intervenções com um componente de IA. Ela foi desenvolvida em paralelo à sua declaração complementar para protocolos de ensaios clínicos, a SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 29 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão CONSORT-AI inclui 14 itens novos que, devido à sua importância para as intervenções de IA, devem ser informados rotineiramente juntamente com os itens básicos da CONSORT 2010. A CONSORT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA está inserida, considerações sobre o manuseio dos dados de entrada e saída da intervenção de IA, a interação humano-IA e uma análise dos casos de erro. A CONSORT-AI ajudará a promover a transparência e a integralidade nos relatórios de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente a qualidade do desenho do ensaio clínico e o risco de viés nos resultados relatados.
ABSTRACT
resumen está disponible en el texto completo
ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.
ABSTRACT
Three billion years of evolution has produced a tremendous diversity of protein molecules1, but the full potential of proteins is likely to be much greater. Accessing this potential has been challenging for both computation and experiments because the space of possible protein molecules is much larger than the space of those likely to have functions. Here we introduce Chroma, a generative model for proteins and protein complexes that can directly sample novel protein structures and sequences, and that can be conditioned to steer the generative process towards desired properties and functions. To enable this, we introduce a diffusion process that respects the conformational statistics of polymer ensembles, an efficient neural architecture for molecular systems that enables long-range reasoning with sub-quadratic scaling, layers for efficiently synthesizing three-dimensional structures of proteins from predicted inter-residue geometries and a general low-temperature sampling algorithm for diffusion models. Chroma achieves protein design as Bayesian inference under external constraints, which can involve symmetries, substructure, shape, semantics and even natural-language prompts. The experimental characterization of 310 proteins shows that sampling from Chroma results in proteins that are highly expressed, fold and have favourable biophysical properties. The crystal structures of two designed proteins exhibit atomistic agreement with Chroma samples (a backbone root-mean-square deviation of around 1.0 Å). With this unified approach to protein design, we hope to accelerate the programming of protein matter to benefit human health, materials science and synthetic biology.
Subject(s)
Algorithms , Computer Simulation , Protein Conformation , Proteins , Humans , Bayes Theorem , Directed Molecular Evolution , Machine Learning , Models, Molecular , Protein Folding , Proteins/chemistry , Proteins/metabolism , Semantics , Synthetic Biology/methods , Synthetic Biology/trendsABSTRACT
This Viewpoint describes the false dichotomy between statistics and machine learning and suggests considerations in building and evaluating clinical prediction models.
Subject(s)
Machine Learning , Statistics as Topic , HumansABSTRACT
OBJECTIVE: To develop machine learning models predicting extubation failure in low birthweight neonates using large amounts of clinical data. STUDY DESIGN: Retrospective cohort study using MIMIC-III, a large single-center, open-source clinical dataset. Logistic regression and boosted-tree (XGBoost) models using demographics, medications, and vital sign and ventilatory data were developed to predict extubation failure, defined as reintubation within 7 days. RESULTS: 1348 low birthweight (≤2500 g) neonates who received mechanical ventilation within the first 7 days were included, of which 350 (26%) failed a trial of extubation. The best-performing model was a boosted-tree model incorporating demographics, vital signs, ventilator parameters, and medications (AUROC 0.82). The most important features were birthweight, last FiO2, average mean airway pressure, caffeine use, and gestational age. CONCLUSIONS: Machine learning models identified low birthweight ventilated neonates at risk for extubation failure. These models will need to be validated across multiple centers to determine generalizability of this tool.
Subject(s)
Airway Extubation , Ventilator Weaning , Infant, Newborn , Humans , Retrospective Studies , Birth Weight , Respiration, ArtificialABSTRACT
resumen está disponible en el texto completo
ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.
ABSTRACT
OBJECTIVES: To describe regional differences in utilization of 17α-hydroxyprogesterone caproate (17-OHP). METHODS: Retrospective cohort study of a large, US commercial managed care plan claims database with pharmacy coverage from 2008 to 2018. Singleton pregnancies with at least one prior spontaneous preterm birth (sPTB) were included. Regional and state-based differences in 17-OHP use were compared. Data were analyzed using t-tests and Fisher's exact tests. RESULTS: Of the 4,514 individuals with an indication for 17-OHP, 580 (12.8%) were prescribed 17-OHP. Regional and state-based differences in 17-OHP utilization were identified; Northeast 15.7%, Midwest 13.7%, South 12.0%, and West 10.4% (p=0.003). CONCLUSIONS: While significant regional differences in 17-OHP utilization were demonstrated, 17-OHP utilization remained low despite this cohort having insurance through a US commercial managed care plan. Suboptimal utilization demonstrates a disconnect between research and uptake in clinical practice. This underscores a need for implementation science in obstetrics to translate updated recommendations more effectively and efficiently into clinical practice.
Subject(s)
Hydroxyprogesterones , Premature Birth , Pregnancy , Female , Infant, Newborn , Humans , 17 alpha-Hydroxyprogesterone Caproate , Hydroxyprogesterones/therapeutic use , Retrospective Studies , Premature Birth/prevention & control , Cohort Studies , 17-alpha-HydroxyprogesteroneABSTRACT
OBJECTIVE: Our objective was to compare rates of hospitalizations for respiratory illnesses in preterm and full-term (FT) children for 4 years before and after the 2014 update to the American Academy of Pediatrics (AAP) respiratory syncytial virus (RSV) immunoprophylaxis guidance, which restricted eligibility among infants born at 29 to 34 weeks in the first winter and all preterm infants in the second winter after neonatal discharge. STUDY DESIGN: We conducted pre-post and interrupted time series analyses on claims data from a commercial national managed care plan. We compared the number of RSV and all respiratory hospital admissions in the first and second RSV seasons after neonatal discharge among a cohort of preterm children, regardless of palivizumab status, in the 4 years before and after the implementation of the 2014 palivizumab eligibility change. A FT group was included for reference. RESULTS: The cohort included 821 early preterm (EP, <29 weeks), 4,790 moderate preterm (MP, 29-34 weeks), and 130,782 FT children. Palivizumab use after the policy update decreased among MP children in the first and second RSV seasons after neonatal discharge, without any change in the odds of hospitalization with RSV or respiratory illness. For the EP group, there was no change in the rate of palivizumab or the odds of hospitalization with RSV or respiratory illness after the policy update. For the FT group, there was a slight decrease in odds of hospitalization post-2014 after the policy update. The interrupted time series did not reveal any secular trends over time in hospitalization rates among preterm children. Following the policy change, there were cost savings for MP children in the first and second RSV seasons, when accounting for the cost of hospitalizations and the cost of palivizumab. CONCLUSION: Hospitalizations for RSV or respiratory illness did not increase, and cost savings were obtained after the implementation of the 2014 AAP palivizumab prophylaxis policy. KEY POINTS: · Palivizumab use decreased among children born moderate preterm (29 to34 weeks) after the 2014 palivizuamb policy update.. · There was no change in odds of hospitalization with respiratory syncitial virus or respiratory illness among preterm infants after the policy update when compared to before.. · There were cost savings, when accounting for the cost of hospitalizations and the cost of palivizumab, after the policy update among children born moderate preterm..
ABSTRACT
INTRODUCTION: Artificial intelligence based on machine learning has made large advancements in many fields of science and medicine but its impact on pharmacovigilance is yet unclear. OBJECTIVE: The present study conducted a scoping review of the use of artificial intelligence based on machine learning to understand how it is used for pharmacovigilance tasks, characterize differences with other fields, and identify opportunities to improve pharmacovigilance through the use of machine learning. DESIGN: The PubMed, Embase, Web of Science, and IEEE Xplore databases were searched to identify articles pertaining to the use of machine learning in pharmacovigilance published from the year 2000 to September 2021. After manual screening of 7744 abstracts, a total of 393 papers met the inclusion criteria for further analysis. Extraction of key data on study design, data sources, sample size, and machine learning methodology was performed. Studies with the characteristics of good machine learning practice were defined and manual review focused on identifying studies that fulfilled these criteria and results that showed promise. RESULTS: The majority of studies (53%) were focused on detecting safety signals using traditional statistical methods. Of the studies that used more recent machine learning methods, 61% used off-the-shelf techniques with minor modifications. Temporal analysis revealed that newer methods such as deep learning have shown increased use in recent years. We found only 42 studies (10%) that reflect current best practices and trends in machine learning. In the subset of 154 papers that focused on data intake and ingestion, 30 (19%) were found to incorporate the same best practices. CONCLUSION: Advances from artificial intelligence have yet to fully penetrate pharmacovigilance, although recent studies show signs that this may be changing.
Subject(s)
Artificial Intelligence , Pharmacovigilance , Humans , Machine LearningABSTRACT
OBJECTIVE: 17-α-hydroxyprogesterone caproate (17-OHP) has been recommended by professional societies for the prevention of recurrent preterm birth, but subsequent clinical studies have reported conflicting efficacy results. This study aimed to contribute to the evidence base regarding the effectiveness of 17-OHP in clinical practice using real-world data. STUDY DESIGN: A total of 4,422 individuals meeting inclusion criteria representing recurrent spontaneous preterm birth (sPTB) were identified in a database of insurance claims, and 568 (12.8%) received 17-OHP. Crude and propensity score-matched recurrence rates and risk ratios (RRs) for the association of receiving 17-OHP on recurrent sPTB were calculated. RESULTS: Raw sPTB recurrence rates were higher among those treated versus not treated; after propensity score matching, no association was detected (26.3 vs. 23.8%, RR = 1.1, 95% CI: 0.9-1.4). CONCLUSION: We failed to identify a beneficial effect of 17-OHP for the prevention of spontaneous recurrent preterm birth in our observational, U.S. based cohort. KEY POINTS: · â¢We observed higher risk for sPTB in the group receiving 17-OHP in the unmatched analysis. · â¢After propensity-score matching, we still failed to identify a beneficial effect of 17-OHP on sPTB. · â¢Sensitivity analyses demonstrated robustness to the inclusion criteria and modeling assumptions..
ABSTRACT
Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using point-prediction metrics, such as the negative log-likelihood (NLL), expected calibration error (ECE) or the Brier score on held-out data. Marginal coverage of prediction intervals or sets, a well-known concept in the statistical literature, is an intuitive alternative to these metrics but has yet to be systematically studied for many popular uncertainty quantification techniques for deep learning models. With marginal coverage and the complementary notion of the width of a prediction interval, downstream users of deployed machine learning models can better understand uncertainty quantification both on a global dataset level and on a per-sample basis. In this study, we provide the first large-scale evaluation of the empirical frequentist coverage properties of well-known uncertainty quantification techniques on a suite of regression and classification tasks. We find that, in general, some methods do achieve desirable coverage properties on in distribution samples, but that coverage is not maintained on out-of-distribution data. Our results demonstrate the failings of current uncertainty quantification techniques as dataset shift increases and reinforce coverage as an important metric in developing models for real-world applications.
ABSTRACT
The black-box nature of current artificial intelligence (AI) has caused some to question whether AI must be explainable to be used in high-stakes scenarios such as medicine. It has been argued that explainable AI will engender trust with the health-care workforce, provide transparency into the AI decision making process, and potentially mitigate various kinds of bias. In this Viewpoint, we argue that this argument represents a false hope for explainable AI and that current explainability methods are unlikely to achieve these goals for patient-level decision support. We provide an overview of current explainability techniques and highlight how various failure cases can cause problems for decision making for individual patients. In the absence of suitable explainability methods, we advocate for rigorous internal and external validation of AI models as a more direct means of achieving the goals often associated with explainability, and we caution against having explainability be a requirement for clinically deployed models.