RESUMEN
Artificial intelligence (AI) health technologies are increasingly available for use in real-world care. This emerging opportunity is accompanied by a need for decision makers and practitioners across healthcare systems to evaluate the safety and effectiveness of these interventions against the needs of their own setting. To meet this need, high-quality evidence regarding AI-enabled interventions must be made available, and decision makers in varying roles and settings must be empowered to evaluate that evidence within the context in which they work. This article summarizes good practices across four stages of evidence generation for AI health technologies: study design, study conduct, study reporting, and study appraisal.
Asunto(s)
Inteligencia Artificial , Humanos , Atención a la Salud , Medicina Basada en la Evidencia , Proyectos de Investigación , Tecnología Biomédica/tendencias , Tecnología Biomédica/métodosRESUMEN
BACKGROUND: The reporting of adverse events (AEs) relating to medical devices is a long-standing area of concern, with suboptimal reporting due to a range of factors including a failure to recognize the association of AEs with medical devices, lack of knowledge of how to report AEs, and a general culture of nonreporting. The introduction of artificial intelligence as a medical device (AIaMD) requires a robust safety monitoring environment that recognizes both generic risks of a medical device and some of the increasingly recognized risks of AIaMD (such as algorithmic bias). There is an urgent need to understand the limitations of current AE reporting systems and explore potential mechanisms for how AEs could be detected, attributed, and reported with a view to improving the early detection of safety signals. OBJECTIVE: The systematic review outlined in this protocol aims to yield insights into the frequency and severity of AEs while characterizing the events using existing regulatory guidance. METHODS: Publicly accessible AE databases will be searched to identify AE reports for AIaMD. Scoping searches have identified 3 regulatory territories for which public access to AE reports is provided: the United States, the United Kingdom, and Australia. AEs will be included for analysis if an artificial intelligence (AI) medical device is involved. Software as a medical device without AI is not within the scope of this review. Data extraction will be conducted using a data extraction tool designed for this review and will be done independently by AUK and a second reviewer. Descriptive analysis will be conducted to identify the types of AEs being reported, and their frequency, for different types of AIaMD. AEs will be analyzed and characterized according to existing regulatory guidance. RESULTS: Scoping searches are being conducted with screening to begin in April 2024. Data extraction and synthesis will commence in May 2024, with planned completion by August 2024. The review will highlight the types of AEs being reported for different types of AI medical devices and where the gaps are. It is anticipated that there will be particularly low rates of reporting for indirect harms associated with AIaMD. CONCLUSIONS: To our knowledge, this will be the first systematic review of 3 different regulatory sources reporting AEs associated with AIaMD. The review will focus on real-world evidence, which brings certain limitations, compounded by the opacity of regulatory databases generally. The review will outline the characteristics and frequency of AEs reported for AIaMD and help regulators and policy makers to continue developing robust safety monitoring processes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/48156.
Asunto(s)
Inteligencia Artificial , Revisiones Sistemáticas como Asunto , Humanos , Equipos y Suministros/efectos adversos , Equipos y Suministros/normas , Bases de Datos Factuales , Estados Unidos , Reino Unido , AustraliaRESUMEN
BACKGROUND: Artificial intelligence (AI) medical devices have the potential to transform existing clinical workflows and ultimately improve patient outcomes. AI medical devices have shown potential for a range of clinical tasks such as diagnostics, prognostics, and therapeutic decision-making such as drug dosing. There is, however, an urgent need to ensure that these technologies remain safe for all populations. Recent literature demonstrates the need for rigorous performance error analysis to identify issues such as algorithmic encoding of spurious correlations (eg, protected characteristics) or specific failure modes that may lead to patient harm. Guidelines for reporting on studies that evaluate AI medical devices require the mention of performance error analysis; however, there is still a lack of understanding around how performance errors should be analyzed in clinical studies, and what harms authors should aim to detect and report. OBJECTIVE: This systematic review will assess the frequency and severity of AI errors and adverse events (AEs) in randomized controlled trials (RCTs) investigating AI medical devices as interventions in clinical settings. The review will also explore how performance errors are analyzed including whether the analysis includes the investigation of subgroup-level outcomes. METHODS: This systematic review will identify and select RCTs assessing AI medical devices. Search strategies will be deployed in MEDLINE (Ovid), Embase (Ovid), Cochrane CENTRAL, and clinical trial registries to identify relevant papers. RCTs identified in bibliographic databases will be cross-referenced with clinical trial registries. The primary outcomes of interest are the frequency and severity of AI errors, patient harms, and reported AEs. Quality assessment of RCTs will be based on version 2 of the Cochrane risk-of-bias tool (RoB2). Data analysis will include a comparison of error rates and patient harms between study arms, and a meta-analysis of the rates of patient harm in control versus intervention arms will be conducted if appropriate. RESULTS: The project was registered on PROSPERO in February 2023. Preliminary searches have been completed and the search strategy has been designed in consultation with an information specialist and methodologist. Title and abstract screening started in September 2023. Full-text screening is ongoing and data collection and analysis began in April 2024. CONCLUSIONS: Evaluations of AI medical devices have shown promising results; however, reporting of studies has been variable. Detection, analysis, and reporting of performance errors and patient harms is vital to robustly assess the safety of AI medical devices in RCTs. Scoping searches have illustrated that the reporting of harms is variable, often with no mention of AEs. The findings of this systematic review will identify the frequency and severity of AI performance errors and patient harms and generate insights into how errors should be analyzed to account for both overall and subgroup performance. TRIAL REGISTRATION: PROSPERO CRD42023387747; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=387747. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/51614.
Asunto(s)
Algoritmos , Inteligencia Artificial , Ensayos Clínicos Controlados Aleatorios como Asunto , Humanos , Ensayos Clínicos Controlados Aleatorios como Asunto/métodos , Revisiones Sistemáticas como Asunto , Daño del Paciente/prevención & control , Equipos y Suministros/efectos adversos , Equipos y Suministros/normas , Proyectos de InvestigaciónRESUMEN
INTRODUCTION: The diagnosis of neovascular age-related macular degeneration (nAMD), the leading cause of visual impairment in the developed world, relies on the interpretation of various imaging tests of the retina. These include invasive angiographic methods, such as Fundus Fluorescein Angiography (FFA) and, on occasion, Indocyanine-Green Angiography (ICGA). Newer, non-invasive imaging modalities, predominately Optical Coherence Tomography (OCT) and Optical Coherence Tomography Angiography (OCTA), have drastically transformed the diagnostic approach to nAMD. The aim of this study is to undertake a comprehensive diagnostic accuracy assessment of the various imaging modalities used in clinical practice for the diagnosis of nAMD (OCT, OCTA, FFA and, when a variant of nAMD called Polypoidal Choroidal Vasculopathy is suspected, ICGA) both alone and in various combinations. METHODS AND ANALYSIS: This is a non-inferiority, prospective, randomised diagnostic accuracy study of 1067 participants. Participants are patients with clinical features consistent with nAMD who present to a National Health Service secondary care ophthalmology unit in the UK. Patients will undergo OCT as per standard practice and those with suspicious features of nAMD on OCT will be approached for participation in the study. Patients who agree to take part will also undergo both OCTA and FFA (and ICGA if indicated). Interpretation of the imaging tests will be undertaken by clinicians at recruitment sites. A randomised design was selected to avoid bias from consecutive review of all imaging tests by the same clinician. The primary outcome of the study will be the difference in sensitivity and specificity between OCT+OCTA and OCT+FFA (±ICGA) for nAMD detection as interpreted by clinicians at recruitment sites. ETHICS AND DISSEMINATION: The study has been approved by the South Central-Oxford B Research Ethics Committee with reference number 21/SC/0412.Dissemination of study results will involve peer-review publications, presentations at major national and international scientific conferences. TRIAL REGISTRATION NUMBER: ISRCTN18313457.
Asunto(s)
Angiografía con Fluoresceína , Tomografía de Coherencia Óptica , Humanos , Neovascularización Coroidal/diagnóstico por imagen , Neovascularización Coroidal/diagnóstico , Angiografía con Fluoresceína/métodos , Degeneración Macular/diagnóstico por imagen , Estudios Multicéntricos como Asunto , Estudios Prospectivos , Ensayos Clínicos Controlados Aleatorios como Asunto , Tomografía de Coherencia Óptica/métodos , Reino Unido , Degeneración Macular Húmeda/diagnóstico por imagen , Degeneración Macular Húmeda/diagnósticoRESUMEN
Optical coherence tomography angiography (OCTA) is widely used for non-invasive retinal vascular imaging, but the OCTA methods used to assess retinal perfusion vary. We evaluated the different methods used to assess retinal perfusion between OCTA studies. MEDLINE and Embase were searched from 2014 to August 2021. We included prospective studies including ≥ 50 participants using OCTA to assess retinal perfusion in either global retinal or systemic disorders. Risk of bias was assessed using the National Institute of Health quality assessment tool for observational cohort and cross-sectional studies. Heterogeneity of data was assessed by Q statistics, Chi-square test, and I2 index. Of the 5974 studies identified, 191 studies were included in this evaluation. The selected studies employed seven OCTA devices, six macula volume dimensions, four macula subregions, nine perfusion analyses, and five vessel layer definitions, totalling 197 distinct methods of assessing macula perfusion and over 7000 possible combinations. Meta-analysis was performed on 88 studies reporting vessel density and foveal avascular zone area, showing lower retinal perfusion in patients with diabetes mellitus than in healthy controls, but with high heterogeneity. Heterogeneity was lowest and reported vascular effects strongest in superficial capillary plexus assessments. Systematic review of OCTA studies revealed massive heterogeneity in the methods employed to assess retinal perfusion, supporting calls for standardisation of methodology.
Asunto(s)
Vasos Retinianos , Tomografía de Coherencia Óptica , Tomografía de Coherencia Óptica/métodos , Humanos , Vasos Retinianos/diagnóstico por imagen , Angiografía con Fluoresceína/métodos , Angiografía/métodosRESUMEN
Purpose: Periodontitis, a ubiquitous severe gum disease affecting the teeth and surrounding alveolar bone, can heighten systemic inflammation. We investigated the association between very severe periodontitis and early biomarkers of age-related macular degeneration (AMD), in individuals with no eye disease. Design: Cross-sectional analysis of the prospective community-based cohort United Kingdom (UK) Biobank. Participants: Sixty-seven thousand three hundred eleven UK residents aged 40 to 70 years recruited between 2006 and 2010 underwent retinal imaging. Methods: Macular-centered OCT images acquired at the baseline visit were segmented for retinal sublayer thicknesses. Very severe periodontitis was ascertained through a touchscreen questionnaire. Linear mixed effects regression modeled the association between very severe periodontitis and retinal sublayer thicknesses, adjusting for age, sex, ethnicity, socioeconomic status, alcohol consumption, smoking status, diabetes mellitus, hypertension, refractive error, and previous cataract surgery. Main Outcome Measures: Photoreceptor layer (PRL) and retinal pigment epithelium-Bruch's membrane (RPE-BM) thicknesses. Results: Among 36 897 participants included in the analysis, 1571 (4.3%) reported very severe periodontitis. Affected individuals were older, lived in areas of greater socioeconomic deprivation, and were more likely to be hypertensive, diabetic, and current smokers (all P < 0.001). On average, those with very severe periodontitis were hyperopic (0.05 ± 2.27 diopters) while those unaffected were myopic (-0.29 ± 2.40 diopters, P < 0.001). Following adjusted analysis, very severe periodontitis was associated with thinner PRL (-0.55 µm, 95% confidence interval [CI], -0.97 to -0.12; P = 0.022) but there was no difference in RPE-BM thickness (0.00 µm, 95% CI, -0.12 to 0.13; P = 0.97). The association between PRL thickness and very severe periodontitis was modified by age (P < 0.001). Stratifying individuals by age, thinner PRL was seen among those aged 60 to 69 years with disease (-1.19 µm, 95% CI, -1.85 to -0.53; P < 0.001) but not among those aged < 60 years. Conclusions: Among those with no known eye disease, very severe periodontitis is statistically associated with a thinner PRL, consistent with incipient AMD. Optimizing oral hygiene may hold additional relevance for people at risk of degenerative retinal disease. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
RESUMEN
OBJECTIVE: Despite significant advances in clinical care and understanding of the underlying pathophysiology, age-related macular degeneration (AMD)-a major cause of global blindness-lacks effective treatment to prevent the irreversible degeneration of photoreceptors leading to central vision loss. Limited studies suggest phosphodiesterase type 5 (PDE5) inhibitors, such as sildenafil, may prevent AMD by increasing retinal blood flow. This study explores the potential association between sildenafil use and AMD risk in men with erectile dysfunction using UK data. METHODS AND ANALYSIS: Using the UK's IQVIA Medical Research Data, the study analysed 31 575 men prescribed sildenafil for erectile dysfunction and no AMD history from 2007 to 2015, matched with a comparator group of 62 155 non-sildenafil users in a 1:2 ratio, over a median follow-up of approximately three years. RESULTS: The primary outcome was the incidence of AMD in the two groups. The study found no significant difference in AMD incidence between the sildenafil users and the non-users, with an adjusted hazard ratio (HR) of 0.99 (95% CI 0.84 to 1.16), after accounting for confounders such as age, ethnicity, Townsend deprivation quintile, body mass index category, and diagnosis of hypertension and type 2 diabetes. CONCLUSION: The study results indicated no significant association between sildenafil use and AMD prevention in UK men with erectile dysfunction, suggesting sildenafil's protective effect on AMD is likely insignificant.
Asunto(s)
Diabetes Mellitus Tipo 2 , Disfunción Eréctil , Degeneración Macular , Masculino , Humanos , Citrato de Sildenafil/efectos adversos , Disfunción Eréctil/inducido químicamente , Estudios Retrospectivos , Diabetes Mellitus Tipo 2/tratamiento farmacológico , Inhibidores de Fosfodiesterasa 5/efectos adversos , Degeneración Macular/inducido químicamenteRESUMEN
INTRODUCTION: Chimeric antigen receptor (CAR) T-cell therapies are novel, potentially curative therapies for haematological malignancies. CAR T-cell therapies are associated with severe toxicities, meaning patients require monitoring during acute and postacute treatment phases. Electronic patient-reported outcomes (ePROs), self-reports of health status provided via online questionnaires, can complement clinician observation with potential to improve patient outcomes. This study will develop and evaluate feasibility of a new ePRO system for CAR-T patients in routine care. METHODS AND ANALYSIS: Multiphase, mixed-methods study involving multiple stakeholder groups (patients, family members, carers, clinicians, academics/researchers and policy-makers). The intervention development phase comprises a Delphi study to select PRO measures for the digital system, a codesign workshop and consensus meetings to establish thresholds for notifications to the clinical team if a patient reports severe symptoms or side effects. Usability testing will evaluate how users interact with the digital system and, lastly, we will evaluate ePRO system feasibility with 30 CAR-T patients (adults aged 18+ years) when used in addition to usual care. Feasibility study participants will use the ePRO system to submit self-reports of symptoms, treatment tolerability and quality of life at specific time points. The CAR-T clinical team will respond to system notifications triggered by patients' submitted responses with actions in line with standard clinical practice. Feasibility measures will be collected at prespecified time points following CAR T-cell infusion. A qualitative substudy involving patients and clinical team members will explore acceptability of the ePRO system. ETHICS AND DISSEMINATION: Favourable ethical opinion was granted by the Health and Social Care Research Ethics Committee B(HSC REC B) (ref: 23/NI/0104) on 28 September 2023. Findings will be submitted for publication in high-quality, peer-reviewed journals. Summaries of results, codeveloped with the Blood and Transplant Research Unit Patient and Public Involvement and Engagement group, will be disseminated to all interested groups. TRIAL REGISTRATION NUMBER: ISCTRN11232653.
Asunto(s)
Inmunoterapia Adoptiva , Receptores Quiméricos de Antígenos , Adulto , Humanos , Inmunoterapia Adoptiva/efectos adversos , Calidad de Vida , Estudios de Factibilidad , Medición de Resultados Informados por el Paciente , Linfocitos TRESUMEN
BACKGROUND: Diabetic eye screening (DES) represents a significant opportunity for the application of machine learning (ML) technologies, which may improve clinical and service outcomes. However, successful integration of ML into DES requires careful product development, evaluation, and implementation. Target product profiles (TPPs) summarize the requirements necessary for successful implementation so these can guide product development and evaluation. OBJECTIVE: This study aims to produce a TPP for an ML-automated retinal imaging analysis software (ML-ARIAS) system for use in DES in England. METHODS: This work will consist of 3 phases. Phase 1 will establish the characteristics to be addressed in the TPP. A list of candidate characteristics will be generated from the following sources: an overview of systematic reviews of diagnostic test TPPs; a systematic review of digital health TPPs; and the National Institute for Health and Care Excellence's Evidence Standards Framework for Digital Health Technologies. The list of characteristics will be refined and validated by a study advisory group (SAG) made up of representatives from key stakeholders in DES. This includes people with diabetes; health care professionals; health care managers and leaders; and regulators and policy makers. In phase 2, specifications for these characteristics will be drafted following a series of semistructured interviews with participants from these stakeholder groups. Data collected from these interviews will be analyzed using the shortlist of characteristics as a framework, after which specifications will be drafted to create a draft TPP. Following approval by the SAG, in phase 3, the draft will enter an internet-based Delphi consensus study with participants sought from the groups previously identified, as well as ML-ARIAS developers, to ensure feasibility. Participants will be invited to score characteristic and specification pairs on a scale from "definitely exclude" to "definitely include," and suggest edits. The document will be iterated between rounds based on participants' feedback. Feedback on the draft document will be sought from a group of ML-ARIAS developers before its final contents are agreed upon in an in-person consensus meeting. At this meeting, representatives from the stakeholder groups previously identified (minus ML-ARIAS developers, to avoid bias) will be presented with the Delphi results and feedback of the user group and asked to agree on the final contents by vote. RESULTS: Phase 1 was completed in November 2023. Phase 2 is underway and expected to finish in March 2024. Phase 3 is expected to be complete in July 2024. CONCLUSIONS: The multistakeholder development of a TPP for an ML-ARIAS for use in DES in England will help developers produce tools that serve the needs of patients, health care providers, and their staff. The TPP development process will also provide methods and a template to produce similar documents in other disease areas. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/50568.
RESUMEN
BACKGROUND: Artificial intelligence as a medical device (AIaMD) has the potential to transform many aspects of ophthalmic care, such as improving accuracy and speed of diagnosis, addressing capacity issues in high-volume areas such as screening, and detecting novel biomarkers of systemic disease in the eye (oculomics). In order to ensure that such tools are safe for the target population and achieve their intended purpose, it is important that these AIaMD have adequate clinical evaluation to support any regulatory decision. Currently, the evidential requirements for regulatory approval are less clear for AIaMD compared to more established interventions such as drugs or medical devices. There is therefore value in understanding the level of evidence that underpins AIaMD currently on the market, as a step toward identifying what the best practices might be in this area. In this systematic scoping review, we will focus on AIaMD that contributes to clinical decision-making (relating to screening, diagnosis, prognosis, and treatment) in the context of ophthalmic imaging. OBJECTIVE: This study aims to identify regulator-approved AIaMD for ophthalmic imaging in Europe, Australia, and the United States; report the characteristics of these devices and their regulatory approvals; and report the available evidence underpinning these AIaMD. METHODS: The Food and Drug Administration (United States), the Australian Register of Therapeutic Goods (Australia), the Medicines and Healthcare products Regulatory Agency (United Kingdom), and the European Database on Medical Devices (European Union) regulatory databases will be searched for ophthalmic imaging AIaMD through a snowballing approach. PubMed and clinical trial registries will be systematically searched, and manufacturers will be directly contacted for studies investigating the effectiveness of eligible AIaMD. Preliminary regulatory database searches, evidence searches, screening, data extraction, and methodological quality assessment will be undertaken by 2 independent review authors and arbitrated by a third at each stage of the process. RESULTS: Preliminary searches were conducted in February 2023. Data extraction, data synthesis, and assessment of methodological quality commenced in October 2023. The review is on track to be completed and submitted for peer review by April 2024. CONCLUSIONS: This systematic review will provide greater clarity on ophthalmic imaging AIaMD that have achieved regulatory approval as well as the evidence that underpins them. This should help adopters understand the range of tools available and whether they can be safely incorporated into their clinical workflow, and it should also support developers in navigating regulatory approval more efficiently. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/52602.
RESUMEN
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77-94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Asunto(s)
Inteligencia Artificial , Ensayos Clínicos Controlados Aleatorios como Asunto , Ensayos Clínicos Controlados Aleatorios como Asunto/normas , Humanos , Guías como Asunto , Proyectos de Investigación/normas , Informe de Investigación/normas , ChinaRESUMEN
[RESUMEN]. La declaración SPIRIT 2013 tiene como objetivo mejorar la exhaustividad de los informes de los protocolos de los ensayos clínicos proporcionando recomendaciones basadas en la evidencia para el conjunto mínimo de elementos que deben abordarse. Esta guía ha sido fundamental para promover la evaluación transparente de nuevas intervenciones. Más recientemente, se ha reconocido cada vez más que las intervenciones con inteligencia artificial (IA) deben someterse a una evaluación rigurosa y prospectiva para demostrar su impacto en los resultados médicos. La extensión SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence, por sus siglas en inglés) es una nueva directriz para el reporte de los protocolos de ensayos clínicos que evalúan intervenciones con un componente de IA. Esta directriz se desarrolló en paralelo con su declaración complemen- taria para los informes de ensayos clínicos: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Ambas directrices se desarrollaron a través de un proceso de consenso por etapas que incluía la revisión de la literatura y la consulta a expertos para generar 26 ítems candidatos, que fueron consultados por un grupo internacional de múltiples partes interesadas en una encuesta Delphi de dos etapas (103 partes interesadas), acordados en una reunión de consenso (31 partes interesadas) y refinados a través de una lista de verificación piloto (34 participantes). La ampliación de SPIRIT-AI incluye 15 nuevos elementos que se consideraron suficientemente importantes para los protocolos de los ensayos clínicos con intervenciones de IA. Estos nuevos ítems deben ser reportados rutinariamente además de los ítems centrales de SPIRIT 2013. SPIRIT-AI recomienda que los investigadores proporcionen descripciones claras de la intervención de IA, incluyendo las instrucciones y las habilidades necesarias para su uso, el entorno en el que se integrará la intervención de IA, las consideraciones para el manejo de los datos de entrada y salida, la interacción entre el ser humano y la IA y el análisis de los casos de error. SPIRIT-AI ayudará a promover la transparencia y la exhaustividad de los protocolos de los ensayos clínicos de las intervenciones de IA. Su uso ayudará a los editores y revisores, así como a los lectores en general, a comprender, interpretar y valorar críticamente el diseño y el riesgo de sesgo de un futuro ensayo clínico.
[ABSTRACT]. The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials–Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials–Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human–AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general reader- ship, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
[RESUMO]. A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens can- didatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.
Asunto(s)
Inteligencia Artificial , Ensayo Clínico , Protocolos Clínicos , Inteligencia Artificial , Ensayo Clínico , Protocolos Clínicos , Inteligencia Artificial , Ensayo ClínicoRESUMEN
The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.
RESUMEN
The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.
A declaração CONSORT 2010 apresenta diretrizes mínimas para relatórios de ensaios clínicos randomizados. Seu uso generalizado tem sido fundamental para garantir a transparência na avaliação de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão CONSORT-AI (Consolidated Standards of Reporting Trials Artificial Intelligence) é uma nova diretriz para relatórios de ensaios clínicos que avaliam intervenções com um componente de IA. Ela foi desenvolvida em paralelo à sua declaração complementar para protocolos de ensaios clínicos, a SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 29 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão CONSORT-AI inclui 14 itens novos que, devido à sua importância para as intervenções de IA, devem ser informados rotineiramente juntamente com os itens básicos da CONSORT 2010. A CONSORT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA está inserida, considerações sobre o manuseio dos dados de entrada e saída da intervenção de IA, a interação humano-IA e uma análise dos casos de erro. A CONSORT-AI ajudará a promover a transparência e a integralidade nos relatórios de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente a qualidade do desenho do ensaio clínico e o risco de viés nos resultados relatados.
RESUMEN
Patient-reported outcomes (PROs) are increasingly used in healthcare research to provide evidence of the benefits and risks of interventions from the patient perspective and to inform regulatory decisions and health policy. The use of PROs in clinical practice can facilitate symptom monitoring, tailor care to individual needs, aid clinical decision-making and inform value-based healthcare initiatives. Despite their benefits, there are concerns that the potential burden on respondents may reduce their willingness to complete PROs, with potential impact on the completeness and quality of the data for decision-making. We therefore conducted an initial literature review to generate a list of candidate recommendations aimed at reducing respondent burden. This was followed by a two-stage Delphi survey by an international multi-stakeholder group. A consensus meeting was held to finalize the recommendations. The final consensus statement includes 19 recommendations to address PRO respondent burden in healthcare research and clinical practice. If implemented, these recommendations may reduce PRO respondent burden.
Asunto(s)
Evaluación del Resultado de la Atención al Paciente , Medición de Resultados Informados por el Paciente , Humanos , Consenso , Toma de Decisiones ClínicasRESUMEN
Intersectional social determinants including ethnicity are vital in health research. We curated a population-wide data resource of self-identified ethnicity data from over 60 million individuals in England primary care, linking it to hospital records. We assessed ethnicity data in terms of completeness, consistency, and granularity and found one in ten individuals do not have ethnicity information recorded in primary care. By linking to hospital records, ethnicity data were completed for 94% of individuals. By reconciling SNOMED-CT concepts and census-level categories into a consistent hierarchy, we organised more than 250 ethnicity sub-groups including and beyond "White", "Black", "Asian", "Mixed" and "Other, and found them to be distributed in proportions similar to the general population. This large observational dataset presents an algorithmic hierarchy to represent self-identified ethnicity data collected across heterogeneous healthcare settings. Accurate and easily accessible ethnicity data can lead to a better understanding of population diversity, which is important to address disparities and influence policy recommendations that can translate into better, fairer health for all.
Asunto(s)
Etnicidad , Salud Poblacional , Humanos , InglaterraRESUMEN
OBJECTIVE: To evaluate the associations between socioeconomic deprivation and sight-threatening diabetic retinopathy (STDR) in individuals with type 1 diabetes (T1D) and type 2 diabetes (T2D). RESEARCH DESIGN AND METHODS: Data from 175,628 individuals with diabetes in the Health Improvement Network were used to assess the risk of STDR across Townsend Deprivation Index quantiles using Cox proportional hazard regression. RESULTS: Among individuals with T1D, the risk of STDR was three times higher (adjusted hazard ratio [aHR] 2.67, 95% CI 1.05-7.78) in the most deprived quintile compared with the least deprived quintile. In T2D, the most deprived quintile had a 28% higher risk (aHR 1.28; 95% CI 1.15-1.43) than the least deprived quintile. CONCLUSIONS: Increasing socioeconomic deprivation is associated with a higher risk of developing STDR in people with diabetes. This underscores persistent health disparities linked to poverty, even within a country offering free universal health care. Further research is needed to address health equity concerns in socioeconomically deprived regions.