Subject(s)
Dementia , Lenses, Intraocular , Humans , Dementia/epidemiology , Dementia/etiology , Risk Factors , Light/adverse effects , Blue LightABSTRACT
The accessibility of the retina with the use of non-invasive and relatively low-cost ophthalmic imaging techniques and analytics provides a unique opportunity to improve the detection, diagnosis and monitoring of systemic diseases. The National Heart, Lung, and Blood Institute conducted a workshop in October 2022 to examine this concept. On the basis of the discussions at that workshop, this Roadmap describes current knowledge gaps and new research opportunities to evaluate the relationships between the eye (in particular, retinal biomarkers) and the risk of cardiovascular diseases, including coronary artery disease, heart failure, stroke, hypertension and vascular dementia. Identified gaps include the need to simplify and standardize the capture of high-quality images of the eye by non-ophthalmic health workers and to conduct longitudinal studies using multidisciplinary networks of diverse at-risk populations with improved implementation and methods to protect participant and dataset privacy. Other gaps include improving the measurement of structural and functional retinal biomarkers, determining the relationship between microvascular and macrovascular risk factors, improving multimodal imaging 'pipelines', and integrating advanced imaging with 'omics', lifestyle factors, primary care data and radiological reports, by using artificial intelligence technology to improve the identification of individual-level risk. Future research on retinal microvascular disease and retinal biomarkers might additionally provide insights into the temporal development of microvascular disease across other systemic vascular beds.
ABSTRACT
Data is the cornerstone of using AI models, because their performance directly depends on the diversity, quantity, and quality of the data used for training. Using AI presents unique potential, particularly in medical applications that involve rich data such as ophthalmology, encompassing a variety of imaging methods, medical records, and eye-tracking data. However, sharing medical data comes with challenges because of regulatory issues and privacy concerns. This review explores traditional and nontraditional data sharing methods in medicine, focusing on previous works in ophthalmology. Traditional methods involve direct data transfer, whereas newer approaches prioritize security and privacy by sharing derived datasets, creating secure research environments, or using model-to-data strategies. We examine each method's mechanisms, variations, recent applications in ophthalmology, and their respective advantages and disadvantages. By empowering medical researchers with insights into data sharing methods and considerations, this review aims to assist informed decision-making while upholding ethical standards and patient privacy in medical AI development.
Subject(s)
Artificial Intelligence , Information Dissemination , Ophthalmology , HumansABSTRACT
Background: The Adult Changes in Thought (ACT) study is a cohort of Kaiser Permanente Washington members ages 65+ that began in 1994. Objective: We wanted to know how well ACT participants represented all older adults in the region, and how well ACT findings on eye disease and its relationship with Alzheimer's disease generalized to all older adults in the Seattle Metropolitan Region. Methods: We used participation weights derived from pooling ACT and Behavioral Risk Factor Surveillance System (BRFSS) data to estimate prevalences of common eye diseases and their associations with Alzheimer's disease incidence. Cox proportional hazards models accounted for age, education, smoking, sex, and APOE genotype. Confidence intervals for weighted analyses were bootstrapped to account for error in estimating the weights. Results: ACT participants were fairly similar to older adults in the region. The largest differences were more self-reported current cholesterol medication use in BRFSS and higher proportions with low education in ACT. Incorporating the weights had little impact on prevalence estimates for age-related macular degeneration or glaucoma. Weighted estimates were slightly higher for diabetic retinopathy (weighted 5.7% (95% Confidence Interval 4.3, 7.1); unweighted 4.1% (3.6, 4.6)) and cataract history (weighted 51.8% (49.6, 54.3); unweighted 48.6% (47.3, 49.9)). The weighted hazard ratio for recent diabetic retinopathy diagnosis and Alzheimer's disease was 1.84 (0.34, 4.29), versus 1.32 (0.87, 2.00) in unweighted ACT. Conclusions: Most, but not all, associations were similar after participation weighting. Even in community-based cohorts, extending inferences to broader populations may benefit from evaluation with participation weights.
Subject(s)
Alzheimer Disease , Humans , Male , Female , Aged , Aged, 80 and over , Cohort Studies , Prospective Studies , Alzheimer Disease/epidemiology , Eye Diseases/epidemiology , Washington/epidemiology , Prevalence , Proportional Hazards Models , Behavioral Risk Factor Surveillance System , Residence CharacteristicsABSTRACT
Background: Conflicting research on retinal biomarkers of Alzheimer's disease and related dementias (AD/ADRD) is likely related to limited sample sizes, study design, and protocol differences. Objective: The prospective Eye Adult Changes in Thought (Eye ACT) seeks to address these gaps. Methods: Eye ACT participants are recruited from ACT, an ongoing cohort of dementia-free, older adults followed biennially until AD/ADRD, and undergo visual function and retinal imaging assessment either in clinic or at home. Results: 330 participants were recruited as of 03/2023. Compared to ACT participants not in Eye ACT (Nâ=â1868), Eye ACT participants (Nâ=â330) are younger (mean age: 70.3 versus 71.2, pâ=â0.014), newer to ACT (median ACT visits since baseline: 3 versus 4, pâ<â0.001), have more years of education (17.7 versus 16.2, pâ<â0.001) and had lower rates of visual impairment (12% versus 22%, pâ<â0.001). Compared to those seen in clinic (Nâ=â300), Eye ACT participants seen at home (Nâ=â30) are older (77.2 versus 74.9, pâ=â0.015), more frequently female (60% versus 49%, pâ=â0.026), and have significantly worse visual acuity (71.1 versus 78.9 Early Treatment Diabetic Retinopathy Study letters, pâ<â0.001) and contrast sensitivity (-1.9 versus -2.1 mean log units at 3 cycles per degree, pâ=â0.002). Cognitive scores and retinal imaging measurements are similar between the two groups. Conclusions: Participants assessed at home had significantly worse visual function than those seen in clinic. By including these participants, Eye ACT provides a unique longitudinal cohort for evaluating potential retinal biomarkers of dementia.
Subject(s)
Alzheimer Disease , Humans , Female , Male , Aged , Prospective Studies , Cohort Studies , Alzheimer Disease/diagnostic imaging , Retina/diagnostic imaging , Aged, 80 and over , Vision Disorders , Middle Aged , Dementia/diagnostic imaging , Tomography, Optical Coherence , Research DesignABSTRACT
The aim of this perspective is to promote the theory of salutogenesis as a novel approach to addressing ophthalmologic inflammatory conditions, illustrating several concepts in which it is based upon and how they can be applied to medical practice. This theory can better contextualize why patients with similar demographics and exposures are not uniform in their clinical presentations. Stressors in daily life can contribute to a state of ill-health and there are various factors that help alleviate their negative impact. These alleviating factors are significantly impaired in people with poor vision, one of the most common presentations of ophthalmologic conditions. Salutogenic principles can guide the treatment of eye conditions to be more respectful of patient autonomy amidst shifting expectations of the doctor-patient relationship. Being able to take ownership of their health and feeling that their cultural beliefs were considered improves compliance and subsequently gives more optimal outcomes. Population-level policy interventions could also utilize salutogenic principles to identify previously overlooked domains that can be addressed. We identified several papers about salutogenesis in an ophthalmological context and acknowledged the relatively few studies on this topic at present and offer directions in which we can explore further in subsequent studies.
ABSTRACT
BACKGROUND/AIMS: To compare the performance of generative versus retrieval-based chatbots in answering patient inquiries regarding age-related macular degeneration (AMD) and diabetic retinopathy (DR). METHODS: We evaluated four chatbots: generative models (ChatGPT-4, ChatGPT-3.5 and Google Bard) and a retrieval-based model (OcularBERT) in a cross-sectional study. Their response accuracy to 45 questions (15 AMD, 15 DR and 15 others) was evaluated and compared. Three masked retinal specialists graded the responses using a three-point Likert scale: either 2 (good, error-free), 1 (borderline) or 0 (poor with significant inaccuracies). The scores were aggregated, ranging from 0 to 6. Based on majority consensus among the graders, the responses were also classified as 'Good', 'Borderline' or 'Poor' quality. RESULTS: Overall, ChatGPT-4 and ChatGPT-3.5 outperformed the other chatbots, both achieving median scores (IQR) of 6 (1), compared with 4.5 (2) in Google Bard, and 2 (1) in OcularBERT (all p ≤8.4×10-3). Based on the consensus approach, 83.3% of ChatGPT-4's responses and 86.7% of ChatGPT-3.5's were rated as 'Good', surpassing Google Bard (50%) and OcularBERT (10%) (all p ≤1.4×10-2). ChatGPT-4 and ChatGPT-3.5 had no 'Poor' rated responses. Google Bard produced 6.7% Poor responses, and OcularBERT produced 20%. Across question types, ChatGPT-4 outperformed Google Bard only for AMD, and ChatGPT-3.5 outperformed Google Bard for DR and others. CONCLUSION: ChatGPT-4 and ChatGPT-3.5 demonstrated superior performance, followed by Google Bard and OcularBERT. Generative chatbots are potentially capable of answering domain-specific questions outside their original training. Further validation studies are still required prior to real-world implementation.
ABSTRACT
Purpose: Research on Alzheimer's disease (AD) and precursor states demonstrates a thinner retinal nerve fiber layer (NFL) compared to age-similar controls. Because AD and age-related macular degeneration (AMD) both impact older adults and share risk factors, we asked if retinal layer thicknesses, including NFL, are associated with cognition in AMD. Methods: Adults ≥ 70 years with normal retinal aging, early AMD, or intermediate AMD per Age-Related Eye Disease Study (AREDS) nine-step grading of color fundus photography were enrolled in a cross-sectional study. Optical coherence tomography (OCT) volumes underwent 11-line segmentation and adjustments by a trained operator. Evaluated thicknesses reflect the vertical organization of retinal neurons and two vascular watersheds: NFL, ganglion cell layer-inner plexiform layer complex (GCL-IPL), inner retina, outer retina (including retinal pigment epithelium-Bruch's membrane), and total retina. Thicknesses were area weighted to achieve mean thickness across the 6-mm-diameter Early Treatment of Diabetic Retinopathy Study (ETDRS) grid. Cognitive status was assessed by the National Institutes of Health Toolbox cognitive battery for fluid and crystallized cognition. Correlations estimated associations between cognition and thicknesses, adjusting for age. Results: Based on 63 subjects (21 per group), thinning of the outer retina was significantly correlated with lower cognition scores (P < 0.05). No other retinal thickness variables were associated with cognition. Conclusions: Only the outer retina (photoreceptors, supporting glia, retinal pigment epithelium, Bruch's membrane) is associated with cognition in aging to intermediate AMD; NFL was not associated with cognition, contrary to AD-associated condition reports. Early and intermediate AMD constitute a retinal disease whose earliest, primary impact is in the outer retina. Our findings hint at a unique impact on the brain from the outer retina in persons with AMD.
Subject(s)
Aging , Cognition , Macular Degeneration , Retina , Tomography, Optical Coherence , Humans , Tomography, Optical Coherence/methods , Male , Aged , Female , Cross-Sectional Studies , Aging/physiology , Aged, 80 and over , Macular Degeneration/physiopathology , Cognition/physiology , Retina/diagnostic imaging , Retina/pathology , Retina/physiopathology , Nerve Fibers/pathology , Retinal Ganglion Cells/pathologyABSTRACT
Purpose: Understanding sociodemographic factors associated with poor visual outcomes in children with juvenile idiopathic arthritis-associated uveitis may help inform practice patterns. Patients and Methods: Retrospective cohort study on patients <18 years old who were diagnosed with both juvenile idiopathic arthritis and uveitis based on International Classification of Diseases tenth edition codes in the Intelligent Research in Sight Registry through December 2020. Surgical history was extracted using current procedural terminology codes. The primary outcome was incidence of blindness (20/200 or worse) in at least one eye in association with sociodemographic factors. Secondary outcomes included cataract and glaucoma surgery following uveitis diagnosis. Hazard ratios were calculated using multivariable-adjusted Cox proportional hazards models. Results: Median age of juvenile idiopathic arthritis-associated uveitis diagnosis was 11 (Interquartile Range: 8 to 15). In the Cox models adjusting for sociodemographic and insurance factors, the hazard ratios of best corrected visual acuity 20/200 or worse were higher in males compared to females (HR 2.15; 95% CI: 1.45-3.18), in Black or African American patients compared to White patients (2.54; 1.44-4.48), and in Medicaid-insured patients compared to commercially-insured patients (2.23; 1.48-3.37). Conclusion: Sociodemographic factors and insurance coverage were associated with varying levels of risk for poor visual outcomes in children with juvenile idiopathic arthritis-associated uveitis.
ABSTRACT
BACKGROUND: Sensory changes due to aging or disease can impact brain tissue. This study aims to investigate the link between glaucoma, a leading cause of blindness, and alterations in brain connections. METHODS: We analyzed diffusion MRI measurements of white matter tissue in a large group, consisting of 905 glaucoma patients (aged 49-80) and 5292 healthy individuals (aged 45-80) from the UK Biobank. Confounds due to group differences were mitigated by matching a sub-sample of controls to glaucoma subjects. We compared classification of glaucoma using convolutional neural networks (CNNs) focusing on the optic radiations, which are the primary visual connection to the cortex, against those analyzing non-visual brain connections. As a control, we evaluated the performance of regularized linear regression models. RESULTS: We showed that CNNs using information from the optic radiations exhibited higher accuracy in classifying subjects with glaucoma when contrasted with CNNs relying on information from non-visual brain connections. Regularized linear regression models were also tested, and showed significantly weaker classification performance. Additionally, the CNN was unable to generalize to the classification of age-group or of age-related macular degeneration. CONCLUSIONS: Our findings indicate a distinct and potentially non-linear signature of glaucoma in the tissue properties of optic radiations. This study enhances our understanding of how glaucoma affects brain tissue and opens avenues for further research into how diseases that affect sensory input may also affect brain aging.
In this study, we explored the relationship between glaucoma, the most common cause of blindness, and changes within the brain. We used data from diffusion MRI, a measurement method which assesses the properties of brain connections. We examined 905 individuals with glaucoma alongside 5292 healthy people. We refined the test cohort to be closely matched in age, sex, ethnicity, and socioeconomic backgrounds. The use of deep learning neural networks allowed accurate detection of glaucoma by focusing on the tissue properties of the optic radiations, a major brain pathway that transmits visual information, rather than other brain pathways used for comparison. Our work provides additional evidence that brain connections may age differently based on varying sensory inputs.
ABSTRACT
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77-94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
Subject(s)
Artificial Intelligence , Randomized Controlled Trials as Topic , Randomized Controlled Trials as Topic/standards , Humans , Guidelines as Topic , Research Design/standards , Research Report/standards , ChinaABSTRACT
PURPOSE: Deep learning (DL) models have achieved state-of-the-art medical diagnosis classification accuracy. Current models are limited by discrete diagnosis labels, but could yield more information with diagnosis in a continuous scale. We developed a novel continuous severity scaling system for macular telangiectasia (MacTel) type 2 by combining a DL classification model with uniform manifold approximation and projection (UMAP). DESIGN: We used a DL network to learn a feature representation of MacTel severity from discrete severity labels and applied UMAP to embed this feature representation into 2 dimensions, thereby creating a continuous MacTel severity scale. PARTICIPANTS: A total of 2003 OCT volumes were analyzed from 1089 MacTel Project participants. METHODS: We trained a multiview DL classifier using multiple B-scans from OCT volumes to learn a previously published discrete 7-step MacTel severity scale. The classifiers' last feature layer was extracted as input for UMAP, which embedded these features into a continuous 2-dimensional manifold. The DL classifier was assessed in terms of test accuracy. Rank correlation for the continuous UMAP scale against the previously published scale was calculated. Additionally, the UMAP scale was assessed in the κ agreement against 5 clinical experts on 100 pairs of patient volumes. For each pair of patient volumes, clinical experts were asked to select the volume with more severe MacTel disease and to compare them against the UMAP scale. MAIN OUTCOME MEASURES: Classification accuracy for the DL classifier and κ agreement versus clinical experts for UMAP. RESULTS: The multiview DL classifier achieved top 1 accuracy of 63.3% (186/294) on held-out test OCT volumes. The UMAP metric showed a clear continuous gradation of MacTel severity with a Spearman rank correlation of 0.84 with the previously published scale. Furthermore, the continuous UMAP metric achieved κ agreements of 0.56 to 0.63 with 5 clinical experts, which was comparable with interobserver κ values. CONCLUSIONS: Our UMAP embedding generated a continuous MacTel severity scale, without requiring continuous training labels. This technique can be applied to other diseases and may lead to more accurate diagnosis, improved understanding of disease progression, and key imaging features for pathologic characteristics. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Subject(s)
Deep Learning , Diabetic Retinopathy , Retinal Telangiectasis , Humans , Retinal Telangiectasis/diagnosis , Fluorescein Angiography/methods , Disease Progression , Tomography, Optical Coherence/methodsABSTRACT
Objective: To describe visual acuity data representation in the American Academy of Ophthalmology Intelligent Research in Sight (IRIS) Registry and present a data-cleaning strategy. Design: Reliability and validity study. Participants: Patients with visual acuity records from 2018 in the IRIS Registry. Methods: Visual acuity measurements and metadata were identified and characterized from 2018 IRIS Registry records. Metadata, including laterality, assessment method (distance, near, and unspecified), correction (corrected, uncorrected, and unspecified), and flags for refraction or pinhole assessment were compared between Rome (frozen April 20, 2020) and Chicago (frozen December 24, 2021) versions. We developed a data-cleaning strategy to infer patients' corrected distance visual acuity in their better-seeing eye. Main Outcome Measures: Visual acuity data characteristics in the IRIS Registry. Results: The IRIS Registry Chicago data set contains 168 920 049 visual acuity records among 23 001 531 unique patients and 49 968 974 unique patient visit dates in 2018. Visual acuity records were associated with refraction in 5.3% of cases, and with pinhole in 11.0%. Mean (standard deviation) of all measurements was 0.26 (0.41) logarithm of the minimum angle of resolution (logMAR), with a range of - 0.3 to 4.0 A plurality of visual acuity records were labeled corrected (corrected visual acuity [CVA], 39.1%), followed by unspecified (37.6%) and uncorrected (uncorrected visual acuity [UCVA], 23.4%). Corrected visual acuity measurements were paradoxically worse than same day UCVA 15% of the time. In aggregate, mean and median values were similar for CVA and unspecified visual acuity. Most visual acuity measurements were at distance (59.8%, vs. 32.1% unspecified and 8.2% near). Rome contained more duplicate visual acuity records than Chicago (10.8% vs. 1.4%). Near visual acuity was classified with Jaeger notation and (in Chicago only) also assigned logMAR values by Verana Health. LogMAR values for hand motion and light perception visual acuity were lower in Chicago than in Rome. The impact of data entry errors or outliers on analyses may be reduced by filtering and averaging visual acuity per eye over time. Conclusions: The IRIS Registry includes similar visual acuity metadata in Rome and Chicago. Although fewer duplicate records were found in Chicago, both versions include duplicate and atypical measurements (i.e., CVA worse than UCVA on the same day). Analyses may benefit from using algorithms to filter outliers and average visual acuity measurements over time. Financial Disclosures: Proprietary or commercial disclosure may be found found in the Footnotes and Disclosures at the end of this article.
ABSTRACT
resumen está disponible en el texto completo
ABSTRACT The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.
RESUMO A declaração CONSORT 2010 apresenta diretrizes mínimas para relatórios de ensaios clínicos randomizados. Seu uso generalizado tem sido fundamental para garantir a transparência na avaliação de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence) é uma nova diretriz para relatórios de ensaios clínicos que avaliam intervenções com um componente de IA. Ela foi desenvolvida em paralelo à sua declaração complementar para protocolos de ensaios clínicos, a SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 29 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão CONSORT-AI inclui 14 itens novos que, devido à sua importância para as intervenções de IA, devem ser informados rotineiramente juntamente com os itens básicos da CONSORT 2010. A CONSORT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA está inserida, considerações sobre o manuseio dos dados de entrada e saída da intervenção de IA, a interação humano-IA e uma análise dos casos de erro. A CONSORT-AI ajudará a promover a transparência e a integralidade nos relatórios de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente a qualidade do desenho do ensaio clínico e o risco de viés nos resultados relatados.
ABSTRACT
resumen está disponible en el texto completo
ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.
RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.
ABSTRACT
The advent of generative artificial intelligence and large language models has ushered in transformative applications within medicine. Specifically in ophthalmology, large language models offer unique opportunities to revolutionise digital eye care, address clinical workflow inefficiencies, and enhance patient experiences across diverse global eye care landscapes. Yet alongside these prospects lie tangible and ethical challenges, encompassing data privacy, security, and the intricacies of embedding large language models into clinical routines. This Viewpoint highlights the promising applications of large language models in ophthalmology, while weighing up the practical and ethical barriers towards their real-world implementation. This Viewpoint seeks to stimulate broader discourse on the potential of large language models in ophthalmology and to galvanise both clinicians and researchers into tackling the prevailing challenges and optimising the benefits of large language models while curtailing the associated risks.
Subject(s)
Medicine , Ophthalmology , Humans , Artificial Intelligence , Language , PrivacyABSTRACT
Current guidelines recommend that individuals with diabetes receive yearly eye exams for detection of referable diabetic retinopathy (DR), one of the leading causes of new-onset blindness. For addressing the immense screening burden, artificial intelligence (AI) algorithms have been developed to autonomously screen for DR from fundus photography without human input. Over the last 10 years, many AI algorithms have achieved good sensitivity and specificity (>85%) for detection of referable DR compared with human graders; however, many questions still remain. In this narrative review on AI in DR screening, we discuss key concepts in AI algorithm development as a background for understanding the algorithms. We present the AI algorithms that have been prospectively validated against human graders and demonstrate the variability of reference standards and cohort demographics. We review the limited head-to-head validation studies where investigators attempt to directly compare the available algorithms. Next, we discuss the literature regarding cost-effectiveness, equity and bias, and medicolegal considerations, all of which play a role in the implementation of these AI algorithms in clinical practice. Lastly, we highlight ongoing efforts to bridge gaps in AI model data sets to pursue equitable development and delivery.
Subject(s)
Diabetes Mellitus , Diabetic Retinopathy , Humans , Artificial Intelligence , Diabetic Retinopathy/diagnosis , Prospective Studies , Cost-Benefit Analysis , AlgorithmsABSTRACT
Background: Few metrics exist to describe phenotypic diversity within ophthalmic imaging datasets, with researchers often using ethnicity as an inappropriate marker for biological variability. Methods: We derived a continuous, measured metric, the retinal pigment score (RPS), that quantifies the degree of pigmentation from a colour fundus photograph of the eye. RPS was validated using two large epidemiological studies with demographic and genetic data (UK Biobank and EPIC-Norfolk Study). Findings: A genome-wide association study (GWAS) of RPS from UK Biobank identified 20 loci with known associations with skin, iris and hair pigmentation, of which 8 were replicated in the EPIC-Norfolk cohort. There was a strong association between RPS and ethnicity, however, there was substantial overlap between each ethnicity and the respective distributions of RPS scores. Interpretation: RPS serves to decouple traditional demographic variables, such as ethnicity, from clinical imaging characteristics. RPS may serve as a useful metric to quantify the diversity of the training, validation, and testing datasets used in the development of AI algorithms to ensure adequate inclusion and explainability of the model performance, critical in evaluating all currently deployed AI models. The code to derive RPS is publicly available at: https://github.com/uw-biomedical-ml/retinal-pigmentation-score. Funding: The authors did not receive support from any organisation for the submitted work.