Comparing generative and retrieval-based chatbots in answering patient questions regarding age-related macular degeneration and diabetic retinopathy.

BACKGROUND/AIMS: To compare the performance of generative versus retrieval-based chatbots in answering patient inquiries regarding age-related macular degeneration (AMD) and diabetic retinopathy (DR). METHODS: We evaluated four chatbots: generative models (ChatGPT-4, ChatGPT-3.5 and Google Bard) and a retrieval-based model (OcularBERT) in a cross-sectional study. Their response accuracy to 45 questions (15 AMD, 15 DR and 15 others) was evaluated and compared. Three masked retinal specialists graded the responses using a three-point Likert scale: either 2 (good, error-free), 1 (borderline) or 0 (poor with significant inaccuracies). The scores were aggregated, ranging from 0 to 6. Based on majority consensus among the graders, the responses were also classified as 'Good', 'Borderline' or 'Poor' quality. RESULTS: Overall, ChatGPT-4 and ChatGPT-3.5 outperformed the other chatbots, both achieving median scores (IQR) of 6 (1), compared with 4.5 (2) in Google Bard, and 2 (1) in OcularBERT (all p ≤8.4×10-3). Based on the consensus approach, 83.3% of ChatGPT-4's responses and 86.7% of ChatGPT-3.5's were rated as 'Good', surpassing Google Bard (50%) and OcularBERT (10%) (all p ≤1.4×10-2). ChatGPT-4 and ChatGPT-3.5 had no 'Poor' rated responses. Google Bard produced 6.7% Poor responses, and OcularBERT produced 20%. Across question types, ChatGPT-4 outperformed Google Bard only for AMD, and ChatGPT-3.5 outperformed Google Bard for DR and others. CONCLUSION: ChatGPT-4 and ChatGPT-3.5 demonstrated superior performance, followed by Google Bard and OcularBERT. Generative chatbots are potentially capable of answering domain-specific questions outside their original training. Further validation studies are still required prior to real-world implementation.

Misspellings or "miscellings"-Non-verifiable and unknown cell lines in cancer research publications.

Reproducible laboratory research relies on correctly identified reagents. We have previously described gene research papers with wrongly identified nucleotide sequence(s), including papers studying miR-145. Manually verifying reagent identities in 36 recent miR-145 papers found that 56% and 17% of papers described misidentified nucleotide sequences and cell lines, respectively. We also found 5 cell line identifiers in miR-145 papers with misidentified nucleotide sequences and cell lines, and 18 cell line identifiers published elsewhere, that did not represent indexed human cell lines. These 23 identifiers were described as non-verifiable (NV), as their identities were unclear. Studying 420 papers that mentioned 8 NV identifier(s) found 235 papers (56%) that referred to 7 identifiers (BGC-803, BSG-803, BSG-823, GSE-1, HGC-7901, HGC-803, and MGC-823) as independent cell lines. We could not find any publications describing how these cell lines were established. Six cell lines were sourced from cell line repositories with externally accessible online catalogs, but these cell lines were not indexed as claimed. Some papers also stated that short tandem repeat (STR) profiles had been generated for three cell lines, yet no STR profiles could be identified. In summary, as NV cell lines represent new challenges to research integrity and reproducibility, further investigations are required to clarify their status and identities.

Sociodemographic and Visual Outcomes of Juvenile Idiopathic Arthritis Uveitis: IRIS® Registry Study.

Purpose: Understanding sociodemographic factors associated with poor visual outcomes in children with juvenile idiopathic arthritis-associated uveitis may help inform practice patterns. Patients and Methods: Retrospective cohort study on patients <18 years old who were diagnosed with both juvenile idiopathic arthritis and uveitis based on International Classification of Diseases tenth edition codes in the Intelligent Research in Sight Registry through December 2020. Surgical history was extracted using current procedural terminology codes. The primary outcome was incidence of blindness (20/200 or worse) in at least one eye in association with sociodemographic factors. Secondary outcomes included cataract and glaucoma surgery following uveitis diagnosis. Hazard ratios were calculated using multivariable-adjusted Cox proportional hazards models. Results: Median age of juvenile idiopathic arthritis-associated uveitis diagnosis was 11 (Interquartile Range: 8 to 15). In the Cox models adjusting for sociodemographic and insurance factors, the hazard ratios of best corrected visual acuity 20/200 or worse were higher in males compared to females (HR 2.15; 95% CI: 1.45-3.18), in Black or African American patients compared to White patients (2.54; 1.44-4.48), and in Medicaid-insured patients compared to commercially-insured patients (2.23; 1.48-3.37). Conclusion: Sociodemographic factors and insurance coverage were associated with varying levels of risk for poor visual outcomes in children with juvenile idiopathic arthritis-associated uveitis.

Cardiovascular Magnetic Resonance Reference Ranges From the Healthy Hearts Consortium.

BACKGROUND: The absence of population-stratified cardiovascular magnetic resonance (CMR) reference ranges from large cohorts is a major shortcoming for clinical care. OBJECTIVES: This paper provides age-, sex-, and ethnicity-specific CMR reference ranges for atrial and ventricular metrics from the Healthy Hearts Consortium, an international collaborative comprising 9,088 CMR studies from verified healthy individuals, covering the complete adult age spectrum across both sexes, and with the highest ethnic diversity reported to date. METHODS: CMR studies were analyzed using certified software with batch processing capability (cvi42, version 5.14 prototype, Circle Cardiovascular Imaging) by 2 expert readers. Three segmentation methods (smooth, papillary, anatomic) were used to contour the endocardial and epicardial borders of the ventricles and atria from long- and short-axis cine series. Clinically established ventricular and atrial metrics were extracted and stratified by age, sex, and ethnicity. Variations by segmentation method, scanner vendor, and magnet strength were examined. Reference ranges are reported as 95% prediction intervals. RESULTS: The sample included 4,452 (49.0%) men and 4,636 (51.0%) women with average age of 61.1 ± 12.9 years (range: 18-83 years). Among these, 7,424 (81.7%) were from White, 510 (5.6%) South Asian, 478 (5.3%) mixed/other, 341 (3.7%) Black, and 335 (3.7%) Chinese ethnicities. Images were acquired using 1.5-T (n = 8,779; 96.6%) and 3.0-T (n = 309; 3.4%) scanners from Siemens (n = 8,299; 91.3%), Philips (n = 498; 5.5%), and GE (n = 291, 3.2%). CONCLUSIONS: This work represents a resource with healthy CMR-derived volumetric reference ranges ready for clinical implementation.

Convolutional neural network-based classification of glaucoma using optic radiation tissue properties.

BACKGROUND: Sensory changes due to aging or disease can impact brain tissue. This study aims to investigate the link between glaucoma, a leading cause of blindness, and alterations in brain connections. METHODS: We analyzed diffusion MRI measurements of white matter tissue in a large group, consisting of 905 glaucoma patients (aged 49-80) and 5292 healthy individuals (aged 45-80) from the UK Biobank. Confounds due to group differences were mitigated by matching a sub-sample of controls to glaucoma subjects. We compared classification of glaucoma using convolutional neural networks (CNNs) focusing on the optic radiations, which are the primary visual connection to the cortex, against those analyzing non-visual brain connections. As a control, we evaluated the performance of regularized linear regression models. RESULTS: We showed that CNNs using information from the optic radiations exhibited higher accuracy in classifying subjects with glaucoma when contrasted with CNNs relying on information from non-visual brain connections. Regularized linear regression models were also tested, and showed significantly weaker classification performance. Additionally, the CNN was unable to generalize to the classification of age-group or of age-related macular degeneration. CONCLUSIONS: Our findings indicate a distinct and potentially non-linear signature of glaucoma in the tissue properties of optic radiations. This study enhances our understanding of how glaucoma affects brain tissue and opens avenues for further research into how diseases that affect sensory input may also affect brain aging.

In this study, we explored the relationship between glaucoma, the most common cause of blindness, and changes within the brain. We used data from diffusion MRI, a measurement method which assesses the properties of brain connections. We examined 905 individuals with glaucoma alongside 5292 healthy people. We refined the test cohort to be closely matched in age, sex, ethnicity, and socioeconomic backgrounds. The use of deep learning neural networks allowed accurate detection of glaucoma by focusing on the tissue properties of the optic radiations, a major brain pathway that transmits visual information, rather than other brain pathways used for comparison. Our work provides additional evidence that brain connections may age differently based on varying sensory inputs.

Higher odds of periodontitis in systemic lupus erythematosus compared to controls and rheumatoid arthritis: a systematic review, meta-analysis and network meta-analysis.

Introduction: Periodontitis as a comorbidity in systemic lupus erythematosus (SLE) is still not well recognized in the dental and rheumatology communities. A meta-analysis and network meta-analysis were thus performed to compare the (i) prevalence of periodontitis in SLE patients compared to those with rheumatoid arthritis (RA) and (ii) odds of developing periodontitis in controls, RA, and SLE. Methods: Pooled prevalence of and odds ratio (OR) for periodontitis were compared using meta-analysis and network meta-analysis (NMA). Results: Forty-three observational studies involving 7,800 SLE patients, 49,388 RA patients, and 766,323 controls were included in this meta-analysis. The pooled prevalence of periodontitis in SLE patients (67.0%, 95% confidence interval [CI] 57.0-77.0%) was comparable to that of RA (65%, 95% CI 55.0-75.0%) (p>0.05). Compared to controls, patients with SLE (OR=2.64, 95% CI 1.24-5.62, p<0.01) and RA (OR=1.81, 95% CI 1.25-2.64, p<0.01) were more likely to have periodontitis. Indirect comparisons through the NMA demonstrated that the odds of having periodontitis in SLE was 1.49 times higher compared to RA (OR=1.49, 95% CI 1.09-2.05, p<0.05). Discussion: Given that RA is the autoimmune disease classically associated with periodontal disease, the higher odds of having periodontitis in SLE are striking. These results highlight the importance of addressing the dental health needs of patients with SLE. Systematic review registration: https://www.crd.york.ac.uk/PROSPERO/ identifier CRD42021272876.

The role of emotion dysregulation in self-management behaviors among adults with type 2 diabetes.

Suboptimal disease self-management among adults with type 2 diabetes is associated with greater risk of diabetes related health complications and mortality. Emotional distress has been linked with poor diabetes self-management; however, few studies have examined the role of emotion dysregulation in diabetes management. The purpose of this study was to examine the relations between different facets of emotion dysregulation and diabetes self-management behaviors among a sample of 373 adults with type 2 diabetes. Separate median regression and binary logistic regression models were used to examine the association of emotion dysregulation facets and each diabetes self-care behavior (i.e., medication nonadherence, diet, exercise, self-monitoring of blood glucose (SMBG), foot care, and smoking). Generally, greater difficulties in emotion regulation were associated with poorer self-management behaviors. However, several facets of emotion dysregulation were linked with better self-management behaviors. Addressing emotion dysregulation among adults with type 2 diabetes has the potential to improve diabetes related self-management.

Self-Supervised Learning for Improved Optical Coherence Tomography Detection of Macular Telangiectasia Type 2.

Importance: Deep learning image analysis often depends on large, labeled datasets, which are difficult to obtain for rare diseases. Objective: To develop a self-supervised approach for automated classification of macular telangiectasia type 2 (MacTel) on optical coherence tomography (OCT) with limited labeled data. Design, Setting, and Participants: This was a retrospective comparative study. OCT images from May 2014 to May 2019 were collected by the Lowy Medical Research Institute, La Jolla, California, and the University of Washington, Seattle, from January 2016 to October 2022. Clinical diagnoses of patients with and without MacTel were confirmed by retina specialists. Data were analyzed from January to September 2023. Exposures: Two convolutional neural networks were pretrained using the Bootstrap Your Own Latent algorithm on unlabeled training data and fine-tuned with labeled training data to predict MacTel (self-supervised method). ResNet18 and ResNet50 models were also trained using all labeled data (supervised method). Main Outcomes and Measures: The ground truth yes vs no MacTel diagnosis is determined by retinal specialists based on spectral-domain OCT. The models' predictions were compared against human graders using accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), area under precision recall curve (AUPRC), and area under the receiver operating characteristic curve (AUROC). Uniform manifold approximation and projection was performed for dimension reduction and GradCAM visualizations for supervised and self-supervised methods. Results: A total of 2636 OCT scans from 780 patients with MacTel and 131 patients without MacTel were included from the MacTel Project (mean [SD] age, 60.8 [11.7] years; 63.8% female), and another 2564 from 1769 patients without MacTel from the University of Washington (mean [SD] age, 61.2 [18.1] years; 53.4% female). The self-supervised approach fine-tuned on 100% of the labeled training data with ResNet50 as the feature extractor performed the best, achieving an AUPRC of 0.971 (95% CI, 0.969-0.972), an AUROC of 0.970 (95% CI, 0.970-0.973), accuracy of 0.898%, sensitivity of 0.898, specificity of 0.949, PPV of 0.935, and NPV of 0.919. With only 419 OCT volumes (185 MacTel patients in 10% of labeled training dataset), the ResNet18 self-supervised model achieved comparable performance, with an AUPRC of 0.958 (95% CI, 0.957-0.960), an AUROC of 0.966 (95% CI, 0.964-0.967), and accuracy, sensitivity, specificity, PPV, and NPV of 90.2%, 0.884, 0.916, 0.896, and 0.906, respectively. The self-supervised models showed better agreement with the more experienced human expert graders. Conclusions and Relevance: The findings suggest that self-supervised learning may improve the accuracy of automated MacTel vs non-MacTel binary classification on OCT with limited labeled training data, and these approaches may be applicable to other rare diseases, although further research is warranted.

Large language models as tax attorneys: a case study in legal capabilities emergence.

Better understanding of Large Language Models' (LLMs) legal analysis abilities can contribute to improving the efficiency of legal services, governing artificial intelligence and leveraging LLMs to identify inconsistencies in law. This paper explores LLM capabilities in applying tax law. We choose this area of law because it has a structure that allows us to set up automated validation pipelines across thousands of examples, requires logical reasoning and maths skills, and enables us to test LLM capabilities in a manner relevant to real-world economic lives of citizens and companies. Our experiments demonstrate emerging legal understanding capabilities, with improved performance in each subsequent OpenAI model release. We experiment with retrieving and using the relevant legal authority to assess the impact of providing additional legal context to LLMs. Few-shot prompting, presenting examples of question-answer pairs, is also found to significantly enhance the performance of the most advanced model, GPT-4. The findings indicate that LLMs, particularly when combined with prompting enhancements and the correct legal texts, can perform at high levels of accuracy but not yet at expert tax lawyer levels. As LLMs continue to advance, their ability to reason about law autonomously could have significant implications for the legal profession and AI governance. This article is part of the theme issue 'A complexity science approach to law and governance'.

The Effect of Substrate Properties on Cellular Behavior and Nanoparticle Uptake in Human Fibroblasts and Epithelial Cells.

The delivery of nanomedicines into cells holds enormous therapeutic potential; however little is known regarding how the extracellular matrix (ECM) can influence cell-nanoparticle (NP) interactions. Changes in ECM organization and composition occur in several pathophysiological states, including fibrosis and tumorigenesis, and may contribute to disease progression. We show that the physical characteristics of cellular substrates, that more closely resemble the ECM in vivo, can influence cell behavior and the subsequent uptake of NPs. Electrospinning was used to create two different substrates made of soft polyurethane (PU) with aligned and non-aligned nanofibers to recapitulate the ECM in two different states. To investigate the impact of cell-substrate interaction, A549 lung epithelial cells and MRC-5 lung fibroblasts were cultured on soft PU membranes with different alignments and compared against stiff tissue culture plastic (TCP)/glass. Both cell types could attach and grow on both PU membranes with no signs of cytotoxicity but with increased cytokine release compared with cells on the TCP. The uptake of silica NPs increased more than three-fold in fibroblasts but not in epithelial cells cultured on both membranes. This study demonstrates that cell-matrix interaction is substrate and cell-type dependent and highlights the importance of considering the ECM and tissue mechanical properties when designing NPs for effective cell targeting and treatment.

Non-operative Management of Acute Knee Injuries.

PURPOSE OF REVIEW: Acute knee injuries are commonly encountered in both the clinical and sideline setting and may be treated operatively or non-operatively. This article describes an evidence-based approach to non-operative acute knee injury. This includes history, physical exam, imaging, and initial management. In addition, the non-operative management of three such injuries-ligament injury, meniscus injury, and patellar dislocation injury-will be discussed via a case-based practical approach. RECENT FINDINGS: Aside from grade III ACL tears, most acute knee ligament injuries, especially in the absence of other concurrent injuries, can be treated non-operatively. There is new evidence that acute traumatic meniscus tears in those younger than 40 can be successfully treated non-operatively and can do equally, as well as those that undergo surgery, at 1 year out from injury. Based on the current literature, a short period of knee bracing in extension with progression to weightbearing to tolerance is recommended after initial patellar dislocation. Many of the most common acute knee injuries, including MCL tears, meniscus tears, and patellar dislocations, can be managed non-operatively. A detailed systemic approach to initial evaluation, including pertinent history, physical exam, and appropriate imaging, is essential and complementary to the subsequent non-operative treatment algorithm.

Developing a Continuous Severity Scale for Macular Telangiectasia Type 2 Using Deep Learning and Implications for Disease Grading.

PURPOSE: Deep learning (DL) models have achieved state-of-the-art medical diagnosis classification accuracy. Current models are limited by discrete diagnosis labels, but could yield more information with diagnosis in a continuous scale. We developed a novel continuous severity scaling system for macular telangiectasia (MacTel) type 2 by combining a DL classification model with uniform manifold approximation and projection (UMAP). DESIGN: We used a DL network to learn a feature representation of MacTel severity from discrete severity labels and applied UMAP to embed this feature representation into 2 dimensions, thereby creating a continuous MacTel severity scale. PARTICIPANTS: A total of 2003 OCT volumes were analyzed from 1089 MacTel Project participants. METHODS: We trained a multiview DL classifier using multiple B-scans from OCT volumes to learn a previously published discrete 7-step MacTel severity scale. The classifiers' last feature layer was extracted as input for UMAP, which embedded these features into a continuous 2-dimensional manifold. The DL classifier was assessed in terms of test accuracy. Rank correlation for the continuous UMAP scale against the previously published scale was calculated. Additionally, the UMAP scale was assessed in the κ agreement against 5 clinical experts on 100 pairs of patient volumes. For each pair of patient volumes, clinical experts were asked to select the volume with more severe MacTel disease and to compare them against the UMAP scale. MAIN OUTCOME MEASURES: Classification accuracy for the DL classifier and κ agreement versus clinical experts for UMAP. RESULTS: The multiview DL classifier achieved top 1 accuracy of 63.3% (186/294) on held-out test OCT volumes. The UMAP metric showed a clear continuous gradation of MacTel severity with a Spearman rank correlation of 0.84 with the previously published scale. Furthermore, the continuous UMAP metric achieved κ agreements of 0.56 to 0.63 with 5 clinical experts, which was comparable with interobserver κ values. CONCLUSIONS: Our UMAP embedding generated a continuous MacTel severity scale, without requiring continuous training labels. This technique can be applied to other diseases and may lead to more accurate diagnosis, improved understanding of disease progression, and key imaging features for pathologic characteristics. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Psychometric Properties of the Short Scale Anxiety Sensitivity Index Among Adults with Chronic Respiratory Disease.

Approximately one-third of adults with chronic respiratory disease (CRD) have comorbid depressive and anxiety disorders; yet these disorders are often unrecognized in this patient population. Transdiagnostic processes such as anxiety sensitivity (AS) are useful for identifying mechanisms underlying psychological and heath conditions. The Short-Scale AS Index (SSASI) is a brief self-report measure of AS which has potential clinical utility among CRD populations to evaluate psychological distress and inform comprehensive care. The present study investigated the psychometric properties of the SSASI among adults with CRDs. Participants were recruited from a web-based panel of adults with CRDs (n = 768; 49.3% female; 57.8% White) including adults with asthma only (n = 230), COPD only (n = 321), or co-occurring asthma and COPD (n = 217). Participants completed a battery of self-report questionnaires assessing psychological and medical symptoms. Analyses were conducted to examine the factor structure and measurement invariance across CRD groups. Convergent validity and criterion validity of the SSASI were assessed within each group. Results supported partial measurement invariance across CRD groups. The SSASI demonstrated high reliability, convergent validity, and criterion validity with each CRD group. Findings from this study and existing work indicate that the SSASI is an effective and economical assessment tool for identifying patients CRD who may benefit from psychological interventions to reduce AS.

Evaluating Visual Acuity in the American Academy of Ophthalmology IRIS® Registry.

Objective: To describe visual acuity data representation in the American Academy of Ophthalmology Intelligent Research in Sight (IRIS) Registry and present a data-cleaning strategy. Design: Reliability and validity study. Participants: Patients with visual acuity records from 2018 in the IRIS Registry. Methods: Visual acuity measurements and metadata were identified and characterized from 2018 IRIS Registry records. Metadata, including laterality, assessment method (distance, near, and unspecified), correction (corrected, uncorrected, and unspecified), and flags for refraction or pinhole assessment were compared between Rome (frozen April 20, 2020) and Chicago (frozen December 24, 2021) versions. We developed a data-cleaning strategy to infer patients' corrected distance visual acuity in their better-seeing eye. Main Outcome Measures: Visual acuity data characteristics in the IRIS Registry. Results: The IRIS Registry Chicago data set contains 168 920 049 visual acuity records among 23 001 531 unique patients and 49 968 974 unique patient visit dates in 2018. Visual acuity records were associated with refraction in 5.3% of cases, and with pinhole in 11.0%. Mean (standard deviation) of all measurements was 0.26 (0.41) logarithm of the minimum angle of resolution (logMAR), with a range of - 0.3 to 4.0 A plurality of visual acuity records were labeled corrected (corrected visual acuity [CVA], 39.1%), followed by unspecified (37.6%) and uncorrected (uncorrected visual acuity [UCVA], 23.4%). Corrected visual acuity measurements were paradoxically worse than same day UCVA 15% of the time. In aggregate, mean and median values were similar for CVA and unspecified visual acuity. Most visual acuity measurements were at distance (59.8%, vs. 32.1% unspecified and 8.2% near). Rome contained more duplicate visual acuity records than Chicago (10.8% vs. 1.4%). Near visual acuity was classified with Jaeger notation and (in Chicago only) also assigned logMAR values by Verana Health. LogMAR values for hand motion and light perception visual acuity were lower in Chicago than in Rome. The impact of data entry errors or outliers on analyses may be reduced by filtering and averaging visual acuity per eye over time. Conclusions: The IRIS Registry includes similar visual acuity metadata in Rome and Chicago. Although fewer duplicate records were found in Chicago, both versions include duplicate and atypical measurements (i.e., CVA worse than UCVA on the same day). Analyses may benefit from using algorithms to filter outliers and average visual acuity measurements over time. Financial Disclosures: Proprietary or commercial disclosure may be found found in the Footnotes and Disclosures at the end of this article.

Directrices para presentación de informes de ensayos clínicos sobre intervenciones con inteligencia artificial: extensión CONSORT-AI / Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension / Diretrizes para relatórios de ensaios clínicos com intervenções que utilizam inteligência artificial: a extensão CONSORT-AI

resumen está disponible en el texto completo

ABSTRACT The CONSORT 2010 statement provides minimum guidelines for reporting randomized trials. Its widespread use has been instrumental in ensuring transparency in the evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate impact on health outcomes. The CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trials evaluating interventions with an AI component. It was developed in parallel with its companion statement for clinical trial protocols: SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 29 candidate items, which were assessed by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a two-day consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The CONSORT-AI extension includes 14 new items that were considered sufficiently important for AI interventions that they should be routinely reported in addition to the core CONSORT 2010 items. CONSORT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention is integrated, the handling of inputs and outputs of the AI intervention, the human-AI interaction and provision of an analysis of error cases. CONSORT-AI will help promote transparency and completeness in reporting clinical trials for AI interventions. It will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the quality of clinical trial design and risk of bias in the reported outcomes.

RESUMO A declaração CONSORT 2010 apresenta diretrizes mínimas para relatórios de ensaios clínicos randomizados. Seu uso generalizado tem sido fundamental para garantir a transparência na avaliação de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence) é uma nova diretriz para relatórios de ensaios clínicos que avaliam intervenções com um componente de IA. Ela foi desenvolvida em paralelo à sua declaração complementar para protocolos de ensaios clínicos, a SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 29 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão CONSORT-AI inclui 14 itens novos que, devido à sua importância para as intervenções de IA, devem ser informados rotineiramente juntamente com os itens básicos da CONSORT 2010. A CONSORT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA está inserida, considerações sobre o manuseio dos dados de entrada e saída da intervenção de IA, a interação humano-IA e uma análise dos casos de erro. A CONSORT-AI ajudará a promover a transparência e a integralidade nos relatórios de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente a qualidade do desenho do ensaio clínico e o risco de viés nos resultados relatados.

Directrices para los protocolos de ensayos clínicos de intervenciones con inteligencia artificial: la extensión SPIRIT-AI / Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension / Diretrizes para protocolos de ensaios clínicos com intervenções que utilizam inteligência artificial: a extensão SPIRIT-AI

resumen está disponible en el texto completo

ABSTRACT The SPIRIT 2013 statement aims to improve the completeness of clinical trial protocol reporting by providing evidence-based recommendations for the minimum set of items to be addressed. This guidance has been instrumental in promoting transparent evaluation of new interventions. More recently, there has been a growing recognition that interventions involving artificial intelligence (AI) need to undergo rigorous, prospective evaluation to demonstrate their impact on health outcomes. The SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials-Artificial Intelligence) extension is a new reporting guideline for clinical trial protocols evaluating interventions with an AI component. It was developed in parallel with its companion statement for trial reports: CONSORT-AI (Consolidated Standards of Reporting Trials-Artificial Intelligence). Both guidelines were developed through a staged consensus process involving literature review and expert consultation to generate 26 candidate items, which were consulted upon by an international multi-stakeholder group in a two-stage Delphi survey (103 stakeholders), agreed upon in a consensus meeting (31 stakeholders) and refined through a checklist pilot (34 participants). The SPIRIT-AI extension includes 15 new items that were considered sufficiently important for clinical trial protocols of AI interventions. These new items should be routinely reported in addition to the core SPIRIT 2013 items. SPIRIT-AI recommends that investigators provide clear descriptions of the AI intervention, including instructions and skills required for use, the setting in which the AI intervention will be integrated, considerations for the handling of input and output data, the human-AI interaction and analysis of error cases. SPIRIT-AI will help promote transparency and completeness for clinical trial protocols for AI interventions. Its use will assist editors and peer reviewers, as well as the general readership, to understand, interpret and critically appraise the design and risk of bias for a planned clinical trial.

RESUMO A declaração SPIRIT 2013 tem como objetivo melhorar a integralidade dos relatórios dos protocolos de ensaios clínicos, fornecendo recomendações baseadas em evidências para o conjunto mínimo de itens que devem ser abordados. Essas orientações têm sido fundamentais para promover uma avaliação transparente de novas intervenções. Recentemente, tem-se reconhecido cada vez mais que intervenções que incluem inteligência artificial (IA) precisam ser submetidas a uma avaliação rigorosa e prospectiva para demonstrar seus impactos sobre os resultados de saúde. A extensão SPIRIT-AI (Standard Protocol Items: Recommendations for Interventional Trials - Artificial Intelligence) é uma nova diretriz de relatório para protocolos de ensaios clínicos que avaliam intervenções com um componente de IA. Essa diretriz foi desenvolvida em paralelo à sua declaração complementar para relatórios de ensaios clínicos, CONSORT-AI (Consolidated Standards of Reporting Trials - Artificial Intelligence). Ambas as diretrizes foram desenvolvidas por meio de um processo de consenso em etapas que incluiu revisão da literatura e consultas a especialistas para gerar 26 itens candidatos. Foram feitas consultas sobre esses itens a um grupo internacional composto por 103 interessados diretos, que participaram de uma pesquisa Delphi em duas etapas. Chegou-se a um acordo sobre os itens em uma reunião de consenso que incluiu 31 interessados diretos, e os itens foram refinados por meio de uma lista de verificação piloto que envolveu 34 participantes. A extensão SPIRIT-AI inclui 15 itens novos que foram considerados suficientemente importantes para os protocolos de ensaios clínicos com intervenções que utilizam IA. Esses itens novos devem constar dos relatórios de rotina, juntamente com os itens básicos da SPIRIT 2013. A SPIRIT-AI preconiza que os pesquisadores descrevam claramente a intervenção de IA, incluindo instruções e as habilidades necessárias para seu uso, o contexto no qual a intervenção de IA será integrada, considerações sobre o manuseio dos dados de entrada e saída, a interação humano-IA e a análise de casos de erro. A SPIRIT-AI ajudará a promover a transparência e a integralidade nos protocolos de ensaios clínicos com intervenções que utilizam IA. Seu uso ajudará editores e revisores, bem como leitores em geral, a entender, interpretar e avaliar criticamente o delineamento e o risco de viés de um futuro estudo clínico.

Ethnic disparities in progression rates for sight-threatening diabetic retinopathy in diabetic eye screening: a population-based retrospective cohort study.

INTRODUCTION: The English Diabetic Eye Screening Programme (DESP) offers people living with diabetes (PLD) annual eye screening. We examined incidence and determinants of sight-threatening diabetic retinopathy (STDR) in a sociodemographically diverse multi-ethnic population. RESEARCH DESIGN AND METHODS: North East London DESP cohort data (January 2012 to December 2021) with 137 591 PLD with no retinopathy, or non-STDR at baseline in one/both eyes, were used to calculate STDR incidence rates by sociodemographic factors, diabetes type, and duration. HR from Cox models examined associations with STDR. RESULTS: There were 16 388 incident STDR cases over a median of 5.4 years (IQR 2.8-8.2; STDR rate 2.214, 95% CI 2.214 to 2.215 per 100 person-years). People with no retinopathy at baseline had a lower risk of sight-threatening diabetic retinopathy (STDR) compared with those with non-STDR in one eye (HR 3.03, 95% CI 2.91 to 3.15, p<0.001) and both eyes (HR 7.88, 95% CI 7.59 to 8.18, p<0.001). Black and South Asian individuals had higher STDR hazards than white individuals (HR 1.57, 95% CI 1.50 to 1.64 and HR 1.36, 95% CI 1.31 to 1.42, respectively). Additionally, every 5-year increase in age at inclusion was associated with an 8% reduction in STDR hazards (p<0.001). CONCLUSIONS: Ethnic disparities exist in a health system limited by capacity rather than patient economic circumstances. Diabetic retinopathy at first screen is a strong determinant of STDR development. By using basic demographic characteristics, screening programmes or clinical practices can stratify risk for sight-threatening diabetic retinopathy development.

Large language models and their impact in ophthalmology.

The advent of generative artificial intelligence and large language models has ushered in transformative applications within medicine. Specifically in ophthalmology, large language models offer unique opportunities to revolutionise digital eye care, address clinical workflow inefficiencies, and enhance patient experiences across diverse global eye care landscapes. Yet alongside these prospects lie tangible and ethical challenges, encompassing data privacy, security, and the intricacies of embedding large language models into clinical routines. This Viewpoint highlights the promising applications of large language models in ophthalmology, while weighing up the practical and ethical barriers towards their real-world implementation. This Viewpoint seeks to stimulate broader discourse on the potential of large language models in ophthalmology and to galvanise both clinicians and researchers into tackling the prevailing challenges and optimising the benefits of large language models while curtailing the associated risks.

Two-year recall for people with no diabetic retinopathy: a multi-ethnic population-based retrospective cohort study using real-world data to quantify the effect.

BACKGROUND/AIMS: The English Diabetic Eye Screening Programme (DESP) offers people living with diabetes (PLD) annual screening. Less frequent screening has been advocated among PLD without diabetic retinopathy (DR), but evidence for each ethnic group is limited. We examined the potential effect of biennial versus annual screening on the detection of sight-threatening diabetic retinopathy (STDR) and proliferative diabetic retinopathy (PDR) among PLD without DR from a large urban multi-ethnic English DESP. METHODS: PLD in North-East London DESP (January 2012 to December 2021) with no DR on two prior consecutive screening visits with up to 8 years of follow-up were examined. Annual STDR and PDR incidence rates, overall and by ethnicity, were quantified. Delays in identification of STDR and PDR events had 2-year screening intervals been used were determined. FINDINGS: Among 82 782 PLD (37% white, 36% South Asian, and 16% black people), there were 1788 incident STDR cases over mean (SD) 4.3 (2.4) years (STDR rate 0.51, 95% CI 0.47 to 0.55 per 100-person-years). STDR incidence rates per 100-person-years by ethnicity were 0.55 (95% CI 0.48 to 0.62) for South Asian, 0.34 (95% CI 0.29 to 0.40) for white, and 0.77 (95% CI 0.65 to 0.90) for black people. Biennial screening would have delayed diagnosis by 1 year for 56.3% (1007/1788) with STDR and 43.6% (45/103) with PDR. Standardised cumulative rates of delayed STDR per 100 000 persons for each ethnic group were 1904 (95% CI 1683 to 2154) for black people, 1276 (95% CI 1153 to 1412) for South Asian people, and 844 (95% CI 745 to 955) for white people. INTERPRETATION: Biennial screening would have delayed detection of some STDR and PDR by 1 year, especially among those of black ethnic origin, leading to healthcare inequalities.