ABSTRACT
Purpose: To assess the performance of Chat Generative Pre-Trained Transformer-4 in providing accurate diagnoses to retina teaching cases from OCTCases. Design: Cross-sectional study. Subjects: Retina teaching cases from OCTCases. Methods: We prompted a custom chatbot with 69 retina cases containing multimodal ophthalmic images, asking it to provide the most likely diagnosis. In a sensitivity analysis, we inputted increasing amounts of clinical information pertaining to each case until the chatbot achieved a correct diagnosis. We performed multivariable logistic regressions on Stata v17.0 (StataCorp LLC) to investigate associations between the amount of text-based information inputted per prompt and the odds of the chatbot achieving a correct diagnosis, adjusting for the laterality of cases, number of ophthalmic images inputted, and imaging modalities. Main Outcome Measures: Our primary outcome was the proportion of cases for which the chatbot was able to provide a correct diagnosis. Our secondary outcome was the chatbot's performance in relation to the amount of text-based information accompanying ophthalmic images. Results: Across 69 retina cases collectively containing 139 ophthalmic images, the chatbot was able to provide a definitive, correct diagnosis for 35 (50.7%) cases. The chatbot needed variable amounts of clinical information to achieve a correct diagnosis, where the entire patient description as presented by OCTCases was required for a majority of correctly diagnosed cases (23 of 35 cases, 65.7%). Relative to when the chatbot was only prompted with a patient's age and sex, the chatbot achieved a higher odds of a correct diagnosis when prompted with an entire patient description (odds ratio = 10.1, 95% confidence interval = 3.3-30.3, P < 0.01). Despite providing an incorrect diagnosis for 34 (49.3%) cases, the chatbot listed the correct diagnosis within its differential diagnosis for 7 (20.6%) of these incorrectly answered cases. Conclusions: This custom chatbot was able to accurately diagnose approximately half of the retina cases requiring multimodal input, albeit relying heavily on text-based contextual information that accompanied ophthalmic images. The diagnostic ability of the chatbot in interpretation of multimodal imaging without text-based information is currently limited. The appropriate use of the chatbot in this setting is of utmost importance, given bioethical concerns. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
ABSTRACT
PURPOSE: In the context of ophthalmologic practice, there has been a rapid increase in the amount of data collected using electronic health records (EHR). Artificial intelligence (AI) offers a promising means of centralizing data collection and analysis, but to date, most AI algorithms have only been applied to analyzing image data in ophthalmologic practice. In this review we aimed to characterize the use of AI in the analysis of EHR, and to critically appraise the adherence of each included study to the CONSORT-AI reporting guideline. METHODS: A comprehensive search of three relevant databases (MEDLINE, EMBASE, and Cochrane Library) from January 2010 to February 2023 was conducted. The included studies were evaluated for reporting quality based on the AI-specific items from the CONSORT-AI reporting guideline. RESULTS: Of the 4,968 articles identified by our search, 89 studies met all inclusion criteria and were included in this review. Most of the studies utilized AI for ocular disease prediction (n = 41, 46.1%), and diabetic retinopathy was the most studied ocular pathology (n = 19, 21.3%). The overall mean CONSORT-AI score across the 14 measured items was 12.1 (range 8-14, median 12). Categories with the lowest adherence rates were: describing handling of poor quality data (48.3%), specifying participant inclusion and exclusion criteria (56.2%), and detailing access to the AI intervention or its code, including any restrictions (62.9%). CONCLUSIONS: In conclusion, we have identified that AI is prominently being used for disease prediction in ophthalmology clinics, however these algorithms are limited by their lack of generalizability and cross-center reproducibility. A standardized framework for AI reporting should be developed, to improve AI applications in the management of ocular disease and ophthalmology decision making.
ABSTRACT
INTRODUCTION: Quality improvement (QI) efforts are critical to promoting health equity and mitigating disparities in healthcare outcomes. Equity-focused QI (EF-QI) interventions address the unique needs of equity-deserving groups and the root causes of disparities. This scoping review aims to identify themes from EF-QI interventions that improve the health of equity-deserving groups, to serve as a resource for researchers embarking on QI. METHODS: In adherence with Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines, several healthcare and medical databases were systematically searched from inception to December 2022. Primary studies that report results from EF-QI interventions in healthcare were included. Reviewers conducted screening and data extraction using Covidence. Inductive thematic analysis using NVivo identified key barriers to inform future EF-QI interventions. RESULTS: Of 5,330 titles and abstracts screened, 36 articles were eligible for inclusion. They reported on EF-QI interventions across eight medical disciplines: primary care, obstetrics, psychiatry, paediatrics, oncology, cardiology, neurology and respirology. The most common focus was racialised communities (15/36; 42%). Barriers to EF-QI interventions included those at the provider level (training and supervision, time constraints) and institution level (funding and partnerships, infrastructure). The last theme critical to EF-QI interventions is sustainability. Only six (17%) interventions actively involved patient partners. DISCUSSION: EF-QI interventions can be an effective tool for promoting health equity, but face numerous barriers to success. It is unclear whether the demonstrated barriers are intrinsic to the equity focus of the projects or can be generalised to all QI work. Researchers embarking on EF-QI work should engage patients, in addition to hospital and clinic leadership in the design process to secure funding and institutional support, improving sustainability. To the best of our knowledge, no review has synthesised the results of EF-QI interventions in healthcare. Further studies of EF-QI champions are required to better understand the barriers and how to overcome them.
ABSTRACT
The majority of the literature focused on whether consent should be extended to the adolescent population arises from themes adapted from American tort law. In contrast to the USA, Ontario does not delineate an age of consent for medical treatment and relying on American guidelines to guide practice in Ontario is problematic. While the literature is saturated with discussions for and against seeking adolescent consent, there are currently no bioethical guidelines on adolescent consent in the province of Ontario. This paper explores adolescent refusal of care and adolescent request for care in opposition to parental wishes. The paper seeks to answer the following questions: What is the difference between an adolescent and an adult in medical decision-making? What are the barriers to seeking adolescent consent? And, can the neurobiological argument be an accurate guide for obtaining adolescent consent?
ABSTRACT
BACKGROUND: Vascularized free tissue transfer has been established as an effective method in the reconstruction of mandibular defects. However, a limited understanding of its efficacy in pediatric patients persists due to its infrequent presentation. The aim of this study is to systematically consolidate the survival and infection rates of free flaps in pediatric mandibular reconstruction. METHODS: A systematic literature search was conducted on Ovid Medline, Embase, and Cochrane Library for studies published up to January 2024. We included peer-reviewed studies reporting on survival and infection outcomes associated with free flap mandibular reconstruction in pediatric patients (<18 years). We performed a random-effects meta-analysis with the inverse-variance weighted approach to estimate survival and infection rates. Heterogeneity was assessed by I2, and publication bias was examined using Egger's test. RESULTS: A total of 26 studies, reporting on 463 free flaps and 439 pediatric patients with a mean age of 10.7 years, were included in our study. Most free flaps originated from the fibula (n = 392/463, 84.7%) and benign tumors were the most common cause for mandibular reconstruction (n = 179/463, 38.7%). The pooled estimate for survival of flaps was 96% (95% CI: 93-97, I2 = 0%), and recipient-site infections were estimated to occur in 9% (95% CI: 6-13, I2 = 0%) of cases. The most common reported complications within the study timeframe were early malocclusion (n = 28/123, 21.4%) and bite abnormalities (18/131, 13.7%). CONCLUSION: Free tissue transfer for mandibular reconstruction in pediatric patients is effective and safe. Further research is required to explore functionality following mandibular reconstruction in diverse pediatric populations.
Subject(s)
Free Tissue Flaps , Mandibular Reconstruction , Humans , Free Tissue Flaps/transplantation , Mandibular Reconstruction/methods , Child , Graft Survival , Surgical Wound Infection/epidemiology , Surgical Wound Infection/etiologyABSTRACT
PURPOSE: To elicit associations between vision difficulties and physical or psychosocial challenges in children in the United States. METHODS: Children aged 2-17 years old from the 2021 National Health Interview Survey with data pertaining to vision difficulty were included in our retrospective, population-based analysis. Our primary aim was investigating physical and psychosocial challenges as predictors of vision difficulty. Logistic regression models were performed on Stata version 17.0 (StataCorp LLC, College Station, Texas). Analyses were accompanied by an odds ratio (OR) and 95% confidence interval (CI). RESULTS: A total of 7,373 children had data pertaining to their level of vision difficulty and were included in our sample. In our multivariable analysis, children with a good/fair (OR = 1.84, 95% CI = [1.31, 2.60], p < 0.01), or poor (OR = 5.08, 95% CI = [1.61, 16.04], p < 0.01) general health status had higher odds of vision difficulty relative to children with an excellent/very good health status. Furthermore, children with difficulties hearing (OR = 8.67, 95% CI = [5.25, 14.31], p < 0.01), communicating (OR = 1.96, 95% CI = [1.18, 3.25], p < 0.01), learning (OR = 1.93, 95% CI = [1.27, 2.93], p < 0.01), and making friends (OR = 1.94, 95% CI = [1.12, 3.36], p = 0.02) had higher odds of vision difficulty. Nonetheless, the following factors were only predictors of vision difficulty in our univariable analysis: requiring equipment for mobility (p < 0.01), experiencing anxiety (p < 0.01), and experiencing depression (p < 0.01). CONCLUSION: Several factors pertaining to physical and psychosocial challenges in children are associated with vision difficulty. Future research should further explore potential causal links between vision difficulty and physical or psychosocial factors to aid in coordinating public health efforts dedicated to vision health equity.
ABSTRACT
PURPOSE: To compare the efficacy and safety of pars plana vitrectomy (PPV) with silicone oil compared to gas tamponade for uncomplicated rhegmatogenous retinal detachment (RRD). DESIGN: Systematic review and meta-analysis. METHODS: A systematic literature search was conducted on Ovid MEDLINE, Embase, and the Cochrane Library from January 2000 to September 2023 for comparative studies evaluating the efficacy and safety of PPV with either silicone oil or gas tamponade in the setting of uncomplicated RRD. Our primary outcome was best-corrected visual acuity at the last study observation. Secondary outcomes included the rates of retinal reattachment, retinal thickness, and the incidence of adverse events. We performed a meta-analysis using a random-effects model. RESULTS: Nine observational studies reporting on 491 RRD eyes were included. The mean best-corrected visual acuity at the last study observation was significantly better in the gas tamponade group than in the silicone oil group (weighted mean difference [WMD] = 0.17 logMAR, 95% confidence interval [CI] = [0.06, 0.27], P = .002). Rates of primary retinal reattachment were similar between the silicone oil and gas tamponade groups (P = .89). The ganglion cell layer was significantly thinner in the silicone oil group compared to the gas tamponade group (WMD =-3.70 µm, 95% CI = [-5.87, -1.53, P = .0008), as was the inner plexiform layer (WMD = -2.45, 95% CI = [-4.50, -0.40], P = .02) and outer nuclear layer (WMD = -11.74 µm, 95% CI = [-18.39, -5.10], P = .0005). CONCLUSIONS: PPV with gas tamponade was associated with better functional outcomes compared to PPV with silicone oil, although both tamponades yielded comparable primary reattachment rates. The absence of randomized trials and the potential for selection bias underscore the importance of further investigation in diverse patient populations.
Subject(s)
Biomarkers , Cisplatin , Hypertension , Renal Insufficiency, Chronic , Humans , Cisplatin/adverse effects , Biomarkers/blood , Child , Renal Insufficiency, Chronic/diagnosis , Kidney Tubules/pathology , Kidney Tubules/metabolism , Kidney Tubules/drug effects , Female , Male , Child, Preschool , Antineoplastic Agents/adverse effects , Antineoplastic Agents/therapeutic use , Adolescent , Hepatitis A Virus Cellular Receptor 1/metabolismABSTRACT
PURPOSE: With the popularization of ChatGPT (Open AI, San Francisco, California, United States) in recent months, understanding the potential of artificial intelligence (AI) chatbots in a medical context is important. Our study aims to evaluate Google Gemini and Bard's (Google, Mountain View, California, United States) knowledge in ophthalmology. METHODS: In this study, we evaluated Google Gemini and Bard's performance on EyeQuiz, a platform containing ophthalmology board certification examination practice questions, when used from the United States (US). Accuracy, response length, response time, and provision of explanations were evaluated. Subspecialty-specific performance was noted. A secondary analysis was conducted using Bard from Vietnam, and Gemini from Vietnam, Brazil, and the Netherlands. RESULTS: Overall, Google Gemini and Bard both had accuracies of 71% across 150 text-based multiple-choice questions. The secondary analysis revealed an accuracy of 67% using Bard from Vietnam, with 32 questions (21%) answered differently than when using Bard from the US. Moreover, the Vietnam version of Gemini achieved an accuracy of 74%, with 23 (15%) answered differently than the US version of Gemini. While the Brazil (68%) and Netherlands (65%) versions of Gemini performed slightly worse than the US version, differences in performance across the various country-specific versions of Bard and Gemini were not statistically significant. CONCLUSION: Google Gemini and Bard had an acceptable performance in responding to ophthalmology board examination practice questions. Subtle variability was noted in the performance of the chatbots across different countries. The chatbots also tended to provide a confident explanation even when providing an incorrect answer.
ABSTRACT
BACKGROUND: Stereotactic ablative radiation therapy (SBRT) is an emerging treatment option for primary renal cell carcinoma (RCC), particularly in patients who are unsuitable for surgery. The aim of this review is to assess the effect of increasing the biologically equivalent dose (BED) via various radiation fractionation regimens on clinical outcomes. METHODS: A literature search was conducted in PubMed (Medline), EMBASE, and the Cochrane Library for studies published up to October 2023. Studies reporting on patients with localized RCC receiving SBRT were included to determine its effectiveness on local control, progression-free survival, and overall survival. A random effects model was used to meta-regress clinical outcomes relative to the BED for each study and heterogeneity was assessed by I2. RESULTS: A total of 724 patients with RCC from 22 studies were included, with a mean age of 72.7 years (range: 44.0-81.0). Local control was excellent with an estimate of 99 % (95 %CI: 97-100 %, I2 = 19 %), 98 % (95 %CI: 96-99 %, I2 = 8 %), and 94 % (95 %CI: 90-97 %, I2 = 11 %) at one year, two years, and five years respectively. No definitive association between increasing BED and local control, progression-free survival and overall survival was observed. No publication bias was observed. CONCLUSIONS: A significant dose response relationship between oncological outcomes and was not identified, and excellent local control outcomes were observed at the full range of doses. Until new evidence points otherwise, we support current recommendations against routine dose escalation beyond 25-26 Gy in one fraction or 42-48 Gy in three fractions, and to consider de-escalation or compromising target coverage if required to achieve safe organ at risk doses.
Subject(s)
Carcinoma, Renal Cell , Dose-Response Relationship, Radiation , Kidney Neoplasms , Humans , Carcinoma, Renal Cell/radiotherapy , Dose Fractionation, Radiation , Kidney Neoplasms/radiotherapy , Treatment OutcomeABSTRACT
Importance: Ophthalmology is reliant on effective interpretation of multimodal imaging to ensure diagnostic accuracy. The new ability of ChatGPT-4 (OpenAI) to interpret ophthalmic images has not yet been explored. Objective: To evaluate the performance of the novel release of an artificial intelligence chatbot that is capable of processing imaging data. Design, Setting, and Participants: This cross-sectional study used a publicly available dataset of ophthalmic cases from OCTCases, a medical education platform based out of the Department of Ophthalmology and Vision Sciences at the University of Toronto, with accompanying clinical multimodal imaging and multiple-choice questions. Across 137 available cases, 136 contained multiple-choice questions (99%). Exposures: The chatbot answered questions requiring multimodal input from October 16 to October 23, 2023. Main Outcomes and Measures: The primary outcome was the accuracy of the chatbot in answering multiple-choice questions pertaining to image recognition in ophthalmic cases, measured as the proportion of correct responses. χ2 Tests were conducted to compare the proportion of correct responses across different ophthalmic subspecialties. Results: A total of 429 multiple-choice questions from 136 ophthalmic cases and 448 images were included in the analysis. The chatbot answered 299 of multiple-choice questions correctly across all cases (70%). The chatbot's performance was better on retina questions than neuro-ophthalmology questions (77% vs 58%; difference = 18%; 95% CI, 7.5%-29.4%; χ21 = 11.4; P < .001). The chatbot achieved a better performance on nonimage-based questions compared with image-based questions (82% vs 65%; difference = 17%; 95% CI, 7.8%-25.1%; χ21 = 12.2; P < .001).The chatbot performed best on questions in the retina category (77% correct) and poorest in the neuro-ophthalmology category (58% correct). The chatbot demonstrated intermediate performance on questions from the ocular oncology (72% correct), pediatric ophthalmology (68% correct), uveitis (67% correct), and glaucoma (61% correct) categories. Conclusions and Relevance: In this study, the recent version of the chatbot accurately responded to approximately two-thirds of multiple-choice questions pertaining to ophthalmic cases based on imaging interpretation. The multimodal chatbot performed better on questions that did not rely on the interpretation of imaging modalities. As the use of multimodal chatbots becomes increasingly widespread, it is imperative to stress their appropriate integration within medical contexts.
Subject(s)
Glaucoma , Ophthalmology , Child , Humans , Artificial Intelligence , Cross-Sectional Studies , RetinaABSTRACT
BACKGROUND: Cleft lip and/or palate (CL/P) is one of the most common congenital anomalies worldwide. Although CL/P management may require a series of interventions, mortality resulting from CL/P alone is rare. This study aims to examine recent trends of CL/P mortality rates in the USA. METHODS: A retrospective population-based study was conducted using official US birth and death certificate data from the Centers for Disease Control and Prevention from 2000 to 2019. Annual mortality rates per 1000 births with CL/P were calculated across sex and racial groups. Multivariable logistic regression models estimated the effects of sex and race on the risk of mortality with CL/P, and linear regression models were used to examine temporal changes in mortality rate across sex and race. RESULTS: From 2000 to 2019, 1119 deaths occurred in patients with documented CL/P, for an overall incidence of 20.3 deaths per 1000 births with CL/P (95% CI 18.9 to 22.8). Of these, Patau syndrome was the listed cause of death in 167 cases (14.9%). Black individuals (OR 1.93, 95% CI 1.85 to 2.01), Hispanic (1.54, 1.49 to 1.58) and American Indian individuals (1.28, 1.20 to 1.35) were at a greater risk of CL/P mortality compared with white individuals. Additionally, females were also at a greater risk (1.35, 1.21 to 1.49). A significant upward trend in CL/P mortality was observed in Hispanic (r2=0.70, p<0.01) and American Indian individuals (r2=0.81, p<0.01) from 2000 to 2019. CONCLUSIONS: Cleft birth and mortality surveillance is essential in healthcare and prevention planning. Future studies are required to understand the differences in CL/P mortality rates across various sociodemographic groups.
Subject(s)
Cleft Lip , Cleft Palate , Female , Humans , United States/epidemiology , Cleft Lip/epidemiology , Cleft Palate/epidemiology , Retrospective Studies , WhiteABSTRACT
Primary vitreoretinal lymphoma is a potentially aggressive intraocular malignancy with poor systemic prognosis and sometimes significant diagnostic delays as it may masquerade as chronic uveitis. Despite the variety of diagnostic techniques, it is unclear which modality is most accurate in the diagnosis of PVRL. A systematic literature search was conducted on Ovid MEDLINE, EMBASE and the Cochrane Controlled Register of Trials for studies published between January, 2000, and June, 2023. Randomized controlled trials (RCTs) reporting on the following diagnostic tools used to diagnose patients with PVRL were included: cytology, flow cytometry, MYD88 L265P mutation, CD79B mutation, interleukin 10/interleukin-6 (IL-10/IL-6) ratio, polymerase chain reaction (PCR) for monoclonal immunoglobulin heavy chain (IgH) and immunoglobulin kappa light chain (IgK) rearrangements, and imaging findings. The aggregated sensitivity of each diagnostic modality was reported and compared using the chi-squared (χ2) test. A total of 662 eyes from 29 retrospective studies reporting on patients diagnosed with PVRL were included. An IL-10/IL-6 ratio greater than 1 had the highest sensitivity (89.39%, n = 278/311 eyes, n = 16 studies) for PVRL, where the sensitivity was not significantly different when only vitreous samples were drawn (88.89%, n = 232/261 eyes, n = 13 studies) compared to aqueous samples (83.33%, n = 20/24, n = 2) (p = 0.42). Flow cytometry of vitreous samples gave a positive result in 66/75 eyes (88.00%, n = 6 studies) with PVRL, and monoclonal IgH rearrangements on PCR gave a positive result in 354/416 eyes (85.10%, n = 20 studies) with PVRL. MYD88 L265P and CD79B mutation analysis performed poorly, yielding a positive result in 63/90 eyes (70.00%, n = 8 studies) with PVRL, and 20/57 eyes (35.09%, n = 4 studies) with PVRL, respectively. Overall, our systematic review found that an IL-10/IL-6 ratio greater or equal to one may provide the highest sensitivity in identifying patients with PVRL. Future studies are needed to employ multiple diagnostic tools to aid in the detection of PVRL and to further establish nuanced guidelines when determining the optimal diagnostic tool to use in diverse patient populations.