A Comparative Study of Large Language Models, Human Experts, and Expert-Edited Large Language Models to Neuro-Ophthalmology Questions.

BACKGROUND: While large language models (LLMs) are increasingly used in medicine, their effectiveness compared with human experts remains unclear. This study evaluates the quality and empathy of Expert + AI, human experts, and LLM responses in neuro-ophthalmology. METHODS: This randomized, masked, multicenter cross-sectional study was conducted from June to July 2023. We randomly assigned 21 neuro-ophthalmology questions to 13 experts. Each expert provided an answer and then edited a ChatGPT-4-generated response, timing both tasks. In addition, 5 LLMs (ChatGPT-3.5, ChatGPT-4, Claude 2, Bing, Bard) generated responses. Anonymized and randomized responses from Expert + AI, human experts, and LLMs were evaluated by the remaining 12 experts. The main outcome was the mean score for quality and empathy, rated on a 1-5 scale. RESULTS: Significant differences existed between response types for both quality and empathy (P < 0.0001, P < 0.0001). For quality, Expert + AI (4.16 ± 0.81) performed the best, followed by GPT-4 (4.04 ± 0.92), GPT-3.5 (3.99 ± 0.87), Claude (3.6 ± 1.09), Expert (3.56 ± 1.01), Bard (3.5 ± 1.15), and Bing (3.04 ± 1.12). For empathy, Expert + AI (3.63 ± 0.87) had the highest score, followed by GPT-4 (3.6 ± 0.88), Bard (3.54 ± 0.89), GPT-3.5 (3.5 ± 0.83), Bing (3.27 ± 1.03), Expert (3.26 ± 1.08), and Claude (3.11 ± 0.78). For quality (P < 0.0001) and empathy (P = 0.002), Expert + AI performed better than Expert. Time taken for expert-created and expert-edited LLM responses was similar (P = 0.75). CONCLUSIONS: Expert-edited LLM responses had the highest expert-determined ratings of quality and empathy warranting further exploration of their potential benefits in clinical settings.

Central Retinal Artery Occlusion Associated with Takayasu Arteritis.

Takayasu arteritis is a chronic inflammatory vasculitis with granulomatous panarteritis particularly impacting large vessels including the aorta and its branches, especially the subclavian arteries, with clinical manifestation dependent on the involved artery. Sequelae of the active disease vary, including stenosis, occlusions, or aneurysmal dilatations of the large vessels. The prevalence of Takayasu arteritis is higher in the Asian population and in Japan, but quite low in the United States, varying from 0.9-8.4 per million people. Ocular manifestations are rare and lead to a delay in diagnosis and appropriate treatment. Ocular manifestations include Takayasu retinopathy, anterior ischemic optic neuropathy (AION), retinal artery occlusion (RAO) and retinal vein occlusion (RVO). We present two cases in which central retinal artery occlusion (CRAO) was associated with Takayasu arteritis. CRAO is an ophthalmic emergency with an incidence of 1.9 per 100,000 person years in the United States; only 5% of cases are arteritic, which can be observed with inflammatory vasculitides secondary to the formation of immune deposits.

Ocular Neuromyotonia: Clinical Features, Diagnosis, and Outcomes.

PURPOSE: The purpose of this study was to describe the clinical features, management, outcomes, and diagnostic pitfalls in a large series of patients with ocular neuromyotonia. DESIGN: Retrospective cohort. METHODS: Patients diagnosed with ocular neuromyotonia from January 1, 2004, through January 1, 2023, seen at one of the 3 Mayo Clinic sites in Rochester, MN, Scottsdale, AZ, and Jacksonville, FL, comprised the study population. We ascertained patients with ocular neuromyotonia through a search using the medical records database. Only patients with an observed episode of ocular neuromyotonia were included and the medical records were reviewed. The main outcome measures were clinical features and outcomes of patients with ocular neuromyotonia. RESULTS: Forty-two patients who were diagnosed with ocular neuromyotonia were included. The median age was 58 years (range, 16-80 years). A history of cranial radiation therapy was present in 39 patients (93%). The sixth cranial nerve was involved in 31 patients (74%). Bilateral disease was found in 2 patients (5%). The median time from onset of diplopia to diagnosis was 8 months (range, 1 month-25 years), with a high rate of initial misdiagnosis in 52%. Twenty of 42 patients (48%) were treated with oral medication, of whom 95% had significant improvement or resolution of symptoms. CONCLUSION: Prior cranial irradiation is the most common cause for ocular neuromyotonia, affecting the sixth cranial nerve most often. Although delayed and initial misdiagnosis is common, most patients show improved symptoms on medical treatment.