Methodological insights into ChatGPT's screening performance in systematic reviews.

BACKGROUND: The screening process for systematic reviews and meta-analyses in medical research is a labor-intensive and time-consuming task. While machine learning and deep learning have been applied to facilitate this process, these methods often require training data and user annotation. This study aims to assess the efficacy of ChatGPT, a large language model based on the Generative Pretrained Transformers (GPT) architecture, in automating the screening process for systematic reviews in radiology without the need for training data. METHODS: A prospective simulation study was conducted between May 2nd and 24th, 2023, comparing ChatGPT's performance in screening abstracts against that of general physicians (GPs). A total of 1198 abstracts across three subfields of radiology were evaluated. Metrics such as sensitivity, specificity, positive and negative predictive values (PPV and NPV), workload saving, and others were employed. Statistical analyses included the Kappa coefficient for inter-rater agreement, ROC curve plotting, AUC calculation, and bootstrapping for p-values and confidence intervals. RESULTS: ChatGPT completed the screening process within an hour, while GPs took an average of 7-10 days. The AI model achieved a sensitivity of 95% and an NPV of 99%, slightly outperforming the GPs' sensitive consensus (i.e., including records if at least one person includes them). It also exhibited remarkably low false negative counts and high workload savings, ranging from 40 to 83%. However, ChatGPT had lower specificity and PPV compared to human raters. The average Kappa agreement between ChatGPT and other raters was 0.27. CONCLUSIONS: ChatGPT shows promise in automating the article screening phase of systematic reviews, achieving high sensitivity and workload savings. While not entirely replacing human expertise, it could serve as an efficient first-line screening tool, particularly in reducing the burden on human resources. Further studies are needed to fine-tune its capabilities and validate its utility across different medical subfields.

Outcome after Neuro-interventional Treatment of Intracranial Aneurysm (as a First Treatment Modality).

Endovascular treatment is widely applied as the first-line treatment for intracranial aneurysms and includes simple coiling (SC), stent-assisted coiling (SAC), flow diversion stent, and flow disruption stent. The present study is a retrospective cohort study performed in Imam Khomeini Hospital, Department of Neurovascular Intervention, between March 2016 and March 2021. A total number of 229 patients with intracranial aneurysms who underwent therapeutic intravascular interventions were enrolled, of which 89 were treated with SC, 111 with SAC, 25 with flow diversion stent, and 4 with flow disruption stent. The mean age of the subjects was 51.8±12.6 years, and 51.1% were male. Modified Raymond-Roy classification (MRRC) was used to define the occlusion outcome. The success rate, considered as Class I and Class II of MRRC at treatment time was 89% (94.4% in SC, and 84.7% in SAC), which was increased to 90.9% (94% in SC, 93% in SAC, 69.6% in flow diversion stenting, 100% in flow disruption) at 6-month follow-up, and 84.6% (80.8% in SC, 87.8% in SAC, 78.3% in flow diversion stenting, and 100% in flow disruption) at 12-month follow-up. The mean modified Rankin Scale (mRS) before the procedure was 0.05±0.26 which was increased to 0.22±0.76 after the procedure, 0.22±0.76 at 6 months, and 0.30±0.95 at 12 months (P<0.001). Similar to previous studies, the present study demonstrates that neurovascular intervention can treat ruptured aneurysms as the first therapeutic modality with favourable outcomes. A double-blind, randomized clinical trial is needed to eliminate the confounding factors and better demonstrate the outcome.

Pregnancy Rate and Outcomes following Uterine Artery Embolization for Uterine Arteriovenous Malformations: A Systematic Review and Meta-Analysis.

PURPOSE: To systematically review published studies on the pregnancy rate and outcomes after uterine artery embolization (UAE) for uterine arteriovenous malformations (UAVMs). MATERIALS AND METHODS: International medical databases were searched for all English-language studies published between 2000 and 2022 on patients with UAVMs who had undergone embolization and had a subsequent pregnancy. Data on the pregnancy rate, pregnancy complications, and physiologic status of newborns were extracted from the articles. Ten case series were included in the meta-analysis, and 18 case reports on pregnancy following UAE were reviewed. RESULTS: In the case series, 44 pregnancies were reported in 189 patients. The pooled estimate of pregnancy rate was 23.3% (95% confidence interval [CI], 17.3%-29.3%). The pregnancy rate was higher in studies of women with a mean age of ≤30 years (50.6% vs 22.2%; P < .05). The pooled estimate of live birth rate was 88.6% (95% CI, 78.6%-98.7%). CONCLUSIONS: All published series report preservation of fertility and successful pregnancies after embolization of UAVMs. The live birth rate in these series does not differ substantially from that of the general population.

Popularity and Harms of Aural Foreign Bodies: A Descriptive Study of Patients in Baqiyatallah University Hospital, Tehran, Iran.

OBJECTIVE: To evaluate the prevalence of external ear complications among Iranian aural foreign body users attending to otolaryngology clinic of our hospital. METHODS: In this cross-sectional study patients attending to Otolaryngology clinics of Baqiyatallah hospital were enrolled regardless of their age, gender and reason of attending. Patients between 15 and 60 years of age were included in the present study. Those with positive history of chronic ear diseases, ear surgery, congenital ear disorders, trauma to ear or head and neck region or shock wave trauma were excluded from the study. Demographic information as well as data on chief complaint, educational level, frequency and type of used foreign body and findings of physical examination and Otoscopy by a single otolaryngologist were recorded in a predesigned checklist. RESULTS: Eventually 362 patients (232 male and 130 female) with a mean age of 40.32 ± 16.90 years underwent analysis. Of all patients 244 (67.2%) were using a kind of aural foreign body frequently and Cotton bud was the most popular (63.5%) used foreign body among patients. Drying ear canal was the most common (54.9%) reason of using AFBs among study individuals followed by itching (29.5%) and pyorrhea (11.06%). Also 11 (4.5%) patients were using AFBs as a habit with no specific reason. Itching was the most prevalent symptom reported by both aural foreign body users (78%) and non-users (45.5%); however it was significantly higher among AFB users (p = 0.026). Also hearing loss was significantly more reported by AFB users (p = 0.033). A majority of patients had normal physical examination in both AFB users and non-users group. Inflammation of ear canal was significantly more detected in AFB users (p = 0.004). In addition, rate of right ear wax impaction was higher among AFB users (p = 0.016). CONCLUSION: In conclusion we realized that 67.2% of patients attending to Otolaryngology clinic of our hospital were using a kind of aural foreign bodies and itching was the most common chief complaint of these patients.