Performance of GPT-3.5 and GPT-4 on standardized urology knowledge assessment items in the United States: a descriptive study.

PURPOSE: This study aimed to evaluate the performance of Chat Generative Pre-Trained Transformer (ChatGPT) with respect to standardized urology multiple-choice items in the United States. METHODS: In total, 700 multiple-choice urology board exam-style items were submitted to GPT-3.5 and GPT-4, and responses were recorded. Items were categorized based on topic and question complexity (recall, interpretation, and problem-solving). The accuracy of GPT-3.5 and GPT-4 was compared across item types in February 2024. RESULTS: GPT-4 answered 44.4% of items correctly compared to 30.9% for GPT-3.5 (P>0.0001). GPT-4 (vs. GPT-3.5) had higher accuracy with urologic oncology (43.8% vs. 33.9%, P=0.03), sexual medicine (44.3% vs. 27.8%, P=0.046), and pediatric urology (47.1% vs. 27.1%, P=0.012) items. Endourology (38.0% vs. 25.7%, P=0.15), reconstruction and trauma (29.0% vs. 21.0%, P=0.41), and neurourology (49.0% vs. 33.3%, P=0.11) items did not show significant differences in performance across versions. GPT-4 also outperformed GPT-3.5 with respect to recall (45.9% vs. 27.4%, P<0.00001), interpretation (45.6% vs. 31.5%, P=0.0005), and problem-solving (41.8% vs. 34.5%, P=0.56) type items. This difference was not significant for the higher-complexity items. Conclusion: s: ChatGPT performs relatively poorly on standardized multiple-choice urology board exam-style items, with GPT-4 outperforming GPT-3.5. The accuracy was below the proposed minimum passing standards for the American Board of Urology's Continuing Urologic Certification knowledge reinforcement activity (60%). As artificial intelligence progresses in complexity, ChatGPT may become more capable and accurate with respect to board examination items. For now, its responses should be scrutinized.

Smaller Differences in the Comparative Effectiveness of Biologics in Reducing Asthma-Related Hospitalizations Compared With Overall Exacerbations.

BACKGROUND: Evidence on the comparative effectiveness of respiratory biologics remains sparse. OBJECTIVE: We sought to evaluate the comparative effectiveness of omalizumab, mepolizumab, benralizumab, and dupilumab in a matched retrospective cohort of patients with asthma. METHODS: We identified patients with asthma aged ≥18 years who were incident users of these biologics between November 1, 2018, and June 30, 2023, in administrative claims data from the Food and Drug Administration's Sentinel System and Merative MarketScan Commercial Database. We compared asthma-related exacerbations and hospitalizations in the 12 months since biologic prescription in pairwise comparisons of propensity score-matched cohorts. Covariates used in matching included age, sex, allergic comorbidities, baseline asthma medications use, and the Charlson Comorbidity Index. Incidence rate ratios (IRR) and 95% confidence intervals (CI) were estimated using negative binomial regression models. RESULTS: A total of 893 patients on mepolizumab, 1300 on benralizumab, 1170 on omalizumab, and 1863 on dupilumab were identified. The average age was 55 years, and two-thirds of the participants were female. At baseline, over 80% of these individuals had an active prescription for an inhaled corticosteroid. Almost half of patients on dupilumab had concomitant nasal polyposis compared with 6% to 13% of patients on the other biologics. Covariates were balanced after matching. In matched analyses, dupilumab was associated with the lowest incidence of exacerbations over the follow-up period (vs dupilumab): mepolizumab (IRR: 1.36; 95% CI: 1.12, 1.64), omalizumab (IRR: 1.33; 95% CI: 1.13, 1.58), benralizumab (IRR: 1.19; 95% CI: 1.00, 1.41). For exacerbations leading to hospitalizations, benralizumab and mepolizumab were associated with the lowest incidence of hospitalizations, and the greatest difference was between mepolizumab versus dupilumab (IRR: 0.76; 95% CI: 0.56, 1.03). CONCLUSIONS: Dupilumab was associated with the lowest incidence of overall exacerbations, and mepolizumab with the lowest incidence of asthma hospitalizations in this administrative claims-based cohort of individuals with asthma. Despite matching propensity scores, residual confounding, such as baseline eosinophil count, may explain some of these findings.

Treatment and care received by children hospitalized with COVID-19 in a large hospital network in the United States, February 2020 to September 2021.

We described care received by hospitalized children with COVID-19 or multi-system inflammatory syndrome (MIS-C) prior to the 2021 COVID-19 Omicron variant surge in the US. We identified hospitalized children <18 years of age with a COVID-19 or MIS-C diagnosis (COVID-19 not required), separately, from February 2020-September 2021 (n = 126 hospitals). We described high-risk conditions, inpatient treatments, and complications among these groups. Among 383,083 pediatric hospitalizations, 2,186 had COVID-19 and 395 had MIS-C diagnosis. Less than 1% had both COVID-19 and MIS-C diagnosis (n = 154). Over half were >6 years old (54% COVID-19, 70% MIS-C). High-risk conditions included asthma (14% COVID-19, 11% MIS-C), and obesity (9% COVID-19, 10% MIS-C). Pulmonary complications in children with COVID-19 included viral pneumonia (24%) and acute respiratory failure (11%). In reference to children with COVID-19, those with MIS-C had more hematological disorders (62% vs 34%), sepsis (16% vs 6%), pericarditis (13% vs 2%), myocarditis (8% vs 1%). Few were ventilated or died, but some required oxygen support (38% COVID-19, 45% MIS-C) or intensive care (42% COVID-19, 69% MIS-C). Treatments included: methylprednisolone (34% COVID-19, 75% MIS-C), dexamethasone (25% COVID-19, 15% MIS-C), remdesivir (13% COVID-19, 5% MIS-C). Antibiotics (50% COVID-19, 68% MIS-C) and low-molecular weight heparin (17% COVID-19, 34% MIS-C) were frequently administered. Markers of illness severity among hospitalized children with COVID-19 prior to the 2021 Omicron surge are consistent with previous studies. We report important trends on treatments in hospitalized children with COVID-19 to improve the understanding of real-world treatment patterns in this population.

Why Does Magnetic Resonance Imaging-Targeted Biopsy Miss Clinically Significant Cancer?

PURPOSE: Multiple studies demonstrate magnetic resonance imaging (MRI)-targeted biopsy detects more clinically significant cancer than systematic biopsy; however, some clinically significant cancers are detected by systematic biopsy only. While these events are rare, we sought to perform a retrospective analysis of these cases to ascertain the reasons that MRI-targeted biopsy missed clinically significant cancer which was subsequently detected on systematic prostate biopsy. MATERIALS AND METHODS: Patients were enrolled in a prospective study comparing cancer detection rates by transrectal MRI-targeted fusion biopsy and systematic 12-core biopsy. Patients with an elevated prostate specific antigen (PSA), abnormal digital rectal examination, or imaging findings concerning for prostate cancer underwent prostate MRI and subsequent MRI-targeted and systematic biopsy in the same setting. The subset of patients with grade group (GG) ≥3 cancer found on systematic biopsy and GG ≤2 cancer (or no cancer) on MRI-targeted biopsy was classified as MRI-targeted biopsy misses. A retrospective analysis of the MRI and MRI-targeted biopsy real-time screen captures determined the cause of MRI-targeted biopsy miss. Multivariable logistic regression analysis compared baseline characteristics of patients with MRI-targeted biopsy misses to GG-matched patients whose clinically significant cancer was detected by MRI-targeted biopsy. RESULTS: Over the study period of 2007 to 2019, 2,103 patients met study inclusion criteria and underwent combined MRI-targeted and systematic prostate biopsies. A total of 41 (1.9%) men were classified as MRI-targeted biopsy misses. Most MRI-targeted biopsy misses were due to errors in lesion targeting (21, 51.2%), followed by MRI-invisible lesions (17, 40.5%) and MRI lesions missed by the radiologist (3, 7.1%). On logistic regression analysis, lower Prostate Imaging-Reporting and Data System (PI-RADSTM) score was associated with having clinically significant cancer missed on MRI-targeted biopsy. CONCLUSIONS: While uncommon, most MRI-targeted biopsy misses are due to errors in lesion targeting, which highlights the importance of accurate co-registration and targeting when using software-based fusion platforms. Additionally, some patients will harbor MRI-invisible lesions which are untargetable by MRI-targeted platforms. The presence of a low PI-RADS score despite a high PSA is suggestive of harboring an MRI-invisible lesion.

Integration of Robotics in Urology Residency Programs: an Unchecked Technological Revolution.

PURPOSE OF REVIEW: To review the integration of robotics in urology residency programs and evaluate how it has impacted a graduates' level of surgical competence. RECENT FINDINGS: Surgical technique training has shown a dramatic shift towards robotics with the most profound occurring in oncology. However, integration of robotics is not uniform across programs nor even among residents themselves. Robotics require graduates to garner a broader skill set within the same prescribed training time. Unfortunately, in this modern era, graduates are feeling more ill-equipped to start independent practice and show an increased need to pursue fellowship training to achieve technical proficiency. The dissemination of robotics in residency programs has gone unchecked. Modulating existing training structures through (1) development of procedure- and surgical technique-specific target metrics for graduation and (2) integration of a formalized robotic curriculum may improve the overall quality and outcome of the educational experience.

MRI-guided pelvic lymph node biopsy via transrectal approach in prostate cancer.

Lymph node assessment in prostate cancer is most commonly performed at the time of radical prostatectomy. We present the case of pre-operative pelvic lymph node sampling with the use of MRI/TRUS fusion-guided biopsy at the time of prostate biopsy. Lymph node pathology revealed metastatic, poorly differentiated prostate cancer, concurrent with Gleason 4 + 5 disease showing perineural invasion. The use of MRI fusion guided biopsy for nodal sampling may be an effective method pre-operative staging and treatment planning for prostate adenocarcinoma.

Screening for acute human immunodeficiency virus infection in Baltimore public testing sites.

BACKGROUND: Human immunodeficiency virus (HIV) RNA testing of pooled HIV antibody-negative specimens can identify acute HIV infection (AHI) and trigger interventions to reduce transmission during this highly infectious period. METHODS: A Baltimore, MD program serving sexually transmitted disease clinics and other high-risk sites combined HIV testing by third-generation enzyme immunoassay (EIA) with RNA testing of pooled antibody-negative specimens. Laboratory and Disease Intervention Specialists' records were reviewed for program evaluation. A cost analysis was performed. RESULTS: In 22 months, we tested 60,695 specimens for HIV. Of these, 1766 (2.9%) tested positive by EIA. Pooled HIV RNA testing of 58,925 EIA-negative specimens detected 7 cases of AHI (0.01%). Reflex HIV RNA testing of EIA-reactive, Western blot-indeterminate specimens confirmed 4 additional AHI cases (total AHI, 0.02%). Contact tracing detected no additional previously unknown cases of HIV infection. CONCLUSIONS: The utility of pooled HIV RNA testing may be limited by advances in HIV testing technology that reduce the seronegative window period and by characteristics of the local HIV epidemic.