Performance of Artificial Intelligence Content Detectors Using Human and Artificial Intelligence-Generated Scientific Writing.

BACKGROUND: Few studies have examined the performance of artificial intelligence (AI) content detection in scientific writing. This study evaluates the performance of publicly available AI content detectors when applied to both human-written and AI-generated scientific articles. METHODS: Articles published in Annals of Surgical Oncology (ASO) during the year 2022, as well as AI-generated articles using OpenAI's ChatGPT, were analyzed by three AI content detectors to assess the probability of AI-generated content. Full manuscripts and their individual sections were evaluated. Group comparisons and trend analyses were conducted by using ANOVA and linear regression. Classification performance was determined using area under the curve (AUC). RESULTS: A total of 449 original articles met inclusion criteria and were evaluated to determine the likelihood of being generated by AI. Each detector also evaluated 47 AI-generated articles by using titles from ASO articles. Human-written articles had an average probability of being AI-generated of 9.4% with significant differences between the detectors. Only two (0.4%) human-written manuscripts were detected as having a 0% probability of being AI-generated by all three detectors. Completely AI-generated articles were evaluated to have a higher average probability of being AI-generated (43.5%) with a range from 12.0 to 99.9%. CONCLUSIONS: This study demonstrates differences in the performance of various AI content detectors with the potential to label human-written articles as AI-generated. Any effort toward implementing AI detectors must include a strategy for continuous evaluation and validation as AI models and detectors rapidly evolve.

From Alpha to Omicron and Beyond: Associations Between SARS-CoV-2 Variants and Surgical Outcomes.

INTRODUCTION: The COVID-19 pandemic has significantly influenced surgical practices, with SARS-CoV-2 variants presenting unique pathologic profiles and potential impacts on perioperative outcomes. This study explores associations between Alpha, Delta, and Omicron variants of SARS-CoV-2 and surgical outcomes. METHODS: We conducted a retrospective analysis using the National COVID Cohort Collaborative database, which included patients who underwent selected major inpatient surgeries within eight weeks post-SARS-CoV-2 infection from January 2020 to April 2023. The viral variant was determined by the predominant strain at the time of the patient's infection. Multivariable logistic regression models explored the association between viral variants, COVID-19 severity, and 30-d major morbidity or mortality. RESULTS: The study included 10,617 surgical patients with preoperative COVID-19, infected by the Alpha (4456), Delta (1539), and Omicron (4622) variants. Patients infected with Omicron had the highest vaccination rates, most mild disease, and lowest 30-d morbidity and mortality rates. Multivariable logistic regression demonstrated that Omicron was linked to a reduced likelihood of adverse outcomes compared to Alpha, while Delta showed odds comparable to Alpha. Inclusion of COVID-19 severity in the model rendered the odds of major morbidity or mortality equal across all three variants. CONCLUSIONS: Our study examines the associations between the clinical and pathological characteristics of SARS-CoV-2 variants and surgical outcomes. As novel SARS-CoV-2 variants emerge, this research supports COVID-19-related surgical policy that assesses the severity of disease to estimate surgical outcomes.

Severity of Prior Coronavirus Disease 2019 is Associated With Postoperative Outcomes After Major Inpatient Surgery.

OBJECTIVE: To determine how the severity of prior history (Hx) of severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) infection influences postoperative outcomes after major elective inpatient surgery. BACKGROUND: Surgical guidelines instituted early in the coronavirus disease 2019 (COVID-19) pandemic recommended a delay in surgery of up to 8 weeks after an acute SARS-CoV-2 infection. This was based on the observation of elevated surgical risk after recovery from COVID-19 early in the pandemic. As the pandemic shifts to an endemic phase, it is unclear whether this association remains, especially for those recovering from asymptomatic or mildly symptomatic COVID-19. METHODS: Utilizing the National COVID Cohort Collaborative, we assessed postoperative outcomes for adults with and without a Hx of COVID-19 who underwent major elective inpatient surgery between January 2020 and February 2023. COVID-19 severity and time from infection to surgery were each used as independent variables in multivariable logistic regression models. RESULTS: This study included 387,030 patients, of whom 37,354 (9.7%) were diagnosed with preoperative COVID-19. Hx of COVID-19 was found to be an independent risk factor for adverse postoperative outcomes even after a 12-week delay for patients with moderate and severe SARS-CoV-2 infection. Patients with mild COVID-19 did not have an increased risk of adverse postoperative outcomes at any time point. Vaccination decreased the odds of respiratory failure. CONCLUSIONS: Impact of COVID-19 on postoperative outcomes is dependent on the severity of illness, with only moderate and severe disease leading to a higher risk of adverse outcomes. Existing perioperative policies should be updated to include consideration of COVID-19 disease severity and vaccination status.

Patterns of Unnecessary Insurer Prior Authorization Denials in a Complex Surgical Oncology Practice.

INTRODUCTION: Insurance prior authorization (PA) is a determination of need, required by a health insurer for an ordered test/procedure. If the test/procedure is denied, a peer-to-peer (P2P) discussion between ordering provider and payer is used to appeal the decision. The objective of this study was to measure the number and patterns of unnecessary PA denials. METHODS: This was a retrospective review at a quaternary cancer center from October 2021 to March 2022. Included were all patients with outpatient imaging orders for surgical planning or surveillance of gastrointestinal, endocrine, or skin cancer. Primary outcome was unnecessary initial denial (UID) defined as an order that required preauthorization, was initially denied by the insurer, and subsequently overturned by P2P. RESULTS: Nine hundred fifty seven orders were placed and 419 required PA (44%). Of tests requiring authorization, 55/419 (13.1%) were denied. Variability in the likelihood of initial denial was seen across insurers, ranging from 0% to 57%. Following P2P, 32/55 were overturned (58.2% UID). The insurers most likely to have a UID were Aetna (100%), Anthem (77.8%), and Cigna (50.0%). UID was most common for gastrointestinal (58.9%) and endocrine (58.3%) cancers. Average P2P was 33.5 min (interquartile range 28-40). CONCLUSIONS: The majority of imaging studies initially denied were overturned after P2P. If all UIDs were eliminated, this would represent 108 less P2P discussions with an estimated time-savings of 60.3 h annually within a high-volume surgical oncology practice. Combined personnel costs to the health systems and stress on patients with cancer due to image-associated PAs and P2P appear hard to justify.

Evaluating the benefit of surgical resection for hepatocellular carcinoma with multifocality or intrahepatic vascular invasion.

BACKGROUND: The role of hepatectomy for hepatocellular carcinoma (HCC) with multifocality or intrahepatic vascular involvement remains ill-defined. Our objective was to evaluate benefits of surgical resection for patients with these high-risk features. METHODS: The National Cancer Database was used to identify HCC patients with vascular involvement and/or multifocality (T2/T3, N-/M-) from 2011 to 2015. Propensity score matching (k-nearest neighbors, no replacement, 1:1) grouped patients by treatment: surgical resection versus non-surgical modalities. Groups were matched using patient, clinical, and liver-specific characteristics. Median overall survival (OS) was calculated using Kaplan-Meier, and adjusted analyses were performed using shared frailty models. RESULTS: 14,557 patients met inclusion criteria, including 1892 (9.4%) treated with surgical resection. Median cohort OS was 20.5 months. After adjustment, surgical resection was associated with survival advantage compared to non-surgical treatment (37.8 versus 15.7 months, log-rank P < .001; adjusted hazard ratio 0.49, 95% confidence interval, 0.45-0.54). Patients with minimal comorbidity, unifocal disease, and age <54 had highest probability of survival one year post-surgery. CONCLUSIONS: Surgical resection is associated with a survival advantage in HCC with multifocality and/or intrahepatic vascular involvement. The presence of these features should not contraindicate consideration of hepatectomy in suitable surgical candidates.

Severity of Prior COVID-19 Infection is Associated with Postoperative Outcomes Following Major Inpatient Surgery.

Objective: To determine the association between severity of prior history of SARS-CoV-2 infection and postoperative outcomes following major elective inpatient surgery. Summary Background Data: Surgical guidelines instituted early in the COVID-19 pandemic recommended delay in surgery up to 8 weeks following an acute SARS-CoV-2 infection. Given that surgical delay can lead to worse medical outcomes, it is unclear if continuation of such stringent policies is necessary and beneficial for all patients, especially those recovering from asymptomatic or mildly symptomatic COVID-19. Methods: Utilizing the National Covid Cohort Collaborative (N3C), we assessed postoperative outcomes for adults with and without a history of COVID-19 who underwent major elective inpatient surgery between January 2020 and February 2023. COVID-19 severity and time from SARS-CoV-2 infection to surgery were each used as independent variables in multivariable logistic regression models. Results: This study included 387,030 patients, of which 37,354 (9.7%) had a diagnosis of preoperative COVID-19. History of COVID-19 was found to be an independent risk factor for adverse postoperative outcomes even after a 12-week delay for patients with moderate and severe SARS-CoV-2 infection. Patients with mild COVID-19 did not have an increased risk of adverse postoperative outcomes at any time point. Vaccination decreased the odds of mortality and other complications. Conclusions: Impact of COVID-19 on postoperative outcomes is dependent on severity of illness, with only moderate and severe disease leading to higher risk of adverse outcomes. Existing wait time policies should be updated to include consideration of COVID-19 disease severity and vaccination status.