Effect of Real-Time Computer-Aided Polyp Detection System (ENDO-AID) on Adenoma Detection in Endoscopists-in-Training: A Randomized Trial.

BACKGROUND: The effect of computer-aided polyp detection (CADe) on adenoma detection rate (ADR) among endoscopists-in-training remains unknown. METHODS: We performed a single-blind, parallel-group, randomized controlled trial in Hong Kong between April 2021 and July 2022 (NCT04838951). Eligible subjects undergoing screening/surveillance/diagnostic colonoscopies were randomized 1:1 to receive colonoscopies with CADe (ENDO-AID[OIP-1]) or not (control) during withdrawal. Procedures were performed by endoscopists-in-training with <500 procedures and <3 years' experience. Randomization was stratified by patient age, sex, and endoscopist experience (beginner vs intermediate level, <200 vs 200-500 procedures). Image enhancement and distal attachment devices were disallowed. Subjects with incomplete colonoscopies or inadequate bowel preparation were excluded. Treatment allocation was blinded to outcome assessors. The primary outcome was ADR. Secondary outcomes were ADR for different adenoma sizes and locations, mean number of adenomas, and non-neoplastic resection rate. RESULTS: A total of 386 and 380 subjects were randomized to CADe and control groups, respectively. The overall ADR was significantly higher in the CADe group than in the control group (57.5% vs 44.5%; adjusted relative risk, 1.41; 95% CI, 1.17-1.72; P < .001). The ADRs for <5 mm (40.4% vs 25.0%) and 5- to 10-mm adenomas (36.8% vs 29.2%) were higher in the CADe group. The ADRs were higher in the CADe group in both the right colon (42.0% vs 30.8%) and left colon (34.5% vs 27.6%), but there was no significant difference in advanced ADR. The ADRs were higher in the CADe group among beginner (60.0% vs 41.9%) and intermediate-level (56.5% vs 45.5%) endoscopists. Mean number of adenomas (1.48 vs 0.86) and non-neoplastic resection rate (52.1% vs 35.0%) were higher in the CADe group. CONCLUSIONS: Among endoscopists-in-training, the use of CADe during colonoscopies was associated with increased overall ADR. (ClinicalTrials.gov, Number: NCT04838951).

AGA Clinical Practice Update on the Role of Artificial Intelligence in Colon Polyp Diagnosis and Management: Commentary.

DESCRIPTION: The purpose of this American Gastroenterological Association (AGA) Institute Clinical Practice Update (CPU) is to review the available evidence and provide expert commentary on the current landscape of artificial intelligence in the evaluation and management of colorectal polyps. METHODS: This CPU was commissioned and approved by the AGA Institute Clinical Practice Updates Committee (CPUC) and the AGA Governing Board to provide timely guidance on a topic of high clinical importance to the AGA membership and underwent internal peer review by the CPUC and external peer review through standard procedures of Gastroenterology. This Expert Commentary incorporates important as well as recently published studies in this field, and it reflects the experiences of the authors who are experienced endoscopists with expertise in the field of artificial intelligence and colorectal polyps.

Lack of Effectiveness of Computer Aided Detection for Colorectal Neoplasia: A Systematic Review and Meta-Analysis of Nonrandomized Studies.

BACKGROUND AND AIMS: Benefits of computer-aided detection (CADe) in detecting colorectal neoplasia were shown in many randomized trials in which endoscopists' behavior was strictly controlled. However, the effect of CADe on endoscopists' performance in less-controlled setting is unclear. This systematic review and meta-analyses were aimed at clarifying benefits and harms of using CADe in real-world colonoscopy. METHODS: We searched MEDLINE, EMBASE, Cochrane, and Google Scholar from inception to August 20, 2023. We included nonrandomized studies that compared the effectiveness between CADe-assisted and standard colonoscopy. Two investigators independently extracted study data and quality. Pairwise meta-analysis was performed utilizing risk ratio for dichotomous variables and mean difference (MD) for continuous variables with a 95% confidence interval (CI). RESULTS: Eight studies were included, comprising 9782 patients (4569 with CADe and 5213 without CADe). Regarding benefits, there was a difference in neither adenoma detection rate (44% vs 38%; risk ratio, 1.11; 95% CI, 0.97 to 1.28) nor mean adenomas per colonoscopy (0.93 vs 0.79; MD, 0.14; 95% CI, -0.04 to 0.32) between CADe-assisted and standard colonoscopy, respectively. Regarding harms, there was no difference in the mean non-neoplastic lesions per colonoscopy (8 studies included for analysis; 0.52 vs 0.47; MD, 0.14; 95% CI, -0.07 to 0.34) and withdrawal time (6 studies included for analysis; 14.3 vs 13.4 minutes; MD, 0.8 minutes; 95% CI, -0.18 to 1.90). There was a substantial heterogeneity, and all outcomes were graded with a very low certainty of evidence. CONCLUSION: CADe in colonoscopies neither improves the detection of colorectal neoplasia nor increases burden of colonoscopy in real-world, nonrandomized studies, questioning the generalizability of the results of randomized trials.

A video based benchmark data set (ENDOTEST) to evaluate computer-aided polyp detection systems.

BACKGROUND AND AIMS: Computer-aided polyp detection (CADe) may become a standard for polyp detection during colonoscopy. Several systems are already commercially available. We report on a video-based benchmark technique for the first preclinical assessment of such systems before comparative randomized trials are to be undertaken. Additionally, we compare a commercially available CADe system with our newly developed one. METHODS: ENDOTEST consisted in the combination of two datasets. The validation dataset contained 48 video-snippets with 22,856 manually annotated images of which 53.2% contained polyps. The performance dataset contained 10 full-length screening colonoscopies with 230,898 manually annotated images of which 15.8% contained a polyp. Assessment parameters were accuracy for polyp detection and time delay to first polyp detection after polyp appearance (FDT). Two CADe systems were assessed: a commercial CADe system (GI-Genius, Medtronic), and a self-developed new system (ENDOMIND). The latter being a convolutional neuronal network trained on 194,983 manually labeled images extracted from colonoscopy videos recorded in mainly six different gastroenterologic practices. RESULTS: On the ENDOTEST, both CADe systems detected all polyps in at least one image. The per-frame sensitivity and specificity in full colonoscopies was 48.1% and 93.7%, respectively for GI-Genius; and 54% and 92.7%, respectively for ENDOMIND. Median FDT of ENDOMIND with 217 ms (Inter-Quartile Range(IQR)8-1533) was significantly faster than GI-Genius with 1050 ms (IQR 358-2767, p = 0.003). CONCLUSIONS: Our benchmark ENDOTEST may be helpful for preclinical testing of new CADe devices. There seems to be a correlation between a shorter FDT with a higher sensitivity and a lower specificity for polyp detection.

Pilot study of a new freely available computer-aided polyp detection system in clinical practice.

PURPOSE: Computer-aided polyp detection (CADe) systems for colonoscopy are already presented to increase adenoma detection rate (ADR) in randomized clinical trials. Those commercially available closed systems often do not allow for data collection and algorithm optimization, for example regarding the usage of different endoscopy processors. Here, we present the first clinical experiences of a, for research purposes publicly available, CADe system. METHODS: We developed an end-to-end data acquisition and polyp detection system named EndoMind. Examiners of four centers utilizing four different endoscopy processors used EndoMind during their clinical routine. Detected polyps, ADR, time to first detection of a polyp (TFD), and system usability were evaluated (NCT05006092). RESULTS: During 41 colonoscopies, EndoMind detected 29 of 29 adenomas in 66 of 66 polyps resulting in an ADR of 41.5%. Median TFD was 130 ms (95%-CI, 80-200 ms) while maintaining a median false positive rate of 2.2% (95%-CI, 1.7-2.8%). The four participating centers rated the system using the System Usability Scale with a median of 96.3 (95%-CI, 70-100). CONCLUSION: EndoMind's ability to acquire data, detect polyps in real-time, and high usability score indicate substantial practical value for research and clinical practice. Still, clinical benefit, measured by ADR, has to be determined in a prospective randomized controlled trial.

Real-time colorectal polyp detection using a novel computer-aided detection system (CADe): a feasibility study.

BACKGROUND AND AIMS: Colonoscopy aims to early detect and remove precancerous colorectal polyps, thereby preventing development of colorectal cancer (CRC). Recently, computer-aided detection (CADe) systems have been developed to assist endoscopists in polyp detection during colonoscopy. The aim of this study was to investigate feasibility and safety of a novel CADe system during real-time colonoscopy in three European tertiary referral centers. METHODS: Ninety patients undergoing colonoscopy assisted by a real-time CADe system (DISCOVERY; Pentax Medical, Tokyo, Japan) were prospectively included. The CADe system was turned on only at withdrawal, and its output was displayed on secondary monitor. To study feasibility, inspection time, polyp detection rate (PDR), adenoma detection rate (ADR), sessile serrated lesion (SSL) detection rate (SDR), and the number of false positives were recorded. To study safety, (severe) adverse events ((S)AEs) were collected. Additionally, user friendliness was rated from 1 (worst) to 10 (best) by endoscopists. RESULTS: Mean inspection time was 10.8 ± 4.3 min, while PDR was 55.6%, ADR 28.9%, and SDR 11.1%. The CADe system users estimated that < 20 false positives occurred in 81 colonoscopy procedures (90%). No (S)AEs related to the CADe system were observed during the 30-day follow-up period. User friendliness was rated as good, with a median score of 8/10. CONCLUSION: Colonoscopy with this novel CADe system in a real-time setting was feasible and safe. Although PDR and SDR were high compared to previous studies with other CADe systems, future randomized controlled trials are needed to confirm these detection rates. The high SDR is of particular interest since interval CRC has been suggested to develop frequently through the serrated neoplasia pathway. CLINICAL TRIAL REGISTRATION: The study was registered in the Dutch Trial Register (reference number: NL8788).

Diagnostic Performance of an Artificial Intelligence System in Breast Ultrasound.

OBJECTIVES: We study the performance of an artificial intelligence (AI) program designed to assist radiologists in the diagnosis of breast cancer, relative to measures obtained from conventional readings by radiologists. METHODS: A total of 10 radiologists read a curated, anonymized group of 299 breast ultrasound images that contained at least one suspicious lesion and for which a final diagnosis was independently determined. Separately, the AI program was initialized by a lead radiologist and the computed results compared against those of the radiologists. RESULTS: The AI program's diagnoses of breast lesions had concordance with the 10 radiologists' readings across a number of BI-RADS descriptors. The sensitivity, specificity, and accuracy of the AI program's diagnosis of benign versus malignant was above 0.8, in agreement with the highest performing radiologists and commensurate with recent studies. CONCLUSION: The trained AI program can contribute to accuracy of breast cancer diagnoses with ultrasound.

Is AI the Ultimate QA?

We are among the many that believe that artificial intelligence will not replace practitioners and is most valuable as an adjunct in diagnostic radiology. We suggest a different approach to utilizing the technology, which may help even radiologists who may be averse to adopting AI. A novel method of leveraging AI combines computer vision and natural language processing to ambiently function in the background, monitoring for critical care gaps. This AI Quality workflow uses a visual classifier to predict the likelihood of a finding of interest, such as a lung nodule, and then leverages natural language processing to review a radiologist's report, identifying discrepancies between imaging and documentation. Comparing artificial intelligence predictions with natural language processing report extractions with artificial intelligence in the background of computer-aided detection decisions may offer numerous potential benefits, including streamlined workflow, improved detection quality, an alternative approach to thinking of AI, and possibly even indemnity against malpractice. Here we consider early indications of the potential of artificial intelligence as the ultimate quality assurance for radiologists.

An analysis about the function of a new artificial intelligence, CAD EYE with the lesion recognition and diagnosis for colorectal polyps in clinical practice.

OBJECTIVES: Recently, CAD EYE (Fujifilm, Tokyo, Japan), an artificial intelligence for the lesion recognition (CADe) and the optical diagnosis (CADx) of colorectal polyps, was released. We evaluated the function of CADe and CADx of CAD EYE. METHODS: In this single-center retrospective study, we examined consecutive polyps ≤ 10 mm detected from March to April 2021 to determine whether CAD EYE could recognize them live with both normal- and high-speed observation using white-light imaging (WLI) and linked-color imaging (LCI). We then examined whether the polyps were neoplastic or hyperplastic live with magnified or non-magnified blue-laser imaging (BLI-LASER) or blue-light imaging (BLI-LED) under CAD EYE, comparing the retrospective evaluations with 5 experts and 5 trainees using still images. All polyps were histopathologically examined. RESULTS: We analyzed 100 polyps (mean size 3.9 ± 2.6 mm; 55 neoplastic and 45 hyperplastic lesions) in 25 patients. Regarding CADe, the respective detection rates of CAD EYE with normal- and high-speed observation were 85.0% and 67.0% for WLI (p = 0.002) and 89.0% and 75.0% for LCI (p = 0.009). Regarding CADx for differentiating neoplastic and hyperplastic lesions, the diagnostic accuracy values of CAD EYE with non-magnified and magnified BLI-LASER/LED were 88.8% and 87.8%. Regarding magnified BLI-LASER/LED, the diagnostic accuracy value of CAD EYE was not significantly different from that of experts (92.0%, p = 0.17), but that of trainees (79.0%, p = 0.04). We also found no significant differences in CADe or CADx between LED (53 lesions) and LASER (47 lesions). CONCLUSIONS: CAD EYE was a helpful tool for CADe and CADx in clinical practice.

Artificial intelligence (AI) real-time detection vs. routine colonoscopy for colorectal neoplasia: a meta-analysis and trial sequential analysis.

GOALS AND BACKGROUND: Studies analyzing artificial intelligence (AI) in colonoscopies have reported improvements in detecting colorectal cancer (CRC) lesions, however its utility in the realworld remains limited. In this systematic review and meta-analysis, we evaluate the efficacy of AI-assisted colonoscopies against routine colonoscopy (RC). STUDY: We performed an extensive search of major databases (through January 2021) for randomized controlled trials (RCTs) reporting adenoma and polyp detection rates. Odds ratio (OR) and standardized mean differences (SMD) with 95% confidence intervals (CIs) were reported. Additionally, trial sequential analysis (TSA) was performed to guard against errors. RESULTS: Six RCTs were included (4996 participants). The mean age (SD) was 51.99 (4.43) years, and 49% were females. Detection rates favored AI over RC for adenomas (OR 1.77; 95% CI: 1.570-2.08) and polyps (OR 1.91; 95% CI: 1.68-2.16). Secondary outcomes including mean number of adenomas (SMD 0.23; 95% CI: 0.18-0.29) and polyps (SMD 0.23; 95% CI: 0.17-0.29) detected per procedure favored AI. However, RC outperformed AI in detecting pedunculated polyps. Withdrawal times (WTs) favored AI when biopsies were included, while WTs without biopsies, cecal intubation times, and bowel preparation adequacy were similar. CONCLUSIONS: Colonoscopies equipped with AI detection algorithms could significantly detect previously missed adenomas and polyps while retaining the ability to self-assess and improve periodically. More effective clearance of diminutive adenomas may allow lengthening in surveillance intervals, reducing the burden of surveillance colonoscopies, and increasing its accessibility to those at higher risk. TSA ruled out the risk for false-positive results and confirmed a sufficient sample size to detect the observed effect. Currently, these findings suggest that AI-assisted colonoscopy can serve as a useful proxy to address critical gaps in CRC identification.

Artificial intelligence for non-polypoid colorectal neoplasms.

The miss rate of flat advanced colorectal neoplasia is still unacceptably high, especially in the Western setting, notwithstanding the widespread implementation of quality improvement programs and training. It is well known that flat morphology is associated with miss rate of colorectal neoplasia, and that this subset of lesions often shows a more aggressive biological behaviour. Artificial intelligence (AI) applied to the detection of colorectal neoplasia has been shown to increase adenoma detection rate, consistently across all lesion sizes and locations in the colon. However, there is still uncertainty whether AI can reduce the miss rate of flat advanced neoplasia, mainly because all published trials report a low number of flat colorectal lesions in their training sets, and this could reduce AI accuracy for this subset of lesions. In addition, flat lesions have different morphologies with variable prevalence and potentially different accuracy in their detection. For example, the subtle appearance and rarer frequency of a non-granular laterally spreading tumor (LST) could be much harder to identify than a granular mixed LST. In this review, we present a summary of the evidence on the role of AI in the identification of colorectal flat neoplasia, with a focus on data regarding presence of LSTs in the training/validation sets of the AI systems currently available on the market.

Artificial intelligence in endoscopy: Present and future perspectives.

Artificial intelligence (AI) has been attracting considerable attention as an important scientific topic in the field of medicine. Deep-leaning (DL) technologies have been applied more dominantly than other traditional machine-learning methods. They have demonstrated excellent capability to retract visual features of objectives, even unnoticeable ones for humans, and analyze huge amounts of information within short periods. The amount of research applying DL-based models to real-time computer-aided diagnosis (CAD) systems has been increasing steadily in the GI endoscopy field. An array of published data has already demonstrated the advantages of DL-based CAD models in the detection and characterization of various neoplastic lesions, regardless of the level of the GI tract. Although the diagnostic performances and study designs vary widely, owing to a lack of academic standards to assess the capability of AI for GI endoscopic diagnosis fairly, the superiority of CAD models has been demonstrated for almost all applications studied so far. Most of the challenges associated with AI in the endoscopy field are general problems for AI models used in the real world outside of medical fields. Solutions have been explored seriously and some solutions have been tested in the endoscopy field. Given that AI has become the basic technology to make machines react to the environment, AI would be a major technological paradigm shift, for not only diagnosis but also treatment. In the near future, autonomous endoscopic diagnosis might no longer be just a dream, as we are witnessing with the advent of autonomously driven electric vehicles.

Cultural adoption, and validation of the Persian version of the coronary artery disease education questionnaire (CADE-Q): a second-order confirmatory factor analysis.

BACKGROUND: Evaluating knowledge in patients with coronary artery disease requires a specific measure. The aim of the present study was to translate and evaluate the CADE-Q in patients with coronary artery disease in Iran. METHODS: Forward-backward procedure was applied to translate the questionnaire from English into Persian. Then a cross-sectional study was conducted to evaluate psychometric properties of the questionnaire. A sample of patients with coronary artery disease attending to cardiac departments of teaching hospitals affiliated to medical universities in Tehran, Iran completed the 19-item CADE-Q from April to December 2017. Structural validity of CADE-Q was assessed using both exploratory and confirmatory factor analyses. Reliability was examined using Cronbach's alpha coefficient. Stability was evaluated by estimation intraclass correlation coefficient. RESULTS: In all 500 patients participated in the study. The mean age of patients was 53.63. (SD = 14.36) years, and 57% were male. The results obtained from the exploratory factor analysis showed a four factor solution (lifestyle habits and exercise, risk factors, diagnosis and treatment, signals & symptoms and medicine) that jointly explained 48.9% of the total variance observed. However, the second-order confirmatory factor analysis supported the three-factor solution while convergent and divergent validity were not confirmed. Finally, the Cronbach's alpha coefficient of 0.84 ranging from 0.50 to 0.82 was obtained for the scale and its subscales. In addition, the ICC value of 0.88 showed satisfactory stability for the questionnaire. CONCLUSION: The Coronary Artery Disease Education Questionnaire was found to be a multidimensional instrument. The results confirmed the factor structure of the questionnaire with a second-order analysis. Since the convergent and divergent validity of the scale were not confirmed, further assessment is essential to establish fitness of the questionnaire in Iran.

Research progress of computer aided diagnosis system for pulmonary nodules in CT images.

BACKGROUND AND OBJECTIVE: Since CAD (Computer Aided Diagnosis) system can make it easier and more efficient to interpret CT (Computer Tomography) images, it has gained much attention and developed rapidly in recent years. This article reviews recent CAD techniques for pulmonary nodule detection and diagnosis in CT Images. METHODS: CAD systems can be classified into computer-aided detection (CADe) and computer-aided diagnosis (CADx) systems. This review reports recent researches of both systems, including the database, technique, innovation and experimental results of each work. Multi-task CAD systems, which can handle segmentation, false positive reduction, malignancy prediction and other tasks at the same time. The commercial CAD systems are also briefly introduced. RESULTS: We have found that deep learning based CAD is the mainstream of current research. The reported sensitivity of deep learning based CADe systems ranged between 80.06% and 94.1% with an average 4.3 false-positive (FP) per scan when using LIDC-IDRI dataset, and between 94.4% and 97.9% with an average 4 FP/scan when using LUNA16 dataset, respectively. The overall accuracy of deep learning based CADx systems ranged between 86.84% and 92.3% with an average AUC of 0.956 reported when using LIDC-IDRI dataset. CONCLUSIONS: We summarized the current tendency and limitations as well as future challenges in this field. The development of CAD needs to meet the rigid clinical requirements, such as high accuracy, strong robustness, high efficiency, fine-grained analysis and classification, and to provide practical clinical functions. This review provides helpful information for both engineering researchers and radiologists to learn the latest development of CAD systems.

Expert knowledge-infused deep learning for automatic lung nodule detection.

BACKGROUND: Computer aided detection (CADe) of pulmonary nodules from computed tomography (CT) is crucial for early diagnosis of lung cancer. Self-learned features obtained by training datasets via deep learning have facilitated CADe of the nodules. However, the complexity of CT lung images renders a challenge of extracting effective features by self-learning only. This condition is exacerbated for limited size of datasets. On the other hand, the engineered features have been widely studied. OBJECTIVE: We proposed a novel nodule CADe which aims to relieve the challenge by the use of available engineered features to prevent convolution neural networks (CNN) from overfitting under dataset limitation and reduce the running-time complexity of self-learning. METHODS: The CADe methodology infuses adequately the engineered features, particularly texture features, into the deep learning process. RESULTS: The methodology was validated on 208 patients with at least one juxta-pleural nodule from the public LIDC-IDRI database. Results demonstrated that the methodology achieves a sensitivity of 88% with 1.9 false positives per scan and a sensitivity of 94.01% with 4.01 false positives per scan. CONCLUSIONS: The methodology shows high performance compared with the state-of-the-art results, in terms of accuracy and efficiency, from both existing CNN-based approaches and engineered feature-based classifications.

Feasibility Study of a Generalized Framework for Developing Computer-Aided Detection Systems-a New Paradigm.

We propose a generalized framework for developing computer-aided detection (CADe) systems whose characteristics depend only on those of the training dataset. The purpose of this study is to show the feasibility of the framework. Two different CADe systems were experimentally developed by a prototype of the framework, but with different training datasets. The CADe systems include four components; preprocessing, candidate area extraction, candidate detection, and candidate classification. Four pretrained algorithms with dedicated optimization/setting methods corresponding to the respective components were prepared in advance. The pretrained algorithms were sequentially trained in the order of processing of the components. In this study, two different datasets, brain MRA with cerebral aneurysms and chest CT with lung nodules, were collected to develop two different types of CADe systems in the framework. The performances of the developed CADe systems were evaluated by threefold cross-validation. The CADe systems for detecting cerebral aneurysms in brain MRAs and for detecting lung nodules in chest CTs were successfully developed using the respective datasets. The framework was shown to be feasible by the successful development of the two different types of CADe systems. The feasibility of this framework shows promise for a new paradigm in the development of CADe systems: development of CADe systems without any lesion specific algorithm designing.

Toxicity of Juniperus oxycedrus oil constituents and related compounds and the efficacy of oil spray formulations to Dermatophagoides farinae (Acari: Pyroglyphidae).

The American house dust mite (AHDM), Dermatophagoides farinae Hughes (Acari: Pyroglyphidae), is recognized as an important source of allergens in the domestic environment. This study was conducted to determine whether 19 constituents from essential oil of cade, Juniperus oxycedrus L. (Cupressaceae), eight structurally related compounds, and another 16 previously known cade oil constituents were toxic for adult AHDMs and to determine the route of acaricidal action of the test compounds, as well as to assess the control efficacy of four experimental spray formulations containing the oil (10-40 mg/L sprays). In a fabric-circle contact mortality bioassay, methyleugenol (LD50, 5.82 µg/cm2) and guaiacol (8.24 µg/cm2) were the most toxic compounds against the mites, and the toxicity of these compounds and benzyl benzoate did not significantly differ. High toxicity was also observed with eugenol, m-cresol, and nerolidol (LD50, 12.52-19.52 µg/cm2), and these compounds were significantly more toxic than N,N-diethyl-3-methylbenzamide (DEET) (LD50, 37.67 µg/cm2). Cade applied as 30 or 40 mg/L experimental sprays provided 96 and 100% mortality against the mites, respectively, whereas permethrin (cis:trans, 25:75) 2.5 g/L spray treatment resulted in 17% mortality. In vapor-phase mortality tests, the compounds described were consistently more toxic in closed versus open containers, indicating that toxicity was achieved mainly through the action of vapor. Reasonable mite control in indoor environments can be achieved by spray formulation containing the 40 mg/L cade oil as potential contact-action fumigants.

Part I: prostate cancer detection, artificial intelligence for prostate cancer and how we measure diagnostic performance: a comprehensive review.

MRI has firmly established itself as a mainstay for the detection, staging and surveillance of prostate cancer. Despite its success, prostate MRI continues to suffer from poor inter-reader variability and a low positive predictive value. The recent emergence of Artificial Intelligence (AI) to potentially improve diagnostic performance shows great potential. Understanding and interpreting the AI landscape as well as ever-increasing research literature, however, is difficult. This is in part due to widely varying study design and reporting techniques. This paper aims to address this need by first outlining the different types of AI used for the detection and diagnosis of prostate cancer, next deciphering how data collection methods, statistical analysis metrics (such as ROC and FROC analysis) and end points/outcomes (lesion detection vs. case diagnosis) affect the performance and limit the ability to compare between studies. Finally, this work explores the need for appropriately enriched investigational datasets and proper ground truth, and provides guidance on how to best conduct AI prostate MRI studies. Published in parallel, a clinical study applying this suggested study design was applied to review and report a multiple-reader multiple-case clinical study of 150 bi-parametric prostate MRI studies across nine readers, measuring physician performance both with and without the use of a recently FDA cleared Artificial Intelligence software.1.

Part II: Effect of different evaluation methods to the application of a computer-aided prostate MRI detection/diagnosis (CADe/CADx) device on reader performance.

INTRODUCTION: The construction and results of a multiple-reader multiple-case prostate MRI study are described and reported to illustrate recommendations for how to standardize artificial intelligence (AI) prostate studies per the review constituting Part I1. METHODS: Our previously reported approach was applied to review and report an IRB approved, HIPAA compliant multiple-reader multiple-case clinical study of 150 bi-parametric prostate MRI studies across 9 readers, measuring physician performance both with and without the use of the recently FDA cleared CADe/CADx software ProstatID. RESULTS: Unassisted reader AUC values ranged from 0.418 - 0.759, with AI assisted AUC values ranging from 0.507 - 0.787. This represented a statistically significant AUC improvement of 0.045 (α = 0.05). A free-response ROC (FROC) analysis similarly demonstrated a statistically significant increase in θ from 0.405 to 0.453 (α = 0.05). The standalone performance of ProstatID performed across all prostate tissues demonstrated an AUC of 0.929, while the standalone lesion level performance of ProstatID at all biopsied locations achieved an AUC of 0.710. CONCLUSION: This study applies and illustrates suggested reporting and standardization methods for prostate AI studies that will make it easier to understand, evaluate and compare between AI studies. Providing radiologists with the ProstatID CADe/CADx software significantly increased diagnostic performance as assessed by both ROC and free-response ROC metrics. Such algorithms have the potential to improve radiologist performance in the detection and localization of clinically significant prostate cancer.

Effectiveness of artificial intelligence assisted colonoscopy on adenoma and polyp miss rate: A meta-analysis of tandem RCTs.

BACKGROUND AND AIMS: One-fourth of colorectal neoplasia is missed at screening colonoscopy, representing the leading cause of interval colorectal cancer (I-CRC). This systematic review and meta-analysis summarizes the efficacy of computer-aided colonoscopy (CAC) compared to white-light colonoscopy (WLC) in reducing lesion miss rates. METHODS: Major databases were systematically searched through May 2024 for tandem-design RCTs comparing lesion miss rates in CAC-first followed by WLC vs WLC-first followed by CAC. The primary outcomes were adenoma miss rate (AMR) and polyp miss rate (PMR). The secondary outcomes were advanced AMR (aAMR) and sessile serrated lesion miss rate (SMR). RESULTS: Six RCTs (1718 patients) were included. AMR was significantly lower for CAC compared to WLC (RR = 0.46; 95 %CI [0.38-0.55]; P < 0.001). PMR was also lower for CAC compared to WLC (RR = 0.44; 95 %CI [0.33-0.60]; P < 0.001). No significant difference in aAMR (RR = 1.28; 95 %CI [0.34-4.83]; P = 0.71) and SMR (RR = 0.44; 95 %CI [0.15-1.28]; P = 0.13) were observed. Sensitivity analysis including only RCTs performed in CRC screening and surveillance setting confirmed lower AMR (RR = 0.48; 95 %CI [0.39-0.58]; P < 0.001) and PMR (RR = 0.50; 95 %CI [0.37-0.66]; P < 0.001), also showing significantly lower SMR (RR = 0.28; 95 %CI [0.11-0.70]; P = 0.007) for CAC compared to WLC. CONCLUSIONS: CAC results in significantly lower AMR and PMR compared to WLC overall, and significantly lower AMR, PMR and SMR in the screening/surveillance setting, potentially reducing the incidence of I-CRC.