Calibrating ensembles for scalable uncertainty quantification in deep learning-based medical image segmentation.

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the uncertainty of the models can play a critical role for example in active learning or machine human interaction. Uncertainty quantification is especially difficult when using deep learning-based models, which are the state-of-the-art in many imaging applications. The current uncertainty quantification approaches do not scale well in high-dimensional real-world problems. Scalable solutions often rely on classical techniques, such as dropout, during inference or training ensembles of identical models with different random seeds to obtain a posterior distribution. In this paper, we present the following contributions. First, we show that the classical approaches fail to approximate the classification probability. Second, we propose a scalable and intuitive framework for uncertainty quantification in medical image segmentation that yields measurements that approximate the classification probability. Third, we suggest the usage of k-fold cross-validation to overcome the need for held out calibration data. Lastly, we motivate the adoption of our method in active learning, creating pseudo-labels to learn from unlabeled images and human-machine collaboration.

Artificial intelligence for early detection of renal cancer in computed tomography: A review.

Renal cancer is responsible for over 100,000 yearly deaths and is principally discovered in computed tomography (CT) scans of the abdomen. CT screening would likely increase the rate of early renal cancer detection, and improve general survival rates, but it is expected to have a prohibitively high financial cost. Given recent advances in artificial intelligence (AI), it may be possible to reduce the cost of CT analysis and enable CT screening by automating the radiological tasks that constitute the early renal cancer detection pipeline. This review seeks to facilitate further interdisciplinary research in early renal cancer detection by summarising our current knowledge across AI, radiology, and oncology and suggesting useful directions for future novel work. Initially, this review discusses existing approaches in automated renal cancer diagnosis, and methods across broader AI research, to summarise the existing state of AI cancer analysis. Then, this review matches these methods to the unique constraints of early renal cancer detection and proposes promising directions for future research that may enable AI-based early renal cancer detection via CT screening. The primary targets of this review are clinicians with an interest in AI and data scientists with an interest in the early detection of cancer.

Lesion-specific 3D-printed moulds for image-guided tissue multi-sampling of ovarian tumours: A prospective pilot study.

Background: High-Grade Serous Ovarian Carcinoma (HGSOC) is the most prevalent and lethal subtype of ovarian cancer, but has a paucity of clinically-actionable biomarkers due to high degrees of multi-level heterogeneity. Radiogenomics markers have the potential to improve prediction of patient outcome and treatment response, but require accurate multimodal spatial registration between radiological imaging and histopathological tissue samples. Previously published co-registration work has not taken into account the anatomical, biological and clinical diversity of ovarian tumours. Methods: In this work, we developed a research pathway and an automated computational pipeline to produce lesion-specific three-dimensional (3D) printed moulds based on preoperative cross-sectional CT or MRI of pelvic lesions. Moulds were designed to allow tumour slicing in the anatomical axial plane to facilitate detailed spatial correlation of imaging and tissue-derived data. Code and design adaptations were made following each pilot case through an iterative refinement process. Results: Five patients with confirmed or suspected HGSOC who underwent debulking surgery between April and December 2021 were included in this prospective study. Tumour moulds were designed and 3D-printed for seven pelvic lesions, covering a range of tumour volumes (7 to 133 cm3) and compositions (cystic and solid proportions). The pilot cases informed innovations to improve specimen and subsequent slice orientation, through the use of 3D-printed tumour replicas and incorporation of a slice orientation slit in the mould design, respectively. The overall research pathway was compatible with implementation within the clinically determined timeframe and treatment pathway for each case, involving multidisciplinary clinical professionals from Radiology, Surgery, Oncology and Histopathology Departments. Conclusions: We developed and refined a computational pipeline that can model lesion-specific 3D-printed moulds from preoperative imaging for a variety of pelvic tumours. This framework can be used to guide comprehensive multi-sampling of tumour resection specimens.

Integrating Artificial Intelligence Tools in the Clinical Research Setting: The Ovarian Cancer Use Case.

Artificial intelligence (AI) methods applied to healthcare problems have shown enormous potential to alleviate the burden of health services worldwide and to improve the accuracy and reproducibility of predictions. In particular, developments in computer vision are creating a paradigm shift in the analysis of radiological images, where AI tools are already capable of automatically detecting and precisely delineating tumours. However, such tools are generally developed in technical departments that continue to be siloed from where the real benefit would be achieved with their usage. Significant effort still needs to be made to make these advancements available, first in academic clinical research and ultimately in the clinical setting. In this paper, we demonstrate a prototype pipeline based entirely on open-source software and free of cost to bridge this gap, simplifying the integration of tools and models developed within the AI community into the clinical research setting, ensuring an accessible platform with visualisation applications that allow end-users such as radiologists to view and interact with the outcome of these AI tools.

Deep learning-based segmentation of multisite disease in ovarian cancer.

PURPOSE: To determine if pelvic/ovarian and omental lesions of ovarian cancer can be reliably segmented on computed tomography (CT) using fully automated deep learning-based methods. METHODS: A deep learning model for the two most common disease sites of high-grade serous ovarian cancer lesions (pelvis/ovaries and omentum) was developed and compared against the well-established "no-new-Net" framework and unrevised trainee radiologist segmentations. A total of 451 CT scans collected from four different institutions were used for training (n = 276), evaluation (n = 104) and testing (n = 71) of the methods. The performance was evaluated using the Dice similarity coefficient (DSC) and compared using a Wilcoxon test. RESULTS: Our model outperformed no-new-Net for the pelvic/ovarian lesions in cross-validation, on the evaluation and test set by a significant margin (p values being 4 × 10-7, 3 × 10-4, 4 × 10-2, respectively), and for the omental lesions on the evaluation set (p = 1 × 10-3). Our model did not perform significantly differently in segmenting pelvic/ovarian lesions (p = 0.371) compared to a trainee radiologist. On an independent test set, the model achieved a DSC performance of 71 ± 20 (mean ± standard deviation) for pelvic/ovarian and 61 ± 24 for omental lesions. CONCLUSION: Automated ovarian cancer segmentation on CT scans using deep neural networks is feasible and achieves performance close to a trainee-level radiologist for pelvic/ovarian lesions. RELEVANCE STATEMENT: Automated segmentation of ovarian cancer may be used by clinicians for CT-based volumetric assessments and researchers for building complex analysis pipelines. KEY POINTS: • The first automated approach for pelvic/ovarian and omental ovarian cancer lesion segmentation on CT images has been presented. • Automated segmentation of ovarian cancer lesions can be comparable with manual segmentation of trainee radiologists. • Careful hyperparameter tuning can provide models significantly outperforming strong state-of-the-art baselines.

Integrated radiogenomics models predict response to neoadjuvant chemotherapy in high grade serous ovarian cancer.

High grade serous ovarian carcinoma (HGSOC) is a highly heterogeneous disease that typically presents at an advanced, metastatic state. The multi-scale complexity of HGSOC is a major obstacle to predicting response to neoadjuvant chemotherapy (NACT) and understanding critical determinants of response. Here we present a framework to predict the response of HGSOC patients to NACT integrating baseline clinical, blood-based, and radiomic biomarkers extracted from all primary and metastatic lesions. We use an ensemble machine learning model trained to predict the change in total disease volume using data obtained at diagnosis (n = 72). The model is validated in an internal hold-out cohort (n = 20) and an independent external patient cohort (n = 42). In the external cohort the integrated radiomics model reduces the prediction error by 8% with respect to the clinical model, achieving an AUC of 0.78 for RECIST 1.1 classification compared to 0.47 for the clinical model. Our results emphasize the value of including radiomics data in integrative models of treatment response and provide methods for developing new biomarker-based clinical trials of NACT in HGSOC.

Radiomic and Volumetric Measurements as Clinical Trial Endpoints-A Comprehensive Review.

Clinical trials for oncology drug development have long relied on surrogate outcome biomarkers that assess changes in tumor burden to accelerate drug registration (i.e., Response Evaluation Criteria in Solid Tumors version 1.1 (RECIST v1.1) criteria). Drug-induced reduction in tumor size represents an imperfect surrogate marker for drug activity and yet a radiologically determined objective response rate is a widely used endpoint for Phase 2 trials. With the addition of therapies targeting complex biological systems such as immune system and DNA damage repair pathways, incorporation of integrative response and outcome biomarkers may add more predictive value. We performed a review of the relevant literature in four representative tumor types (breast cancer, rectal cancer, lung cancer and glioblastoma) to assess the preparedness of volumetric and radiomics metrics as clinical trial endpoints. We identified three key areas-segmentation, validation and data sharing strategies-where concerted efforts are required to enable progress of volumetric- and radiomics-based clinical trial endpoints for wider clinical implementation.

Clinically Interpretable Radiomics-Based Prediction of Histopathologic Response to Neoadjuvant Chemotherapy in High-Grade Serous Ovarian Carcinoma.

Background: Pathological response to neoadjuvant treatment for patients with high-grade serous ovarian carcinoma (HGSOC) is assessed using the chemotherapy response score (CRS) for omental tumor deposits. The main limitation of CRS is that it requires surgical sampling after initial neoadjuvant chemotherapy (NACT) treatment. Earlier and non-invasive response predictors could improve patient stratification. We developed computed tomography (CT) radiomic measures to predict neoadjuvant response before NACT using CRS as a gold standard. Methods: Omental CT-based radiomics models, yielding a simplified fully interpretable radiomic signature, were developed using Elastic Net logistic regression and compared to predictions based on omental tumor volume alone. Models were developed on a single institution cohort of neoadjuvant-treated HGSOC (n = 61; 41% complete response to NCT) and tested on an external test cohort (n = 48; 21% complete response). Results: The performance of the comprehensive radiomics models and the fully interpretable radiomics model was significantly higher than volume-based predictions of response in both the discovery and external test sets when assessed using G-mean (geometric mean of sensitivity and specificity) and NPV, indicating high generalizability and reliability in identifying non-responders when using radiomics. The performance of a fully interpretable model was similar to that of comprehensive radiomics models. Conclusions: CT-based radiomics allows for predicting response to NACT in a timely manner and without the need for abdominal surgery. Adding pre-NACT radiomics to volumetry improved model performance for predictions of response to NACT in HGSOC and was robust to external testing. A radiomic signature based on five robust predictive features provides improved clinical interpretability and may thus facilitate clinical acceptance and application.

Radioproteomics in patients with ovarian cancer.

Radioproteomics is the integration of proteomics, the systematic study of the protein expression of an organism, with radiomics, the extraction and analysis of large numbers of quantitative features from medical images. This article examines this developing field, and it's application in high grade serous ovarian carcinoma. Seminal proteomic studies in the area of ovarian cancer, such as the PROVAR and CPTA studies are discussed, along side recent research, such as that highlighting the central role of methyltransferase nicotinamide N-methyltransferase as the metabolic regulation of cancer progression in the tumour stroma. Finally, this article considers a novel, hypothesis generating approach to integrate CT-based qualitative and radiomic features with proteomic analysis, and the future direction of the field. Combined advances in radiomic, proteomic and genomic analysis has the potential to signal the age of true precision medicine, where treatment is centered specifically on the molecular profile of the tumour, rather than based on empirical knowledge, thus altering the course of a disease that has the highest mortality of all cancers of the female reproductive system.

Radiomics and radiogenomics in ovarian cancer: a literature review.

Ovarian cancer remains one of the most lethal gynecological cancers in the world despite extensive progress in the areas of chemotherapy and surgery. Many studies have postulated that this is because of the profound heterogeneity that underpins response to therapy and prognosis. Standard imaging evaluation using CT or MRI does not take into account this tumoral heterogeneity especially in advanced stages with peritoneal carcinomatosis. As such, newly emergent fields in the assessment of tumor heterogeneity have been proposed using radiomics to evaluate the whole tumor burden heterogeneity as opposed to single biopsy sampling. This review provides an overview of radiomics, radiogenomics, and proteomics and examines the use of these newly emergent fields in assessing tumor heterogeneity and its implications in ovarian cancer.