A systematic review of machine learning-based tumor-infiltrating lymphocytes analysis in colorectal cancer: Overview of techniques, performance metrics, and clinical outcomes.

The incidence of colorectal cancer (CRC), one of the deadliest cancers around the world, is increasing. Tissue microenvironment (TME) features such as tumor-infiltrating lymphocytes (TILs) can have a crucial impact on diagnosis or decision-making for treating patients with CRC. While clinical studies showed that TILs improve the host immune response, leading to a better prognosis, inter-observer agreement for quantifying TILs is not perfect. Incorporating machine learning (ML) based applications in clinical routine may promote diagnosis reliability. Recently, ML has shown potential for making progress in routine clinical procedures. We aim to systematically review the TILs analysis based on ML in CRC histological images. Deep learning (DL) and non-DL techniques can aid pathologists in identifying TILs, and automated TILs are associated with patient outcomes. However, a large multi-institutional CRC dataset with a diverse and multi-ethnic population is necessary to generalize ML methods.

[Digital transformation of a routine histopathology lab : Dos and don'ts!] / Digitalisierung der histopathologischen Routinediagnostik : Dos and Don'ts!

The implementation of digital histopathology in the laboratory marks a crucial milestone in the overall digital transformation of pathology. This shift offers a range of new possibilities, including access to extensive datasets for AI-assisted analyses, the flexibility of remote work and home office arrangements for specialists, and the expedited and simplified sharing of images and data for research, conferences, and tumor boards. However, the transition to a fully digital workflow involves significant technological and personnel-related efforts. It necessitates careful and adaptable change management to minimize disruptions, particularly in the personnel domain, and to prevent the loss of valuable potential from employees who may be resistant to change. This article consolidates our institute's experiences, highlighting technical and personnel-related challenges encountered during the transition to digital pathology. It also presents a comprehensive overview of potential difficulties at various interfaces when converting routine operations to a digital workflow.

Assessment of the Tumor-Stroma Ratio and Tumor-Infiltrating Lymphocytes in Colorectal Cancer: Inter-Observer Agreement Evaluation.

BACKGROUND: To implement the new marker in clinical practice, reliability assessment, validation, and standardization of utilization must be applied. This study evaluated the reliability of tumor-infiltrating lymphocytes (TILs) and tumor-stroma ratio (TSR) assessment through conventional microscopy by comparing observers' estimations. METHODS: Intratumoral and tumor-front stromal TILs, and TSR, were assessed by three pathologists using 86 CRC HE slides. TSR and TILs were categorized using one and four different proposed cutoff systems, respectively, and agreement was assessed using the intraclass coefficient (ICC) and Cohen's kappa statistics. Pairwise evaluation of agreement was performed using the Fleiss kappa statistic and the concordance rate and it was visualized by Bland-Altman plots. To investigate the association between biomarkers and patient data, Pearson's correlation analysis was applied. RESULTS: For the evaluation of intratumoral stromal TILs, ICC of 0.505 (95% CI: 0.35-0.64) was obtained, kappa values were in the range of 0.21 to 0.38, and concordance rates in the range of 0.61 to 0.72. For the evaluation of tumor-front TILs, ICC was 0.52 (95% CI: 0.32-0.67), the overall kappa value ranged from 0.24 to 0.30, and the concordance rate ranged from 0.66 to 0.72. For estimating the TSR, the ICC was 0.48 (95% CI: 0.35-0.60), the kappa value was 0.49 and the concordance rate was 0.76. We observed a significant correlation between tumor grade and the median of TSR (0.29 (95% CI: 0.032-0.51), p-value = 0.03). CONCLUSIONS: The agreement between pathologists in estimating these markers corresponds to poor-to-moderate agreement; implementing immune scores in daily practice requires more concentration in inter-observer agreements.

Clinical Validation of Artificial Intelligence-Augmented Pathology Diagnosis Demonstrates Significant Gains in Diagnostic Accuracy in Prostate Cancer Detection.

CONTEXT.­: Prostate cancer diagnosis rests on accurate assessment of tissue by a pathologist. The application of artificial intelligence (AI) to digitized whole slide images (WSIs) can aid pathologists in cancer diagnosis, but robust, diverse evidence in a simulated clinical setting is lacking. OBJECTIVE.­: To compare the diagnostic accuracy of pathologists reading WSIs of prostatic biopsy specimens with and without AI assistance. DESIGN.­: Eighteen pathologists, 2 of whom were genitourinary subspecialists, evaluated 610 prostate needle core biopsy WSIs prepared at 218 institutions, with the option for deferral. Two evaluations were performed sequentially for each WSI: initially without assistance, and immediately thereafter aided by Paige Prostate (PaPr), a deep learning-based system that provides a WSI-level binary classification of suspicious for cancer or benign and pinpoints the location that has the greatest probability of harboring cancer on suspicious WSIs. Pathologists' changes in sensitivity and specificity between the assisted and unassisted modalities were assessed, together with the impact of PaPr output on the assisted reads. RESULTS.­: Using PaPr, pathologists improved their sensitivity and specificity across all histologic grades and tumor sizes. Accuracy gains on both benign and cancerous WSIs could be attributed to PaPr, which correctly classified 100% of the WSIs showing corrected diagnoses in the PaPr-assisted phase. CONCLUSIONS.­: This study demonstrates the effectiveness and safety of an AI tool for pathologists in simulated diagnostic practice, bridging the gap between computational pathology research and its clinical application, and resulted in the first US Food and Drug Administration authorization of an AI system in pathology.

Pathological Reporting of Radical Prostatectomy Specimens Following ICCR Recommendation: Impact of Electronic Reporting Tool Implementation on Quality and Interdisciplinary Communication in a Large University Hospital.

Prostate cancer represents one of the most common malignant tumors in male patients in Germany. The pathological reporting of radical prostatectomy specimens following a structured process constitutes an excellent prototype for the introduction of software-based standardized structured reporting in pathology. This can lead to reports of higher quality and could create a fundamental improvement for future AI applications. A software-based reporting template was used to generate standardized structured pathological reports of radical prostatectomy specimens of patients treated at the University Hospital Klinikum rechts der Isar of Technische Universität München, Germany. Narrative reports (NR) and standardized structured reports (SSR) were analyzed with regard to completeness, and clinicians' satisfaction with each report type was evaluated. SSR show considerably higher completeness than NR. A total of 10 categories out of 32 were significantly more complete in SSR than in NR (p < 0.05). Clinicians awarded overall high scores in NR and SSR reports. One rater acknowledged a significantly higher level of clarity and time saving when comparing SSR to NR. Our findings highlight that the standardized structured reporting of radical prostatectomy specimens, qualifying as level 5 reports, significantly increases objectively measured content quality and the level of completeness. The implementation of nationwide SSR in Germany, particularly in oncologic pathology, can serve pathologists, clinicians, and patients.

Efficient Visualization of Whole Slide Images in Web-based Viewers for Digital Pathology.

CONTEXT.­: Wide adoption of digital pathology requires efficient visualization and navigation in Web-based digital slide viewers, which is poorly defined. OBJECTIVE.­: To define and quantify relevant performance metrics for efficient visualization of cases and slides in digital slide viewers. DESIGN.­: With a universal slide viewer used in clinical routine diagnostics, we evaluated the impact of slide caching, compression type, tile, and block size of whole slide images generated from Philips, Leica, and 3DHistech scanners on streaming performance on case, slide, and field of view levels. RESULTS.­: Two hundred thirty-nine pathologists routinely reviewed 60 080 whole slide images over 3 months. The median time to open a case's slides from the laboratory information system was less than 4 seconds, the time to change to a slide within the case was less than 1 second, and the time to render the adjacent field of view when navigating the slide was less than one-quarter of a second. A whole slide image's block size and a viewer tile size of 1024 pixels showed best performance to display a field of view and was preferrable over smaller tiles due to fewer mosaic effects. For Philips, fastest median slide streaming pace was 238 ms per field of view and for 3DHistech, 125 ms. For Leica, the fastest pace of 108 ms per field of view was established with block serving without decompression. CONCLUSIONS.­: This is the first study to systematically assess user-centric slide visualization performance metrics for digital viewers, including time to open a case, time to change a slide, and time to change a field of view. These metrics help to improve the viewer's configuration, leading to an efficient visualization baseline that is widely accepted among pathologists using routine digital pathology.

FlexTileSource: An OpenSeadragon Extension for Efficient Whole-Slide Image Visualization.

BACKGROUND: Web-based digital slide viewers for pathology commonly use OpenSlide and OpenSeadragon (OSD) to access, visualize, and navigate whole-slide images (WSI). Their standard settings represent WSI as deep zoom images (DZI), a generic image pyramid structure that differs from the proprietary pyramid structure in the WSI files. The transformation from WSI to DZI is an additional, time-consuming step when rendering digital slides in the viewer, and inefficiency of digital slide viewers is a major criticism for digital pathology. AIMS: To increase efficiency of digital slide visualization by serving tiles directly from the native WSI pyramid, making the transformation from WSI to DZI obsolete. METHODS: We implemented a new flexible tile source for OSD that accepts arbitrary native pyramid structures instead of DZI levels. We measured its performance on a data set of 8104 WSI reviewed by 207 pathologists over 40 days in a web-based digital slide viewer used for routine diagnostics. RESULTS: The new FlexTileSource accelerates the display of a field of view in general by 67 ms and even by 117 ms if the block size of the WSI and the tile size of the viewer is increased to 1024 px. We provide the code of our open-source library freely on https://github.com/schuefflerlab/openseadragon. CONCLUSIONS: This is the first study to quantify visualization performance on a web-based slide viewer at scale, taking block size and tile size of digital slides into account. Quantifying performance will enable to compare and improve web-based viewers and therewith facilitate the adoption of digital pathology.

Integrated digital pathology at scale: A solution for clinical diagnostics and cancer research at a large academic medical center.

OBJECTIVE: Broad adoption of digital pathology (DP) is still lacking, and examples for DP connecting diagnostic, research, and educational use cases are missing. We blueprint a holistic DP solution at a large academic medical center ubiquitously integrated into clinical workflows; researchapplications including molecular, genetic, and tissue databases; and educational processes. MATERIALS AND METHODS: We built a vendor-agnostic, integrated viewer for reviewing, annotating, sharing, and quality assurance of digital slides in a clinical or research context. It is the first homegrown viewer cleared by New York State provisional approval in 2020 for primary diagnosis and remote sign-out during the COVID-19 (coronavirus disease 2019) pandemic. We further introduce an interconnected Honest Broker for BioInformatics Technology (HoBBIT) to systematically compile and share large-scale DP research datasets including anonymized images, redacted pathology reports, and clinical data of patients with consent. RESULTS: The solution has been operationally used over 3 years by 926 pathologists and researchers evaluating 288 903 digital slides. A total of 51% of these were reviewed within 1 month after scanning. Seamless integration of the viewer into 4 hospital systems clearly increases the adoption of DP. HoBBIT directly impacts the translation of knowledge in pathology into effective new health measures, including artificial intelligence-driven detection models for prostate cancer, basal cell carcinoma, and breast cancer metastases, developed and validated on thousands of cases. CONCLUSIONS: We highlight major challenges and lessons learned when going digital to provide orientation for other pathologists. Building interconnected solutions will not only increase adoption of DP, but also facilitate next-generation computational pathology at scale for enhanced cancer research.

Overcoming an Annotation Hurdle: Digitizing Pen Annotations from Whole Slide Images.

BACKGROUND: The development of artificial intelligence (AI) in pathology frequently relies on digitally annotated whole slide images (WSI). The creation of these annotations - manually drawn by pathologists in digital slide viewers - is time consuming and expensive. At the same time, pathologists routinely annotate glass slides with a pen to outline cancerous regions, for example, for molecular assessment of the tissue. These pen annotations are currently considered artifacts and excluded from computational modeling. METHODS: We propose a novel method to segment and fill hand-drawn pen annotations and convert them into a digital format to make them accessible for computational models. Our method is implemented in Python as an open source, publicly available software tool. RESULTS: Our method is able to extract pen annotations from WSI and save them as annotation masks. On a data set of 319 WSI with pen markers, we validate our algorithm segmenting the annotations with an overall Dice metric of 0.942, Precision of 0.955, and Recall of 0.943. Processing all images takes 15 min in contrast to 5 h manual digital annotation time. Further, the approach is robust against text annotations. CONCLUSIONS: We envision that our method can take advantage of already pen-annotated slides in scenarios in which the annotations would be helpful for training computational models. We conclude that, considering the large archives of many pathology departments that are currently being digitized, our method will help to collect large numbers of training samples from those data.

Deep Learning Methods for Lung Cancer Segmentation in Whole-Slide Histopathology Images-The ACDC@LungHP Challenge 2019.

Accurate segmentation of lung cancer in pathology slides is a critical step in improving patient care. We proposed the ACDC@LungHP (Automatic Cancer Detection and Classification in Whole-slide Lung Histopathology) challenge for evaluating different computer-aided diagnosis (CADs) methods on the automatic diagnosis of lung cancer. The ACDC@LungHP 2019 focused on segmentation (pixel-wise detection) of cancer tissue in whole slide imaging (WSI), using an annotated dataset of 150 training images and 50 test images from 200 patients. This paper reviews this challenge and summarizes the top 10 submitted methods for lung cancer segmentation. All methods were evaluated using metrics using the precision, accuracy, sensitivity, specificity, and DICE coefficient (DC). The DC ranged from 0.7354 ±0.1149 to 0.8372 ±0.0858. The DC of the best method was close to the inter-observer agreement (0.8398 ±0.0890). All methods were based on deep learning and categorized into two groups: multi-model method and single model method. In general, multi-model methods were significantly better (p 0.01) than single model methods, with mean DC of 0.7966 and 0.7544, respectively. Deep learning based methods could potentially help pathologists find suspicious regions for further analysis of lung cancer in WSI.

Validation of a digital pathology system including remote review during the COVID-19 pandemic.

Remote digital pathology allows healthcare systems to maintain pathology operations during public health emergencies. Existing Clinical Laboratory Improvement Amendments regulations require pathologists to electronically verify patient reports from a certified facility. During the 2019 pandemic of COVID-19 disease, caused by the SAR-CoV-2 virus, this requirement potentially exposes pathologists, their colleagues, and household members to the risk of becoming infected. Relaxation of government enforcement of this regulation allows pathologists to review and report pathology specimens from a remote, non-CLIA certified facility. The availability of digital pathology systems can facilitate remote microscopic diagnosis, although formal comprehensive (case-based) validation of remote digital diagnosis has not been reported. All glass slides representing routine clinical signout workload in surgical pathology subspecialties at Memorial Sloan Kettering Cancer Center were scanned on an Aperio GT450 at ×40 equivalent resolution (0.26 µm/pixel). Twelve pathologists from nine surgical pathology subspecialties remotely reviewed and reported complete pathology cases using a digital pathology system from a non-CLIA certified facility through a secure connection. Whole slide images were integrated to and launched within the laboratory information system to a custom vendor-agnostic, whole slide image viewer. Remote signouts utilized consumer-grade computers and monitors (monitor size, 13.3-42 in.; resolution, 1280 × 800-3840 × 2160 pixels) connecting to an institution clinical workstation via secure virtual private network. Pathologists subsequently reviewed all corresponding glass slides using a light microscope within the CLIA-certified department. Intraobserver concordance metrics included reporting elements of top-line diagnosis, margin status, lymphovascular and/or perineural invasion, pathology stage, and ancillary testing. The median whole slide image file size was 1.3 GB; scan time/slide averaged 90 s; and scanned tissue area averaged 612 mm2. Signout sessions included a total of 108 cases, comprised of 254 individual parts and 1196 slides. Major diagnostic equivalency was 100% between digital and glass slide diagnoses; and overall concordance was 98.8% (251/254). This study reports validation of primary diagnostic review and reporting of complete pathology cases from a remote site during a public health emergency. Our experience shows high (100%) intraobserver digital to glass slide major diagnostic concordance when reporting from a remote site. This randomized, prospective study successfully validated remote use of a digital pathology system including operational feasibility supporting remote review and reporting of pathology specimens, and evaluation of remote access performance and usability for remote signout.

Accuracy of Intraoperative Frozen Section of Sentinel Lymph Nodes After Neoadjuvant Chemotherapy for Breast Carcinoma.

False-negative (FN) intraoperative frozen section (FS) results of sentinel lymph nodes (SLN) have been reported to be more common after neoadjuvant chemotherapy (NAC) in the primary surgical setting. We evaluated SLN FS assessment in breast cancer patients treated with NAC to determine the FN rate and the histomorphologic factors associated with FN results. Patients who had FS SLN assessment following NAC from July 2008 to July 2017 were identified. Of the 711 SLN FS cases, 522 were negative, 181 positive, and 8 deferred. The FN rate was 5.4% (28/522). There were no false-positive results. Of the 8 deferred cases, 5 were positive on permanent section and 3 were negative. There was a higher frequency of micrometastasis and isolated tumor cells in FN cases (P<0.001). There was a significant increase in tissue surface area present on permanent section slides compared with FS slides (P<0.001), highlighting the inherent technical limitations of FS and histologic under-sampling of tissue which leads to most FN results. The majority (25/28, 89%) of FN cases had metastatic foci identified exclusively on permanent sections and were not due to a true diagnostic interpretation error. FN cases were more frequently estrogen receptor positive (P<0.001), progesterone receptor positive (P=0.001), human epidermal growth factor receptor-2 negative (P=0.009) and histologic grade 1 (P=0.015), which most likely reflects the lower rates of pathologic complete response in these tumors. Despite its limitations, FS is a reliable modality to assess the presence of SLN metastases in NAC treated patients.

Whole slide imaging equivalency and efficiency study: experience at a large academic center.

Whole slide imaging is Food and Drug Administration-approved for primary diagnosis in the United States of America; however, relatively few pathology departments in the country have fully implemented an enterprise wide digital pathology system enabled for primary diagnosis. Digital pathology has significant potential to transform pathology practice with several published studies documenting some level of diagnostic equivalence between digital and conventional systems. However, whole slide imaging also has significant potential to disrupt pathology practice, due to the differences in efficiency of manipulating digital images vis-à-vis glass slides, and studies on the efficiency of actual digital pathology workload are lacking. Our randomized, equivalency and efficiency study aimed to replicate clinical workflow, comparing conventional microscopy to a complete digital pathology signout using whole slide images, evaluating the equivalency and efficiency of glass slide to whole slide image reporting, reflective of true pathology practice workloads in the clinical setting. All glass slides representing an entire day's routine clinical signout workload for six different anatomic pathology subspecialties at Memorial Sloan Kettering Cancer Center were scanned on Leica Aperio AT2 at ×40 (0.25 µm/pixel). Integration of whole slide images for each accessioned case is through an interface between the Leica eSlide manager database and the laboratory information system, Cerner CoPathPlus. Pathologists utilized a standard institution computer workstation and viewed whole slide images through an internally developed, vendor agnostic whole slide image viewer, named the "MSK Slide Viewer". Subspecialized pathologists first reported on glass slides from surgical pathology cases using routine clinical workflow. Glass slides were de-identified, scanned, and re-accessioned in the laboratory information system test environment. After a washout period of 13 weeks, pathologists reported the same clinical workload using whole slide image integrated within the laboratory information system. Intraobserver equivalency metrics included top-line diagnosis, margin status, lymphovascular and/or perineural invasion, pathology stage, and the need to order ancillary testing (i.e., recuts, immunohistochemistry). Turnaround time (efficiency) evaluation was defined by the start of each case when opened in the laboratory information system and when the case was completed for that day (i.e., case sent to signout queue or pending ancillary studies). Eight pathologists participated from the following subspecialties: bone and soft tissue, genitourinary, gastrointestinal, breast, gynecologic, and dermatopathology. Glass slides signouts comprised of 204 cases, encompassing 2091 glass slides; and digital signouts comprised of 199 cases, encompassing 2073 whole slide images. The median whole slide image file size was 1.54 GB; scan time/slide, 6 min 24 s; and scan area 32.1 × 18.52 mm. Overall diagnostic equivalency (e.g., top-line diagnosis) was 99.3% between digital and glass slide signout; however, signout using whole slide images showed a median overall 19% decrease in efficiency per case. No significant difference by reader, subspecialty, or specimen type was identified. Our experience is the most comprehensive study to date and shows high intraobserver whole slide image to glass slide equivalence in reporting of true clinical workflows and workloads. Efficiency needs to improve for digital pathology to gain more traction among pathologists.

Comparison of contrast-enhanced and diffusion-weighted MRI in assessment of the terminal ileum in Crohn's disease patients.

PURPOSE: The purpose of the study was to compare the performance of contrast-enhanced (CE)-MRI and diffusion-weighted imaging (DW)-MRI in grading Crohn's disease activity of the terminal ileum. METHODS: Three readers evaluated CE-MRI, DW-MRI, and their combinations (CE/DW-MRI and DW/CE-MRI, depending on which protocol was used at the start of evaluation). Disease severity grading scores were correlated to the Crohn's Disease Endoscopic Index of Severity (CDEIS). Diagnostic accuracy, severity grading, and levels of confidence were compared between imaging protocols and interobserver agreement was calculated. RESULTS: Sixty-one patients were included (30 female, median age 36). Diagnostic accuracy for active disease for CE-MRI, DW-MRI, CE/DW-MRI, and DW/CE-MRI ranged between 0.82 and 0.85, 0.75 and 0.83, 0.79 and 0.84, and 0.74 and 0.82, respectively. Severity grading correlation to CDEIS ranged between 0.70 and 0.74, 0.66 and 0.70, 0.69 and 0.75, and 0.67 and 0.74, respectively. For each reader, CE-MRI values were consistently higher than DW-MRI, albeit not significantly. Confidence levels for all readers were significantly higher for CE-MRI compared to DW-MRI (P < 0.001). Further increased confidence was seen when using combined imaging protocols. CONCLUSIONS: There was no significant difference of CE-MRI and DW-MRI in determining disease activity, but the higher confidence levels may favor CE-MRI. DW-MRI is a good alternative in cases with relative contraindications for the use of intravenous contrast medium.

Comprehensive immunohistochemical analysis of PD-L1 shows scarce expression in castration-resistant prostate cancer.

BACKGROUND: We aimed to analyze the frequency and distribution of PD-L1 expression in specimens from prostate cancer (PC) patients using two different anti-PD-L1 antibodies (E1L3N, SP263). MATERIALS AND METHODS: PD-L1 immunohistochemistry was performed in a tissue microarray consisting of 82 castration-resistant prostate cancer (CRPC) specimens, 70 benign prostate hyperplasia (BPH) specimens, 96 localized PC cases, and 3 PC cell lines, using two different antibodies (clones E1L3N, and SP263). Staining images for CD4, CD8, PD-L1, and PanCK of a single PD-L1 positive case were compared, using a newly developed dot-wise correlation method for digital images to objectively test for co-expression. RESULTS: Depending on the antibody used, in tumor cells (TC) only five (E1L3N: 6%) and three (SP263: 3.7%) samples were positive. In infiltrating immune cells (IC) 12 (SP263: 14.6%) and 8 (E1L3N: 9.9%) specimens showed PD-L1 expression. Two PC cell lines (PC3, LnCaP) also displayed membranous immunoreactivity. All localized PCs or BPH samples tested were negative. Dot-wise digital correlation of expression patterns revealed a moderate positive correlation between PD-L1 and PanCK expression, whereas both PanCK and PD-L1 showed a weak negative Pearson correlation coefficient between CD4 and CD8. CONCLUSIONS: PD-L1 was not expressed in localized PC or BPH, and was only found in a minority of CRPC tumors and infiltrating immune cells. Protein expression maps and systematic dot-wise comparison could be a useful objective way to describe the relationship between immuno- and tumor-related proteins in the future, without the need to develop multiplex staining methods.

Semiautomatic Assessment of the Terminal Ileum and Colon in Patients with Crohn Disease Using MRI (the VIGOR++ Project).

RATIONALE AND OBJECTIVES: The objective of this study was to develop and validate a predictive magnetic resonance imaging (MRI) activity score for ileocolonic Crohn disease activity based on both subjective and semiautomatic MRI features. MATERIALS AND METHODS: An MRI activity score (the "virtual gastrointestinal tract [VIGOR]" score) was developed from 27 validated magnetic resonance enterography datasets, including subjective radiologist observation of mural T2 signal and semiautomatic measurements of bowel wall thickness, excess volume, and dynamic contrast enhancement (initial slope of increase). A second subjective score was developed based on only radiologist observations. For validation, two observers applied both scores and three existing scores to a prospective dataset of 106 patients (59 women, median age 33) with known Crohn disease, using the endoscopic Crohn's Disease Endoscopic Index of Severity (CDEIS) as a reference standard. RESULTS: The VIGOR score (17.1 × initial slope of increase + 0.2 × excess volume + 2.3 × mural T2) and other activity scores all had comparable correlation to the CDEIS scores (observer 1: r = 0.58 and 0.59, and observer 2: r = 0.34-0.40 and 0.43-0.51, respectively). The VIGOR score, however, improved interobserver agreement compared to the other activity scores (intraclass correlation coefficient = 0.81 vs 0.44-0.59). A diagnostic accuracy of 80%-81% was seen for the VIGOR score, similar to the other scores. CONCLUSIONS: The VIGOR score achieves comparable accuracy to conventional MRI activity scores, but with significantly improved reproducibility, favoring its use for disease monitoring and therapy evaluation.

Towards machine learned quality control: A benchmark for sharpness quantification in digital pathology.

Pathology is on the verge of a profound change from an analog and qualitative to a digital and quantitative discipline. This change is mostly driven by the high-throughput scanning of microscope slides in modern pathology departments, reaching tens of thousands of digital slides per month. The resulting vast digital archives form the basis of clinical use in digital pathology and allow large scale machine learning in computational pathology. One of the most crucial bottlenecks of high-throughput scanning is quality control (QC). Currently, digital slides are screened manually to detected out-of-focus regions, to compensate for the limitations of scanner software. We present a solution to this problem by introducing a benchmark dataset for blur detection, an in-depth comparison of state-of-the art sharpness descriptors and their prediction performance within a random forest framework. Furthermore, we show that convolution neural networks, like residual networks, can be used to train blur detectors from scratch. We thoroughly evaluate the accuracy of feature based and deep learning based approaches for sharpness classification (99.74% accuracy) and regression (MSE 0.004) and additionally compare them to domain experts in a comprehensive human perception study. Our pipeline outputs spacial heatmaps enabling to quantify and localize blurred areas on a slide. Finally, we tested the proposed framework in the clinical setting and demonstrate superior performance over the state-of-the-art QC pipeline comprising commercial software and human expert inspection by reducing the error rate from 17% to 4.7%.

DeepScope: Nonintrusive Whole Slide Saliency Annotation and Prediction from Pathologists at the Microscope.

Modern digital pathology departments have grown to produce whole-slide image data at petabyte scale, an unprecedented treasure chest for medical machine learning tasks. Unfortunately, most digital slides are not annotated at the image level, hindering large-scale application of supervised learning. Manual labeling is prohibitive, requiring pathologists with decades of training and outstanding clinical service responsibilities. This problem is further aggravated by the United States Food and Drug Administration's ruling that primary diagnosis must come from a glass slide rather than a digital image. We present the first end-to-end framework to overcome this problem, gathering annotations in a nonintrusive manner during a pathologist's routine clinical work: (i) microscope-specific 3D-printed commodity camera mounts are used to video record the glass-slide-based clinical diagnosis process; (ii) after routine scanning of the whole slide, the video frames are registered to the digital slide; (iii) motion and observation time are estimated to generate a spatial and temporal saliency map of the whole slide. Demonstrating the utility of these annotations, we train a convolutional neural network that detects diagnosis-relevant salient regions, then report accuracy of 85.15% in bladder and 91.40% in prostate, with 75.00% accuracy when training on prostate but predicting in bladder, despite different pathologists examining the different tissues. When training on one patient but testing on another, AUROC in bladder is 0.79±0.11 and in prostate is 0.96±0.04. Our tool is available at https://bitbucket.org/aschaumberg/deepscope.

Image-based computational quantification and visualization of genetic alterations and tumour heterogeneity.

Recent large-scale genome analyses of human tissue samples have uncovered a high degree of genetic alterations and tumour heterogeneity in most tumour entities, independent of morphological phenotypes and histopathological characteristics. Assessment of genetic copy-number variation (CNV) and tumour heterogeneity by fluorescence in situ hybridization (ISH) provides additional tissue morphology at single-cell resolution, but it is labour intensive with limited throughput and high inter-observer variability. We present an integrative method combining bright-field dual-colour chromogenic and silver ISH assays with an image-based computational workflow (ISHProfiler), for accurate detection of molecular signals, high-throughput evaluation of CNV, expressive visualization of multi-level heterogeneity (cellular, inter- and intra-tumour heterogeneity), and objective quantification of heterogeneous genetic deletions (PTEN) and amplifications (19q12, HER2) in diverse human tumours (prostate, endometrial, ovarian and gastric), using various tissue sizes and different scanners, with unprecedented throughput and reproducibility.

Oxygen supply maps for hypoxic microenvironment visualization in prostate cancer.

BACKGROUND: Intratumoral hypoxia plays an important role with regard to tumor biology and susceptibility to radio- and chemotherapy. For further investigation of hypoxia-related changes, areas of certain hypoxia must be reliably detected within cancer tissues. Pimonidazole, a 2-nitroimindazole, accumulates in hypoxic tissue and can be easily visualized using immunohistochemistry. MATERIALS AND METHODS: To improve detection of highly hypoxic versus normoxic areas in prostate cancer, immunoreactivity of pimonidazole and a combination of known hypoxia-related proteins was used to create computational oxygen supply maps of prostate cancer. Pimonidazole was intravenously administered before radical prostatectomy in n = 15 patients, using the da Vinci robot-assisted surgical system. Prostatectomy specimens were immediately transferred into buffered formaldehyde, fixed overnight, and completely embedded in paraffin. Pimonidazole accumulation and hypoxia-related protein expression were visualized by immunohistochemistry. Oxygen supply maps were created using the normalized information from pimonidazole and hypoxia-related proteins. RESULTS: Based on pimonidazole staining and other hypoxia.related proteins (osteopontin, hypoxia-inducible factor 1-alpha, and glucose transporter member 1) oxygen supply maps in prostate cancer were created. Overall, oxygen supply maps consisting of information from all hypoxia-related proteins showed high correlation and mutual information to the golden standard of pimonidazole. Here, we describe an improved computer-based ex vivo model for an accurate detection of oxygen supply in human prostate cancer tissue. CONCLUSIONS: This platform can be used for precise colocalization of novel candidate hypoxia-related proteins in a representative number of prostate cancer cases, and improve issues of single marker correlations. Furthermore, this study provides a source for further in situ tests and biochemical investigations.