Predicting lymph node metastasis from primary tumor histology and clinicopathologic factors in colorectal cancer using deep learning.

BACKGROUND: Presence of lymph node metastasis (LNM) influences prognosis and clinical decision-making in colorectal cancer. However, detection of LNM is variable and depends on a number of external factors. Deep learning has shown success in computational pathology, but has struggled to boost performance when combined with known predictors. METHODS: Machine-learned features are created by clustering deep learning embeddings of small patches of tumor in colorectal cancer via k-means, and then selecting the top clusters that add predictive value to a logistic regression model when combined with known baseline clinicopathological variables. We then analyze performance of logistic regression models trained with and without these machine-learned features in combination with the baseline variables. RESULTS: The machine-learned extracted features provide independent signal for the presence of LNM (AUROC: 0.638, 95% CI: [0.590, 0.683]). Furthermore, the machine-learned features add predictive value to the set of 6 clinicopathologic variables in an external validation set (likelihood ratio test, p < 0.00032; AUROC: 0.740, 95% CI: [0.701, 0.780]). A model incorporating these features can also further risk-stratify patients with and without identified metastasis (p < 0.001 for both stage II and stage III). CONCLUSION: This work demonstrates an effective approach to combine deep learning with established clinicopathologic factors in order to identify independently informative features associated with LNM. Further work building on these specific results may have important impact in prognostication and therapeutic decision making for LNM. Additionally, this general computational approach may prove useful in other contexts.

When colorectal cancers spread to the lymph nodes, it can indicate a poorer prognosis. However, detecting lymph node metastasis (spread) can be difficult and depends on a number of factors such as how samples are taken and processed. Here, we show that machine learning, which involves computer software learning from patterns in data, can predict lymph node metastasis in patients with colorectal cancer from the microscopic appearance of their primary tumor and the clinical characteristics of the patients. We also show that the same approach can predict patient survival. With further work, our approach may help clinicians to inform patients about their prognosis and decide on appropriate treatments.

Pathologist Validation of a Machine Learning-Derived Feature for Colon Cancer Risk Stratification.

Importance: Identifying new prognostic features in colon cancer has the potential to refine histopathologic review and inform patient care. Although prognostic artificial intelligence systems have recently demonstrated significant risk stratification for several cancer types, studies have not yet shown that the machine learning-derived features associated with these prognostic artificial intelligence systems are both interpretable and usable by pathologists. Objective: To evaluate whether pathologist scoring of a histopathologic feature previously identified by machine learning is associated with survival among patients with colon cancer. Design, Setting, and Participants: This prognostic study used deidentified, archived colorectal cancer cases from January 2013 to December 2015 from the University of Milano-Bicocca. All available histologic slides from 258 consecutive colon adenocarcinoma cases were reviewed from December 2021 to February 2022 by 2 pathologists, who conducted semiquantitative scoring for tumor adipose feature (TAF), which was previously identified via a prognostic deep learning model developed with an independent colorectal cancer cohort. Main Outcomes and Measures: Prognostic value of TAF for overall survival and disease-specific survival as measured by univariable and multivariable regression analyses. Interpathologist agreement in TAF scoring was also evaluated. Results: A total of 258 colon adenocarcinoma histopathologic cases from 258 patients (138 men [53%]; median age, 67 years [IQR, 65-81 years]) with stage II (n = 119) or stage III (n = 139) cancer were included. Tumor adipose feature was identified in 120 cases (widespread in 63 cases, multifocal in 31, and unifocal in 26). For overall survival analysis after adjustment for tumor stage, TAF was independently prognostic in 2 ways: TAF as a binary feature (presence vs absence: hazard ratio [HR] for presence of TAF, 1.55 [95% CI, 1.07-2.25]; P = .02) and TAF as a semiquantitative categorical feature (HR for widespread TAF, 1.87 [95% CI, 1.23-2.85]; P = .004). Interpathologist agreement for widespread TAF vs lower categories (absent, unifocal, or multifocal) was 90%, corresponding to a κ metric at this threshold of 0.69 (95% CI, 0.58-0.80). Conclusions and Relevance: In this prognostic study, pathologists were able to learn and reproducibly score for TAF, providing significant risk stratification on this independent data set. Although additional work is warranted to understand the biological significance of this feature and to establish broadly reproducible TAF scoring, this work represents the first validation to date of human expert learning from machine learning in pathology. Specifically, this validation demonstrates that a computationally identified histologic feature can represent a human-identifiable, prognostic feature with the potential for integration into pathology practice.

Deep learning models for histologic grading of breast cancer and association with disease prognosis.

Histologic grading of breast cancer involves review and scoring of three well-established morphologic features: mitotic count, nuclear pleomorphism, and tubule formation. Taken together, these features form the basis of the Nottingham Grading System which is used to inform breast cancer characterization and prognosis. In this study, we develop deep learning models to perform histologic scoring of all three components using digitized hematoxylin and eosin-stained slides containing invasive breast carcinoma. We first evaluate model performance using pathologist-based reference standards for each component. To complement this typical approach to evaluation, we further evaluate the deep learning models via prognostic analyses. The individual component models perform at or above published benchmarks for algorithm-based grading approaches, achieving high concordance rates with pathologist grading. Further, prognostic performance using deep learning-based grading is on par with that of pathologists performing review of matched slides. By providing scores for each component feature, the deep-learning based approach also provides the potential to identify the grading components contributing most to prognostic value. This may enable optimized prognostic models, opportunities to improve access to consistent grading, and approaches to better understand the links between histologic features and clinical outcomes in breast cancer.

An Interlaboratory Comparison Study of Regulated and Emerging Mycotoxins Using Liquid Chromatography Mass Spectrometry: Challenges and Future Directions of Routine Multi-Mycotoxin Analysis including Emerging Mycotoxins.

The present interlaboratory comparison study involved nine laboratories located throughout the world that tested for 24 regulated and non-regulated mycotoxins by applying their in-house LC-MS/MS multi-toxin method to 10 individual lots of 4 matrix commodities, including complex chicken and swine feed, soy and corn gluten. In total, more than 6000 data points were collected and analyzed statistically by calculating a consensus value in combination with a target standard deviation following a modified Horwitz equation. The performance of each participant was evaluated by a z-score assessment with a satisfying range of ±2, leading to an overall success rate of 70% for all tested compounds. Equal performance for both regulated and emerging mycotoxins indicates that participating routine laboratories have successfully expanded their analytical portfolio in view of potentially new regulations. In addition, the study design proved to be fit for the purpose of providing future certified reference materials, which surpass current analyte matrix combinations and exceed the typical scope of the regulatory framework.

Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge.

Artificial intelligence (AI) has shown promise for diagnosing prostate cancer in biopsies. However, results have been limited to individual studies, lacking validation in multinational settings. Competitions have been shown to be accelerators for medical imaging innovations, but their impact is hindered by lack of reproducibility and independent validation. With this in mind, we organized the PANDA challenge-the largest histopathology competition to date, joined by 1,290 developers-to catalyze development of reproducible AI algorithms for Gleason grading using 10,616 digitized prostate biopsies. We validated that a diverse set of submitted algorithms reached pathologist-level performance on independent cross-continental cohorts, fully blinded to the algorithm developers. On United States and European external validation sets, the algorithms achieved agreements of 0.862 (quadratically weighted κ, 95% confidence interval (CI), 0.840-0.884) and 0.868 (95% CI, 0.835-0.900) with expert uropathologists. Successful generalization across different patient populations, laboratories and reference standards, achieved by a variety of algorithmic approaches, warrants evaluating AI-based Gleason grading in prospective clinical trials.

Prospective molecular classification of endometrial carcinomas: institutional implementation, practice, and clinical experience.

The comprehensive genomic analysis of endometrial carcinoma (EC) by The Cancer Genome Atlas (TCGA) led to the discovery of four distinct and prognostically significant molecular subgroups. Molecular classification has the potential to improve risk-stratification when integrated with clinicopathologic features and has recently been included in national and international patient management EC guidelines. Thus, the adoption of molecular classification into routine pathologic and clinical practice is likely to grow significantly in the upcoming years. Establishing an efficient and standardized workflow for performing molecular classification on ECs, and reporting both the molecular and histologic findings in an integrative manner, is imperative. Here we describe our effort to implement rapid and routine molecular classification on all ECs diagnosed at our institution. To this effect, we performed immunohistochemistry as a surrogate marker for identifying genetic and/or epigenetic alterations in DNA mismatch repair (e.g., MLH1, PMS2, MSH6, MSH2), and TP53 genes. In addition, we have developed and employed a single-gene POLE SNaPshot assay, which is a rapid and analytically sensitive method for detecting select POLE exonuclease domain mutations (EDMs). We report our molecular testing workflow and integrative reporting system as well as the clinicopathologic and molecular features of 310 ECs that underwent routine molecular classification at our institution. The 310 ECs were molecularly classified as follows: 15 (5%) POLE mutant (POLEmut), 79 (25%) mismatch repair-deficient (MMRd), 135 (44%) no specific molecular profile (NSMP), and 81 (26%) p53 abnormal (p53abnl). This work provides an initial framework for implementing routine molecular classification of ECs.

A Multiplex SNaPshot Assay is a Rapid and Cost-Effective Method for Detecting POLE Exonuclease Domain Mutations in Endometrial Carcinoma.

Determining the replicative DNA polymerase epsilon ( POLE) mutation status in endometrial carcinomas (ECs) has important clinical implications given that the majority of "ultramutated" tumors harboring pathogenic exonuclease domain mutations in POLE ( POLE mut) have a favorable prognosis, even among high-grade histotypes. Currently, there are no specific morphologic or immunophenotypic features that allow accurate detection of POLE mut tumors without molecular testing. Consequently, identifying POLE mut tumors has been challenging without employing costly and/or time-consuming DNA sequencing approaches. Here we developed a novel SNaPshot assay to facilitate routine and efficient POLE mutation testing in EC. The SNaPshot assay interrogates 15 nucleotide sites within exons 9, 11, 13, and 14 encoding the POLE exonuclease domain. The variant sites were selected based on recurrence, evidence of functional impact, association with high tumor mutation burden and/or detection in EC clinical outcome studies. Based on the pathogenic somatic variants reported in the literature, the assay is predicted to have a clinical sensitivity of 90% to 95% for ECs. Validation studies showed 100% specificity and sensitivity for the variants covered, with expected genotypic results for both the positive (n=11) and negative (n=20) patient controls on multiple repeat tests and dilution series. Analytic sensitivity was conservatively approximated at a 10% variant allele fraction (VAF), with documented detection as low as 5% VAF. As expected, the SNaPshot assay demonstrated greater sensitivity than Sanger sequencing for VAFs below 20%, an important characteristic for somatic mutation detection. Here we have developed and validated the first SNaPshot assay to detect hotspot POLE mutations. While next-generation sequencing and Sanger sequencing-based approaches have also been used to detect POLE mutations, a SNaPshot approach provides useful balance of analytical sensitivity, cost-effectiveness, and efficiency in a high-volume case load setting.

Comparative analysis of machine learning approaches to classify tumor mutation burden in lung adenocarcinoma using histopathology images.

Both histologic subtypes and tumor mutation burden (TMB) represent important biomarkers in lung cancer, with implications for patient prognosis and treatment decisions. Typically, TMB is evaluated by comprehensive genomic profiling but this requires use of finite tissue specimens and costly, time-consuming laboratory processes. Histologic subtype classification represents an established component of lung adenocarcinoma histopathology, but can be challenging and is associated with substantial inter-pathologist variability. Here we developed a deep learning system to both classify histologic patterns in lung adenocarcinoma and predict TMB status using de-identified Hematoxylin and Eosin (H&E) stained whole slide images. We first trained a convolutional neural network to map histologic features across whole slide images of lung cancer resection specimens. On evaluation using an external data source, this model achieved patch-level area under the receiver operating characteristic curve (AUC) of 0.78-0.98 across nine histologic features. We then integrated the output of this model with clinico-demographic data to develop an interpretable model for TMB classification. The resulting end-to-end system was evaluated on 172 held out cases from TCGA, achieving an AUC of 0.71 (95% CI 0.63-0.80). The benefit of using histologic features in predicting TMB is highlighted by the significant improvement this approach offers over using the clinical features alone (AUC of 0.63 [95% CI 0.53-0.72], p = 0.002). Furthermore, we found that our histologic subtype-based approach achieved performance similar to that of a weakly supervised approach (AUC of 0.72 [95% CI 0.64-0.80]). Together these results underscore that incorporating histologic patterns in biomarker prediction for lung cancer provides informative signals, and that interpretable approaches utilizing these patterns perform comparably with less interpretable, weakly supervised approaches.

Interpretable survival prediction for colorectal cancer using deep learning.

Deriving interpretable prognostic features from deep-learning-based prognostic histopathology models remains a challenge. In this study, we developed a deep learning system (DLS) for predicting disease-specific survival for stage II and III colorectal cancer using 3652 cases (27,300 slides). When evaluated on two validation datasets containing 1239 cases (9340 slides) and 738 cases (7140 slides), respectively, the DLS achieved a 5-year disease-specific survival AUC of 0.70 (95% CI: 0.66-0.73) and 0.69 (95% CI: 0.64-0.72), and added significant predictive value to a set of nine clinicopathologic features. To interpret the DLS, we explored the ability of different human-interpretable features to explain the variance in DLS scores. We observed that clinicopathologic features such as T-category, N-category, and grade explained a small fraction of the variance in DLS scores (R2 = 18% in both validation sets). Next, we generated human-interpretable histologic features by clustering embeddings from a deep-learning-based image-similarity model and showed that they explained the majority of the variance (R2 of 73-80%). Furthermore, the clustering-derived feature most strongly associated with high DLS scores was also highly prognostic in isolation. With a distinct visual appearance (poorly differentiated tumor cell clusters adjacent to adipose tissue), this feature was identified by annotators with 87.0-95.5% accuracy. Our approach can be used to explain predictions from a prognostic deep learning model and uncover potentially-novel prognostic features that can be reliably identified by people for future validation studies.

Predicting prostate cancer specific-mortality with artificial intelligence-based Gleason grading.

Background: Gleason grading of prostate cancer is an important prognostic factor, but suffers from poor reproducibility, particularly among non-subspecialist pathologists. Although artificial intelligence (A.I.) tools have demonstrated Gleason grading on-par with expert pathologists, it remains an open question whether and to what extent A.I. grading translates to better prognostication. Methods: In this study, we developed a system to predict prostate cancer-specific mortality via A.I.-based Gleason grading and subsequently evaluated its ability to risk-stratify patients on an independent retrospective cohort of 2807 prostatectomy cases from a single European center with 5-25 years of follow-up (median: 13, interquartile range 9-17). Results: Here, we show that the A.I.'s risk scores produced a C-index of 0.84 (95% CI 0.80-0.87) for prostate cancer-specific mortality. Upon discretizing these risk scores into risk groups analogous to pathologist Grade Groups (GG), the A.I. has a C-index of 0.82 (95% CI 0.78-0.85). On the subset of cases with a GG provided in the original pathology report (n = 1517), the A.I.'s C-indices are 0.87 and 0.85 for continuous and discrete grading, respectively, compared to 0.79 (95% CI 0.71-0.86) for GG obtained from the reports. These represent improvements of 0.08 (95% CI 0.01-0.15) and 0.07 (95% CI 0.00-0.14), respectively. Conclusions: Our results suggest that A.I.-based Gleason grading can lead to effective risk stratification, and warrants further evaluation for improving disease management.

Determining breast cancer biomarker status and associated morphological features using deep learning.

Background: Breast cancer management depends on biomarkers including estrogen receptor, progesterone receptor, and human epidermal growth factor receptor 2 (ER/PR/HER2). Though existing scoring systems are widely used and well-validated, they can involve costly preparation and variable interpretation. Additionally, discordances between histology and expected biomarker findings can prompt repeat testing to address biological, interpretative, or technical reasons for unexpected results. Methods: We developed three independent deep learning systems (DLS) to directly predict ER/PR/HER2 status for both focal tissue regions (patches) and slides using hematoxylin-and-eosin-stained (H&E) images as input. Models were trained and evaluated using pathologist annotated slides from three data sources. Areas under the receiver operator characteristic curve (AUCs) were calculated for test sets at both a patch-level (>135 million patches, 181 slides) and slide-level (n = 3274 slides, 1249 cases, 37 sites). Interpretability analyses were performed using Testing with Concept Activation Vectors (TCAV), saliency analysis, and pathologist review of clustered patches. Results: The patch-level AUCs are 0.939 (95%CI 0.936-0.941), 0.938 (0.936-0.940), and 0.808 (0.802-0.813) for ER/PR/HER2, respectively. At the slide level, AUCs are 0.86 (95%CI 0.84-0.87), 0.75 (0.73-0.77), and 0.60 (0.56-0.64) for ER/PR/HER2, respectively. Interpretability analyses show known biomarker-histomorphology associations including associations of low-grade and lobular histology with ER/PR positivity, and increased inflammatory infiltrates with triple-negative staining. Conclusions: This study presents rapid breast cancer biomarker estimation from routine H&E slides and builds on prior advances by prioritizing interpretability of computationally learned features in the context of existing pathological knowledge.

Assessing the Performance of a Novel Point-of-Care Qualitative Assay for Early Diagnosis of Acute Coronary Syndrome.

BACKGROUND: Early and accurate diagnosis of acute coronary syndrome (ACS) is essential for initiating lifesaving interventions. In this article, the diagnostic performance of a novel point-of-care rapid assay (SensAheart©) is analyzed. This assay qualitatively determines the presence of 2 cardiac biomarkers troponin I and heart-type fatty acid-binding protein that are present soon after onset of myocardial injury. METHODS: We conducted a prospective observational study of consecutive patients who presented to the emergency department with typical chest pain. Simultaneous high-sensitive cardiac troponin T (hs-cTnT) and SensAheart testing was performed upon hospital admission. Diagnostic accuracy was computed using SensAheart or hs-cTnT levels versus the final diagnosis defined as positive/negative. RESULTS: Of 225 patients analyzed, a final diagnosis of ACS was established in 138 patients, 87 individuals diagnosed with nonischemic chest pain. In the overall population, as compared to hs-cTnT, the sensitivity of the initial SensAheart assay was significantly higher (80.4 vs. 63.8%, p = 0.002) whereas specificity was lower (78.6 vs. 95.4%, p = 0.036). The overall diagnostic accuracy of SensAheart assay was similar to the hs-cTnT (82.7% compared to 76.0%, p = 0.08). CONCLUSIONS: Upon first medical contact, the novel point-of-care rapid SensAheart assay shows a diagnostic performance similar to hs-cTnT. The combination of 2 cardiac biomarkers in the same kit allows for very early detection of myocardial damage. The SensAheart assay is a reliable and practical tool for ruling-in the diagnosis of ACS.

Closing the translation gap: AI applications in digital pathology.

Recent advances in artificial intelligence show tremendous promise to improve the accuracy, reproducibility, and availability of medical diagnostics across a number of medical subspecialities. This is especially true in the field of digital pathology, which has recently witnessed a surge in publications describing state-of-the-art performance for machine learning models across a wide range of diagnostic applications. Nonetheless, despite this promise, there remain significant gaps in translating applications for any of these technologies into actual clinical practice. In this review, we will first give a brief overview of the recent progress in applying AI to digitized pathology images, focusing on how these tools might be applied in clinical workflows in the near term to improve the accuracy and efficiency of pathologists. Then we define and describe in detail the various factors that need to be addressed in order to successfully close the "translation gap" for AI applications in digital pathology.

Challenges and future directions in LC-MS-based multiclass method development for the quantification of food contaminants.

Monitoring of food contaminants and residues has undergone a significant improvement in recent years and is now performed in an intensive manner. Achievements in the area of chromatography-mass spectrometry coupling techniques enabled the development of quantitative multi-target approaches covering several hundred analytes. Although the majority of methods are focusing on the analysis of one specific group of substances, such as pesticides, mycotoxins, or veterinary drugs, current trends are going towards the simultaneous determination of multiclass compounds from several families of contaminants and residues. This work provides an overview of relevant multiclass concepts based on LC-MS/MS and LC-HRMS instruments. Merits and shortcomings will be critically discussed based on current performance characteristics of the EU legislation system. In addition, the discussion of a recently developed multiclass approach covering >1000 substances is presented as a case study to illustrate the current developments in this area.

Evaluation of the Use of Combined Artificial Intelligence and Pathologist Assessment to Review and Grade Prostate Biopsies.

Importance: Expert-level artificial intelligence (AI) algorithms for prostate biopsy grading have recently been developed. However, the potential impact of integrating such algorithms into pathologist workflows remains largely unexplored. Objective: To evaluate an expert-level AI-based assistive tool when used by pathologists for the grading of prostate biopsies. Design, Setting, and Participants: This diagnostic study used a fully crossed multiple-reader, multiple-case design to evaluate an AI-based assistive tool for prostate biopsy grading. Retrospective grading of prostate core needle biopsies from 2 independent medical laboratories in the US was performed between October 2019 and January 2020. A total of 20 general pathologists reviewed 240 prostate core needle biopsies from 240 patients. Each pathologist was randomized to 1 of 2 study cohorts. The 2 cohorts reviewed every case in the opposite modality (with AI assistance vs without AI assistance) to each other, with the modality switching after every 10 cases. After a minimum 4-week washout period for each batch, the pathologists reviewed the cases for a second time using the opposite modality. The pathologist-provided grade group for each biopsy was compared with the majority opinion of urologic pathology subspecialists. Exposure: An AI-based assistive tool for Gleason grading of prostate biopsies. Main Outcomes and Measures: Agreement between pathologists and subspecialists with and without the use of an AI-based assistive tool for the grading of all prostate biopsies and Gleason grade group 1 biopsies. Results: Biopsies from 240 patients (median age, 67 years; range, 39-91 years) with a median prostate-specific antigen level of 6.5 ng/mL (range, 0.6-97.0 ng/mL) were included in the analyses. Artificial intelligence-assisted review by pathologists was associated with a 5.6% increase (95% CI, 3.2%-7.9%; P < .001) in agreement with subspecialists (from 69.7% for unassisted reviews to 75.3% for assisted reviews) across all biopsies and a 6.2% increase (95% CI, 2.7%-9.8%; P = .001) in agreement with subspecialists (from 72.3% for unassisted reviews to 78.5% for assisted reviews) for grade group 1 biopsies. A secondary analysis indicated that AI assistance was also associated with improvements in tumor detection, mean review time, mean self-reported confidence, and interpathologist agreement. Conclusions and Relevance: In this study, the use of an AI-based assistive tool for the review of prostate biopsies was associated with improvements in the quality, efficiency, and consistency of cancer detection and grading.

Realizing the simultaneous liquid chromatography-tandem mass spectrometry based quantification of >1200 biotoxins, pesticides and veterinary drugs in complex feed.

The first quantitative multiclass approach enabling the accurate quantification of >1200 biotoxins, pesticides and veterinary drugs in complex feed using liquid chromatography tandem mass spectrometry (LC-MS/MS) has been developed. Optimization of HPLC/UHPLC (chromatographic column, flow rate and injection volume) and MS/MS conditions (dwell time and cycle time) were carried out in order to allow the combination of five major substance classes and the high number of target analytes with different physico-chemical properties. Cycle times and retention windows were carefully optimized and ensured appropriate dwell times reducing the overall measurement error. Validation was carried out in two compound feed matrices according to the EU SANTE validation guideline. Apparent recoveries matching the acceptable range of 60-140% accounted 60% and 79% for all analytes in cattle and chicken feed, respectively. High extraction efficiencies were obtained for all analyte/matrix combinations and revealed matrix effects as the main source for deviation of the targeted performance criteria. Concerning the methods repeatability 99% of all analytes in chicken and 96% in cattle feed complied with the acceptable RSD ≤ 20% criterion. Limits of quantification were between 1-10 µg/kg for the vast majority of compounds. Finally, the methods applicability was tested in >130 real compound feed samples and provides first insights into co-exposure of agro-contaminants in animal feed.

Development and Validation of a Deep Learning Algorithm for Gleason Grading of Prostate Cancer From Biopsy Specimens.

Importance: For prostate cancer, Gleason grading of the biopsy specimen plays a pivotal role in determining case management. However, Gleason grading is associated with substantial interobserver variability, resulting in a need for decision support tools to improve the reproducibility of Gleason grading in routine clinical practice. Objective: To evaluate the ability of a deep learning system (DLS) to grade diagnostic prostate biopsy specimens. Design, Setting, and Participants: The DLS was evaluated using 752 deidentified digitized images of formalin-fixed paraffin-embedded prostate needle core biopsy specimens obtained from 3 institutions in the United States, including 1 institution not used for DLS development. To obtain the Gleason grade group (GG), each specimen was first reviewed by 2 expert urologic subspecialists from a multi-institutional panel of 6 individuals (years of experience: mean, 25 years; range, 18-34 years). A third subspecialist reviewed discordant cases to arrive at a majority opinion. To reduce diagnostic uncertainty, all subspecialists had access to an immunohistochemical-stained section and 3 histologic sections for every biopsied specimen. Their review was conducted from December 2018 to June 2019. Main Outcomes and Measures: The frequency of the exact agreement of the DLS with the majority opinion of the subspecialists in categorizing each tumor-containing specimen as 1 of 5 categories: nontumor, GG1, GG2, GG3, or GG4-5. For comparison, the rate of agreement of 19 general pathologists' opinions with the subspecialists' majority opinions was also evaluated. Results: For grading tumor-containing biopsy specimens in the validation set (n = 498), the rate of agreement with subspecialists was significantly higher for the DLS (71.7%; 95% CI, 67.9%-75.3%) than for general pathologists (58.0%; 95% CI, 54.5%-61.4%) (P < .001). In subanalyses of biopsy specimens from an external validation set (n = 322), the Gleason grading performance of the DLS remained similar. For distinguishing nontumor from tumor-containing biopsy specimens (n = 752), the rate of agreement with subspecialists was 94.3% (95% CI, 92.4%-95.9%) for the DLS and similar at 94.7% (95% CI, 92.8%-96.3%) for general pathologists (P = .58). Conclusions and Relevance: In this study, the DLS showed higher proficiency than general pathologists at Gleason grading prostate needle core biopsy specimens and generalized to an independent institution. Future research is necessary to evaluate the potential utility of using the DLS as a decision support tool in clinical workflows and to improve the quality of prostate cancer grading for therapy decisions.

Deep learning-based survival prediction for multiple cancer types using histopathology images.

Providing prognostic information at the time of cancer diagnosis has important implications for treatment and monitoring. Although cancer staging, histopathological assessment, molecular features, and clinical variables can provide useful prognostic insights, improving risk stratification remains an active research area. We developed a deep learning system (DLS) to predict disease specific survival across 10 cancer types from The Cancer Genome Atlas (TCGA). We used a weakly-supervised approach without pixel-level annotations, and tested three different survival loss functions. The DLS was developed using 9,086 slides from 3,664 cases and evaluated using 3,009 slides from 1,216 cases. In multivariable Cox regression analysis of the combined cohort including all 10 cancers, the DLS was significantly associated with disease specific survival (hazard ratio of 1.58, 95% CI 1.28-1.70, p<0.0001) after adjusting for cancer type, stage, age, and sex. In a per-cancer adjusted subanalysis, the DLS remained a significant predictor of survival in 5 of 10 cancer types. Compared to a baseline model including stage, age, and sex, the c-index of the model demonstrated an absolute 3.7% improvement (95% CI 1.0-6.5) in the combined cohort. Additionally, our models stratified patients within individual cancer stages, particularly stage II (p = 0.025) and stage III (p<0.001). By developing and evaluating prognostic models across multiple cancer types, this work represents one of the most comprehensive studies exploring the direct prediction of clinical outcomes using deep learning and histopathology images. Our analysis demonstrates the potential for this approach to provide significant prognostic information in multiple cancer types, and even within specific pathologic stages. However, given the relatively small number of cases and observed clinical events for a deep learning task of this type, we observed wide confidence intervals for model performance, thus highlighting that future work will benefit from larger datasets assembled for the purposes for survival modeling.