Intraoperative margin assessment for basal cell carcinoma with deep learning and histologic tumor mapping to surgical site.

Successful treatment of solid cancers relies on complete surgical excision of the tumor either for definitive treatment or before adjuvant therapy. Intraoperative and postoperative radial sectioning, the most common form of margin assessment, can lead to incomplete excision and increase the risk of recurrence and repeat procedures. Mohs Micrographic Surgery is associated with complete removal of basal cell and squamous cell carcinoma through real-time margin assessment of 100% of the peripheral and deep margins. Real-time assessment in many tumor types is constrained by tissue size, complexity, and specimen processing / assessment time during general anesthesia. We developed an artificial intelligence platform to reduce the tissue preprocessing and histological assessment time through automated grossing recommendations, mapping and orientation of tumor to the surgical specimen. Using basal cell carcinoma as a model system, results demonstrate that this approach can address surgical laboratory efficiency bottlenecks for rapid and complete intraoperative margin assessment.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: A retrospective assessment.

Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumour removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. The aim of this study was to develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. To do this, a retrospective cohort study was conducted using frozen cSCC section slides. These slides were scanned and annotated, delineating benign tissue structures, inflammation and tumour to develop an AI algorithm for real-time margin analysis. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC. This algorithm demonstrated proof of concept for identifying cSCC with high accuracy, highlighting the potential for integration of AI into the surgical workflow. Incorporation of AI algorithms may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumours/neoplasms. Further algorithmic improvement incorporating surrounding tissue context is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumours, and to map tumours to their original anatomical position/orientation.

Assessment of emerging pretraining strategies in interpretable multimodal deep learning for cancer prognostication.

BACKGROUND: Deep learning models can infer cancer patient prognosis from molecular and anatomic pathology information. Recent studies that leveraged information from complementary multimodal data improved prognostication, further illustrating the potential utility of such methods. However, current approaches: 1) do not comprehensively leverage biological and histomorphological relationships and 2) make use of emerging strategies to "pretrain" models (i.e., train models on a slightly orthogonal dataset/modeling objective) which may aid prognostication by reducing the amount of information required for achieving optimal performance. In addition, model interpretation is crucial for facilitating the clinical adoption of deep learning methods by fostering practitioner understanding and trust in the technology. METHODS: Here, we develop an interpretable multimodal modeling framework that combines DNA methylation, gene expression, and histopathology (i.e., tissue slides) data, and we compare performance of crossmodal pretraining, contrastive learning, and transfer learning versus the standard procedure. RESULTS: Our models outperform the existing state-of-the-art method (average 11.54% C-index increase), and baseline clinically driven models (average 11.7% C-index increase). Model interpretations elucidate consideration of biologically meaningful factors in making prognosis predictions. DISCUSSION: Our results demonstrate that the selection of pretraining strategies is crucial for obtaining highly accurate prognostication models, even more so than devising an innovative model architecture, and further emphasize the all-important role of the tumor microenvironment on disease progression.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: a retrospective assessment.

Importance: Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumor removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. Objective: To develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. Design: A retrospective cohort study was conducted using frozen cSCC section slides and adjacent tissues. Setting: This study was conducted in a tertiary care academic center. Participants: Patients undergoing Mohs micrographic surgery for cSCC between January and March 2020. Exposures: Frozen section slides were scanned and annotated, delineating benign tissue structures, inflammation, and tumor to develop an AI algorithm for real-time margin analysis. Patients were stratified by tumor differentiation status. Epithelial tissues including epidermis and hair follicles were annotated for moderate-well to well differentiated cSCC tumors. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC at 50-micron resolution. Main Outcomes and Measures: The performance of the AI algorithm in identifying cSCC at 50-micron resolution was reported using the area under the receiver operating characteristic curve. Accuracy was also reported by tumor differentiation status and by delineation of cSCC from epidermis. Model performance using histomorphological features alone was compared to architectural features (i.e., tissue context) for well-differentiated tumors. Results: The AI algorithm demonstrated proof of concept for identifying cSCC with high accuracy. Accuracy differed by differentiation status, driven by challenges in separating cSCC from epidermis using histomorphological features alone for well-differentiated tumors. Consideration of broader tissue context through architectural features improved the ability to delineate tumor from epidermis. Conclusions and Relevance: Incorporating AI into the surgical workflow may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumors/neoplasms. Further algorithmic improvement is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumors, and to map tumors to their original anatomical position/orientation. Future studies should assess the efficiency improvements and cost benefits and address other confounding pathologies such as inflammation and nuclei. Funding sources: JL is supported by NIH grants R24GM141194, P20GM104416 and P20GM130454. Support for this work was also provided by the Prouty Dartmouth Cancer Center development funds. Key Points: Question: How can the efficiency and accuracy of real-time intraoperative margin analysis for the removal of cutaneous squamous cell carcinoma (cSCC) be improved, and how can tumor differentiation be incorporated into this approach?Findings: A proof-of-concept deep learning algorithm was trained, validated, and tested on frozen section whole slide images (WSI) for a retrospective cohort of cSCC cases, demonstrating high accuracy in identifying cSCC and related pathologies. Histomorphology alone was found to be insufficient to delineate tumor from epidermis in histologic identification of well-differentiated cSCC. Incorporation of surrounding tissue architecture and shape improved the ability to delineate tumor from normal tissue.Meaning: Integrating artificial intelligence into surgical procedures has the potential to enhance the thoroughness and efficiency of intraoperative margin analysis for cSCC removal. However, accurately accounting for the epidermal tissue based on the tumor's differentiation status requires specialized algorithms that consider the surrounding tissue context. To meaningfully integrate AI algorithms into clinical practice, further algorithmic refinement is needed, as well as the mapping of tumors to their original surgical site, and evaluation of the cost and efficacy of these approaches to address existing bottlenecks.