Intraoperative margin assessment for basal cell carcinoma with deep learning and histologic tumor mapping to surgical site.

Successful treatment of solid cancers relies on complete surgical excision of the tumor either for definitive treatment or before adjuvant therapy. Intraoperative and postoperative radial sectioning, the most common form of margin assessment, can lead to incomplete excision and increase the risk of recurrence and repeat procedures. Mohs Micrographic Surgery is associated with complete removal of basal cell and squamous cell carcinoma through real-time margin assessment of 100% of the peripheral and deep margins. Real-time assessment in many tumor types is constrained by tissue size, complexity, and specimen processing / assessment time during general anesthesia. We developed an artificial intelligence platform to reduce the tissue preprocessing and histological assessment time through automated grossing recommendations, mapping and orientation of tumor to the surgical specimen. Using basal cell carcinoma as a model system, results demonstrate that this approach can address surgical laboratory efficiency bottlenecks for rapid and complete intraoperative margin assessment.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: A retrospective assessment.

Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumour removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. The aim of this study was to develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. To do this, a retrospective cohort study was conducted using frozen cSCC section slides. These slides were scanned and annotated, delineating benign tissue structures, inflammation and tumour to develop an AI algorithm for real-time margin analysis. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC. This algorithm demonstrated proof of concept for identifying cSCC with high accuracy, highlighting the potential for integration of AI into the surgical workflow. Incorporation of AI algorithms may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumours/neoplasms. Further algorithmic improvement incorporating surrounding tissue context is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumours, and to map tumours to their original anatomical position/orientation.

Potential to Enhance Large Scale Molecular Assessments of Skin Photoaging through Virtual Inference of Spatial Transcriptomics from Routine Staining.

The advent of spatial transcriptomics technologies has heralded a renaissance in research to advance our understanding of the spatial cellular and transcriptional heterogeneity within tissues. Spatial transcriptomics allows investigation of the interplay between cells, molecular pathways, and the surrounding tissue architecture and can help elucidate developmental trajectories, disease pathogenesis, and various niches in the tumor microenvironment. Photoaging is the histological and molecular skin damage resulting from chronic/acute sun exposure and is a major risk factor for skin cancer. Spatial transcriptomics technologies hold promise for improving the reliability of evaluating photoaging and developing new therapeutics. Challenges to current methods include limited focus on dermal elastosis variations and reliance on self-reported measures, which can introduce subjectivity and inconsistency. Spatial transcriptomics offers an opportunity to assess photoaging objectively and reproducibly in studies of carcinogenesis and discern the effectiveness of therapies that intervene in photoaging and preventing cancer. Evaluation of distinct histological architectures using highly-multiplexed spatial technologies can identify specific cell lineages that have been understudied due to their location beyond the depth of UV penetration. However, the cost and interpatient variability using state-of-the-art assays such as the 10x Genomics Spatial Transcriptomics assays limits the scope and scale of large-scale molecular epidemiologic studies. Here, we investigate the inference of spatial transcriptomics information from routine hematoxylin and eosin-stained (H&E) tissue slides. We employed the Visium CytAssist spatial transcriptomics assay to analyze over 18,000 genes at a 50-micron resolution for four patients from a cohort of 261 skin specimens collected adjacent to surgical resection sites for basal cell and squamous cell keratinocyte tumors. The spatial transcriptomics data was co-registered with 40x resolution whole slide imaging (WSI) information. We developed machine learning models that achieved a macro-averaged median AUC and F1 score of 0.80 and 0.61 and Spearman coefficient of 0.60 in inferring transcriptomic profiles across the slides, and accurately captured biological pathways across various tissue architectures.

Spatial Omics Driven Crossmodal Pretraining Applied to Graph-based Deep Learning for Cancer Pathology Analysis.

Graph-based deep learning has shown great promise in cancer histopathology image analysis by contextualizing complex morphology and structure across whole slide images to make high quality downstream outcome predictions (ex: prognostication). These methods rely on informative representations (i.e., embeddings) of image patches comprising larger slides, which are used as node attributes in slide graphs. Spatial omics data, including spatial transcriptomics, is a novel paradigm offering a wealth of detailed information. Pairing this data with corresponding histological imaging localized at 50-micron resolution, may facilitate the development of algorithms which better appreciate the morphological and molecular underpinnings of carcinogenesis. Here, we explore the utility of leveraging spatial transcriptomics data with a contrastive crossmodal pretraining mechanism to generate deep learning models that can extract molecular and histological information for graph-based learning tasks. Performance on cancer staging, lymph node metastasis prediction, survival prediction, and tissue clustering analyses indicate that the proposed methods bring improvement to graph based deep learning models for histopathological slides compared to leveraging histological information from existing schemes, demonstrating the promise of mining spatial omics data to enhance deep learning for pathology workflows.

Feasibility of Inferring Spatial Transcriptomics from Single-Cell Histological Patterns for Studying Colon Cancer Tumor Heterogeneity.

Background: Spatial transcriptomics involves studying the spatial organization of gene expression within tissues, offering insights into the molecular diversity of tumors. While spatial gene expression is commonly amalgamated from 1-10 cells across 50-micron spots, recent methods have demonstrated the capability to disaggregate this information at subspot resolution by leveraging both expression and histological patterns. However, elucidating such information from histology alone presents a significant challenge but if solved can better permit spatial molecular analysis at cellular resolution for instances where Visium data is not available, reducing study costs. This study explores integrating single-cell histological and transcriptomic data to infer spatial mRNA expression patterns in whole slide images collected from a cohort of stage pT3 colorectal cancer patients. A cell graph neural network algorithm was developed to align histological information extracted from detected cells with single cell RNA patterns through optimal transport methods, facilitating the analysis of cellular groupings and gene relationships. This approach leveraged spot-level expression as an intermediary to co-map histological and transcriptomic information at the single-cell level. Results: Our study demonstrated that single-cell transcriptional heterogeneity within a spot could be predicted from histological markers extracted from cells detected within a spot. Furthermore, our model exhibited proficiency in delineating overarching gene expression patterns across whole-slide images. This approach compared favorably to traditional patch-based computer vision methods as well as other methods which did not incorporate single cell expression during the model fitting procedures. Topological nuances of single-cell expression within a Visium spot were preserved using the developed methodology. Conclusion: This innovative approach augments the resolution of spatial molecular assays utilizing histology as a sole input through synergistic co-mapping of histological and transcriptomic datasets at the single-cell level, anchored by spatial transcriptomics. While initial results are promising, they warrant rigorous validation. This includes collaborating with pathologists for precise spatial identification of distinct cell types and utilizing sophisticated assays, such as Xenium, to attain deeper subcellular insights.

The Overlooked Role of Specimen Preparation in Bolstering Deep Learning-Enhanced Spatial Transcriptomics Workflows.

The application of deep learning methods to spatial transcriptomics has shown promise in unraveling the complex relationships between gene expression patterns and tissue architecture as they pertain to various pathological conditions. Deep learning methods that can infer gene expression patterns directly from tissue histomorphology can expand the capability to discern spatial molecular markers within tissue slides. However, current methods utilizing these techniques are plagued by substantial variability in tissue preparation and characteristics, which can hinder the broader adoption of these tools. Furthermore, training deep learning models using spatial transcriptomics on small study cohorts remains a costly endeavor. Necessitating novel tissue preparation processes enhance assay reliability, resolution, and scalability. This study investigated the impact of an enhanced specimen processing workflow for facilitating a deep learning-based spatial transcriptomics assessment. The enhanced workflow leveraged the flexibility of the Visium CytAssist assay to permit automated H&E staining (e.g., Leica Bond) of tissue slides, whole-slide imaging at 40x-resolution, and multiplexing of tissue sections from multiple patients within individual capture areas for spatial transcriptomics profiling. Using a cohort of thirteen pT3 stage colorectal cancer (CRC) patients, we compared the efficacy of deep learning models trained on slide prepared using an enhanced workflow as compared to the traditional workflow which leverages manual tissue staining and standard imaging of tissue slides. Leveraging Inceptionv3 neural networks, we aimed to predict gene expression patterns across matched serial tissue sections, each stemming from a distinct workflow but aligned based on persistent histological structures. Findings indicate that the enhanced workflow considerably outperformed the traditional spatial transcriptomics workflow. Gene expression profiles predicted from enhanced tissue slides also yielded expression patterns more topologically consistent with the ground truth. This led to enhanced statistical precision in pinpointing biomarkers associated with distinct spatial structures. These insights can potentially elevate diagnostic and prognostic biomarker detection by broadening the range of spatial molecular markers linked to metastasis and recurrence. Future endeavors will further explore these findings to enrich our comprehension of various diseases and uncover molecular pathways with greater nuance. Combining deep learning with spatial transcriptomics provides a compelling avenue to enrich our understanding of tumor biology and improve clinical outcomes. For results of the highest fidelity, however, effective specimen processing is crucial, and fostering collaboration between histotechnicians, pathologists, and genomics specialists is essential to herald this new era in spatial transcriptomics-driven cancer research.

Use of molecular testing results to analyze the overuse of atypia of undetermined significance in thyroid cytology.

INTRODUCTION: The suggested atypia of undetermined significance (AUS) rate for thyroid fine-needle aspiration biopsies is 10% or less. Prompted by a high institutional AUS rate, we examined using molecular testing results (MTR) as a potential quality metric tool to reduce the AUS rate. We correlated MTR with AUS cytologic findings, surgical pathology follow-up, and individual pathologist AUS rates. MATERIALS AND METHODS: Demographic data, cytologic diagnoses, MTR, and surgical pathology diagnoses were retrospectively obtained. MTR were classified as either positive or negative. AUS rates and MTR proportions were compared among pathologists. The cytomorphologic features of 143 AUS cases were assessed and correlated with MTR. RESULTS: Between 2017 and 2022, 710 of 3247 thyroid fine-needle aspirations were classified as AUS, with a yearly average rate of 22% (range = 19%-26%). AUS cases included: 331 (47%) with architectural atypia; 204 (29%) with oncocytic (Hürthle cell) atypia; 99 (14%) with combined architectural and cytologic atypia; and 76 (10%) with isolated cytologic atypia. Most AUS cases with molecular testing had negative MTR (360/492, 73%). AUS with cytologic atypia had higher positive MTR risk (logarithm of odds ratio = 1.27, 95% credible interval [0.5-2.04], P = 0.001). The average positive MTR rate by pathologist was 21.5% (range 0%-35%); higher positive MTR rates had better correlation with subsequent neoplastic/malignant histologic diagnoses. The MTR sensitivity for malignant disease was 89% and the negative predictive value was 91%. CONCLUSIONS: MTR analysis reveals the importance of cytologic atypia as a determinant of malignancy risk in AUS cases. Periodic analysis of MTR data alongside individual pathologist AUS rates can help refine diagnostic criteria and potentially reduce AUS overuse.

Paired-agent imaging as a rapid en face margin screening method in Mohs micrographic surgery.

Background: Mohs micrographic surgery is a procedure used for non-melanoma skin cancers that has 97-99% cure rates largely owing to 100% margin analysis enabled by en face sectioning with real-time, iterative histologic assessment. However, the technique is limited to small and aggressive tumors in high-risk areas because the histopathological preparation and assessment is very time intensive. To address this, paired-agent imaging (PAI) can be used to rapidly screen excised specimens and identify tumor positive margins for guided and more efficient microscopic evaluation. Methods: A mouse xenograft model of human squamous cell carcinoma (n = 8 mice, 13 tumors) underwent PAI. Targeted (ABY-029, anti-epidermal growth factor receptor (EGFR) affibody molecule) and untargeted (IRDye 680LT carboxylate) imaging agents were simultaneously injected 3-4 h prior to surgical tumor resection. Fluorescence imaging was performed on main, unprocessed excised specimens and en face margins (tissue sections tangential to the deep margin surface). Binding potential (BP) - a quantity proportional to receptor concentration - and targeted fluorescence signal were measured for each, and respective mean and maximum values were analyzed to compare diagnostic ability and contrast. The BP and targeted fluorescence of the main specimen and margin samples were also correlated with EGFR immunohistochemistry (IHC). Results: PAI consistently outperformed targeted fluorescence alone in terms of diagnostic ability and contrast-to-variance ratio (CVR). Mean and maximum measures of BP resulted in 100% accuracy, while mean and maximum targeted fluorescence signal offered 97% and 98% accuracy, respectively. Moreover, maximum BP had the greatest average CVR for both main specimen and margin samples (average 1.7 ± 0.4 times improvement over other measures). Fresh tissue margin imaging improved similarity with EGFR IHC volume estimates compared to main specimen imaging in line profile analysis; and margin BP specifically had the strongest concordance (average 3.6 ± 2.2 times improvement over other measures). Conclusions: PAI was able to reliably distinguish tumor from normal tissue in fresh en face margin samples using the single metric of maximum BP. This demonstrated the potential for PAI to act as a highly sensitive screening tool to eliminate the extra time wasted on real-time pathological assessment of low-risk margins.

Assessment of emerging pretraining strategies in interpretable multimodal deep learning for cancer prognostication.

BACKGROUND: Deep learning models can infer cancer patient prognosis from molecular and anatomic pathology information. Recent studies that leveraged information from complementary multimodal data improved prognostication, further illustrating the potential utility of such methods. However, current approaches: 1) do not comprehensively leverage biological and histomorphological relationships and 2) make use of emerging strategies to "pretrain" models (i.e., train models on a slightly orthogonal dataset/modeling objective) which may aid prognostication by reducing the amount of information required for achieving optimal performance. In addition, model interpretation is crucial for facilitating the clinical adoption of deep learning methods by fostering practitioner understanding and trust in the technology. METHODS: Here, we develop an interpretable multimodal modeling framework that combines DNA methylation, gene expression, and histopathology (i.e., tissue slides) data, and we compare performance of crossmodal pretraining, contrastive learning, and transfer learning versus the standard procedure. RESULTS: Our models outperform the existing state-of-the-art method (average 11.54% C-index increase), and baseline clinically driven models (average 11.7% C-index increase). Model interpretations elucidate consideration of biologically meaningful factors in making prognosis predictions. DISCUSSION: Our results demonstrate that the selection of pretraining strategies is crucial for obtaining highly accurate prognostication models, even more so than devising an innovative model architecture, and further emphasize the all-important role of the tumor microenvironment on disease progression.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: a retrospective assessment.

Importance: Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumor removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. Objective: To develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. Design: A retrospective cohort study was conducted using frozen cSCC section slides and adjacent tissues. Setting: This study was conducted in a tertiary care academic center. Participants: Patients undergoing Mohs micrographic surgery for cSCC between January and March 2020. Exposures: Frozen section slides were scanned and annotated, delineating benign tissue structures, inflammation, and tumor to develop an AI algorithm for real-time margin analysis. Patients were stratified by tumor differentiation status. Epithelial tissues including epidermis and hair follicles were annotated for moderate-well to well differentiated cSCC tumors. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC at 50-micron resolution. Main Outcomes and Measures: The performance of the AI algorithm in identifying cSCC at 50-micron resolution was reported using the area under the receiver operating characteristic curve. Accuracy was also reported by tumor differentiation status and by delineation of cSCC from epidermis. Model performance using histomorphological features alone was compared to architectural features (i.e., tissue context) for well-differentiated tumors. Results: The AI algorithm demonstrated proof of concept for identifying cSCC with high accuracy. Accuracy differed by differentiation status, driven by challenges in separating cSCC from epidermis using histomorphological features alone for well-differentiated tumors. Consideration of broader tissue context through architectural features improved the ability to delineate tumor from epidermis. Conclusions and Relevance: Incorporating AI into the surgical workflow may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumors/neoplasms. Further algorithmic improvement is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumors, and to map tumors to their original anatomical position/orientation. Future studies should assess the efficiency improvements and cost benefits and address other confounding pathologies such as inflammation and nuclei. Funding sources: JL is supported by NIH grants R24GM141194, P20GM104416 and P20GM130454. Support for this work was also provided by the Prouty Dartmouth Cancer Center development funds. Key Points: Question: How can the efficiency and accuracy of real-time intraoperative margin analysis for the removal of cutaneous squamous cell carcinoma (cSCC) be improved, and how can tumor differentiation be incorporated into this approach?Findings: A proof-of-concept deep learning algorithm was trained, validated, and tested on frozen section whole slide images (WSI) for a retrospective cohort of cSCC cases, demonstrating high accuracy in identifying cSCC and related pathologies. Histomorphology alone was found to be insufficient to delineate tumor from epidermis in histologic identification of well-differentiated cSCC. Incorporation of surrounding tissue architecture and shape improved the ability to delineate tumor from normal tissue.Meaning: Integrating artificial intelligence into surgical procedures has the potential to enhance the thoroughness and efficiency of intraoperative margin analysis for cSCC removal. However, accurately accounting for the epidermal tissue based on the tumor's differentiation status requires specialized algorithms that consider the surrounding tissue context. To meaningfully integrate AI algorithms into clinical practice, further algorithmic refinement is needed, as well as the mapping of tumors to their original surgical site, and evaluation of the cost and efficacy of these approaches to address existing bottlenecks.

Large-scale validation study of an improved semiautonomous urine cytology assessment tool: AutoParis-X.

BACKGROUND: Adopting a computational approach for the assessment of urine cytology specimens has the potential to improve the efficiency, accuracy, and reliability of bladder cancer screening, which has heretofore relied on semisubjective manual assessment methods. As rigorous, quantitative criteria and guidelines have been introduced for improving screening practices (e.g., The Paris System for Reporting Urinary Cytology), algorithms to emulate semiautonomous diagnostic decision-making have lagged behind, in part because of the complex and nuanced nature of urine cytology reporting. METHODS: In this study, the authors report on the development and large-scale validation of a deep-learning tool, AutoParis-X, which can facilitate rapid, semiautonomous examination of urine cytology specimens. RESULTS: The results of this large-scale, retrospective validation study indicate that AutoParis-X can accurately determine urothelial cell atypia and aggregate a wide variety of cell-related and cluster-related information across a slide to yield an atypia burden score, which correlates closely with overall specimen atypia and is predictive of Paris system diagnostic categories. Importantly, this approach accounts for challenges associated with the assessment of overlapping cell cluster borders, which improve the ability to predict specimen atypia and accurately estimate the nuclear-to-cytoplasm ratio for cells in these clusters. CONCLUSIONS: The authors developed a publicly available, open-source, interactive web application that features a simple, easy-to-use display for examining urine cytology whole-slide images and determining the level of atypia in specific cells, flagging the most abnormal cells for pathologist review. The accuracy of AutoParis-X (and other semiautomated digital pathology systems) indicates that these technologies are approaching clinical readiness and necessitates full evaluation of these algorithms in head-to-head clinical trials.

Examining longitudinal markers of bladder cancer recurrence through a semiautonomous machine learning system for quantifying specimen atypia from urine cytology.

BACKGROUND: Urine cytology is generally considered the primary approach for screening for recurrence of bladder cancer. However, it is currently unclear how best to use cytological examinations for assessment and early detection of recurrence, beyond identifying a positive finding that requires more invasive methods to confirm recurrence and decide on therapeutic options. Because screening programs are frequent, and can be burdensome, finding quantitative means to reduce this burden for patients, cytopathologists, and urologists is an important endeavor and can improve both the efficiency and reliability of findings. Additionally, identifying ways to risk-stratify patients is crucial for improving quality of life while reducing the risk of future recurrence or progression of the cancer. METHODS: In this study, a computational machine learning tool, AutoParis-X, was leveraged to extract imaging features from urine cytology examinations longitudinally to study the predictive potential of urine cytology for assessing recurrence risk. This study examined how the significance of imaging predictors changes over time before and after surgery to determine which predictors and time periods are most relevant for assessing recurrence risk. RESULTS: Results indicate that imaging predictors extracted using AutoParis-X can predict recurrence as well or better than traditional cytological/histological assessments alone and that the predictiveness of these features is variable across time, with key differences in overall specimen atypia identified immediately before tumor recurrence. CONCLUSIONS: Further research will clarify how computational methods can be effectively used in high-volume screening programs to improve recurrence detection and complement traditional modes of assessment.

GRANDPA: GeneRAtive network sampling using degree and property augmentation applied to the analysis of partially confidential healthcare networks.

Protecting medical privacy can create obstacles in the analysis and distribution of healthcare graphs and statistical inferences accompanying them. We pose a graph simulation model which generates networks using degree and property augmentation and provide a flexible R package that allows users to create graphs that preserve vertex attribute relationships and approximating the retention of topological properties observed in the original graph (e.g., community structure). We illustrate our proposed algorithm using a case study based on Zachary's karate network and a patient-sharing graph generated from Medicare claims data in 2019. In both cases, we find that community structure is preserved, and normalized root mean square error between cumulative distributions of the degrees across the generated and the original graphs is low (0.0508 and 0.0514 respectively).

Identification of Spatial Proteomic Signatures of Colon Tumor Metastasis: A Digital Spatial Profiling Approach.

Over 150,000 Americans are diagnosed with colorectal cancer (CRC) every year, and annually >50,000 individuals are estimated to die of CRC, necessitating improvements in screening, prognostication, disease management, and therapeutic options. CRC tumors are removed en bloc with surrounding vasculature and lymphatics. Examination of regional lymph nodes at the time of surgical resection is essential for prognostication. Developing alternative approaches to indirectly assess recurrence risk would have utility in cases where lymph node yield is incomplete or inadequate. Spatially dependent, immune cell-specific (eg, tumor-infiltrating lymphocytes), proteomic, and transcriptomic expression patterns inside and around the tumor-the tumor immune microenvironment-can predict nodal/distant metastasis and probe the coordinated immune response from the primary tumor site. The comprehensive characterization of tumor-infiltrating lymphocytes and other immune infiltrates is possible using highly multiplexed spatial omics technologies, such as the GeoMX Digital Spatial Profiler. In this study, machine learning and differential co-expression analyses helped identify biomarkers from Digital Spatial Profiler-assayed protein expression patterns inside, at the invasive margin, and away from the tumor, associated with extracellular matrix remodeling (eg, granzyme B and fibronectin), immune suppression (eg, forkhead box P3), exhaustion and cytotoxicity (eg, CD8), Programmed death ligand 1-expressing dendritic cells, and neutrophil proliferation, among other concomitant alterations. Further investigation of these biomarkers may reveal independent risk factors of CRC metastasis that can be formulated into low-cost, widely available assays.

HiTAIC: hierarchical tumor artificial intelligence classifier traces tissue of origin and tumor type in primary and metastasized tumors using DNA methylation.

Human cancers are heterogenous by their cell composition and origination site. Cancer metastasis generates the conundrum of the unknown origin of migrated tumor cells. Tracing tissue of origin and tumor type in primary and metastasized cancer is vital for clinical significance. DNA methylation alterations play a crucial role in carcinogenesis and mark cell fate differentiation, thus can be used to trace tumor tissue of origin. In this study, we employed a novel tumor-type-specific hierarchical model using genome-scale DNA methylation data to develop a multilayer perceptron model, HiTAIC, to trace tissue of origin and tumor type in 27 cancers from 23 tissue sites in data from 7735 tumors with high resolution, accuracy, and specificity. In tracing primary cancer origin, HiTAIC accuracy was 99% in the test set and 93% in the external validation data set. Metastatic cancers were identified with a 96% accuracy in the external data set. HiTAIC is a user-friendly web-based application through https://sites.dartmouth.edu/salaslabhitaic/. In conclusion, we developed HiTAIC, a DNA methylation-based algorithm, to trace tumor tissue of origin in primary and metastasized cancers. The high accuracy and resolution of tumor tracing using HiTAIC holds promise for clinical assistance in identifying cancer of unknown origin.

Inferring spatial transcriptomics markers from whole slide images to characterize metastasis-related spatial heterogeneity of colorectal tumors: A pilot study.

Over 150 000 Americans are diagnosed with colorectal cancer (CRC) every year, and annually over 50 000 individuals will die from CRC, necessitating improvements in screening, prognostication, disease management, and therapeutic options. Tumor metastasis is the primary factor related to the risk of recurrence and mortality. Yet, screening for nodal and distant metastasis is costly, and invasive and incomplete resection may hamper adequate assessment. Signatures of the tumor-immune microenvironment (TIME) at the primary site can provide valuable insights into the aggressiveness of the tumor and the effectiveness of various treatment options. Spatially resolved transcriptomics technologies offer an unprecedented characterization of TIME through high multiplexing, yet their scope is constrained by cost. Meanwhile, it has long been suspected that histological, cytological, and macroarchitectural tissue characteristics correlate well with molecular information (e.g., gene expression). Thus, a method for predicting transcriptomics data through inference of RNA patterns from whole slide images (WSI) is a key step in studying metastasis at scale. In this work, we collected tissue from 4 stage-III (pT3) matched colorectal cancer patients for spatial transcriptomics profiling. The Visium spatial transcriptomics (ST) assay was used to measure transcript abundance for 17 943 genes at up to 5000 55-micron (i.e., 1-10 cells) spots per patient sampled in a honeycomb pattern, co-registered with hematoxylin and eosin (H&E) stained WSI. The Visium ST assay can measure expression at these spots through tissue permeabilization of mRNAs, which are captured through spatially (i.e., x-y positional coordinates) barcoded, gene specific oligo probes. WSI subimages were extracted around each co-registered Visium spot and were used to predict the expression at these spots using machine learning models. We prototyped and compared several convolutional, transformer, and graph convolutional neural networks to predict spatial RNA patterns at the Visium spots under the hypothesis that the transformer- and graph-based approaches better capture relevant spatial tissue architecture. We further analyzed the model's ability to recapitulate spatial autocorrelation statistics using SPARK and SpatialDE. Overall, the results indicate that the transformer- and graph-based approaches were unable to outperform the convolutional neural network architecture, though they exhibited optimal performance for relevant disease-associated genes. Initial findings suggest that different neural networks that operate on different scales are relevant for capturing distinct disease pathways (e.g., epithelial to mesenchymal transition). We add further evidence that deep learning models can accurately predict gene expression in whole slide images and comment on understudied factors which may increase its external applicability (e.g., tissue context). Our preliminary work will motivate further investigation of inference for molecular patterns from whole slide images as metastasis predictors and in other applications.

Utility of Retrospective Molecular Analysis in Diagnostically Challenging Mesenchymal Neoplasms.

Introduction: Molecular analysis plays a growing role in the diagnosis of mesenchymal neoplasms. The aim of this study was to retrospectively apply broad, multiplex molecular assays (a solid tumor targeted next-generation sequencing [NGS]) assay and single nucleotide polymorphism [SNP] microarray) to selected tumors, exploring the current utility and limitations. Methods: We searched our database (2010-2020) for diagnostically challenging mesenchymal neoplasms. After histologic review of available slides, tissue blocks were selected for NGS, SNP microarray, or both. DNA and RNA were extracted using the AllPrep DNA/RNA FFPE Kit Protocol on the QIAcube instrument. The NGS platform used was the TruSight Tumor 170 (TST-170). For SNP array, copy number variant (CNV) analysis was performed using the OncoScanTM CNV Plus Assay. Results: DNA/RNA was successfully extracted from 50% of tumors (n = 10/20). Specimens not successfully extracted included 6 core biopsies, 3 incisional biopsies, and 1 resection; 4 were decalcified (3 hydrochloric acid, 1 ethylenediaminetetraacetic acid). Higher tumor proportion and number of tumor cells were parameters positively associated with sufficient DNA/RNA extraction whereas necrosis and decalcification were negatively associated with sufficient extraction. Molecular testing helped reach a definitive diagnosis in 50% of tumors (n = 5/10). Conclusions: Although the overall utility of this approach is limited, these molecular panels can be helpful in detecting a specific "driver" alteration.

Functional Reorganization of the Mesial Frontal Premotor Cortex in Patients With Supplementary Motor Area Seizures.

BACKGROUND: Direct cortical stimulation of the mesial frontal premotor cortex, including the supplementary motor area (SMA), is challenging in humans. Limited access to these brain regions impedes understanding of human premotor cortex functional organization and somatotopy. OBJECTIVE: To test whether seizure onset within the SMA was associated with functional remapping of mesial frontal premotor areas in a cohort of patients with epilepsy who underwent awake brain mapping after implantation of interhemispheric subdural electrodes. METHODS: Stimulation trials from 646 interhemispheric subdural electrodes were analyzed and compared between patients who had seizure onset in the SMA (n = 13) vs patients who had seizure onset outside of the SMA (n = 12). 1:1 matching with replacement between SMA and non-SMA data sets was used to ensure similar spatial distribution of electrodes. Centroids and 95% confidence regions were computed for clustered head, trunk, upper extremity, lower extremity, and vision responses. A generalized linear mixed-effects model was used to test for significant differences in the resulting functional maps. Clinical, radiographic, and histopathologic data were reviewed. RESULTS: After analyzing direct cortical stimulation trials from interhemispheric electrodes, we found significant displacement of the head and trunk responses in SMA compared with non-SMA patients ( P < .01 for both). These differences remained significant after accounting for structural lesions, preexisting motor deficits, and seizure outcome. CONCLUSION: The somatotopy of the mesial frontal premotor regions is significantly altered in patients who have SMA-onset seizures compared with patients who have seizure onset outside of the SMA, suggesting that functional remapping can occur in these brain regions.

Video-Based Deep Learning to Detect Dyssynergic Defecation with 3D High-Definition Anorectal Manometry.

BACKGROUND: We developed a deep learning algorithm to evaluate defecatory patterns to identify dyssynergic defecation using 3-dimensional high definition anal manometry (3D-HDAM). AIMS: We developed a 3D-HDAM deep learning algorithm to evaluate for dyssynergia. METHODS: Spatial-temporal data were extracted from consecutive 3D-HDAM studies performed between 2018 and 2020 at Dartmouth-Hitchcock Health. The technical procedure and gold standard definition of dyssynergia were based on the London consensus, adapted to the needs of 3D-HDAM technology. Three machine learning models were generated: (1) traditional machine learning informed by conventional anorectal function metrics, (2) deep learning, and (3) a hybrid approach. Diagnostic accuracy was evaluated using bootstrap sampling to calculate area-under-the-curve (AUC). To evaluate overfitting, models were validated by adding 502 simulated defecation maneuvers with diagnostic ambiguity. RESULTS: 302 3D-HDAM studies representing 1208 simulated defecation maneuvers were included (average age 55.2 years; 80.5% women). The deep learning model had comparable diagnostic accuracy [AUC 0.91 (95% confidence interval 0.89-0.93)] to traditional [AUC 0.93(0.92-0.95)] and hybrid [AUC 0.96(0.94-0.97)] predictive models in training cohorts. However, the deep learning model handled ambiguous tests more cautiously than other models; the deep learning model was more likely to designate an ambiguous test as inconclusive [odds ratio 4.21(2.78-6.38)] versus traditional/hybrid approaches. CONCLUSIONS: Deep learning is capable of considering complex spatial-temporal information on 3D-HDAM technology. Future studies are needed to evaluate the clinical context of these preliminary findings.

Uncovering additional predictors of urothelial carcinoma from voided urothelial cell clusters through a deep learning-based image preprocessing technique.

BACKGROUND: Urine cytology is commonly used as a screening test for high-grade urothelial carcinoma for patients with risk factors or hematuria and is an essential step in longitudinal monitoring of patients with previous bladder cancer history. However, the semisubjective nature of current reporting systems for urine cytology (e.g., The Paris System) can hamper reproducibility. For instance, the incorporation of urothelial cell clusters into the classification schema is still an item of debate and perplexity among expert cytopathologists because several previous works have disputed their diagnostic relevance. METHODS: In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). RESULTS: In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). Results indicate that cell cluster atypia (i.e., defined by whether the cell cluster harbored multiple atypical cells, thresholded by a minimum number of cells), cell border overlap and smoothness, and total number of clusters are important markers of specimen atypia when considering assessment of urothelial cell clusters. CONCLUSIONS: Markers established through techniques to separate cell clusters may have wider applicability for the design and implementation of machine learning approaches for urine cytology assessment.