Identification of Spatial Proteomic Signatures of Colon Tumor Metastasis: A Digital Spatial Profiling Approach.

Over 150,000 Americans are diagnosed with colorectal cancer (CRC) every year, and annually >50,000 individuals are estimated to die of CRC, necessitating improvements in screening, prognostication, disease management, and therapeutic options. CRC tumors are removed en bloc with surrounding vasculature and lymphatics. Examination of regional lymph nodes at the time of surgical resection is essential for prognostication. Developing alternative approaches to indirectly assess recurrence risk would have utility in cases where lymph node yield is incomplete or inadequate. Spatially dependent, immune cell-specific (eg, tumor-infiltrating lymphocytes), proteomic, and transcriptomic expression patterns inside and around the tumor-the tumor immune microenvironment-can predict nodal/distant metastasis and probe the coordinated immune response from the primary tumor site. The comprehensive characterization of tumor-infiltrating lymphocytes and other immune infiltrates is possible using highly multiplexed spatial omics technologies, such as the GeoMX Digital Spatial Profiler. In this study, machine learning and differential co-expression analyses helped identify biomarkers from Digital Spatial Profiler-assayed protein expression patterns inside, at the invasive margin, and away from the tumor, associated with extracellular matrix remodeling (eg, granzyme B and fibronectin), immune suppression (eg, forkhead box P3), exhaustion and cytotoxicity (eg, CD8), Programmed death ligand 1-expressing dendritic cells, and neutrophil proliferation, among other concomitant alterations. Further investigation of these biomarkers may reveal independent risk factors of CRC metastasis that can be formulated into low-cost, widely available assays.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: A retrospective assessment.

Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumour removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. The aim of this study was to develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. To do this, a retrospective cohort study was conducted using frozen cSCC section slides. These slides were scanned and annotated, delineating benign tissue structures, inflammation and tumour to develop an AI algorithm for real-time margin analysis. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC. This algorithm demonstrated proof of concept for identifying cSCC with high accuracy, highlighting the potential for integration of AI into the surgical workflow. Incorporation of AI algorithms may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumours/neoplasms. Further algorithmic improvement incorporating surrounding tissue context is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumours, and to map tumours to their original anatomical position/orientation.

Video-Based Deep Learning to Detect Dyssynergic Defecation with 3D High-Definition Anorectal Manometry.

BACKGROUND: We developed a deep learning algorithm to evaluate defecatory patterns to identify dyssynergic defecation using 3-dimensional high definition anal manometry (3D-HDAM). AIMS: We developed a 3D-HDAM deep learning algorithm to evaluate for dyssynergia. METHODS: Spatial-temporal data were extracted from consecutive 3D-HDAM studies performed between 2018 and 2020 at Dartmouth-Hitchcock Health. The technical procedure and gold standard definition of dyssynergia were based on the London consensus, adapted to the needs of 3D-HDAM technology. Three machine learning models were generated: (1) traditional machine learning informed by conventional anorectal function metrics, (2) deep learning, and (3) a hybrid approach. Diagnostic accuracy was evaluated using bootstrap sampling to calculate area-under-the-curve (AUC). To evaluate overfitting, models were validated by adding 502 simulated defecation maneuvers with diagnostic ambiguity. RESULTS: 302 3D-HDAM studies representing 1208 simulated defecation maneuvers were included (average age 55.2 years; 80.5% women). The deep learning model had comparable diagnostic accuracy [AUC 0.91 (95% confidence interval 0.89-0.93)] to traditional [AUC 0.93(0.92-0.95)] and hybrid [AUC 0.96(0.94-0.97)] predictive models in training cohorts. However, the deep learning model handled ambiguous tests more cautiously than other models; the deep learning model was more likely to designate an ambiguous test as inconclusive [odds ratio 4.21(2.78-6.38)] versus traditional/hybrid approaches. CONCLUSIONS: Deep learning is capable of considering complex spatial-temporal information on 3D-HDAM technology. Future studies are needed to evaluate the clinical context of these preliminary findings.

A large-scale internal validation study of unsupervised virtual trichrome staining technologies on nonalcoholic steatohepatitis liver biopsies.

Non-alcoholic steatohepatitis (NASH) is a fatty liver disease characterized by accumulation of fat in hepatocytes with concurrent inflammation and is associated with morbidity, cirrhosis and liver failure. After extraction of a liver core biopsy, tissue sections are stained with hematoxylin and eosin (H&E) to grade NASH activity, and stained with trichrome to stage fibrosis. Methods to computationally transform one stain into another on digital whole slide images (WSI) can lessen the need for additional physical staining besides H&E, reducing personnel, equipment, and time costs. Generative adversarial networks (GAN) have shown promise for virtual staining of tissue. We conducted a large-scale validation study of the viability of GANs for H&E to trichrome conversion on WSI (n = 574). Pathologists were largely unable to distinguish real images from virtual/synthetic images given a set of twelve Turing Tests. We report high correlation between staging of real and virtual stains ([Formula: see text]; 95% CI: 0.84-0.88). Stages assigned to both virtual and real stains correlated similarly with a number of clinical biomarkers and progression to End Stage Liver Disease (Hazard Ratio HR = 2.06, 95% CI: 1.36-3.12, p < 0.001 for real stains; HR = 2.02, 95% CI: 1.40-2.92, p < 0.001 for virtual stains). Our results demonstrate that virtual trichrome technologies may offer a software solution that can be employed in the clinical setting as a diagnostic decision aid.

A machine learning algorithm for simulating immunohistochemistry: development of SOX10 virtual IHC and evaluation on primarily melanocytic neoplasms.

Immunohistochemistry (IHC) is a diagnostic technique used throughout pathology. A machine learning algorithm that could predict individual cell immunophenotype based on hematoxylin and eosin (H&E) staining would save money, time, and reduce tissue consumed. Prior approaches have lacked the spatial accuracy needed for cell-specific analytical tasks. Here IHC performed on destained H&E slides is used to create a neural network that is potentially capable of predicting individual cell immunophenotype. Twelve slides were stained with H&E and scanned to create digital whole slide images. The H&E slides were then destained, and stained with SOX10 IHC. The SOX10 IHC slides were scanned, and corresponding H&E and IHC digital images were registered. Color-thresholding and machine learning techniques were applied to the registered H&E and IHC images to segment 3,396,668 SOX10-negative cells and 306,166 SOX10-positive cells. The resulting segmentation was used to annotate the original H&E images, and a convolutional neural network was trained to predict SOX10 nuclear staining. Sixteen thousand three hundred and nine image patches were used to train the virtual IHC (vIHC) neural network, and 1,813 image patches were used to quantitatively evaluate it. The resulting vIHC neural network achieved an area under the curve of 0.9422 in a receiver operator characteristics analysis when sorting individual nuclei. The vIHC network was applied to additional images from clinical practice, and was evaluated qualitatively by a board-certified dermatopathologist. Further work is needed to make the process more efficient and accurate for clinical use. This proof-of-concept demonstrates the feasibility of creating neural network-driven vIHC assays.

A2B adenosine receptor expression by myeloid cells is proinflammatory in murine allergic-airway inflammation.

Asthma is a chronic condition with high morbidity and healthcare costs, and cockroach allergens are an established cause of urban pediatric asthma. A better understanding of cell types involved in promoting lung inflammation could provide new targets for the treatment of chronic pulmonary disease. Because of its role in regulating myeloid cell-dependent inflammatory processes, we examined A(2B) R expression by myeloid cells in a cockroach allergen model of murine asthma-like pulmonary inflammation. Both systemic and myeloid tissue-specific A(2B) R deletion significantly decreased pulmonary inflammatory cell recruitment, airway mucin production, and proinflammatory cytokine secretion after final allergen challenge in sensitized mice. A(2B) R deficiency resulted in a dramatic reduction on Th2-type airways responses with decreased pulmonary eosinophilia without augmenting neutrophilia, and decreased lung IL-4, IL-5, and IL-13 production. Chemokine analysis demonstrated that eotaxin 1 and 2 secretion in response to repeated allergen challenge is myeloid cell A(2B) R dependent. In contrast, there were no differences in the levels of the CXC chemokines keratinocyte-derived chemokine and MIP-2 in the myeloid cell A(2B) R-deficient mice, strengthening A(2B) R involvement in the development of Th2-type airways inflammation. Proinflammatory TNF-α, IFN-γ, and IL-17 secretion were also reduced in systemic and myeloid tissue-specific A(2B) R deletion mouse lines. Our results demonstrate Th2-type predominance for A(2B) R expression by myeloid cells as a mechanism of development of asthma-like pulmonary inflammation.

Spatial Omics Driven Crossmodal Pretraining Applied to Graph-based Deep Learning for Cancer Pathology Analysis.

Graph-based deep learning has shown great promise in cancer histopathology image analysis by contextualizing complex morphology and structure across whole slide images to make high quality downstream outcome predictions (ex: prognostication). These methods rely on informative representations (i.e., embeddings) of image patches comprising larger slides, which are used as node attributes in slide graphs. Spatial omics data, including spatial transcriptomics, is a novel paradigm offering a wealth of detailed information. Pairing this data with corresponding histological imaging localized at 50-micron resolution, may facilitate the development of algorithms which better appreciate the morphological and molecular underpinnings of carcinogenesis. Here, we explore the utility of leveraging spatial transcriptomics data with a contrastive crossmodal pretraining mechanism to generate deep learning models that can extract molecular and histological information for graph-based learning tasks. Performance on cancer staging, lymph node metastasis prediction, survival prediction, and tissue clustering analyses indicate that the proposed methods bring improvement to graph based deep learning models for histopathological slides compared to leveraging histological information from existing schemes, demonstrating the promise of mining spatial omics data to enhance deep learning for pathology workflows.

Intraoperative margin assessment for basal cell carcinoma with deep learning and histologic tumor mapping to surgical site.

Successful treatment of solid cancers relies on complete surgical excision of the tumor either for definitive treatment or before adjuvant therapy. Intraoperative and postoperative radial sectioning, the most common form of margin assessment, can lead to incomplete excision and increase the risk of recurrence and repeat procedures. Mohs Micrographic Surgery is associated with complete removal of basal cell and squamous cell carcinoma through real-time margin assessment of 100% of the peripheral and deep margins. Real-time assessment in many tumor types is constrained by tissue size, complexity, and specimen processing / assessment time during general anesthesia. We developed an artificial intelligence platform to reduce the tissue preprocessing and histological assessment time through automated grossing recommendations, mapping and orientation of tumor to the surgical specimen. Using basal cell carcinoma as a model system, results demonstrate that this approach can address surgical laboratory efficiency bottlenecks for rapid and complete intraoperative margin assessment.

Potential to Enhance Large Scale Molecular Assessments of Skin Photoaging through Virtual Inference of Spatial Transcriptomics from Routine Staining.

The advent of spatial transcriptomics technologies has heralded a renaissance in research to advance our understanding of the spatial cellular and transcriptional heterogeneity within tissues. Spatial transcriptomics allows investigation of the interplay between cells, molecular pathways, and the surrounding tissue architecture and can help elucidate developmental trajectories, disease pathogenesis, and various niches in the tumor microenvironment. Photoaging is the histological and molecular skin damage resulting from chronic/acute sun exposure and is a major risk factor for skin cancer. Spatial transcriptomics technologies hold promise for improving the reliability of evaluating photoaging and developing new therapeutics. Challenges to current methods include limited focus on dermal elastosis variations and reliance on self-reported measures, which can introduce subjectivity and inconsistency. Spatial transcriptomics offers an opportunity to assess photoaging objectively and reproducibly in studies of carcinogenesis and discern the effectiveness of therapies that intervene in photoaging and preventing cancer. Evaluation of distinct histological architectures using highly-multiplexed spatial technologies can identify specific cell lineages that have been understudied due to their location beyond the depth of UV penetration. However, the cost and interpatient variability using state-of-the-art assays such as the 10x Genomics Spatial Transcriptomics assays limits the scope and scale of large-scale molecular epidemiologic studies. Here, we investigate the inference of spatial transcriptomics information from routine hematoxylin and eosin-stained (H&E) tissue slides. We employed the Visium CytAssist spatial transcriptomics assay to analyze over 18,000 genes at a 50-micron resolution for four patients from a cohort of 261 skin specimens collected adjacent to surgical resection sites for basal cell and squamous cell keratinocyte tumors. The spatial transcriptomics data was co-registered with 40x resolution whole slide imaging (WSI) information. We developed machine learning models that achieved a macro-averaged median AUC and F1 score of 0.80 and 0.61 and Spearman coefficient of 0.60 in inferring transcriptomic profiles across the slides, and accurately captured biological pathways across various tissue architectures.

Cecal ligation and puncture-induced murine sepsis does not cause lung injury.

OBJECTIVE: The cause of death in murine models of sepsis remains unclear. The primary purpose of this study was to determine if significant lung injury develops in mice predicted to die after cecal ligation and puncture-induced sepsis compared with those predicted to live. DESIGN: Prospective, laboratory controlled experiments. SETTING: University research laboratory. SUBJECTS: Adult, female, outbred Institute of Cancer Research mice. INTERVENTIONS: Mice underwent cecal ligation and puncture to induce sepsis. Two groups of mice were euthanized at 24 and 48 hrs postcecal ligation and puncture and samples were collected. These mice were further stratified into groups predicted to die (Die-P) and predicted to live (Live-P) based on plasma interleukin-6 levels obtained 24 hrs postcecal ligation and puncture. Multiple measures of lung inflammation and lung injury were quantified in these two groups. Results from a group of mice receiving intratracheal normal saline without surgical intervention were also included as a negative control. As a positive control, bacterial pneumonia was induced with Pseudomonas aeruginosa to cause definitive lung injury. Separate mice were followed for survival until Day 28 postcecal ligation and puncture. These mice were used to verify the interleukin-6 cutoffs for survival prediction. MEASUREMENTS AND MAIN RESULTS: After sepsis, both the Die-P and Live-P mice had significantly suppressed measures of respiratory physiology but maintained normal levels of arterial oxygen saturation. Bronchoalveolar lavage levels of pro- and anti-inflammatory cytokines were not elevated in the Die-P mice compared with the Live-P. In addition, there was no increase in the recruitment of neutrophils to the lung, pulmonary vascular permeability, or histological evidence of damage. In contrast, all of these pulmonary injury and inflammatory parameters were increased in mice with Pseudomonas pneumonia. CONCLUSIONS: These data demonstrate that mice predicted to die during sepsis have no significant lung injury. In murine intra-abdominal sepsis, pulmonary injury cannot be considered the etiology of death in the acute phase.

Acute oral ethanol exposure triggers asthma in cockroach allergen-sensitized mice.

Asthma may be triggered by multiple mediators, including allergen-IgE cross-linking and non-IgE mechanisms. Several clinical studies have shown acute ethanol consumption exacerbates asthma, yet no animal model exists to study this process. We developed a model of ethanol-triggered asthma in allergen-sensitized mice to evaluate the mechanisms of ethanol inducing asthma-like responses. Outbred mice were exposed to cockroach allergens on Days 0 and 14; and on Day 21, mice received ethanol by oral gavage. Tracer studies confirmed alcohol aspiration did not occur. Within 30 minutes, alcohol induced degranulation of over 74% of mast cells, and multiple parameters of asthma-like pulmonary inflammation were triggered. Ethanol-gavaged mice had a fivefold increased production of eotaxin-2 (534 pg/mL) and a sevenfold increase in bronchoalveolar eosinophils (70,080 cells). Ethanol induced a 10-fold increase in IL-13, from 84 pg/mL in sensitized mice to 845 pg/mL in ethanol-gavaged sensitized mice. In cockroach allergen-sensitized mice, ethanol triggered asthma-like changes in respiratory physiology and a significant fivefold increase in airway mucin production. Importantly, none of these asthmatic exacerbations were observed in normal mice gavaged with ethanol. Cromolyn sodium effectively stabilized mast cells, yet increased mucin production and bronchoalveolar eosinophil recruitment. Together, these data show a single oral alcohol exposure will trigger asthma-like pulmonary inflammation in allergen-sensitized mice, providing a novel asthma model.

Paired-agent imaging as a rapid en face margin screening method in Mohs micrographic surgery.

Background: Mohs micrographic surgery is a procedure used for non-melanoma skin cancers that has 97-99% cure rates largely owing to 100% margin analysis enabled by en face sectioning with real-time, iterative histologic assessment. However, the technique is limited to small and aggressive tumors in high-risk areas because the histopathological preparation and assessment is very time intensive. To address this, paired-agent imaging (PAI) can be used to rapidly screen excised specimens and identify tumor positive margins for guided and more efficient microscopic evaluation. Methods: A mouse xenograft model of human squamous cell carcinoma (n = 8 mice, 13 tumors) underwent PAI. Targeted (ABY-029, anti-epidermal growth factor receptor (EGFR) affibody molecule) and untargeted (IRDye 680LT carboxylate) imaging agents were simultaneously injected 3-4 h prior to surgical tumor resection. Fluorescence imaging was performed on main, unprocessed excised specimens and en face margins (tissue sections tangential to the deep margin surface). Binding potential (BP) - a quantity proportional to receptor concentration - and targeted fluorescence signal were measured for each, and respective mean and maximum values were analyzed to compare diagnostic ability and contrast. The BP and targeted fluorescence of the main specimen and margin samples were also correlated with EGFR immunohistochemistry (IHC). Results: PAI consistently outperformed targeted fluorescence alone in terms of diagnostic ability and contrast-to-variance ratio (CVR). Mean and maximum measures of BP resulted in 100% accuracy, while mean and maximum targeted fluorescence signal offered 97% and 98% accuracy, respectively. Moreover, maximum BP had the greatest average CVR for both main specimen and margin samples (average 1.7 ± 0.4 times improvement over other measures). Fresh tissue margin imaging improved similarity with EGFR IHC volume estimates compared to main specimen imaging in line profile analysis; and margin BP specifically had the strongest concordance (average 3.6 ± 2.2 times improvement over other measures). Conclusions: PAI was able to reliably distinguish tumor from normal tissue in fresh en face margin samples using the single metric of maximum BP. This demonstrated the potential for PAI to act as a highly sensitive screening tool to eliminate the extra time wasted on real-time pathological assessment of low-risk margins.

Assessment of emerging pretraining strategies in interpretable multimodal deep learning for cancer prognostication.

BACKGROUND: Deep learning models can infer cancer patient prognosis from molecular and anatomic pathology information. Recent studies that leveraged information from complementary multimodal data improved prognostication, further illustrating the potential utility of such methods. However, current approaches: 1) do not comprehensively leverage biological and histomorphological relationships and 2) make use of emerging strategies to "pretrain" models (i.e., train models on a slightly orthogonal dataset/modeling objective) which may aid prognostication by reducing the amount of information required for achieving optimal performance. In addition, model interpretation is crucial for facilitating the clinical adoption of deep learning methods by fostering practitioner understanding and trust in the technology. METHODS: Here, we develop an interpretable multimodal modeling framework that combines DNA methylation, gene expression, and histopathology (i.e., tissue slides) data, and we compare performance of crossmodal pretraining, contrastive learning, and transfer learning versus the standard procedure. RESULTS: Our models outperform the existing state-of-the-art method (average 11.54% C-index increase), and baseline clinically driven models (average 11.7% C-index increase). Model interpretations elucidate consideration of biologically meaningful factors in making prognosis predictions. DISCUSSION: Our results demonstrate that the selection of pretraining strategies is crucial for obtaining highly accurate prognostication models, even more so than devising an innovative model architecture, and further emphasize the all-important role of the tumor microenvironment on disease progression.

Large-scale validation study of an improved semiautonomous urine cytology assessment tool: AutoParis-X.

BACKGROUND: Adopting a computational approach for the assessment of urine cytology specimens has the potential to improve the efficiency, accuracy, and reliability of bladder cancer screening, which has heretofore relied on semisubjective manual assessment methods. As rigorous, quantitative criteria and guidelines have been introduced for improving screening practices (e.g., The Paris System for Reporting Urinary Cytology), algorithms to emulate semiautonomous diagnostic decision-making have lagged behind, in part because of the complex and nuanced nature of urine cytology reporting. METHODS: In this study, the authors report on the development and large-scale validation of a deep-learning tool, AutoParis-X, which can facilitate rapid, semiautonomous examination of urine cytology specimens. RESULTS: The results of this large-scale, retrospective validation study indicate that AutoParis-X can accurately determine urothelial cell atypia and aggregate a wide variety of cell-related and cluster-related information across a slide to yield an atypia burden score, which correlates closely with overall specimen atypia and is predictive of Paris system diagnostic categories. Importantly, this approach accounts for challenges associated with the assessment of overlapping cell cluster borders, which improve the ability to predict specimen atypia and accurately estimate the nuclear-to-cytoplasm ratio for cells in these clusters. CONCLUSIONS: The authors developed a publicly available, open-source, interactive web application that features a simple, easy-to-use display for examining urine cytology whole-slide images and determining the level of atypia in specific cells, flagging the most abnormal cells for pathologist review. The accuracy of AutoParis-X (and other semiautomated digital pathology systems) indicates that these technologies are approaching clinical readiness and necessitates full evaluation of these algorithms in head-to-head clinical trials.

Uncovering additional predictors of urothelial carcinoma from voided urothelial cell clusters through a deep learning-based image preprocessing technique.

BACKGROUND: Urine cytology is commonly used as a screening test for high-grade urothelial carcinoma for patients with risk factors or hematuria and is an essential step in longitudinal monitoring of patients with previous bladder cancer history. However, the semisubjective nature of current reporting systems for urine cytology (e.g., The Paris System) can hamper reproducibility. For instance, the incorporation of urothelial cell clusters into the classification schema is still an item of debate and perplexity among expert cytopathologists because several previous works have disputed their diagnostic relevance. METHODS: In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). RESULTS: In this work, an automated preprocessing tool for urothelial cell cluster assessment was developed that divides urothelial cell clusters into meaningful components for downstream assessment (ie, population-based studies, workflow automation). Results indicate that cell cluster atypia (i.e., defined by whether the cell cluster harbored multiple atypical cells, thresholded by a minimum number of cells), cell border overlap and smoothness, and total number of clusters are important markers of specimen atypia when considering assessment of urothelial cell clusters. CONCLUSIONS: Markers established through techniques to separate cell clusters may have wider applicability for the design and implementation of machine learning approaches for urine cytology assessment.

The Overlooked Role of Specimen Preparation in Bolstering Deep Learning-Enhanced Spatial Transcriptomics Workflows.

The application of deep learning methods to spatial transcriptomics has shown promise in unraveling the complex relationships between gene expression patterns and tissue architecture as they pertain to various pathological conditions. Deep learning methods that can infer gene expression patterns directly from tissue histomorphology can expand the capability to discern spatial molecular markers within tissue slides. However, current methods utilizing these techniques are plagued by substantial variability in tissue preparation and characteristics, which can hinder the broader adoption of these tools. Furthermore, training deep learning models using spatial transcriptomics on small study cohorts remains a costly endeavor. Necessitating novel tissue preparation processes enhance assay reliability, resolution, and scalability. This study investigated the impact of an enhanced specimen processing workflow for facilitating a deep learning-based spatial transcriptomics assessment. The enhanced workflow leveraged the flexibility of the Visium CytAssist assay to permit automated H&E staining (e.g., Leica Bond) of tissue slides, whole-slide imaging at 40x-resolution, and multiplexing of tissue sections from multiple patients within individual capture areas for spatial transcriptomics profiling. Using a cohort of thirteen pT3 stage colorectal cancer (CRC) patients, we compared the efficacy of deep learning models trained on slide prepared using an enhanced workflow as compared to the traditional workflow which leverages manual tissue staining and standard imaging of tissue slides. Leveraging Inceptionv3 neural networks, we aimed to predict gene expression patterns across matched serial tissue sections, each stemming from a distinct workflow but aligned based on persistent histological structures. Findings indicate that the enhanced workflow considerably outperformed the traditional spatial transcriptomics workflow. Gene expression profiles predicted from enhanced tissue slides also yielded expression patterns more topologically consistent with the ground truth. This led to enhanced statistical precision in pinpointing biomarkers associated with distinct spatial structures. These insights can potentially elevate diagnostic and prognostic biomarker detection by broadening the range of spatial molecular markers linked to metastasis and recurrence. Future endeavors will further explore these findings to enrich our comprehension of various diseases and uncover molecular pathways with greater nuance. Combining deep learning with spatial transcriptomics provides a compelling avenue to enrich our understanding of tumor biology and improve clinical outcomes. For results of the highest fidelity, however, effective specimen processing is crucial, and fostering collaboration between histotechnicians, pathologists, and genomics specialists is essential to herald this new era in spatial transcriptomics-driven cancer research.

Use of molecular testing results to analyze the overuse of atypia of undetermined significance in thyroid cytology.

INTRODUCTION: The suggested atypia of undetermined significance (AUS) rate for thyroid fine-needle aspiration biopsies is 10% or less. Prompted by a high institutional AUS rate, we examined using molecular testing results (MTR) as a potential quality metric tool to reduce the AUS rate. We correlated MTR with AUS cytologic findings, surgical pathology follow-up, and individual pathologist AUS rates. MATERIALS AND METHODS: Demographic data, cytologic diagnoses, MTR, and surgical pathology diagnoses were retrospectively obtained. MTR were classified as either positive or negative. AUS rates and MTR proportions were compared among pathologists. The cytomorphologic features of 143 AUS cases were assessed and correlated with MTR. RESULTS: Between 2017 and 2022, 710 of 3247 thyroid fine-needle aspirations were classified as AUS, with a yearly average rate of 22% (range = 19%-26%). AUS cases included: 331 (47%) with architectural atypia; 204 (29%) with oncocytic (Hürthle cell) atypia; 99 (14%) with combined architectural and cytologic atypia; and 76 (10%) with isolated cytologic atypia. Most AUS cases with molecular testing had negative MTR (360/492, 73%). AUS with cytologic atypia had higher positive MTR risk (logarithm of odds ratio = 1.27, 95% credible interval [0.5-2.04], P = 0.001). The average positive MTR rate by pathologist was 21.5% (range 0%-35%); higher positive MTR rates had better correlation with subsequent neoplastic/malignant histologic diagnoses. The MTR sensitivity for malignant disease was 89% and the negative predictive value was 91%. CONCLUSIONS: MTR analysis reveals the importance of cytologic atypia as a determinant of malignancy risk in AUS cases. Periodic analysis of MTR data alongside individual pathologist AUS rates can help refine diagnostic criteria and potentially reduce AUS overuse.

A deep learning algorithm to detect cutaneous squamous cell carcinoma on frozen sections in Mohs micrographic surgery: a retrospective assessment.

Importance: Intraoperative margin analysis is crucial for the successful removal of cutaneous squamous cell carcinomas (cSCC). Artificial intelligence technologies (AI) have previously demonstrated potential for facilitating rapid and complete tumor removal using intraoperative margin assessment for basal cell carcinoma. However, the varied morphologies of cSCC present challenges for AI margin assessment. Objective: To develop and evaluate the accuracy of an AI algorithm for real-time histologic margin analysis of cSCC. Design: A retrospective cohort study was conducted using frozen cSCC section slides and adjacent tissues. Setting: This study was conducted in a tertiary care academic center. Participants: Patients undergoing Mohs micrographic surgery for cSCC between January and March 2020. Exposures: Frozen section slides were scanned and annotated, delineating benign tissue structures, inflammation, and tumor to develop an AI algorithm for real-time margin analysis. Patients were stratified by tumor differentiation status. Epithelial tissues including epidermis and hair follicles were annotated for moderate-well to well differentiated cSCC tumors. A convolutional neural network workflow was used to extract histomorphological features predictive of cSCC at 50-micron resolution. Main Outcomes and Measures: The performance of the AI algorithm in identifying cSCC at 50-micron resolution was reported using the area under the receiver operating characteristic curve. Accuracy was also reported by tumor differentiation status and by delineation of cSCC from epidermis. Model performance using histomorphological features alone was compared to architectural features (i.e., tissue context) for well-differentiated tumors. Results: The AI algorithm demonstrated proof of concept for identifying cSCC with high accuracy. Accuracy differed by differentiation status, driven by challenges in separating cSCC from epidermis using histomorphological features alone for well-differentiated tumors. Consideration of broader tissue context through architectural features improved the ability to delineate tumor from epidermis. Conclusions and Relevance: Incorporating AI into the surgical workflow may improve efficiency and completeness of real-time margin assessment for cSCC removal, particularly in cases of moderately and poorly differentiated tumors/neoplasms. Further algorithmic improvement is necessary to remain sensitive to the unique epidermal landscape of well-differentiated tumors, and to map tumors to their original anatomical position/orientation. Future studies should assess the efficiency improvements and cost benefits and address other confounding pathologies such as inflammation and nuclei. Funding sources: JL is supported by NIH grants R24GM141194, P20GM104416 and P20GM130454. Support for this work was also provided by the Prouty Dartmouth Cancer Center development funds. Key Points: Question: How can the efficiency and accuracy of real-time intraoperative margin analysis for the removal of cutaneous squamous cell carcinoma (cSCC) be improved, and how can tumor differentiation be incorporated into this approach?Findings: A proof-of-concept deep learning algorithm was trained, validated, and tested on frozen section whole slide images (WSI) for a retrospective cohort of cSCC cases, demonstrating high accuracy in identifying cSCC and related pathologies. Histomorphology alone was found to be insufficient to delineate tumor from epidermis in histologic identification of well-differentiated cSCC. Incorporation of surrounding tissue architecture and shape improved the ability to delineate tumor from normal tissue.Meaning: Integrating artificial intelligence into surgical procedures has the potential to enhance the thoroughness and efficiency of intraoperative margin analysis for cSCC removal. However, accurately accounting for the epidermal tissue based on the tumor's differentiation status requires specialized algorithms that consider the surrounding tissue context. To meaningfully integrate AI algorithms into clinical practice, further algorithmic refinement is needed, as well as the mapping of tumors to their original surgical site, and evaluation of the cost and efficacy of these approaches to address existing bottlenecks.

Inferring spatial transcriptomics markers from whole slide images to characterize metastasis-related spatial heterogeneity of colorectal tumors: A pilot study.

Over 150 000 Americans are diagnosed with colorectal cancer (CRC) every year, and annually over 50 000 individuals will die from CRC, necessitating improvements in screening, prognostication, disease management, and therapeutic options. Tumor metastasis is the primary factor related to the risk of recurrence and mortality. Yet, screening for nodal and distant metastasis is costly, and invasive and incomplete resection may hamper adequate assessment. Signatures of the tumor-immune microenvironment (TIME) at the primary site can provide valuable insights into the aggressiveness of the tumor and the effectiveness of various treatment options. Spatially resolved transcriptomics technologies offer an unprecedented characterization of TIME through high multiplexing, yet their scope is constrained by cost. Meanwhile, it has long been suspected that histological, cytological, and macroarchitectural tissue characteristics correlate well with molecular information (e.g., gene expression). Thus, a method for predicting transcriptomics data through inference of RNA patterns from whole slide images (WSI) is a key step in studying metastasis at scale. In this work, we collected tissue from 4 stage-III (pT3) matched colorectal cancer patients for spatial transcriptomics profiling. The Visium spatial transcriptomics (ST) assay was used to measure transcript abundance for 17 943 genes at up to 5000 55-micron (i.e., 1-10 cells) spots per patient sampled in a honeycomb pattern, co-registered with hematoxylin and eosin (H&E) stained WSI. The Visium ST assay can measure expression at these spots through tissue permeabilization of mRNAs, which are captured through spatially (i.e., x-y positional coordinates) barcoded, gene specific oligo probes. WSI subimages were extracted around each co-registered Visium spot and were used to predict the expression at these spots using machine learning models. We prototyped and compared several convolutional, transformer, and graph convolutional neural networks to predict spatial RNA patterns at the Visium spots under the hypothesis that the transformer- and graph-based approaches better capture relevant spatial tissue architecture. We further analyzed the model's ability to recapitulate spatial autocorrelation statistics using SPARK and SpatialDE. Overall, the results indicate that the transformer- and graph-based approaches were unable to outperform the convolutional neural network architecture, though they exhibited optimal performance for relevant disease-associated genes. Initial findings suggest that different neural networks that operate on different scales are relevant for capturing distinct disease pathways (e.g., epithelial to mesenchymal transition). We add further evidence that deep learning models can accurately predict gene expression in whole slide images and comment on understudied factors which may increase its external applicability (e.g., tissue context). Our preliminary work will motivate further investigation of inference for molecular patterns from whole slide images as metastasis predictors and in other applications.