Summary of the National Cancer Institute 2023 Virtual Workshop on Medical Image De-identification-Part 2: Pathology Whole Slide Image De-identification, De-facing, the Role of AI in Image De-identification, and the NCI MIDI Datasets and Pipeline.

De-identification of medical images intended for research is a core requirement for data sharing initiatives, particularly as the demand for data for artificial intelligence (AI) applications grows. The Center for Biomedical Informatics and Information Technology (CBIIT) of the United States National Cancer Institute (NCI) convened a two half-day virtual workshop with the intent of summarizing the state of the art in de-identification technology and processes and exploring interesting aspects of the subject. This paper summarizes the highlights of the second day of the workshop, the recordings and presentations of which are publicly available for review. The topics covered included pathology whole slide image de-identification, de-facing, the role of AI in image de-identification, and the NCI Medical Image De-Identification Initiative (MIDI) datasets and pipeline.

High-Throughput Monitoring of Pathogenic Fungal Growth Using Whole Slide Imaging for Rapid Antifungal Susceptibility Assessment.

Invasive fungal infections are a major health threat with high morbidity and mortality, highlighting the urgent need for rapid diagnostic tools to detect antifungal resistance. Traditional culture-based antifungal susceptibility testing (AFST) methods often fall short due to their lengthy process. In our previous research, we developed a whole-slide imaging (WSI) technique for the high-throughput assessment of bacterial antibiotic resistance. Building on this foundation, this study expands the application of WSI by adapting it for rapid AFST through high-throughput monitoring of the growth of hundreds of individual fungi. Due to the distinct "budding" growth patterns of fungi, we developed a unique approach that utilizes specific cell number change to determine fungi replication, instead of cell area change used for bacteria in our previous study, to accurately determine the growth rates of individual fungal cells. This method not only accelerates the determination of antifungal resistance by directly observing individual fungal cell growth, but also yields accurate results. Employing Candida albicans as a representative model organism, reliable minimum inhibitory concentration (MIC) of fluconazole inhibiting 100% cells of Candida albicans (denoted as MIC100) was obtained within 3h using the developed method, while the modified broth dilution method required 72h for the similar reliable result. In addition, our approach was effectively utilized to test blood culture samples directly, eliminating the need to separate the fungi from whole blood samples spiked with Candida albicans. These features indicate the developed method holds great potential serving as a general tool in rapid antifungal susceptibility testing and MIC determination.

Digital whole-slide imaging of changes in amyloid after peripheral blood stem cell transplantation in patients with amyloid light-chain amyloidosis.

Peripheral blood stem cell transplantation (PBSCT) has made amyloid light-chain (AL) amyloidosis treatable. After PBSCT, hematological complete remission (HCR) can be achieved, leading to improved renal prognosis. The purpose of this study was to evaluate whether whole slide imaging of biopsy samples shows a post-treatment reduction in amyloid deposits in patients with AL amyloidosis. Patients were divided into three groups: Group A (n = 8), not eligible for PBSCT and treated with other therapies; Group B (n = 11), treated with PBSCT and achieved HCR; and Group C (n = 5), treated with PBSCT but did not achieve HCR. Clinical findings and amyloid deposition in glomeruli, interstitium, and blood vessels were compared before and after treatment using digital whole-slide imaging. Proteinuria and hypoalbuminemia improved more in Group B than in the other groups, and in Group B, amyloid deposition improved more in the glomeruli than in the interstitium and blood vessels. The long-term renal and survival prognosis was better in Group B than in the other groups. PBSCT can be expected to improve long-term clinical and renal histological prognosis in patients with AL amyloidosis who achieve HCR. Amyloid disappearance from renal tissue may take a long time even after clinical HCR.

Development of a multi-scanner facility for data acquisition for digital pathology artificial intelligence.

Whole slide imaging (WSI) of pathology glass slides using high-resolution scanners has enabled the large-scale application of artificial intelligence (AI) in pathology, to support the detection and diagnosis of disease, potentially increasing efficiency and accuracy in tissue diagnosis. Despite the promise of AI, it has limitations. 'Brittleness' or sensitivity to variation in inputs necessitates that large amounts of data are used for training. AI is often trained on data from different scanners but not usually by replicating the same slide across scanners. The utilisation of multiple WSI instruments to produce digital replicas of the same slides will make more comprehensive datasets and may improve the robustness and generalisability of AI algorithms as well as reduce the overall data requirements of AI training. To this end, the National Pathology Imaging Cooperative (NPIC) has built the AI FORGE (Facilitating Opportunities for Robust Generalisable data Emulation), a unique multi-scanner facility embedded in a clinical site in the NHS to (1) compare scanner performance, (2) replicate digital pathology image datasets across WSI systems, and (3) support the evaluation of clinical AI algorithms. The NPIC AI FORGE currently comprises 15 scanners from nine manufacturers. It can generate approximately 4,000 WSI images per day (approximately 7 TB of image data). This paper describes the process followed to plan and build such a facility. © 2024 The Author(s). The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Digital Cytology in Veterinary Education: A Comprehensive Survey of Its Application and Perception among Undergraduate and Postgraduate Students.

The COVID-19 pandemic accelerated technological changes in veterinary education, particularly in clinical pathology and anatomic pathology courses transitioning from traditional methods to digital pathology (DP). This study evaluates the personal effectiveness and satisfaction, as well as the advantages and disadvantages, of DP, in particular digital cytology (DC), as a teaching method among European veterinary students, both at the undergraduate and postgraduate level, who attended digital pathology courses during and before the pandemic. A further aim is to discuss the differences between the two student groups. A Google Form survey consisting of 11 multiple-choice questions was emailed to pathology teachers and distributed to their students. Results indicated that undergraduate students showed greater digital pathology training, favouring DC as the most effective learning modality. In contrast, postgraduate students reported less digital slide training, and their preference for learning cytology was split between DC alone and DC integrated with traditional microscopy. All students experienced whole slide imaging for learning cytology slides prevalently, and they stated that DC enhanced their learning experience. While DC demonstrates personal effectiveness and satisfaction as a teaching method, it is important to not replace pathology training with light microscopy completely, as almost a third of the students indicated.

Whole-Slide Imaging (WSI) Versus Traditional Microscopy (TM) Through Evaluation of Parameters in Oral Histopathology: A Pilot Study.

Background: histopathology plays a pivotal role in clinical diagnosis, research, and medical education. In recent years, whole slide imaging (wsi) has emerged as a potential alternative to traditional microscopy for pathological examination. This study aims to provide a comprehensive comparison of wsi and traditional microscopy(tm) in various aspects of histopathology practice. Materials and Methods: In this study, total of 30 cases comprising of oral premalignant and malignant cases which were diagnostically challenging was considered from the archives of the institute for validation. The slides were scanned with slide scanner and were evaluated by histopathologists. The comparative parameters which were noted were diagnostic discordances, number of fields observed to reach the diagnosis and time taken. Results: The mean time taken by the pathologists to reach the diagnosis was significantly less in whole slide imaging technique. The average number of fields observed was higher by using wsi that too in a lesser time compared to tm, the results were found to be statistically significant with p=0.001.however the diagnostic disparity were seen to be maximum for verrucous lesions both in wsi and tm. Conclusion: wsi has facilitated the specialty with rapid mode of diagnosis in a more efficient and error less manner. It has also aided in case banking as well as research possibilities. Hence with the advent of telepathology it is very much necessary to get trained with wsi as early as possible so that the professionals can render correct diagnosis.

Prediction of Mismatch Repair Status in Endometrial Cancer from Histological Slide Images Using Various Deep Learning-Based Algorithms.

The application of deep learning algorithms to predict the molecular profiles of various cancers from digital images of hematoxylin and eosin (H&E)-stained slides has been reported in recent years, mainly for gastric and colon cancers. In this study, we investigated the potential use of H&E-stained endometrial cancer slide images to predict the associated mismatch repair (MMR) status. H&E-stained slide images were collected from 127 cases of the primary lesion of endometrial cancer. After digitization using a Nanozoomer virtual slide scanner (Hamamatsu Photonics), we segmented the scanned images into 5397 tiles of 512 × 512 pixels. The MMR proteins (PMS2, MSH6) were immunohistochemically stained, classified into MMR proficient/deficient, and annotated for each case and tile. We trained several neural networks, including convolutional and attention-based networks, using tiles annotated with the MMR status. Among the tested networks, ResNet50 exhibited the highest area under the receiver operating characteristic curve (AUROC) of 0.91 for predicting the MMR status. The constructed prediction algorithm may be applicable to other molecular profiles and useful for pre-screening before implementing other, more costly genetic profiling tests.

The current state of digital cytology and artificial intelligence (AI): global survey results from the American Society of Cytopathology Digital Cytology Task Force.

INTRODUCTION: The integration of whole slide imaging (WSI) and artificial intelligence (AI) with digital cytology has been growing gradually. Therefore, there is a need to evaluate the current state of digital cytology. This study aimed to determine the current landscape of digital cytology via a survey conducted as part of the American Society of Cytopathology (ASC) Digital Cytology White Paper Task Force. MATERIALS AND METHODS: A survey with 43 questions pertaining to the current practices and experiences of WSI and AI in both surgical pathology and cytology was created. The survey was sent to members of the ASC, the International Academy of Cytology (IAC), and the Papanicolaou Society of Cytopathology (PSC). Responses were recorded and analyzed. RESULTS: In total, 327 individuals participated in the survey, spanning a diverse array of practice settings, roles, and experiences around the globe. The majority of responses indicated there was routine scanning of surgical pathology slides (n = 134; 61%) with fewer respondents scanning cytology slides (n = 150; 46%). The primary challenge for surgical WSI is the need for faster scanning and cost minimization, whereas image quality is the top issue for cytology WSI. AI tools are not widely utilized, with only 16% of participants using AI for surgical pathology samples and 13% for cytology practice. CONCLUSIONS: Utilization of digital pathology is limited in cytology laboratories as compared to surgical pathology. However, as more laboratories are willing to implement digital cytology in the near future, the establishment of practical clinical guidelines is needed.

Digital pathology structure and deployment in Veneto: a proof-of-concept study.

Nowadays pathology laboratories are worldwide facing a digital revolution, with an increasing number of institutions adopting digital pathology (DP) and whole slide imaging solutions. Despite indeed providing novel and helpful advantages, embracing a whole DP workflow is still challenging, especially for wide healthcare networks. The Azienda Zero of the Veneto Italian region has begun a process of a fully digital transformation of an integrated network of 12 hospitals producing nearly 3 million slides per year. In the present article, we describe the planning stages and the operative phases needed to support such a disruptive transition, along with the initial preliminary results emerging from the project. The ultimate goal of the DP program in the Veneto Italian region is to improve patients' clinical care through a safe and standardized process, encompassing a total digital management of pathology samples, easy file sharing with experienced colleagues, and automatic support by artificial intelligence tools.

Digital Pathology for Better Clinical Practice.

(1) Background: Digital pathology (DP) is transforming the landscape of clinical practice, offering a revolutionary approach to traditional pathology analysis and diagnosis. (2) Methods: This innovative technology involves the digitization of traditional glass slides which enables pathologists to access, analyze, and share high-resolution whole-slide images (WSI) of tissue specimens in a digital format. By integrating cutting-edge imaging technology with advanced software, DP promises to enhance clinical practice in numerous ways. DP not only improves quality assurance and standardization but also allows remote collaboration among experts for a more accurate diagnosis. Artificial intelligence (AI) in pathology significantly improves cancer diagnosis, classification, and prognosis by automating various tasks. It also enhances the spatial analysis of tumor microenvironment (TME) and enables the discovery of new biomarkers, advancing their translation for therapeutic applications. (3) Results: The AI-driven immune assays, Immunoscore (IS) and Immunoscore-Immune Checkpoint (IS-IC), have emerged as powerful tools for improving cancer diagnosis, prognosis, and treatment selection by assessing the tumor immune contexture in cancer patients. Digital IS quantitative assessment performed on hematoxylin-eosin (H&E) and CD3+/CD8+ stained slides from colon cancer patients has proven to be more reproducible, concordant, and reliable than expert pathologists' evaluation of immune response. Outperforming traditional staging systems, IS demonstrated robust potential to enhance treatment efficiency in clinical practice, ultimately advancing cancer patient care. Certainly, addressing the challenges DP has encountered is essential to ensure its successful integration into clinical guidelines and its implementation into clinical use. (4) Conclusion: The ongoing progress in DP holds the potential to revolutionize pathology practices, emphasizing the need to incorporate powerful AI technologies, including IS, into clinical settings to enhance personalized cancer therapy.

Crossing the Andes: Challenges and opportunities for digital pathology in Latin America.

The most widely accepted and used type of digital pathology (DP) is whole-slide imaging (WSI). The USFDA granted two WSI system approvals for primary diagnosis, the first in 2017. In Latin America, DP has the potential to reshape healthcare by enhancing diagnostic capabilities through artificial intelligence (AI) and standardizing pathology reports. Yet, we must tackle regulatory hurdles, training, resource availability, and unique challenges to the region. Collectively addressing these hurdles can enable the region to harness DP's advantages-enhancing disease diagnosis, medical research, and healthcare accessibility for its population. Americas Health Foundation assembled a panel of Latin American pathologists who are experts in DP to assess the hurdles to implementing it into pathologists' workflows in the region and provide recommendations for overcoming them. Some key steps recommended include creating a Latin American Society of Digital Pathology to provide continuing education, developing AI models trained on the Latin American population, establishing national regulatory frameworks for protecting the data, and standardizing formats for DP images to ensure that pathologists can collaborate and validate specimens across the various DP platforms.

Automated whole slide morphometry of sural nerve biopsy using machine learning.

AIM: The morphometry of sural nerve biopsies, such as fibre diameter and myelin thickness, helps us understand the underlying mechanism of peripheral neuropathies. However, in current clinical practice, only a portion of the specimen is measured manually because of its labour-intensive nature. In this study, we aimed to develop a machine learning-based application that inputs a whole slide image (WSI) of the biopsied sural nerve and automatically performs morphometric analyses. METHODS: Our application consists of three supervised learning models: (1) nerve fascicle instance segmentation, (2) myelinated fibre detection and (3) myelin sheath segmentation. We fine-tuned these models using 86 toluidine blue-stained slides from various neuropathies and developed an open-source Python library. RESULTS: Performance evaluation showed (1) a mask average precision (AP) of 0.861 for fascicle segmentation, (2) box AP of 0.711 for fibre detection and (3) a mean intersection over union (mIoU) of 0.817 for myelin segmentation. Our software identified 323,298 nerve fibres and 782 fascicles in 70 WSIs. Small and large fibre populations were objectively determined based on clustering analysis. The demyelination group had large fibres with thinner myelin sheaths and higher g-ratios than the vasculitis group. The slope of the regression line from the scatter plots of the diameters and g-ratios was higher in the demyelination group than in the vasculitis group. CONCLUSION: We developed an application that performs whole slide morphometry of human biopsy samples. Our open-source software can be used by clinicians and pathologists without specific machine learning skills, which we expect will facilitate data-driven analysis of sural nerve biopsies for a more detailed understanding of these diseases.

Segmentation of Variants of Nuclei on Whole Slide Images by Using Radiomic Features.

The histopathological segmentation of nuclear types is a challenging task because nuclei exhibit distinct morphologies, textures, and staining characteristics. Accurate segmentation is critical because it affects the diagnostic workflow for patient assessment. In this study, a framework was proposed for segmenting various types of nuclei from different organs of the body. The proposed framework improved the segmentation performance for each nuclear type using radiomics. First, we used distinct radiomic features to extract and analyze quantitative information about each type of nucleus and subsequently trained various classifiers based on the best input sub-features of each radiomic feature selected by a LASSO operator. Second, we inputted the outputs of the best classifier to various segmentation models to learn the variants of nuclei. Using the MoNuSAC2020 dataset, we achieved state-of-the-art segmentation performance for each category of nuclei type despite the complexity, overlapping, and obscure regions. The generalized adaptability of the proposed framework was verified by the consistent performance obtained in whole slide images of different organs of the body and radiomic features.

Expectations and Experiences Among Clinical Staff Regarding Implementation of Digital Pathology: A Qualitative Study at Two Departments of Pathology.

The aim of this study was to assess and evaluate the individual expectations and experiences regarding the implementation of digital pathology (DIPA) among clinical staff in two of the pathology departments in the Region of Southern Denmark before and during the implementation in their department. Seventeen semi-structured interviews based upon McKinsey 7-S framework were held both prior to and during implementation with both managers and employees at the two pathology departments. The interviewees were pathologists, medical doctors in internship in pathology (interns), biomedical laboratory scientists (BLS), secretaries, and a project lead. Using deductive and inductive coding resulted in five overall themes and appertaining sub-themes. The findings pointed to an overall positive attitude towards DIPA from the beginning. The clinical staff perceived being rewarded already during implementation with benefits such as improved collaboration both inter- and intra-departmentally promoting better acceptance of DIPA. The clinical staff also experienced some challenges, e.g., increase in turnaround times, which affected and concerned staff on a personal level. Especially BLS expressed experiencing a demanding and stressful transition due to unexpected increase in workload as well as some barriers for a potentially better implementation process. The key findings of this study were a need for better preparation of staff through transparent communication of the upcoming challenges of the transition to DIPA, more system-specific training beforehand, more allocation of time and resources in the implementation process, and more focus on BLS' work tasks in the requirement specifications.

Slideflow: deep learning for digital histopathology with real-time whole-slide visualization.

Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in an interactive interface. Experimenting with different deep learning approaches typically requires switching software libraries and reprocessing data, reducing the feasibility and practicality of experimenting with new architectures. We developed a flexible deep learning library for histopathology called Slideflow, a package which supports a broad array of deep learning methods for digital pathology and includes a fast whole-slide interface for deploying trained models. Slideflow includes unique tools for whole-slide image data processing, efficient stain normalization and augmentation, weakly-supervised whole-slide classification, uncertainty quantification, feature generation, feature space analysis, and explainability. Whole-slide image processing is highly optimized, enabling whole-slide tile extraction at 40x magnification in 2.5 s per slide. The framework-agnostic data processing pipeline enables rapid experimentation with new methods built with either Tensorflow or PyTorch, and the graphical user interface supports real-time visualization of slides, predictions, heatmaps, and feature space characteristics on a variety of hardware devices, including ARM-based devices such as the Raspberry Pi.

SSTU: Swin-Spectral Transformer U-Net for hyperspectral whole slide image reconstruction.

Whole Slide Imaging and Hyperspectral Microscopic Imaging provide great quality data with high spatial and spectral resolution for histopathology. Existing Hyperspectral Whole Slide Imaging systems combine the advantages of the techniques above, thus providing rich information for pathological diagnosis. However, it cannot avoid the problems of slow acquisition speed and mass data storage demand. Inspired by the spectral reconstruction task in computer vision and remote sensing, the Swin-Spectral Transformer U-Net (SSTU) has been developed to reconstruct Hyperspectral Whole Slide images (HWSis) from multiple Hyperspectral Microscopic images (HMis) of small Field of View and Whole Slide images (WSis). The Swin-Spectral Transformer (SST) module in SSTU takes full advantage of Transformer in extracting global attention. Firstly, Swin Transformer is exploited in space domain, which overcomes the high computation cost in Vision Transformer structures, while it maintains the spatial features extracted from WSis. Furthermore, Spectral Transformer is exploited to collect the long-range spectral features in HMis. Combined with the multi-scale encoder-bottleneck-decoder structure of U-Net, SSTU network is formed by sequential and symmetric residual connections of SSTs, which reconstructs a selected area of HWSi from coarse to fine. Qualitative and quantitative experiments prove the performance of SSTU in HWSi reconstruction task superior to other state-of-the-art spectral reconstruction methods.

Digital Validation in Breast Cancer Needle Biopsies: Comparison of Histological Grade and Biomarker Expression Assessment Using Conventional Light Microscopy, Whole Slide Imaging, and Digital Image Analysis.

Given the widespread use of whole slide imaging (WSI) for primary pathological diagnosis, we evaluated its utility in assessing histological grade and biomarker expression (ER, PR, HER2, and Ki67) compared to conventional light microscopy (CLM). In addition, we explored the utility of digital image analysis (DIA) for assessing biomarker expression. Three breast pathologists assessed the Nottingham combined histological grade, its components, and biomarker expression through the immunohistochemistry of core needle biopsy samples obtained from 101 patients with breast cancer using CLM, WSI, and DIA. There was no significant difference in variance between the WSI and CLM agreement rates for the Nottingham grade and its components and biomarker expression. Nuclear pleomorphism emerged as the most variable histologic component in intra- and inter-observer agreement (kappa ≤ 0.577 and kappa ≤ 0.394, respectively). The assessment of biomarker expression using DIA achieved an enhanced kappa compared to the inter-observer agreement. Compared to each observer's assessment, DIA exhibited an improved kappa coefficient for the expression of most biomarkers with CLM and WSI. Using WSI to assess prognostic and predictive factors, including histological grade and biomarker expression in breast cancer, is acceptable. Furthermore, incorporating DIA to assess biomarker expression shows promise for substantially enhancing scoring reproducibility.

A novel approach correlating pathologic complete response with digital pathology and radiomics in triple-negative breast cancer.

This rapid communication highlights the correlations between digital pathology-whole slide imaging (WSI) and radiomics-magnetic resonance imaging (MRI) features in triple-negative breast cancer (TNBC) patients. The research collected 12 patients who had both core needle biopsy and MRI performed to evaluate pathologic complete response (pCR). The results showed that higher collagenous values in pathology data were correlated with more homogeneity, whereas higher tumor expression values in pathology data correlated with less homogeneity in the appearance of tumors on MRI by size zone non-uniformity normalized (SZNN). Higher myxoid values in pathology data are correlated with less similarity of gray-level non-uniformity (GLN) in tumor regions on MRIs, while higher immune values in WSIs correlated with the more joint distribution of smaller-size zones by small area low gray-level emphasis (SALGE) in the tumor regions on MRIs. Pathologic complete response (pCR) was associated with collagen, tumor, and myxoid expression in WSI and GLN and SZNN in radiomic features. The correlations of WSI and radiomic features may further our understanding of the TNBC tumoral microenvironment (TME) and could be used in the future to better tailor the use of neoadjuvant chemotherapy (NAC). This communication will focus on the post-NAC MRI features correlated with pCR and their association with WSI features from core needle biopsies.

A Comparative Study of Performance Between Federated Learning and Centralized Learning Using Pathological Image of Endometrial Cancer.

Federated learning, an innovative artificial intelligence training method, offers a secure solution for institutions to collaboratively develop models without sharing raw data. This approach offers immense promise and is particularly advantageous for domains dealing with sensitive information, such as patient data. However, when confronted with a distributed data environment, challenges arise due to data paucity or inherent heterogeneity, potentially impacting the performance of federated learning models. Hence, scrutinizing the efficacy of this method in such intricate settings is indispensable. To address this, we harnessed pathological image datasets of endometrial cancer from four hospitals for training and evaluating the performance of a federated learning model and compared it with a centralized learning model. With optimal processing techniques (data augmentation, color normalization, and adaptive optimizer), federated learning exhibited lower precision but higher recall and Dice similarity coefficient (DSC) than centralized learning. Hence, considering the critical importance of recall in the context of medical image processing, federated learning is demonstrated as a viable and applicable approach in this field, offering advantages in terms of both performance and data security.

Deep Learning Provides Rapid Screen for Breast Cancer Metastasis with Sentinel Lymph Nodes.

OBJECTIVE: Deep learning has been shown to be useful in detecting breast cancer metastases by analyzing whole slide images (WSI) of sentinel lymph nodes; however, it requires extensive analysis of all the lymph node slides. Our deep learning study attempts to provide a rapid screen for metastasis by analyzing only a small set of image patches to detect changes in tumor environment. METHODS: We designed a convolutional neural network to build a diagnostic model for metastasis detection. We obtained WSIs of Hematoxylin and Eosin-stained slides from 34 cases with equal distribution in positive/negative categories. Two WSIs were selected from each case for a total of 69 WSIs. From each WSI, 40 image patches (100x100 pixels) were obtained to yield 2720 image patches, from which 2160 (79%) were used for training, 240 (9%) for validation, and 320 (12%) for testing. Interobserver variation was also examined among 3 users. RESULTS: The test results showed excellent diagnostic results: accuracy (91.15%), sensitivity (77.92%), and specificity (92.09%). No significant variation in results was observed among the 3 observers. CONCLUSION: This preliminary study provided a proof of concept for conducting a rapid screen for metastasis rather than an exhaustive search for tumors in all fields of all sentinel lymph nodes.