Development of a multi-scanner facility for data acquisition for digital pathology artificial intelligence.

Whole slide imaging (WSI) of pathology glass slides using high-resolution scanners has enabled the large-scale application of artificial intelligence (AI) in pathology, to support the detection and diagnosis of disease, potentially increasing efficiency and accuracy in tissue diagnosis. Despite the promise of AI, it has limitations. 'Brittleness' or sensitivity to variation in inputs necessitates that large amounts of data are used for training. AI is often trained on data from different scanners but not usually by replicating the same slide across scanners. The utilisation of multiple WSI instruments to produce digital replicas of the same slides will make more comprehensive datasets and may improve the robustness and generalisability of AI algorithms as well as reduce the overall data requirements of AI training. To this end, the National Pathology Imaging Cooperative (NPIC) has built the AI FORGE (Facilitating Opportunities for Robust Generalisable data Emulation), a unique multi-scanner facility embedded in a clinical site in the NHS to (1) compare scanner performance, (2) replicate digital pathology image datasets across WSI systems, and (3) support the evaluation of clinical AI algorithms. The NPIC AI FORGE currently comprises 15 scanners from nine manufacturers. It can generate approximately 4,000 WSI images per day (approximately 7 TB of image data). This paper describes the process followed to plan and build such a facility. © 2024 The Author(s). The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Artificial intelligence and medical research databases: ethical review by data access committees.

BACKGROUND: It has been argued that ethics review committees-e.g., Research Ethics Committees, Institutional Review Boards, etc.- have weaknesses in reviewing big data and artificial intelligence research. For instance, they may, due to the novelty of the area, lack the relevant expertise for judging collective risks and benefits of such research, or they may exempt it from review in instances involving de-identified data. MAIN BODY: Focusing on the example of medical research databases we highlight here ethical issues around de-identified data sharing which motivate the need for review where oversight by ethics committees is weak. Though some argue for ethics committee reform to overcome these weaknesses, it is unclear whether or when that will happen. Hence, we argue that ethical review can be done by data access committees, since they have de facto purview of big data and artificial intelligence projects, relevant technical expertise and governance knowledge, and already take on some functions of ethical review. That said, like ethics committees, they may have functional weaknesses in their review capabilities. To strengthen that function, data access committees must think clearly about the kinds of ethical expertise, both professional and lay, that they draw upon to support their work. CONCLUSION: Data access committees can undertake ethical review of medical research databases provided they enhance that review function through professional and lay ethical expertise.

What Works Where and How for Uptake and Impact of Artificial Intelligence in Pathology: Review of Theories for a Realist Evaluation.

BACKGROUND: There is increasing interest in the use of artificial intelligence (AI) in pathology to increase accuracy and efficiency. To date, studies of clinicians' perceptions of AI have found only moderate acceptability, suggesting the need for further research regarding how to integrate it into clinical practice. OBJECTIVE: The aim of the study was to determine contextual factors that may support or constrain the uptake of AI in pathology. METHODS: To go beyond a simple listing of barriers and facilitators, we drew on the approach of realist evaluation and undertook a review of the literature to elicit stakeholders' theories of how, for whom, and in what circumstances AI can provide benefit in pathology. Searches were designed by an information specialist and peer-reviewed by a second information specialist. Searches were run on the arXiv.org repository, MEDLINE, and the Health Management Information Consortium, with additional searches undertaken on a range of websites to identify gray literature. In line with a realist approach, we also made use of relevant theory. Included documents were indexed in NVivo 12, using codes to capture different contexts, mechanisms, and outcomes that could affect the introduction of AI in pathology. Coded data were used to produce narrative summaries of each of the identified contexts, mechanisms, and outcomes, which were then translated into theories in the form of context-mechanism-outcome configurations. RESULTS: A total of 101 relevant documents were identified. Our analysis indicates that the benefits that can be achieved will vary according to the size and nature of the pathology department's workload and the extent to which pathologists work collaboratively; the major perceived benefit for specialist centers is in reducing workload. For uptake of AI, pathologists' trust is essential. Existing theories suggest that if pathologists are able to "make sense" of AI, engage in the adoption process, receive support in adapting their work processes, and can identify potential benefits to its introduction, it is more likely to be accepted. CONCLUSIONS: For uptake of AI in pathology, for all but the most simple quantitative tasks, measures will be required that either increase confidence in the system or provide users with an understanding of the performance of the system. For specialist centers, efforts should focus on reducing workload rather than increasing accuracy. Designers also need to give careful thought to usability and how AI is integrated into pathologists' workflow.

Guidelines for clinical trials using artificial intelligence - SPIRIT-AI and CONSORT-AI†.

The rapidly growing use of artificial intelligence in pathology presents a challenge in terms of study reporting and methodology. The existing guidelines for the design (SPIRIT) and reporting (CONSORT) of clinical trials have been extended with the aim of ensuring production of the highest quality evidence in this field. We explore these new guidelines and their relevance and application to pathology as a specialty. © 2020 The Authors. The Journal of Pathology published by John Wiley & Sons, Ltd. on behalf of The Pathological Society of Great Britain and Ireland.

The human-in-the-loop: an evaluation of pathologists' interaction with artificial intelligence in clinical practice.

AIMS: One of the major drivers of the adoption of digital pathology in clinical practice is the possibility of introducing digital image analysis (DIA) to assist with diagnostic tasks. This offers potential increases in accuracy, reproducibility, and efficiency. Whereas stand-alone DIA has great potential benefit for research, little is known about the effect of DIA assistance in clinical use. The aim of this study was to investigate the clinical use characteristics of a DIA application for Ki67 proliferation assessment. Specifically, the human-in-the-loop interplay between DIA and pathologists was studied. METHODS AND RESULTS: We retrospectively investigated breast cancer Ki67 areas assessed with human-in-the-loop DIA and compared them with visual and automatic approaches. The results, expressed as standard deviation of the error in the Ki67 index, showed that visual estimation ('eyeballing') (14.9 percentage points) performed significantly worse (P < 0.05) than DIA alone (7.2 percentage points) and DIA with human-in-the-loop corrections (6.9 percentage points). At the overall level, no improvement resulting from the addition of human-in-the-loop corrections to the automatic DIA results could be seen. For individual cases, however, human-in-the-loop corrections could address major DIA errors in terms of poor thresholding of faint staining and incorrect tumour-stroma separation. CONCLUSION: The findings indicate that the primary value of human-in-the-loop corrections is to address major weaknesses of a DIA application, rather than fine-tuning the DIA quantifications.

Hepatectomy risk assessment with functional magnetic resonance imaging (HEPARIM).

BACKGROUND: Post hepatectomy liver failure (PHLF) remains a significant risk in patients undergoing curative liver resection for cancer, however currently available PHLF risk prediction investigations are not sufficiently accurate. The Hepatectomy risk assessment with functional magnetic resonance imaging trial (HEPARIM) aims to establish if quantitative MRI biomarkers of liver function & perfusion can be used to more accurately predict PHLF risk and FLR function, measured against indocyanine green (ICG) liver function test. METHODS: HEPARIM is an observational cohort study recruiting patients undergoing liver resection of 2 segments or more, prior to surgery patients will have both Dynamic Gadoxetate-enhanced (DGE) liver MRI and ICG testing. Day one post op ICG testing is repeated and R15 compared to the Gadoxetate Clearance (GC) of the future liver remnant (FLR-GC) as measure by preoperative DGE- MRI which is the primary outcome, and preoperative ICG R15 compared to GC of whole liver (WL-GC) as a secondary outcome. Data will be collected from medical records, biochemistry, pathology and radiology reports and used in a multi-variate analysis to the value of functional MRI and derive multivariant prediction models for future validation. DISCUSSION: If successful, this test will potentially provide an efficient means to quantitatively assess FLR function and PHLF risk enabling surgeons to push boundaries of liver surgery further while maintaining safe practice and thereby offering chance of cure to patients who would previously been deemed inoperable. MRI has the added benefit of already being part of the routine diagnostic pathway and as such would have limited additional burden on patients time or cost to health care systems. (Hepatectomy Risk Assessment With Functional Magnetic Resonance Imaging - Full Text View - ClinicalTrials.gov , n.d.) TRIAL REGISTRATION: ClinicalTrials.gov, ClinicalTrials.gov NCT04705194 - Registered 12th January 2021 - Retrospectively registered.

Histological 3D reconstruction and in vivo lineage tracing of the human endometrium.

Regular menstrual shedding and repair of the endometrial functionalis is unique to humans and higher-order primates. The current consensus postulates endometrial glands to have a single-tubular architecture, where multi-potential stem cells reside in the blind-ending glandular-bases. Utilising fixed samples from patients, we have studied the three-dimensional (3D) micro-architecture of the human endometrium. We demonstrate that some non-branching, single, vertical functionalis glands originate from a complex horizontally interconnecting network of basalis glands. The existence of a multipotent endometrial epithelial stem cell capable of regenerating the entire complement of glandular lineages was demonstrated by in vivo lineage tracing, using naturally occurring somatic mitochondrial DNA mutations as clonal markers. Vertical tracking of mutated clones showed that at least one stem-cell population resides in the basalis glands. These novel findings provide insight into the efficient and scar-less regenerative potential of the human endometrium. © 2020 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of Pathological Society of Great Britain and Ireland.

Proactive Construction of an Annotated Imaging Database for Artificial Intelligence Training.

Artificial intelligence (AI) holds much promise for enabling highly desired imaging diagnostics improvements. One of the most limiting bottlenecks for the development of useful clinical-grade AI models is the lack of training data. One aspect is the large amount of cases needed and another is the necessity of high-quality ground truth annotation. The aim of the project was to establish and describe the construction of a database with substantial amounts of detail-annotated oncology imaging data from pathology and radiology. A specific objective was to be proactive, that is, to support undefined subsequent AI training across a wide range of tasks, such as detection, quantification, segmentation, and classification, which puts particular focus on the quality and generality of the annotations. The main outcome of this project was the database as such, with a collection of labeled image data from breast, ovary, skin, colon, skeleton, and liver. In addition, this effort also served as an exploration of best practices for further scalability of high-quality image collections, and a main contribution of the study was generic lessons learned regarding how to successfully organize efforts to construct medical imaging databases for AI training, summarized as eight guiding principles covering team, process, and execution aspects.

Digital pathology for primary diagnosis of screen-detected breast lesions - experimental data, validation and experience from four centres.

AIM: The rate of deployment of digital pathology (DP) systems for primary diagnosis in the UK is accelerating. The flexibility and resilience of digital versus standard glass slides could be of great benefit in the NHS breast screening programme (NHSBSP). This study aims to document the safety and benefits of DP for preoperative tissue diagnosis of screen-detected breast lesions. METHODS AND RESULTS: Concordance data for glass and digital slides of the same cases from four sites were subjected to detailed concordance-discordance analysis. A literature review of DP in the primary diagnosis of breast lesions is presented, making this the most comprehensive synthesis of digital breast cancer histopathological diagnostic data to date. Detailed concordance analysis of experimental data from two histopathology departments reveals clinical concordance rates for breast biopsies of 96% (216 of 225) and 99.6% (249 of 250). Data from direct comparison validation studies in two histopathology departments, utilising the protocol recommended by the Royal College of Pathologists, found concordance rates for breast histology cases of 99.4% (180 of 181) and 99.0% (887 of 896). An intraobserver variation study for glass versus digital slides for difficult cases from the NHSBSP yielded a kappa statistic of 0.80, indicating excellent agreement. Discordances encountered in the studies most frequently concerned discrepancies in grading attributable to mitotic count-scoring and identification of weddelite. CONCLUSIONS: The experience of four histopathology laboratories and our review of pre-existing literature suggests that DP is safe for the primary diagnosis of NHSBSP breast histology specimens, and does not increase the risk of misclassification.

Digital pathology for the primary diagnosis of breast histopathological specimens: an innovative validation and concordance study on digital pathology validation and training.

AIM: To train and individually validate a group of breast pathologists in specialty-specific digital primary diagnosis by using a novel protocol endorsed by the Royal College of Pathologists' new guideline for digital pathology. The protocol allows early exposure to live digital reporting, in a risk-mitigated environment, and focuses on patient safety and professional development. METHODS AND RESULTS: Three specialty breast pathologists completed training in the use of a digital microscopy system, and were exposed to a training set of 20 challenging cases, designed to help them identify personal digital diagnostic pitfalls. Following this, the three pathologists viewed a total of 694 live, entire breast cases. All primary diagnoses were made on digital slides, with immediate glass slide review and reconciliation before final case sign-out. There was complete clinical concordance between the glass and digital impression of the case in 98.8% of cases. Only 1.2% of cases had a clinically significant difference in diagnosis/prognosis on glass and digital slide reads. All pathologists elected to continue using the digital microscope as the standard for breast histopathology specimens, with deferral to glass for a limited number of clinical/histological scenarios as a safety net. CONCLUSION: Individual training and validation for digital primary diagnosis allows pathologists to develop competence and confidence in their digital diagnostic skills, and aids safe and responsible transition from the light microscope to the digital microscope.

Intratumoral stromal morphometry predicts disease recurrence but not response to 5-fluorouracil-results from the QUASAR trial of colorectal cancer.

AIMS: The biological importance of tumour-associated stroma is becoming increasingly apparent, but its clinical utility remains ill-defined. For stage II/Dukes B colorectal cancer (CRC), clinical biomarkers are urgently required to direct therapeutic options. We report here prognostic/predictive analyses, and molecular associations, of stromal morphometric quantification in the Quick and Simple and Reliable (QUASAR) trial of CRC. METHODS AND RESULTS: Relative proportions of tumour epithelium (PoT) or stroma (PoS) were morphometrically quantified on digitised haematoxylin and eosin (H&E) sections derived from 1800 patients enrolled in QUASAR, which randomised 3239 (91% stage II) CRC patients between adjuvant fluorouracil/folinic acid (FUFA) chemotherapy and observation. The prognostic and predictive values of PoT/PoS measurements were determined by the use of stratified log-rank analyses. A high proportion of tumour stroma (≥50%) was associated with an increased recurrence risk: 31.3% (143/457) recurrence for ≥50% versus 21.9% (294/1343) for <50% [rate ratio (RR) 1.62; 95% confidence interval (CI) 1.30-2.02; P < 0.0001]. Of patients with stromal proportions of ≥65%, 40% (46/115) had recurrent disease within 10 years. The adverse prognostic effect of a high stromal proportion was independent of established prognostic variables, and was maintained in stage II/Dukes B patients (RR 1.62; 95% CI 1.26-2.08; P = 0.0002). KRAS mutation in the presence of a high stromal proportion augmented recurrence risk (RR 2.93; 95% CI 1.87-4.59; P = 0.0005). Stromal morphometry did not predict response to FUFA chemotherapy. CONCLUSIONS: Simple digital morphometry applied to a single representative H&E section identifies CRC patients with a >50% higher risk of disease recurrence. This technique can reliably partition patients into subpopulations with different risks of tumour recurrence in a simple and cost-effective manner. Further prospective validation is warranted.

Quantitative fat and R2* mapping in vivo to measure lipid-rich necrotic core and intraplaque hemorrhage in carotid atherosclerosis.

PURPOSE: The aim of this work was to quantify the extent of lipid-rich necrotic core (LRNC) and intraplaque hemorrhage (IPH) in atherosclerotic plaques. METHODS: Patients scheduled for carotid endarterectomy underwent four-point Dixon and T1-weighted magnetic resonance imaging (MRI) at 3 Tesla. Fat and R2* maps were generated from the Dixon sequence at the acquired spatial resolution of 0.60 × 0.60 × 0.70 mm voxel size. MRI and three-dimensional (3D) histology volumes of plaques were registered. The registration matrix was applied to segmentations denoting LRNC and IPH in 3D histology to split plaque volumes in regions with and without LRNC and IPH. RESULTS: Five patients were included. Regarding volumes of LRNC identified by 3D histology, the average fat fraction by MRI was significantly higher inside LRNC than outside: 12.64 ± 0.2737% versus 9.294 ± 0.1762% (mean ± standard error of the mean [SEM]; P < 0.001). The same was true for IPH identified by 3D histology, R2* inside versus outside IPH was: 71.81 ± 1.276 s-1 versus 56.94 ± 0.9095 s-1 (mean ± SEM; P < 0.001). There was a strong correlation between the cumulative fat and the volume of LRNC from 3D histology (R2 = 0.92) as well as between cumulative R2* and IPH (R2 = 0.94). CONCLUSION: Quantitative mapping of fat and R2* from Dixon MRI reliably quantifies the extent of LRNC and IPH. Magn Reson Med 78:285-296, 2017. © 2016 International Society for Magnetic Resonance in Medicine.

Digital pathology in clinical use: where are we now and what is holding us back?

Whole slide imaging is being used increasingly in research applications and in frozen section, consultation and external quality assurance practice. Digital pathology, when integrated with other digital tools such as barcoding, specimen tracking and digital dictation, can be integrated into the histopathology workflow, from specimen accession to report sign-out. These elements can bring about improvements in the safety, quality and efficiency of a histopathology department. The present paper reviews the evidence for these benefits. We then discuss the challenges of implementing a fully digital pathology workflow, including the regulatory environment, validation of whole slide imaging and the evidence for the design of a digital pathology workstation.

Colour in digital pathology: a review.

Colour is central to the practice of pathology because of the use of coloured histochemical and immunohistochemical stains to visualize tissue features. Our reliance upon histochemical stains and light microscopy has evolved alongside a wide variation in slide colour, with little investigation into the implications of colour variation. However, the introduction of the digital microscope and whole-slide imaging has highlighted the need for further understanding and control of colour. This is because the digitization process itself introduces further colour variation which may affect diagnosis, and image analysis algorithms often use colour or intensity measures to detect or measure tissue features. The US Food and Drug Administration have released recent guidance stating the need to develop a method of controlling colour reproduction throughout the digitization process in whole-slide imaging for primary diagnostic use. This comprehensive review introduces applied basic colour physics and colour interpretation by the human visual system, before discussing the importance of colour in pathology. The process of colour calibration and its application to pathology are also included, as well as a summary of the current guidelines and recommendations regarding colour in digital pathology.

Three-dimensional reconstruction of ductal carcinoma in situ with virtual slides.

AIMS: This study aimed to assess the feasibility of using virtual slides to create 3D histopathological reconstructions to aid in the study of the biology of DCIS. METHODS: Four µm thick serial sections of formalin fixed paraffin embedded tissue from three cases were cut and mounted onto glass slides, stained with haematoxylin and eosin, then scanned. The three image stacks comprised 30, 115 and 100 scanned sections creating a similar number of virtual slides. The virtual slides were registered using custom 3D software to create 3D tissue volumes. The volumes were annotated to highlight distinct features and 3D visualisations (segmentations) were created to study these features in 3D. RESULTS: The most time-intensive step was the manual annotation of virtual slides 3D histopathological reconstructions were created of (i) DCIS surrounded by adjacent invasion; (ii) pure DCIS and (iii) a 'normal' lobule. CONCLUSION: 3D in silico reconstructions of DCIS were created and more extensive studies can now be done within a realistic timescale. We have identified structural similarities between a benign lobule and DCIS which support the view that much DCIS, apparently in a 'duct' is contained within and expanded lobule. This method has the potential to provide insights into the biology of DCIS.

New insights into the lymphovascular microanatomy of the colon and the risk of metastases in pT1 colorectal cancer obtained with quantitative methods and three-dimensional digital reconstruction.

AIMS: UK faecal occult blood test screening has tripled the proportion of pT1 colorectal cancers. The risk of metastasis is predicted by depth of invasion, suggesting that access to deep lymphovascular vessels is important. The aim of this study was to quantify the distribution and size of the submucosal vasculature, and generate a novel three-dimensional (3D) model to validate the findings. METHODS AND RESULTS: Thirty samples of normal large bowel wall were immunostained with CD31, a vascular endothelium marker, to identify blood vessels, which were quantified and digitally analysed for their number, circumference, area and diameter in the deep mucosa and submucosa (Sm1, Sm2, and Sm3). The model required serial sections, a double immunostain (using CD31 and D2-40), and 3D reconstruction. Significant differences were shown between submucosal layers in the number, circumference and area of vessels (P < 0.001). Blood vessels were most numerous in the mucosa (11.79 vessels/0.2 mm(2)) but smaller [median area of 247 µm(2) , interquartile range (IQR) 162-373 µm(2)] than in Sm2, where they were fewer in number (6.92 vessels/0.2 mm(2)) but considerably larger (2086 µm(2), IQR 1007-4784 µm(2)). The 3D model generated novel observations on lymphovascular structures. CONCLUSIONS: The number and size of blood vessels do not increase with depth of submucosa, as hypothesized. The distribution of vessels suggests that we should investigate the area or volume of submucosal invasion rather than the depth.

Effect of display resolution on time to diagnosis with virtual pathology slides in a systematic search task.

Performing diagnoses using virtual slides can take pathologists significantly longer than with glass slides, presenting a significant barrier to the use of virtual slides in routine practice. Given the benefits in pathology workflow efficiency and safety that virtual slides promise, it is important to understand reasons for this difference and identify opportunities for improvement. The effect of display resolution on time to diagnosis with virtual slides has not previously been explored. The aim of this study was to assess the effect of display resolution on time to diagnosis with virtual slides. Nine pathologists participated in a counterbalanced crossover study, viewing axillary lymph node slides on a microscope, a 23-in 2.3-megapixel single-screen display and a three-screen 11-megapixel display consisting of three 27-in displays. Time to diagnosis and time to first target were faster on the microscope than on the single and three-screen displays. There was no significant difference between the microscope and the three-screen display in time to first target, while the time taken on the single-screen display was significantly higher than that on the microscope. The results suggest that a digital pathology workstation with an increased number of pixels may make it easier to identify where cancer is located in the initial slide overview, enabling quick location of diagnostically relevant regions of interest. However, when a comprehensive, detailed search of a slide has to be made, increased resolution may not offer any additional benefit.

Consistency and standardization of color in medical imaging: a consensus report.

This article summarizes the consensus reached at the Summit on Color in Medical Imaging held at the Food and Drug Administration (FDA) on May 8-9, 2013, co-sponsored by the FDA and ICC (International Color Consortium). The purpose of the meeting was to gather information on how color is currently handled by medical imaging systems to identify areas where there is a need for improvement, to define objective requirements, and to facilitate consensus development of best practices. Participants were asked to identify areas of concern and unmet needs. This summary documents the topics that were discussed at the meeting and recommendations that were made by the participants. Key areas identified where improvements in color would provide immediate tangible benefits were those of digital microscopy, telemedicine, medical photography (particularly ophthalmic and dental photography), and display calibration. Work in these and other related areas has been started within several professional groups, including the creation of the ICC Medical Imaging Working Group.

3-D tissue modelling and virtual pathology as new approaches to study ductal carcinoma in situ.

Widespread screening mammography programmes mean that ductal carcinoma in situ (DCIS), a pre-invasive breast lesion, is now more frequently diagnosed. However, not all diagnosed DCIS lesions progress to invasive breast cancer, which presents a dilemma for clinicians. As such, there is much interest in studying DCIS in the laboratory, in order to help understand more about its biology and determine the characteristics of those that progress to invasion. Greater knowledge would lead to targeted and better DCIS treatment. Here, we outline some of the models available to study DCIS, with a particular focus on animal-free systems.