DeepDOF-SE: affordable deep-learning microscopy platform for slide-free histology.

Histopathology plays a critical role in the diagnosis and surgical management of cancer. However, access to histopathology services, especially frozen section pathology during surgery, is limited in resource-constrained settings because preparing slides from resected tissue is time-consuming, labor-intensive, and requires expensive infrastructure. Here, we report a deep-learning-enabled microscope, named DeepDOF-SE, to rapidly scan intact tissue at cellular resolution without the need for physical sectioning. Three key features jointly make DeepDOF-SE practical. First, tissue specimens are stained directly with inexpensive vital fluorescent dyes and optically sectioned with ultra-violet excitation that localizes fluorescent emission to a thin surface layer. Second, a deep-learning algorithm extends the depth-of-field, allowing rapid acquisition of in-focus images from large areas of tissue even when the tissue surface is highly irregular. Finally, a semi-supervised generative adversarial network virtually stains DeepDOF-SE fluorescence images with hematoxylin-and-eosin appearance, facilitating image interpretation by pathologists without significant additional training. We developed the DeepDOF-SE platform using a data-driven approach and validated its performance by imaging surgical resections of suspected oral tumors. Our results show that DeepDOF-SE provides histological information of diagnostic importance, offering a rapid and affordable slide-free histology platform for intraoperative tumor margin assessment and in low-resource settings.

Multimodal optical imaging with real-time projection of cancer risk and biopsy guidance maps for early oral cancer diagnosis and treatment.

Significance: Despite recent advances in multimodal optical imaging, oral imaging systems often do not provide real-time actionable guidance to the clinician who is making biopsy and treatment decisions. Aim: We demonstrate a low-cost, portable active biopsy guidance system (ABGS) that uses multimodal optical imaging with deep learning to directly project cancer risk and biopsy guidance maps onto oral mucosa in real time. Approach: Cancer risk maps are generated based on widefield autofluorescence images and projected onto the at-risk tissue using a digital light projector. Microendoscopy images are obtained from at-risk areas, and multimodal image data are used to calculate a biopsy guidance map, which is projected onto tissue. Results: Representative patient examples highlight clinically actionable visualizations provided in real time during an imaging procedure. Results show multimodal imaging with cancer risk and biopsy guidance map projection offers a versatile, quantitative, and precise tool to guide biopsy site selection and improve early detection of oral cancers. Conclusions: The ABGS provides direct visible guidance to identify early lesions and locate appropriate sites to biopsy within those lesions. This represents an opportunity to translate multimodal imaging into real-time clinically actionable visualizations to help improve patient outcomes.

Deep learning extended depth-of-field microscope for fast and slide-free histology.

Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells-a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.

Prospective evaluation of oral premalignant lesions using a multimodal imaging system: a pilot study.

BACKGROUND: Multimodal optical imaging, incorporating reflectance and fluorescence modalities, is a promising tool to detect oral premalignant lesions in real-time. METHODS: Images were acquired from 171 sites in 66 patient visits for clinical evaluation of oral lesions. An automated algorithm was used to classify lesions as high- or low-risk for neoplasia. Biopsies were acquired at clinically indicated sites and those classified as high-risk by imaging, at the surgeon's discretion. RESULTS: Twenty sites were biopsied based on clinical examination or imaging. Of these, 12 were indicated clinically and by imaging; 58% were moderate dysplasia or worse. Four biopsies were indicated by imaging evaluation only; 75% were moderate dysplasia or worse. Finally, four biopsies were indicated by clinical evaluation only; 75% were moderate dysplasia or worse. CONCLUSION: Multimodal imaging identified more cases of high-grade dysplasia than clinical evaluation, and can improve detection of high grade precancer in patients with oral lesions.

Autofluorescence Imaging to Monitor the Progression of Oral Potentially Malignant Disorders.

Patients with oral potentially malignant disorders (OPMD) must undergo regular clinical surveillance to ensure that any progression to malignancy is detected promptly. Autofluorescence imaging (AFI) is an optical modality that can assist clinicians in detecting early cancers and high-grade dysplasia. Patients with OPMD undergoing surveillance for the development of oral cancer were examined using AFI at successive clinic visits. Autofluorescence images acquired at 133 clinical visits from sites in 15 patients who met inclusion criteria were analyzed quantitatively using an algorithm to calculate the red-to-green pixel intensity (RG ratio). A quantitative AFI threshold for high risk of progression was defined based on the RG ratio and was compared with expert clinical impression and with histopathology when available. Patients were divided into two groups based on their endpoint: surveillance (n = 6) or surgery (n = 9). In the surveillance group, 0 of 6 (0%) of patients were clinically identified as high risk for progression prior to the study endpoint, whereas 1 of 6 (17%) of patients were deemed at high risk for progression based on AFI during the same time period. In the surgery group, 9 of 9 (100%) of patients were clinically identified as high risk prior to the study endpoint, whereas 8 of 9 (89%) of patients were at high risk for progression based on AFI during the same time period. AFI results tracked over time were comparable with expert clinical impression in these patient groups. AFI has the potential to aid clinicians in noninvasively monitoring oral precancer and evaluating OPMDs that require increased surveillance.

Development of an integrated multimodal optical imaging system with real-time image analysis for the evaluation of oral premalignant lesions.

Oral premalignant lesions (OPLs), such as leukoplakia, are at risk of malignant transformation to oral cancer. Clinicians can elect to biopsy OPLs and assess them for dysplasia, a marker of increased risk. However, it is challenging to decide which OPLs need a biopsy and to select a biopsy site. We developed a multimodal optical imaging system (MMIS) that fully integrates the acquisition, display, and analysis of macroscopic white-light (WL), autofluorescence (AF), and high-resolution microendoscopy (HRME) images to noninvasively evaluate OPLs. WL and AF images identify suspicious regions with high sensitivity, which are explored at higher resolution with the HRME to improve specificity. Key features include a heat map that delineates suspicious regions according to AF images, and real-time image analysis algorithms that predict pathologic diagnosis at imaged sites. Representative examples from ongoing studies of the MMIS demonstrate its ability to identify high-grade dysplasia in OPLs that are not clinically suspicious, and to avoid unnecessary biopsies of benign OPLs that are clinically suspicious. The MMIS successfully integrates optical imaging approaches (WL, AF, and HRME) at multiple scales for the noninvasive evaluation of OPLs.

In Vivo Multimodal Optical Imaging: Improved Detection of Oral Dysplasia in Low-Risk Oral Mucosal Lesions.

Early detection of oral cancer and oral premalignant lesions (OPL) containing dysplasia could improve oral cancer outcomes. However, general dental practitioners have difficulty distinguishing dysplastic OPLs from confounder oral mucosal lesions in low-risk populations. We evaluated the ability of two optical imaging technologies, autofluorescence imaging (AFI) and high-resolution microendoscopy (HRME), to diagnose moderate dysplasia or worse (ModDys+) in 56 oral mucosal lesions in a low-risk patient population, using histopathology as the gold standard, and in 46 clinically normal sites. AFI correctly diagnosed 91% of ModDys+ lesions, 89% of clinically normal sites, and 33% of benign lesions. Benign lesions with severe inflammation were less likely to be correctly diagnosed by AFI (13%) than those without (42%). Multimodal imaging (AFI+HRME) had higher accuracy than either modality alone; 91% of ModDys+ lesions, 93% of clinically normal sites, and 64% of benign lesions were correctly diagnosed. Photos of the 56 lesions were evaluated by 28 dentists of varied training levels, including 26 dental residents. We compared the area under the receiver operator curve (AUC) of clinical impression alone to clinical impression plus AFI and clinical impression plus multimodal imaging using k-Nearest Neighbors models. The mean AUC of the dental residents was 0.71 (range: 0.45-0.86). The addition of AFI alone to clinical impression slightly lowered the mean AUC (0.68; range: 0.40-0.82), whereas the addition of multimodal imaging to clinical impression increased the mean AUC (0.79; range: 0.61-0.90). On the basis of these findings, multimodal imaging could improve the evaluation of oral mucosal lesions in community dental settings. Cancer Prev Res; 11(8); 465-76. ©2018 AACR.