Multiscale Optical Imaging Fusion for Cervical Precancer Diagnosis: Integrating Widefield Colposcopy and High-Resolution Endomicroscopy.

OBJECTIVE: Early detection and treatment of cervical precancers can prevent disease progression. However, in low-resource communities with a high incidence of cervical cancer, high equipment costs and a shortage of specialists hinder preventative strategies. This manuscript presents a low-cost multiscale in vivo optical imaging system coupled with a computer-aided diagnostic system that could enable accurate, real-time diagnosis of high-grade cervical precancers. METHODS: The system combines portable colposcopy and high-resolution endomicroscopy (HRME) to acquire spatially registered widefield and microscopy videos. A multiscale imaging fusion network (MSFN) was developed to identify cervical intraepithelial neoplasia grade 2 or more severe (CIN 2+). The MSFN automatically identifies and segments the ectocervix and lesions from colposcopy images, extracts nuclear morphology features from HRME videos, and integrates the colposcopy and HRME information. RESULTS: With a threshold value set to achieve sensitivity equal to clinical impression (0.98 [p = 1.0]), the MSFN achieved a significantly higher specificity than clinical impression (0.75 vs. 0.43, p = 0.000006). CONCLUSION: Our findings show that multiscale optical imaging of the cervix allows the highly sensitive and specific detection of high-grade precancers. SIGNIFICANCE: The multiscale imaging system and MSFN could facilitate the accurate, real-time diagnosis of cervical precancers in low-resource settings.

Deployment and assessment of a deep learning model for real-time detection of anal precancer with high frame rate high-resolution microendoscopy.

Anal cancer incidence is significantly higher in people living with HIV as HIV increases the oncogenic potential of human papillomavirus. The incidence of anal cancer in the United States has recently increased, with diagnosis and treatment hampered by high loss-to-follow-up rates. Novel methods for the automated, real-time diagnosis of AIN 2+ could enable "see and treat" strategies, reducing loss-to-follow-up rates. A previous retrospective study demonstrated that the accuracy of a high-resolution microendoscope (HRME) coupled with a deep learning model was comparable to expert clinical impression for diagnosis of AIN 2+ (sensitivity 0.92 [P = 0.68] and specificity 0.60 [P = 0.48]). However, motion artifacts and noise led to many images failing quality control (17%). Here, we present a high frame rate HRME (HF-HRME) with improved image quality, deployed in the clinic alongside a deep learning model and evaluated prospectively for detection of AIN 2+ in real-time. The HF-HRME reduced the fraction of images failing quality control to 4.6% by employing a high frame rate camera that enhances contrast and limits motion artifacts. The HF-HRME outperformed the previous HRME (P < 0.001) and clinical impression (P < 0.0001) in the detection of histopathologically confirmed AIN 2+ with a sensitivity of 0.91 and specificity of 0.87.

Multimodal optical imaging with real-time projection of cancer risk and biopsy guidance maps for early oral cancer diagnosis and treatment.

Significance: Despite recent advances in multimodal optical imaging, oral imaging systems often do not provide real-time actionable guidance to the clinician who is making biopsy and treatment decisions. Aim: We demonstrate a low-cost, portable active biopsy guidance system (ABGS) that uses multimodal optical imaging with deep learning to directly project cancer risk and biopsy guidance maps onto oral mucosa in real time. Approach: Cancer risk maps are generated based on widefield autofluorescence images and projected onto the at-risk tissue using a digital light projector. Microendoscopy images are obtained from at-risk areas, and multimodal image data are used to calculate a biopsy guidance map, which is projected onto tissue. Results: Representative patient examples highlight clinically actionable visualizations provided in real time during an imaging procedure. Results show multimodal imaging with cancer risk and biopsy guidance map projection offers a versatile, quantitative, and precise tool to guide biopsy site selection and improve early detection of oral cancers. Conclusions: The ABGS provides direct visible guidance to identify early lesions and locate appropriate sites to biopsy within those lesions. This represents an opportunity to translate multimodal imaging into real-time clinically actionable visualizations to help improve patient outcomes.

Development of a multimodal mobile colposcope for real-time cervical cancer detection.

Cervical cancer remains a leading cause of cancer death among women in low-and middle-income countries. Globally, cervical cancer prevention programs are hampered by a lack of resources, infrastructure, and personnel. We describe a multimodal mobile colposcope (MMC) designed to diagnose precancerous cervical lesions at the point-of-care without the need for biopsy. The MMC integrates two complementary imaging systems: 1) a commercially available colposcope and 2) a high speed, high-resolution, fiber-optic microendoscope (HRME). Combining these two image modalities allows, for the first time, the ability to locate suspicious cervical lesions using widefield imaging and then to obtain co-registered high-resolution images across an entire lesion. The MMC overcomes limitations of high-resolution imaging alone; widefield imaging can be used to guide the placement of the high-resolution imaging probe at clinically suspicious regions and co-registered, mosaicked high-resolution images effectively increase the field of view of high-resolution imaging. Representative data collected from patients referred for colposcopy at Barretos Cancer Hospital in Brazil, including 22,800 high resolution images and 9,900 colposcope images, illustrate the ability of the MMC to identify abnormal cervical regions, image suspicious areas with subcellular resolution, and distinguish between high-grade and low-grade dysplasia.

High frame rate video mosaicking microendoscope to image large regions of intact tissue with subcellular resolution.

High-resolution microendoscopy (HRME) is a low-cost strategy to acquire images of intact tissue with subcellular resolution at frame rates ranging from 11 to 18 fps. Current HRME imaging strategies are limited by the small microendoscope field of view (∼0.5 mm2); multiple images must be acquired and reliably registered to assess large regions of clinical interest. Image mosaics have been assembled from co-registered frames of video acquired as a microendoscope is slowly moved across the tissue surface, but the slow frame rate of previous HRME systems made this approach impractical for acquiring quality mosaicked images from large regions of interest. Here, we present a novel video mosaicking microendoscope incorporating a high frame rate CMOS sensor and optical probe holder to enable high-speed, high quality interrogation of large tissue regions of interest. Microendoscopy videos acquired at >90 fps are assembled into an image mosaic. We assessed registration accuracy and image sharpness across the mosaic for images acquired with a handheld probe over a range of translational speeds. This high frame rate video mosaicking microendoscope enables in vivo probe translation at >15 millimeters per second while preserving high image quality and accurate mosaicking, increasing the size of the region of interest that can be interrogated at high resolution from 0.5 mm2 to >30 mm2. Real-time deployment of this high-frame rate system is demonstrated in vivo and source code made publicly available.

Open-Source Miniature Fluorimeter to Monitor Real-Time Isothermal Nucleic Acid Amplification Reactions in Resource-Limited Settings.

Traditional methods to detect and quantify nucleic acids rely on polymerase chain reaction (PCR) and require the use of expensive thermocyclers with integrated fluorescence detection of amplicons. Isothermal nucleic acid amplification technologies eliminate the need for thermal cycling; however, fluorescence-based detection of products is still required for real-time, quantitative results. Several portable isothermal heaters with integrated fluorescence detection are now commercially available; however, the cost of these devices remains a significant barrier to widespread adoption in resource-limited settings. Described here is a protocol for the design and assembly of a modular, low-cost fluorimeter constructed from off-the-shelf components. Enclosed in a compact 3D printed housing, the fluorimeter is designed to be placed atop a commercially available heat block holding a PCR tube. The fluorimeter described here was optimized to detect fluorescein isothiocyanate (FITC) dye, but the system can be modified for use with dyes commonly used as reporters in real-time nucleic acid amplification reactions. Clinical applicability of the system is demonstrated by performing real-time nucleic acid detection with two isothermal amplification technologies: recombinase polymerase amplification (RPA) for detection of positive control DNA provided in a commercial kit and reverse transcription loop-mediated isothermal amplification (RT-LAMP) for detection of clinically meaningful levels of SARS-CoV-2 RNA.

Initial Results of First In Vivo Imaging of Bladder Lesions Using a High-Resolution Confocal Microendoscope.

Purpose: Conventional cystoscopy plays an important role in detection of bladder cancer; however, it is difficult to differentiate benign and neoplastic lesions based on cystoscopic appearance alone. Advanced microscopic modalities, such as confocal laser endomicroscopy and optical coherence tomography, have been shown to provide critical histopathologic information to help identify neoplastic bladder lesions in real time, but their availability and clinical adoption are limited due to a high cost. In this study, we present the first use of a novel and low-cost ($ <5000) confocal high-resolution microendoscope (confocal HRME) for in vivo imaging of bladder lesions. Materials and Methods: In a cohort of 15 patients undergoing white light cystoscopy as part of their standard of care, high-resolution images of proflavine-stained bladder lesions were acquired in vivo using the confocal HRME. Based on these images, we evaluated the ability of the confocal HRME to visualize uroepithelium with subcellular resolution and high contrast. Furthermore, we analyzed the cellular architecture and staining patterns of benign and neoplastic bladder lesions in confocal HRME images and compared results to that of standard cystoscopy and histopathology. Results:In vivo imaging in the pilot study demonstrates that the confocal HRME resolved subcellular structures of bladder uroepithelium with high contrast. In a wide range of clinical conditions from normal bladder wall to benign and neoplastic lesions, confocal HRME images revealed important diagnostic features that correlated to histopathology. Conclusions: The confocal HRME provides an affordable, portable, and easy-to-use tool to allow real-time and high-contrast subcellular characterization of bladder lesions, well suited for bladder cancer detection in community and resource-constrained settings. The ClinicalTrials.gov Identifier: NCT02340650.

Algorithm to quantify nuclear features and confidence intervals for classification of oral neoplasia from high-resolution optical images.

Purpose: In vivo optical imaging technologies like high-resolution microendoscopy (HRME) can image nuclei of the oral epithelium. In principle, automated algorithms can then calculate nuclear features to distinguish neoplastic from benign tissue. However, images frequently contain regions without visible nuclei, due to biological and technical factors, decreasing the data available to and accuracy of image analysis algorithms. Approach: We developed the nuclear density-confidence interval (ND-CI) algorithm to determine if an HRME image contains sufficient nuclei for classification, or if a better image is required. The algorithm uses a convolutional neural network to exclude image regions without visible nuclei. Then the remaining regions are used to estimate a confidence interval (CI) for the number of abnormal nuclei per mm 2 , a feature used by a previously developed algorithm (called the ND algorithm), to classify images as benign or neoplastic. The range of the CI determines whether the ND-CI algorithm can classify an image with confidence, and if so, the predicted category. The ND and ND-CI algorithm were compared by calculating their positive predictive value (PPV) and negative predictive value (NPV) on 82 oral biopsies with histopathologically confirmed diagnoses. Results: After excluding the images that could not be classified with confidence, the ND-CI algorithm had higher PPV (65% versus 59%) and NPV (78% versus 75%) than the ND algorithm. Conclusions: The ND-CI algorithm could improve the real-time classification of HRME images of the oral epithelium by informing the user if an improved image is required for diagnosis.

In vivo imaging of cervical precancer using a low-cost and easy-to-use confocal microendoscope.

Cervical cancer incidence and mortality rates remain high in medically underserved areas. In this study, we present a low-cost (<$5,000), portable and user-friendly confocal microendoscope, and we report on its clinical use to image precancerous lesions in the cervix. The confocal microendoscope employs digital apertures on a digital light projector and a CMOS sensor to implement line-scanning confocal imaging. Leveraging its versatile programmability, we describe an automated aperture alignment algorithm to ensure clinical ease-of-use and to facilitate technology dissemination in low-resource settings. Imaging performance is then evaluated in ex vivo and in vivo pilot studies; results demonstrate that the confocal microendoscope can enhance visualization of nuclear morphology, contributing to significantly improved recognition of clinically important features for detection of cervical precancer.

Prospective evaluation of oral premalignant lesions using a multimodal imaging system: a pilot study.

BACKGROUND: Multimodal optical imaging, incorporating reflectance and fluorescence modalities, is a promising tool to detect oral premalignant lesions in real-time. METHODS: Images were acquired from 171 sites in 66 patient visits for clinical evaluation of oral lesions. An automated algorithm was used to classify lesions as high- or low-risk for neoplasia. Biopsies were acquired at clinically indicated sites and those classified as high-risk by imaging, at the surgeon's discretion. RESULTS: Twenty sites were biopsied based on clinical examination or imaging. Of these, 12 were indicated clinically and by imaging; 58% were moderate dysplasia or worse. Four biopsies were indicated by imaging evaluation only; 75% were moderate dysplasia or worse. Finally, four biopsies were indicated by clinical evaluation only; 75% were moderate dysplasia or worse. CONCLUSION: Multimodal imaging identified more cases of high-grade dysplasia than clinical evaluation, and can improve detection of high grade precancer in patients with oral lesions.

Simple differential digital confocal aperture to improve axial response of line-scanning confocal microendoscopes.

Line-scanning confocal microendoscopy offers video-rate cellular imaging of scattering tissue with relatively simple hardware, but its axial response is inferior to that of point-scanning systems. Based on Fourier optics theory, we designed differential confocal apertures with a simple subtraction technique to improve the line-scanning sectioning performance. Taking advantage of digital slit apertures on a digital light projector and a CMOS rolling shutter, we demonstrate real-time optical sectioning performance comparable to point scanning in a dual-camera microendoscope (<$6,000). We validate the background rejection capability when imaging porcine columnar epithelium stained with fluorescent contrast agents with different uptake mechanisms and staining properties.

Autofluorescence Imaging to Monitor the Progression of Oral Potentially Malignant Disorders.

Patients with oral potentially malignant disorders (OPMD) must undergo regular clinical surveillance to ensure that any progression to malignancy is detected promptly. Autofluorescence imaging (AFI) is an optical modality that can assist clinicians in detecting early cancers and high-grade dysplasia. Patients with OPMD undergoing surveillance for the development of oral cancer were examined using AFI at successive clinic visits. Autofluorescence images acquired at 133 clinical visits from sites in 15 patients who met inclusion criteria were analyzed quantitatively using an algorithm to calculate the red-to-green pixel intensity (RG ratio). A quantitative AFI threshold for high risk of progression was defined based on the RG ratio and was compared with expert clinical impression and with histopathology when available. Patients were divided into two groups based on their endpoint: surveillance (n = 6) or surgery (n = 9). In the surveillance group, 0 of 6 (0%) of patients were clinically identified as high risk for progression prior to the study endpoint, whereas 1 of 6 (17%) of patients were deemed at high risk for progression based on AFI during the same time period. In the surgery group, 9 of 9 (100%) of patients were clinically identified as high risk prior to the study endpoint, whereas 8 of 9 (89%) of patients were at high risk for progression based on AFI during the same time period. AFI results tracked over time were comparable with expert clinical impression in these patient groups. AFI has the potential to aid clinicians in noninvasively monitoring oral precancer and evaluating OPMDs that require increased surveillance.

Improving nuclear morphometry imaging with real-time and low-cost line-scanning confocal microendoscope.

Fiber-optic endomicroscopy is a minimally invasive tool to probe disease progression with subcellular resolution. In this Letter, we demonstrate a low-cost and compact fluorescence microendoscope capable of line-scanning confocal imaging by synchronizing a digital light projector with a CMOS camera. We present the digital aperture design to enable real-time confocal imaging, and we implement parallel illumination to improve the optical sectioning performance. Furthermore, we show that the confocal microendoscope can enhance visualization of disease-associated features when imaging highly scattering esophageal specimens.

Development of an integrated multimodal optical imaging system with real-time image analysis for the evaluation of oral premalignant lesions.

Oral premalignant lesions (OPLs), such as leukoplakia, are at risk of malignant transformation to oral cancer. Clinicians can elect to biopsy OPLs and assess them for dysplasia, a marker of increased risk. However, it is challenging to decide which OPLs need a biopsy and to select a biopsy site. We developed a multimodal optical imaging system (MMIS) that fully integrates the acquisition, display, and analysis of macroscopic white-light (WL), autofluorescence (AF), and high-resolution microendoscopy (HRME) images to noninvasively evaluate OPLs. WL and AF images identify suspicious regions with high sensitivity, which are explored at higher resolution with the HRME to improve specificity. Key features include a heat map that delineates suspicious regions according to AF images, and real-time image analysis algorithms that predict pathologic diagnosis at imaged sites. Representative examples from ongoing studies of the MMIS demonstrate its ability to identify high-grade dysplasia in OPLs that are not clinically suspicious, and to avoid unnecessary biopsies of benign OPLs that are clinically suspicious. The MMIS successfully integrates optical imaging approaches (WL, AF, and HRME) at multiple scales for the noninvasive evaluation of OPLs.

In Vivo Multimodal Optical Imaging: Improved Detection of Oral Dysplasia in Low-Risk Oral Mucosal Lesions.

Early detection of oral cancer and oral premalignant lesions (OPL) containing dysplasia could improve oral cancer outcomes. However, general dental practitioners have difficulty distinguishing dysplastic OPLs from confounder oral mucosal lesions in low-risk populations. We evaluated the ability of two optical imaging technologies, autofluorescence imaging (AFI) and high-resolution microendoscopy (HRME), to diagnose moderate dysplasia or worse (ModDys+) in 56 oral mucosal lesions in a low-risk patient population, using histopathology as the gold standard, and in 46 clinically normal sites. AFI correctly diagnosed 91% of ModDys+ lesions, 89% of clinically normal sites, and 33% of benign lesions. Benign lesions with severe inflammation were less likely to be correctly diagnosed by AFI (13%) than those without (42%). Multimodal imaging (AFI+HRME) had higher accuracy than either modality alone; 91% of ModDys+ lesions, 93% of clinically normal sites, and 64% of benign lesions were correctly diagnosed. Photos of the 56 lesions were evaluated by 28 dentists of varied training levels, including 26 dental residents. We compared the area under the receiver operator curve (AUC) of clinical impression alone to clinical impression plus AFI and clinical impression plus multimodal imaging using k-Nearest Neighbors models. The mean AUC of the dental residents was 0.71 (range: 0.45-0.86). The addition of AFI alone to clinical impression slightly lowered the mean AUC (0.68; range: 0.40-0.82), whereas the addition of multimodal imaging to clinical impression increased the mean AUC (0.79; range: 0.61-0.90). On the basis of these findings, multimodal imaging could improve the evaluation of oral mucosal lesions in community dental settings. Cancer Prev Res; 11(8); 465-76. ©2018 AACR.