Multimodal optical imaging with real-time projection of cancer risk and biopsy guidance maps for early oral cancer diagnosis and treatment.

Significance: Despite recent advances in multimodal optical imaging, oral imaging systems often do not provide real-time actionable guidance to the clinician who is making biopsy and treatment decisions. Aim: We demonstrate a low-cost, portable active biopsy guidance system (ABGS) that uses multimodal optical imaging with deep learning to directly project cancer risk and biopsy guidance maps onto oral mucosa in real time. Approach: Cancer risk maps are generated based on widefield autofluorescence images and projected onto the at-risk tissue using a digital light projector. Microendoscopy images are obtained from at-risk areas, and multimodal image data are used to calculate a biopsy guidance map, which is projected onto tissue. Results: Representative patient examples highlight clinically actionable visualizations provided in real time during an imaging procedure. Results show multimodal imaging with cancer risk and biopsy guidance map projection offers a versatile, quantitative, and precise tool to guide biopsy site selection and improve early detection of oral cancers. Conclusions: The ABGS provides direct visible guidance to identify early lesions and locate appropriate sites to biopsy within those lesions. This represents an opportunity to translate multimodal imaging into real-time clinically actionable visualizations to help improve patient outcomes.

Optical imaging technologies for in vivo cancer detection in low-resource settings.

Cancer continues to affect underserved populations disproportionately. Novel optical imaging technologies, which can provide rapid, non-invasive, and accurate cancer detection at the point of care, have great potential to improve global cancer care. This article reviews the recent technical innovations and clinical translation of low-cost optical imaging technologies, highlighting the advances in both hardware and software, especially the integration of artificial intelligence, to improve in vivo cancer detection in low-resource settings. Additionally, this article provides an overview of existing challenges and future perspectives of adapting optical imaging technologies into clinical practice, which can potentially contribute to novel insights and programs that effectively improve cancer detection in low-resource settings.

High frame rate video mosaicking microendoscope to image large regions of intact tissue with subcellular resolution.

High-resolution microendoscopy (HRME) is a low-cost strategy to acquire images of intact tissue with subcellular resolution at frame rates ranging from 11 to 18 fps. Current HRME imaging strategies are limited by the small microendoscope field of view (∼0.5 mm2); multiple images must be acquired and reliably registered to assess large regions of clinical interest. Image mosaics have been assembled from co-registered frames of video acquired as a microendoscope is slowly moved across the tissue surface, but the slow frame rate of previous HRME systems made this approach impractical for acquiring quality mosaicked images from large regions of interest. Here, we present a novel video mosaicking microendoscope incorporating a high frame rate CMOS sensor and optical probe holder to enable high-speed, high quality interrogation of large tissue regions of interest. Microendoscopy videos acquired at >90 fps are assembled into an image mosaic. We assessed registration accuracy and image sharpness across the mosaic for images acquired with a handheld probe over a range of translational speeds. This high frame rate video mosaicking microendoscope enables in vivo probe translation at >15 millimeters per second while preserving high image quality and accurate mosaicking, increasing the size of the region of interest that can be interrogated at high resolution from 0.5 mm2 to >30 mm2. Real-time deployment of this high-frame rate system is demonstrated in vivo and source code made publicly available.

A Chest-Laminated Ultrathin and Stretchable E-Tattoo for the Measurement of Electrocardiogram, Seismocardiogram, and Cardiac Time Intervals.

Seismocardiography (SCG) is a measure of chest vibration associated with heartbeats. While skin soft electronic tattoos (e-tattoos) have been widely reported for electrocardiogram (ECG) sensing, wearable SCG sensors are still based on either rigid accelerometers or non-stretchable piezoelectric membranes. This work reports an ultrathin and stretchable SCG sensing e-tattoo based on the filamentary serpentine mesh of 28-µm-thick piezoelectric polymer, polyvinylidene fluoride (PVDF). 3D digital image correlation (DIC) is used to map chest vibration to identify the best location to mount the e-tattoo and to investigate the effects of substrate stiffness. As piezoelectric sensors easily suffer from motion artifacts, motion artifacts are effectively reduced by performing subtraction between a pair of identical SCG tattoos placed adjacent to each other. Integrating the soft SCG sensor with a pair of soft gold electrodes on a single e-tattoo platform forms a soft electro-mechano-acoustic cardiovascular (EMAC) sensing tattoo, which can perform synchronous ECG and SCG measurements and extract various cardiac time intervals including systolic time interval (STI). Using the EMAC tattoo, strong correlations between STI and the systolic/diastolic blood pressures, are found, which may provide a simple way to estimate blood pressure continuously and noninvasively using one chest-mounted e-tattoo.