SNR enhanced high-speed two-photon microscopy using a pulse picker and time gating detection.

Two-photon microscopy (TPM) is an attractive biomedical imaging method due to its large penetration depth and optical sectioning capability. In particular, label-free autofluorescence imaging offers various advantages for imaging biological samples. However, relatively low intensity of autofluorescence leads to low signal-to-noise ratio (SNR), causing practical challenges for imaging biological samples. In this study, we present TPM using a pulse picker to utilize low pulse repetition rate of femtosecond pulsed laser to increase the pulse peak power of the excitation source leading to higher emission of two-photon fluorescence with the same average illumination power. Stronger autofluorescence emission allowed us to obtain higher SNR images of arterial and liver tissues. In addition, by applying the time gating detection method to the pulse signals obtained by TPM, we were able to significantly reduce the background noise of two-photon images. As a result, our TPM system using the pulsed light source with a 19 times lower repetition rate allowed us to obtain the same SNR image more than 19 times faster with the same average power. Although high pulse energy can increase the photobleaching, we also observed that high-speed imaging with low total illumination energy can mitigate the photobleaching effect to a level similar to that of conventional illumination with a high repetition rate. We anticipate that this simple approach will provide guidance for SNR enhancement with high-speed imaging in TPM as well as other nonlinear microscopy.

Feasibility and safety of non-contrast optical coherence tomography imaging using hydroxyethyl starch in coronary arteries.

Intracoronary optical coherence tomography (OCT) requires injection of flushing media for image acquisition. Alternative flushing media needs to be investigated to reduce the risk of contrast-induced renal dysfunction. We investigated the feasibility and safety of pentastarch (hydroxyethyl starch) for clinical OCT imaging. We prospectively enrolled 43 patients with 70 coronary lesions (46-stented; 24-native). Total 81 OCT pullback pairs were obtained by manual injection of iodine contrast, followed by pentastarch. Each pullback was assessed frame-by-frame using an automated customized lumen contour/stent strut segmentation algorithm. Paired images were compared for the clear image segments (CIS), blood-flushing capability, and quantitative morphometric measurements. Overall image quality, as assessed by the proportion of CIS, was comparable between the contrast- and pentastarch-flushed images (97.1% vs. 96.5%; p = 0.160). The pixel-based blood-flushing capability was similar between the groups (0.951 [0.947-0.953] vs. 0.950 [0.948-0.952], p = 0.125). Quantitative two- and three-dimensional morphometric measurements of the paired images correlated well (p < 0.001) with excellent inter-measurement variability. All patients safely underwent OCT imaging using pentastarch without resulting in clinically relevant complications or renal deterioration. Non-contrast OCT imaging using pentastarch is clinically safe and technically feasible with excellent image quality and could be a promising alternative strategy for patients at high risk of renal impairment.

Deep learning-based image enhancement in optical coherence tomography by exploiting interference fringe.

Optical coherence tomography (OCT), an interferometric imaging technique, provides non-invasive, high-speed, high-sensitive volumetric biological imaging in vivo. However, systemic features inherent in the basic operating principle of OCT limit its imaging performance such as spatial resolution and signal-to-noise ratio. Here, we propose a deep learning-based OCT image enhancement framework that exploits raw interference fringes to achieve further enhancement from currently obtainable optimized images. The proposed framework for enhancing spatial resolution and reducing speckle noise in OCT images consists of two separate models: an A-scan-based network (NetA) and a B-scan-based network (NetB). NetA utilizes spectrograms obtained via short-time Fourier transform of raw interference fringes to enhance axial resolution of A-scans. NetB was introduced to enhance lateral resolution and reduce speckle noise in B-scan images. The individually trained networks were applied sequentially. We demonstrate the versatility and capability of the proposed framework by visually and quantitatively validating its robust performance. Comparative studies suggest that deep learning utilizing interference fringes can outperform the existing methods. Furthermore, we demonstrate the advantages of the proposed method by comparing our outcomes with multi-B-scan averaged images and contrast-adjusted images. We expect that the proposed framework will be a versatile technology that can improve functionality of OCT.

In Vivo Cellular-Level 3D Imaging of Peripheral Nerves Using a Dual-Focusing Technique for Intra-Neural Interface Implantation.

In vivo volumetric imaging of the microstructural changes of peripheral nerves with an inserted electrode could be key for solving the chronic implantation failure of an intra-neural interface necessary to provide amputated patients with natural motion and sensation. Thus far, no imaging devices can provide a cellular-level three-dimensional (3D) structural images of a peripheral nerve in vivo. In this study, an optical coherence tomography-based peripheral nerve imaging platform that employs a newly proposed depth of focus extension technique is reported. A point spread function with the finest transverse resolution of 1.27 µm enables the cellular-level volumetric visualization of the metal wire and microstructural changes in a rat sciatic nerve with the metal wire inserted in vivo. Further, the feasibility of applying the imaging platform to large animals for a preclinical study is confirmed through in vivo rabbit sciatic nerve imaging. It is expected that new possibilities for the successful chronic implantation of an intra-neural interface will open up by providing the 3D microstructural changes of nerves around the inserted electrode.

Targeted theranostic photoactivation on atherosclerosis.

BACKGROUND: Photoactivation targeting macrophages has emerged as a therapeutic strategy for atherosclerosis, but limited targetable ability of photosensitizers to the lesions hinders its applications. Moreover, the molecular mechanistic insight to its phototherapeutic effects on atheroma is still lacking. Herein, we developed a macrophage targetable near-infrared fluorescence (NIRF) emitting phototheranostic agent by conjugating dextran sulfate (DS) to chlorin e6 (Ce6) and estimated its phototherapeutic feasibility in murine atheroma. Also, the phototherapeutic mechanisms of DS-Ce6 on atherosclerosis were investigated. RESULTS: The phototheranostic agent DS-Ce6 efficiently internalized into the activated macrophages and foam cells via scavenger receptor-A (SR-A) mediated endocytosis. Customized serial optical imaging-guided photoactivation of DS-Ce6 by light illumination reduced both atheroma burden and inflammation in murine models. Immuno-fluorescence and -histochemical analyses revealed that the photoactivation of DS-Ce6 produced a prominent increase in macrophage-associated apoptotic bodies 1 week after laser irradiation and induced autophagy with Mer tyrosine-protein kinase expression as early as day 1, indicative of an enhanced efferocytosis in atheroma. CONCLUSION: Imaging-guided DS-Ce6 photoactivation was able to in vivo detect inflammatory activity in atheroma as well as to simultaneously reduce both plaque burden and inflammation by harmonic contribution of apoptosis, autophagy, and lesional efferocytosis. These results suggest that macrophage targetable phototheranostic nanoagents will be a promising theranostic strategy for high-risk atheroma.

Robust autofocusing for scanning electron microscopy based on a dual deep learning network.

Scanning electron microscopy (SEM) is a high-resolution imaging technique with subnanometer spatial resolution that is widely used in materials science, basic science, and nanofabrication. However, conducting SEM is rather complex due to the nature of using an electron beam and the many parameters that must be adjusted to acquire high-quality images. Only trained operators can use SEM equipment properly, meaning that the use of SEM is restricted. To broaden the usability of SEM, we propose an autofocus method for a SEM system based on a dual deep learning network, which consists of an autofocusing-evaluation network (AENet) and an autofocusing-control network (ACNet). The AENet was designed to evaluate the quality of given images, with scores ranging from 0 to 9 regardless of the magnification. The ACNet can delicately control the focus of SEM online based on the AENet's outputs for any lateral sample position and magnification. The results of these dual networks showed successful autofocus performance on three trained samples. Moreover, the robustness of the proposed method was demonstrated by autofocusing on unseen samples. We expect that our autofocusing system will not only contribute to expanding the versatility of SEM but will also be applicable to various microscopes.

Macrophage targeted theranostic strategy for accurate detection and rapid stabilization of the inflamed high-risk plaque.

Rationale: Inflammation plays a pivotal role in the pathogenesis of the acute coronary syndrome. Detecting plaques with high inflammatory activity and specifically treating those lesions can be crucial to prevent life-threatening cardiovascular events. Methods: Here, we developed a macrophage mannose receptor (MMR)-targeted theranostic nanodrug (mannose-polyethylene glycol-glycol chitosan-deoxycholic acid-cyanine 7-lobeglitazone; MMR-Lobe-Cy) designed to identify inflammatory activity as well as to deliver peroxisome proliferator-activated gamma (PPARγ) agonist, lobeglitazone, specifically to high-risk plaques based on the high mannose receptor specificity. The MMR-Lobe-Cy was intravenously injected into balloon-injured atheromatous rabbits and serial in vivo optical coherence tomography (OCT)-near-infrared fluorescence (NIRF) structural-molecular imaging was performed. Results: One week after MMR-Lobe-Cy administration, the inflammatory NIRF signals in the plaques notably decreased compared to the baseline whereas the signals in saline controls even increased over time. In accordance with in vivo imaging findings, ex vivo NIRF signals on fluorescence reflectance imaging (FRI) and plaque inflammation by immunostainings significantly decreased compared to oral lobeglitazone group or saline controls. The anti-inflammatory effect of MMR-Lobe-Cy was mediated by inhibition of TLR4/NF-κB pathway. Furthermore, acute resolution of inflammation altered the inflamed plaque into a stable phenotype with less macrophages and collagen-rich matrix. Conclusion: Macrophage targeted PPARγ activator labeled with NIRF rapidly stabilized the inflamed plaques in coronary sized artery, which could be quantitatively assessed using intravascular OCT-NIRF imaging. This novel theranostic approach provides a promising theranostic strategy for high-risk coronary plaques.

Label-free multimodal microscopy using a single light source and detector for biological imaging.

Multimodal nonlinear microscopy has been widely applied in biology and medicine due to its relatively deep penetration into tissue and its label-free manner. However, current multimodal systems require the use of multiple sources and detectors, leading to bulky, complex, and expensive systems. In this Letter, we present a novel method of using a single light source and detector for nonlinear multimodal imaging of biological samples. Using a photonic crystal fiber, a pulse picker, and multimode fibers, our developed system successfully acquired multimodal images of swine coronary arteries, including two-photon excitation fluorescence, second-harmonic generation, coherent anti-Stokes Raman scattering, and backreflection. The developed system could be a valuable tool for various biomedical applications.

Stress-associated neurobiological activity is linked with acute plaque instability via enhanced macrophage activity: a prospective serial 18F-FDG-PET/CT imaging assessment.

AIMS: Emotional stress is associated with future cardiovascular events. However, the mechanistic linkage of brain emotional neural activity with acute plaque instability is not fully elucidated. We aimed to prospectively estimate the relationship between brain amygdalar activity (AmygA), arterial inflammation (AI), and macrophage haematopoiesis (HEMA) in acute myocardial infarction (AMI) as compared with controls. METHODS AND RESULTS: 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG-PET/CT) imaging was performed within 45 days of the index episode in 62 patients (45 with AMI, mean 60.0 years, 84.4% male; 17 controls, mean 59.6 years, 76.4% male). In 10 patients of the AMI group, serial 18F-FDG-PET/CT imaging was performed after 6 months to estimate the temporal changes. The signals were compared using a customized 3D-rendered PET reconstruction. AmygA [target-to-background ratio (TBR), mean ± standard deviation: 0.65 ± 0.05 vs. 0.60 ± 0.05; P = 0.004], carotid AI (TBR: 2.04 ± 0.39 vs. 1.81 ± 0.25; P = 0.026), and HEMA (TBR: 2.60 ± 0.38 vs. 2.22 ± 0.28; P < 0.001) were significantly higher in AMI patients compared with controls. AmygA correlated significantly with those of the carotid artery (r = 0.350; P = 0.005), aorta (r = 0.471; P < 0.001), and bone marrow (r = 0.356; P = 0.005). Psychological stress scales (PHQ-9 and PSS-10) and AmygA assessed by PET/CT imaging correlated well (P < 0.001). Six-month after AMI, AmygA, carotid AI, and HEMA decreased to a level comparable with the controls. CONCLUSION: AmygA, AI, and HEMA were concordantly enhanced in patients with AMI, showing concurrent dynamic changes over time. These results raise the possibility that stress-associated neurobiological activity is linked with acute plaque instability via augmented macrophage activity and could be a potential therapeutic target for plaque inflammation in AMI.

Comprehensive Assessment of High-Risk Plaques by Dual-Modal Imaging Catheter in Coronary Artery.

Coronary plaque destabilization involves alterations in microstructure and biochemical composition; however, no imaging approach allows such comprehensive characterization. Herein, the authors demonstrated a simultaneous microstructural and biochemical assessment of high-risk plaques in the coronary arteries in a beating heart using a fully integrated optical coherence tomography and fluorescence lifetime imaging (FLIm). It was found that plaque components such as lipids, macrophages, lipids+macrophages, and fibrotic tissues had unique fluorescence lifetime signatures that were distinguishable using multispectral FLIm. Because FLIm yielded massive biochemical readouts, the authors incorporated machine learning framework into FLIm, and ultimately, their approach enabled an automated, quantitative imaging of multiple key components relevant for plaque destabilization.

Comprehensive intravascular imaging of atherosclerotic plaque in vivo using optical coherence tomography and fluorescence lifetime imaging.

Comprehensive imaging of both the structural and biochemical characteristics of atherosclerotic plaque is essential for the diagnosis and study of coronary artery disease because both a plaque's morphology and its biochemical composition affect the level of risk it poses. Optical coherence tomography (OCT) and fluorescence lifetime imaging (FLIm) are promising optical imaging methods for characterizing coronary artery plaques morphologically and biochemically, respectively. In this study, we present a hybrid intravascular imaging device, including a custom-built OCT/FLIm system, a hybrid optical rotary joint, and an imaging catheter, to visualize the structure and biochemical composition of the plaque in an atherosclerotic rabbit artery in vivo. Especially, the autofluorescence lifetime of the endogenous tissue molecules can be used to characterize the biochemical composition; thus no exogenous contrast agent is required. Also, the physical properties of the imaging catheter and the imaging procedures are similar to those already used clinically, facilitating rapid translation into clinical use. This new intravascular imaging catheter can open up new opportunities for clinicians and researchers to investigate and diagnose coronary artery disease by simultaneously providing tissue microstructure and biochemical composition data in vivo without the use of exogenous contrast agent.

Multispectral analog-mean-delay fluorescence lifetime imaging combined with optical coherence tomography.

The pathophysiological progression of chronic diseases, including atherosclerosis and cancer, is closely related to compositional changes in biological tissues containing endogenous fluorophores such as collagen, elastin, and NADH, which exhibit strong autofluorescence under ultraviolet excitation. Fluorescence lifetime imaging (FLIm) provides robust detection of the compositional changes by measuring fluorescence lifetime, which is an inherent property of a fluorophore. In this paper, we present a dual-modality system combining a multispectral analog-mean-delay (AMD) FLIm and a high-speed swept-source optical coherence tomography (OCT) to simultaneously visualize the cross-sectional morphology and biochemical compositional information of a biological tissue. Experiments using standard fluorescent solutions showed that the fluorescence lifetime could be measured with a precision of less than 40 psec using the multispectral AMD-FLIm without averaging. In addition, we performed ex vivo imaging on rabbit iliac normal-looking and atherosclerotic specimens to demonstrate the feasibility of the combined FLIm-OCT system for atherosclerosis imaging. We expect that the combined FLIm-OCT will be a promising next-generation imaging technique for diagnosing atherosclerosis and cancer due to the advantages of the proposed label-free high-precision multispectral lifetime measurement.

Endoscopic micro-optical coherence tomography with extended depth of focus using a binary phase spatial filter.

Micro-optical coherence tomography (µOCT) is an advanced imaging technique that acquires a three-dimensional microstructure of biological samples with a high spatial resolution, up to 1 µm, by using a broadband light source and a high numerical aperture (NA) lens. As high NA produces a short depth of focus (DOF), extending the DOF is necessary to obtain a reasonable imaging depth. However, due to the complexity of optics and the limited space, it has been challenging to fabricate endoscopic µOCT, which is essential for clinical translation. Here, we report an endoscopic µOCT probe with an extended DOF by using a binary phase spatial filter. The imaging results from latex beads demonstrated that the µOCT probe achieved an axial resolution of 2.49 µm and a lateral resolution of 2.59 µm with a DOF extended by a factor of 2. The feasibility of clinical use was demonstrated by ex vivo imaging of the rabbit iliac artery.

Characterization of lipid-rich plaques using spectroscopic optical coherence tomography.

Intravascular optical coherence tomography (IV-OCT) is a high-resolution imaging method used to visualize the internal structures of walls of coronary arteries in vivo. However, accurate characterization of atherosclerotic plaques with gray-scale IV-OCT images is often limited by various intrinsic artifacts. In this study, we present an algorithm for characterizing lipid-rich plaques with a spectroscopic OCT technique based on a Gaussian center of mass (GCOM) metric. The GCOM metric, which reflects the absorbance properties of lipids, was validated using a lipid phantom. In addition, the proposed characterization method was successfully demonstrated in vivo using an atherosclerotic rabbit model and was found to have a sensitivity and specificity of 94.3% and 76.7% for lipid classification, respectively.

Automated detection of vessel lumen and stent struts in intravascular optical coherence tomography to evaluate stent apposition and neointimal coverage.

PURPOSE: Intravascular optical coherence tomography (IV-OCT) is a high-resolution imaging method used to visualize the microstructure of arterial walls in vivo. IV-OCT enables the clinician to clearly observe and accurately measure stent apposition and neointimal coverage of coronary stents, which are associated with side effects such as in-stent thrombosis. In this study, the authors present an algorithm for quantifying stent apposition and neointimal coverage by automatically detecting lumen contours and stent struts in IV-OCT images. METHODS: The algorithm utilizes OCT intensity images and their first and second gradient images along the axial direction to detect lumen contours and stent strut candidates. These stent strut candidates are classified into true and false stent struts based on their features, using an artificial neural network with one hidden layer and ten nodes. After segmentation, either the protrusion distance (PD) or neointimal thickness (NT) for each strut is measured automatically. In randomly selected image sets covering a large variety of clinical scenarios, the results of the algorithm were compared to those of manual segmentation by IV-OCT readers. RESULTS: Stent strut detection showed a 96.5% positive predictive value and a 92.9% true positive rate. In addition, case-by-case validation also showed comparable accuracy for most cases. High correlation coefficients (R > 0.99) were observed for PD and NT between the algorithmic and the manual results, showing little bias (0.20 and 0.46 µm, respectively) and a narrow range of limits of agreement (36 and 54 µm, respectively). In addition, the algorithm worked well in various clinical scenarios and even in cases with a low level of stent malapposition and neointimal coverage. CONCLUSIONS: The presented automatic algorithm enables robust and fast detection of lumen contours and stent struts and provides quantitative measurements of PD and NT. In addition, the algorithm was validated using various clinical cases to demonstrate its reliability. Therefore, this technique can be effectively utilized for clinical trials on stent-related side effects, including in-stent thrombosis and in-stent restenosis.

Intravascular optical imaging of high-risk plaques in vivo by targeting macrophage mannose receptors.

Macrophages mediate atheroma expansion and disruption, and denote high-risk arterial plaques. Therefore, they are substantially gaining importance as a diagnostic imaging target for the detection of rupture-prone plaques. Here, we developed an injectable near-infrared fluorescence (NIRF) probe by chemically conjugating thiolated glycol chitosan with cholesteryl chloroformate, NIRF dye (cyanine 5.5 or 7), and maleimide-polyethylene glycol-mannose as mannose receptor binding ligands to specifically target a subset of macrophages abundant in high-risk plaques. This probe showed high affinity to mannose receptors, low toxicity, and allowed the direct visualization of plaque macrophages in murine carotid atheroma. After the scale-up of the MMR-NIRF probe, the administration of the probe facilitated in vivo intravascular imaging of plaque inflammation in coronary-sized vessels of atheromatous rabbits using a custom-built dual-modal optical coherence tomography (OCT)-NIRF catheter-based imaging system. This novel imaging approach represents a potential imaging strategy enabling the identification of high-risk plaques in vivo and holds promise for future clinical implications.

Intracoronary dual-modal optical coherence tomography-near-infrared fluorescence structural-molecular imaging with a clinical dose of indocyanine green for the assessment of high-risk plaques and stent-associated inflammation in a beating coronary artery.

AIMS: Inflammation plays essential role in development of plaque disruption and coronary stent-associated complications. This study aimed to examine whether intracoronary dual-modal optical coherence tomography (OCT)-near-infrared fluorescence (NIRF) structural-molecular imaging with indocyanine green (ICG) can estimate inflammation in swine coronary artery. METHODS AND RESULTS: After administration of clinically approved NIRF-enhancing ICG (2.0 mg/kg) or saline, rapid coronary imaging (20 mm/s pullback speed) using a fully integrated OCT-NIRF catheter was safely performed in 12 atheromatous Yucatan minipigs and in 7 drug-eluting stent (DES)-implanted Yorkshire pigs. Stronger NIRF activity was identified in OCT-proven high-risk plaque compared to normal or saline-injected controls (P = 0.0016), which was validated on ex vivo fluorescence reflectance imaging. In vivo plaque target-to-background ratio (pTBR) was much higher in inflamed lipid-rich plaque compared to fibrous plaque (P < 0.0001). In vivo and ex vivo peak pTBRs correlated significantly (P < 0.0022). In vitro cellular ICG uptake and histological validations corroborated the OCT-NIRF findings in vivo. Indocyanine green colocalization with macrophages and lipids of human plaques was confirmed with autopsy atheroma specimens. Two weeks after DES deployment, OCT-NIRF imaging detected strong NIRF signals along stent struts, which was significantly higher than baseline (P = 0.0156). Histologically, NIRF signals in peri-strut tissue co-localized well with macrophages. CONCLUSION: The OCT-NIRF imaging with a clinical dose of ICG was feasible to accurately assess plaque inflammation and DES-related inflammation in a beating coronary artery. This highly translatable dual-modal molecular-structural imaging strategy could be relevant for clinical intracoronary estimation of high-risk plaques and DES biology.