Tutorial on phantoms for photoacoustic imaging applications.

Significance: Photoacoustic imaging (PAI) is an emerging technology that holds high promise in a wide range of clinical applications, but standardized methods for system testing are lacking, impeding objective device performance evaluation, calibration, and inter-device comparisons. To address this shortfall, this tutorial offers readers structured guidance in developing tissue-mimicking phantoms for photoacoustic applications with potential extensions to certain acoustic and optical imaging applications. Aim: The tutorial review aims to summarize recommendations on phantom development for PAI applications to harmonize efforts in standardization and system calibration in the field. Approach: The International Photoacoustic Standardization Consortium has conducted a consensus exercise to define recommendations for the development of tissue-mimicking phantoms in PAI. Results: Recommendations on phantom development are summarized in seven defined steps, expanding from (1) general understanding of the imaging modality, definition of (2) relevant terminology and parameters and (3) phantom purposes, recommendation of (4) basic material properties, (5) material characterization methods, and (6) phantom design to (7) reproducibility efforts. Conclusions: The tutorial offers a comprehensive framework for the development of tissue-mimicking phantoms in PAI to streamline efforts in system testing and push forward the advancement and translation of the technology.

Unsupervised Segmentation of 3D Microvascular Photoacoustic Images Using Deep Generative Learning.

Mesoscopic photoacoustic imaging (PAI) enables label-free visualization of vascular networks in tissues with high contrast and resolution. Segmenting these networks from 3D PAI data and interpreting their physiological and pathological significance is crucial yet challenging due to the time-consuming and error-prone nature of current methods. Deep learning offers a potential solution; however, supervised analysis frameworks typically require human-annotated ground-truth labels. To address this, an unsupervised image-to-image translation deep learning model is introduced, the Vessel Segmentation Generative Adversarial Network (VAN-GAN). VAN-GAN integrates synthetic blood vessel networks that closely resemble real-life anatomy into its training process and learns to replicate the underlying physics of the PAI system in order to learn how to segment vasculature from 3D photoacoustic images. Applied to a diverse range of in silico, in vitro, and in vivo data, including patient-derived breast cancer xenograft models and 3D clinical angiograms, VAN-GAN demonstrates its capability to facilitate accurate and unbiased segmentation of 3D vascular networks. By leveraging synthetic data, VAN-GAN reduces the reliance on manual labeling, thus lowering the barrier to entry for high-quality blood vessel segmentation (F1 score: VAN-GAN vs. U-Net = 0.84 vs. 0.87) and enhancing preclinical and clinical research into vascular structure and function.

The in vitro dynamics of pseudo-vascular network formation.

BACKGROUND/OBJECTIVES: Pseudo-vascular network formation in vitro is considered a key characteristic of vasculogenic mimicry. While many cancer cell lines form pseudo-vascular networks, little is known about the spatiotemporal dynamics of these formations. METHODS: Here, we present a framework for monitoring and characterising the dynamic formation and dissolution of pseudo-vascular networks in vitro. The framework combines time-resolved optical microscopy with open-source image analysis for network feature extraction and statistical modelling. The framework is demonstrated by comparing diverse cancer cell lines associated with vasculogenic mimicry, then in detecting response to drug compounds proposed to affect formation of vasculogenic mimics. Dynamic datasets collected were analysed morphometrically and a descriptive statistical analysis model was developed in order to measure stability and dissimilarity characteristics of the pseudo-vascular networks formed. RESULTS: Melanoma cells formed the most stable pseudo-vascular networks and were selected to evaluate the response of their pseudo-vascular networks to treatment with axitinib, brucine and tivantinib. Tivantinib has been found to inhibit the formation of the pseudo-vascular networks more effectively, even in dose an order of magnitude less than the two other agents. CONCLUSIONS: Our framework is shown to enable quantitative analysis of both the capacity for network formation, linked vasculogenic mimicry, as well as dynamic responses to treatment.

Distribution-informed and wavelength-flexible data-driven photoacoustic oximetry.

Significance: Photoacoustic imaging (PAI) promises to measure spatially resolved blood oxygen saturation but suffers from a lack of accurate and robust spectral unmixing methods to deliver on this promise. Accurate blood oxygenation estimation could have important clinical applications from cancer detection to quantifying inflammation. Aim: We address the inflexibility of existing data-driven methods for estimating blood oxygenation in PAI by introducing a recurrent neural network architecture. Approach: We created 25 simulated training dataset variations to assess neural network performance. We used a long short-term memory network to implement a wavelength-flexible network architecture and proposed the Jensen-Shannon divergence to predict the most suitable training dataset. Results: The network architecture can flexibly handle the input wavelengths and outperforms linear unmixing and the previously proposed learned spectral decoloring method. Small changes in the training data significantly affect the accuracy of our method, but we find that the Jensen-Shannon divergence correlates with the estimation error and is thus suitable for predicting the most appropriate training datasets for any given application. Conclusions: A flexible data-driven network architecture combined with the Jensen-Shannon divergence to predict the best training data set provides a promising direction that might enable robust data-driven photoacoustic oximetry for clinical use cases.

Tutorial on methods for estimation of optical absorption and scattering properties of tissue.

Significance: The estimation of tissue optical properties using diffuse optics has found a range of applications in disease detection, therapy monitoring, and general health care. Biomarkers derived from the estimated optical absorption and scattering coefficients can reflect the underlying progression of many biological processes in tissues. Aim: Complex light-tissue interactions make it challenging to disentangle the absorption and scattering coefficients, so dedicated measurement systems are required. We aim to help readers understand the measurement principles and practical considerations needed when choosing between different estimation methods based on diffuse optics. Approach: The estimation methods can be categorized as: steady state, time domain, time frequency domain (FD), spatial domain, and spatial FD. The experimental measurements are coupled with models of light-tissue interactions, which enable inverse solutions for the absorption and scattering coefficients from the measured tissue reflectance and/or transmittance. Results: The estimation of tissue optical properties has been applied to characterize a variety of ex vivo and in vivo tissues, as well as tissue-mimicking phantoms. Choosing a specific estimation method for a certain application has to trade-off its advantages and limitations. Conclusion: Optical absorption and scattering property estimation is an increasingly important and accessible approach for medical diagnosis and health monitoring.

Raman micro-spectroscopy reveals the spatial distribution of fumarate in cells and tissues.

Aberrantly accumulated metabolites elicit intra- and inter-cellular pro-oncogenic cascades, yet current measurement methods require sample perturbation/disruption and lack spatio-temporal resolution, limiting our ability to fully characterize their function and distribution. Here, we show that Raman spectroscopy (RS) can directly detect fumarate in living cells in vivo and animal tissues ex vivo, and that RS can distinguish between Fumarate hydratase (Fh1)-deficient and Fh1-proficient cells based on fumarate concentration. Moreover, RS reveals the spatial compartmentalization of fumarate within cellular organelles in Fh1-deficient cells: consistent with disruptive methods, we observe the highest fumarate concentration (37 ± 19 mM) in mitochondria, where the TCA cycle operates, followed by the cytoplasm (24 ± 13 mM) and then the nucleus (9 ± 6 mM). Finally, we apply RS to tissues from an inducible mouse model of FH loss in the kidney, demonstrating RS can classify FH status. These results suggest RS could be adopted as a valuable tool for small molecule metabolic imaging, enabling in situ non-destructive evaluation of fumarate compartmentalization.

Mechanical-scan-free multicolor super-resolution imaging with diffractive spot array illumination.

Point-scanning microscopy approaches are transforming super-resolution imaging. Despite achieving parallel high-speed imaging using multifocal techniques, efficient multicolor imaging methods with high-quality illumination are currently lacking. In this paper, we present for the first time Mechanical-scan-free multiColor Super-resolution Microscopy (MCoSM) with spot array illumination, which enables mechanical-scan-free super-resolution imaging with adjustable resolution and a good effective field-of-view based on spatial light modulators. Through 100-2,500 s super-resolution spot illumination with different effective fields of view for imaging, we demonstrate the adjustable capacity of MCoSM. MCoSM extends existing spectral imaging capabilities through a time-sharing process involving different color illumination with phase-shift scanning while retaining the spatial flexibility of super-resolution imaging with diffractive spot array illumination. To demonstrate the prospects of MCoSM, we perform four-color imaging of fluorescent beads at high resolution. MCoSM provides a versatile platform for studying molecular interactions in complex samples at the nanoscale level.

Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract.

Significance: Color differences between healthy and diseased tissue in the gastrointestinal (GI) tract are detected visually by clinicians during white light endoscopy; however, the earliest signs of cancer are often just a slightly different shade of pink compared to healthy tissue making it hard to detect. Improving contrast in endoscopy is important for early detection of disease in the GI tract during routine screening and surveillance. Aim: We aim to target alternative colors for imaging to improve contrast using custom multispectral filter arrays (MSFAs) that could be deployed in an endoscopic "chip-on-tip" configuration. Approach: Using an open-source toolbox, Opti-MSFA, we examined the optimal design of MSFAs for early cancer detection in the GI tract. The toolbox was first extended to use additional classification models (k-nearest neighbor, support vector machine, and spectral angle mapper). Using input spectral data from published clinical trials examining the esophagus and colon, we optimized the design of MSFAs with three to nine different bands. Results: We examined the variation of the spectral and spatial classification accuracies as a function of the number of bands. The MSFA configurations tested showed good classification accuracies when compared to the full hyperspectral data available from the clinical spectra used in these studies. Conclusion: The ability to retain good classification accuracies with a reduced number of spectral bands could enable the future deployment of multispectral imaging in an endoscopic chip-on-tip configuration using simplified MSFA hardware. Further studies using an expanded clinical dataset are needed to confirm these findings.

An Indocyanine Green-Based Nanoprobe for In Vivo Detection of Cellular Senescence.

There is an urgent need to improve conventional cancer-treatments by preventing detrimental side effects, cancer recurrence and metastases. Recent studies have shown that presence of senescent cells in tissues treated with chemo- or radiotherapy can be used to predict the effectiveness of cancer treatment. However, although the accumulation of senescent cells is one of the hallmarks of cancer, surprisingly little progress has been made in development of strategies for their detection in vivo. To address a lack of detection tools, we developed a biocompatible, injectable organic nanoprobe (NanoJagg), which is selectively taken up by senescent cells and accumulates in the lysosomes. The NanoJagg probe is obtained by self-assembly of indocyanine green (ICG) dimers using a scalable manufacturing process and characterized by a unique spectral signature suitable for both photoacoustic tomography (PAT) and fluorescence imaging. In vitro, ex vivo and in vivo studies all indicate that NanoJaggs are a clinically translatable probe for detection of senescence and their PAT signal makes them suitable for longitudinal monitoring of the senescence burden in solid tumors after chemotherapy or radiotherapy.

Moving Beyond Simulation: Data-Driven Quantitative Photoacoustic Imaging Using Tissue-Mimicking Phantoms.

Accurate measurement of optical absorption coefficients from photoacoustic imaging (PAI) data would enable direct mapping of molecular concentrations, providing vital clinical insight. The ill-posed nature of the problem of absorption coefficient recovery has prohibited PAI from achieving this goal in living systems due to the domain gap between simulation and experiment. To bridge this gap, we introduce a collection of experimentally well-characterised imaging phantoms and their digital twins. This first-of-a-kind phantom data set enables supervised training of a U-Net on experimental data for pixel-wise estimation of absorption coefficients. We show that training on simulated data results in artefacts and biases in the estimates, reinforcing the existence of a domain gap between simulation and experiment. Training on experimentally acquired data, however, yielded more accurate and robust estimates of optical absorption coefficients. We compare the results to fluence correction with a Monte Carlo model from reference optical properties of the materials, which yields a quantification error of approximately 20%. Application of the trained U-Nets to a blood flow phantom demonstrated spectral biases when training on simulated data, while application to a mouse model highlighted the ability of both learning-based approaches to recover the depth-dependent loss of signal intensity. We demonstrate that training on experimental phantoms can restore the correlation of signal amplitudes measured in depth. While the absolute quantification error remains high and further improvements are needed, our results highlight the promise of deep learning to advance quantitative PAI.

Effects of skin tone on photoacoustic imaging and oximetry.

Significance: Photoacoustic imaging (PAI) provides contrast based on the concentration of optical absorbers in tissue, enabling the assessment of functional physiological parameters such as blood oxygen saturation (sO2). Recent evidence suggests that variation in melanin levels in the epidermis leads to measurement biases in optical technologies, which could potentially limit the application of these biomarkers in diverse populations. Aim: To examine the effects of skin melanin pigmentation on PAI and oximetry. Approach: We evaluated the effects of skin tone in PAI using a computational skin model, two-layer melanin-containing tissue-mimicking phantoms, and mice of a consistent genetic background with varying pigmentations. The computational skin model was validated by simulating the diffuse reflectance spectrum using the adding-doubling method, allowing us to assign our simulation parameters to approximate Fitzpatrick skin types. Monte Carlo simulations and acoustic simulations were run to obtain idealized photoacoustic images of our skin model. Photoacoustic images of the phantoms and mice were acquired using a commercial instrument. Reconstructed images were processed with linear spectral unmixing to estimate blood oxygenation. Linear unmixing results were compared with a learned unmixing approach based on gradient-boosted regression. Results: Our computational skin model was consistent with representative literature for in vivo skin reflectance measurements. We observed consistent spectral coloring effects across all model systems, with an overestimation of sO2 and more image artifacts observed with increasing melanin concentration. The learned unmixing approach reduced the measurement bias, but predictions made at lower blood sO2 still suffered from a skin tone-dependent effect. Conclusion: PAI demonstrates measurement bias, including an overestimation of blood sO2, in higher Fitzpatrick skin types. Future research should aim to characterize this effect in humans to ensure equitable application of the technology.

A review of a strategic roadmapping exercise to advance clinical translation of photoacoustic imaging: From current barriers to future adoption.

Photoacoustic imaging (PAI), also referred to as optoacoustic imaging, has shown promise in early-stage clinical trials in a range of applications from inflammatory diseases to cancer. While the first PAI systems have recently received regulatory approvals, successful adoption of PAI technology into healthcare systems for clinical decision making must still overcome a range of barriers, from education and training to data acquisition and interpretation. The International Photoacoustic Standardisation Consortium (IPASC) undertook an community exercise in 2022 to identify and understand these barriers, then develop a roadmap of strategic plans to address them. Here, we outline the nature and scope of the barriers that were identified, along with short-, medium- and long-term community efforts required to overcome them, both within and beyond the IPASC group.

A Stable Phantom Material for Optical and Acoustic Imaging.

Establishing tissue-mimicking biophotonic phantom materials that provide long-term stability are imperative to enable the comparison of biomedical imaging devices across vendors and institutions, support the development of internationally recognized standards, and assist the clinical translation of novel technologies. Here, a manufacturing process is presented that results in a stable, low-cost, tissue-mimicking copolymer-in-oil material for use in photoacoustic, optical, and ultrasound standardization efforts. The base material consists of mineral oil and a copolymer with defined Chemical Abstract Service (CAS) numbers. The protocol presented here yields a representative material with a speed of sound c(f) = 1,481 ± 0.4 m·s-1 at 5 MHz (corresponds to the speed of sound of water at 20 °C), acoustic attenuation α(f) = 6.1 ± 0.06 dB·cm-1 at 5 MHz, optical absorption µa(λ) = 0.05 ± 0.005 mm-1 at 800 nm, and optical scattering µs'(λ) = 1 ± 0.1 mm-1 at 800 nm. The material allows independent tuning of the acoustic and optical properties by respectively varying the polymer concentration or light scattering (titanium dioxide) and absorbing agents (oil-soluble dye). The fabrication of different phantom designs is displayed and the homogeneity of the resulting test objects is confirmed using photoacoustic imaging. Due to its facile, repeatable fabrication process and durability, as well as its biologically relevant properties, the material recipe has high promise in multimodal acoustic-optical standardization initiatives.

Contrast-Enhanced Multispectral Optoacoustic Tomography for Functional Assessment of the Gastrointestinal Tract.

Real-time imaging and functional assessment of the intestinal tract and its transit pose a significant challenge to conventional clinical diagnostic methods. Multispectral optoacoustic tomography (MSOT), a molecular-sensitive imaging technology, offers the potential to visualize endogenous and exogenous chromophores in deep tissue. Herein, a novel approach using the orally administered clinical-approved fluorescent dye indocyanine green (ICG) for bedside, non-ionizing evaluation of gastrointestinal passage is presented. The authors are able to show the detectability and stability of ICG in phantom experiments. Furthermore, ten healthy subjects underwent MSOT imaging at multiple time points over eight hours after ingestion of a standardized meal with and without ICG. ICG signals can be visualized and quantified in different intestinal segments, while its excretion is confirmed by fluorescent imaging of stool samples. These findings indicate that contrast-enhanced MSOT (CE-MSOT) provides a translatable real-time imaging approach for functional assessment of the gastrointestinal tract.

Performance evaluation of mesoscopic photoacoustic imaging.

Photoacoustic mesoscopy visualises vascular architecture at high-resolution up to ~3 mm depth. Despite promise in preclinical and clinical imaging studies, with applications in oncology and dermatology, the accuracy and precision of photoacoustic mesoscopy is not well established. Here, we evaluate a commercial photoacoustic mesoscopy system for imaging vascular structures. Typical artefact types are first highlighted and limitations due to non-isotropic illumination and detection are evaluated with respect to rotation, angularity, and depth of the target. Then, using tailored phantoms and mouse models, we investigate system precision, showing coefficients of variation (COV) between repeated scans [short term (1 h): COV= 1.2%; long term (25 days): COV= 9.6%], from target repositioning (without: COV=1.2%, with: COV=4.1%), or from varying in vivo user experience (experienced: COV=15.9%, unexperienced: COV=20.2%). Our findings show robustness of the technique, but also underscore general challenges of limited-view photoacoustic systems in accurately imaging vessel-like structures, thereby guiding users when interpreting biologically-relevant information.

Transrectal Absorber Guide Raster-Scanning Optoacoustic Mesoscopy for Label-Free In Vivo Assessment of Colitis.

Optoacoustic imaging (OAI) enables microscale imaging of endogenous chromophores such as hemoglobin at significantly higher penetration depths compared to other optical imaging technologies. Raster-scanning optoacoustic mesoscopy (RSOM) has recently been shown to identify superficial microvascular changes associated with human skin pathologies. In animal models, the imaging depth afforded by RSOM can enable entirely new capabilities for noninvasive imaging of vascular structures in the gastrointestinal tract, but exact localization of intra-abdominal organs is still elusive. Herein the development and application of a novel transrectal absorber guide for RSOM (TAG-RSOM) is presented to enable accurate transabdominal localization and assessment of colonic vascular networks in vivo. The potential of TAG-RSOM is demonstrated through application during mild and severe acute colitis in mice. TAG-RSOM enables visualization of transmural vascular networks, with changes in colon wall thickness, blood volume, and OAI signal intensities corresponding to colitis-associated inflammatory changes. These findings suggest TAG-RSOM can provide a novel monitoring tool in preclinical IBD models, refining animal procedures and underlines the capabilities of such technologies to address inflammatory bowel diseases in humans.

Multispectral imaging of nailfold capillaries using light-emitting diode illumination.

Significance: The capillaries are the smallest blood vessels in the body, typically imaged using video capillaroscopy to aid diagnosis of connective tissue diseases, such as systemic sclerosis. Video capillaroscopy allows visualization of morphological changes in the nailfold capillaries but does not provide any physiological information about the blood contained within the capillary network. Extracting parameters such as hemoglobin oxygenation could increase sensitivity for diagnosis and measurement of microvascular disease progression. Aim: To design, construct, and test a low-cost multispectral imaging (MSI) system using light-emitting diode (LED) illumination to assess relative hemoglobin oxygenation in the nailfold capillaries. Approach: An LED ring light was first designed and modeled. The ring light was fabricated using four commercially available LED colors and a custom-designed printed circuit board. The experimental system was characterized and results compared with the illumination model. A blood phantom with variable oxygenation was used to determine the feasibility of using the illumination-based MSI system for oximetry. Nailfold capillaries were then imaged in a healthy subject. Results: The illumination modeling results were in close agreement with the constructed system. Imaging of the blood phantom demonstrated sensitivity to changing hemoglobin oxygenation, which was in line with the spectral modeling of reflection. The morphological properties of the volunteer capillaries were comparable to those measured in current gold standard systems. Conclusions: LED-based illumination could be used as a low-cost approach to enable MSI of the nailfold capillaries to provide insight into the oxygenation of the blood contained within the capillary network.

Photoacoustic imaging radiomics in patient-derived xenografts: a study on feature sensitivity and model discrimination.

Photoacoustic imaging is an increasingly popular method of exploring the tumour microenvironment, which can provide insight into tumour oxygenation status and potentially treatment response assessment. Currently, the measurements most commonly performed on such images are the mean and median of the pixel values of the tumour volumes of interest. We investigated expanding the set of measurements that can be extracted from these images by adding radiomic features. In particular, we found that Skewness was sensitive to differences between basal and luminal patient derived xenograft cancer models with an [Formula: see text] of 0.86, and that it was robust to variations in confounding factors such as reconstruction type and wavelength. We also built discriminant models with radiomic features that were correlated with the underlying tumour model and were independent from each other. We then ranked features by their importance in the model. Skewness was again found to be an important feature, as were 10th Percentile, Root Mean Squared, and several other texture-based features. In summary, this paper proposes a methodology to select radiomic features extracted from photoacoustic images that are robust to changes in acquisition and reconstruction parameters, and discusses features found to have discriminating power between the underlying tumour models in a pre-clinical dataset.

Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis.

SIGNIFICANCE: Measurement and imaging of hemoglobin oxygenation are used extensively in the detection and diagnosis of disease; however, the applied instruments vary widely in their depth of imaging, spatiotemporal resolution, sensitivity, accuracy, complexity, physical size, and cost. The wide variation in available instrumentation can make it challenging for end users to select the appropriate tools for their application and to understand the relative limitations of different methods. AIM: We aim to provide a systematic overview of the field of hemoglobin imaging and sensing. APPROACH: We reviewed the sensing and imaging methods used to analyze hemoglobin oxygenation, including pulse oximetry, spectral reflectance imaging, diffuse optical imaging, spectroscopic optical coherence tomography, photoacoustic imaging, and diffuse correlation spectroscopy. RESULTS: We compared and contrasted the ability of different methods to determine hemoglobin biomarkers such as oxygenation while considering factors that influence their practical application. CONCLUSIONS: We highlight key limitations in the current state-of-the-art and make suggestions for routes to advance the clinical use and interpretation of hemoglobin oxygenation information.