Performance evaluation of image co-registration methods in photoacoustic mesoscopy of the vasculature.

Objective:The formation of functional vasculature in solid tumours enables delivery of oxygen and nutrients, and is vital for effective treatment with chemotherapeutic agents. Longitudinal characterisation of vascular networks can be enabled using mesoscopic photoacoustic imaging, but requires accurate image co-registration to precisely assess local changes across disease development or in response to therapy. Co-registration in photoacoustic imaging is challenging due to the complex nature of the generated signal, including the sparsity of data, artefacts related to the illumination/detection geometry, scan-to-scan technical variability, and biological variability, such as transient changes in perfusion. To better inform the choice of co-registration algorithms, we compared five open-source methods, in physiological and pathological tissues, with the aim of aligning evolving vascular networks in tumours imaged over growth at different time-points.Approach:Co-registration techniques were applied to 3D vascular images acquired with photoacoustic mesoscopy from murine ears and breast cancer patient-derived xenografts, at a fixed time-point and longitudinally. Images were pre-processed and segmented using an unsupervised generative adversarial network. To compare co-registration quality in different settings, pairs of fixed and moving intensity images and/or segmentations were fed into five methods split into the following categories: affine intensity-based using 1)mutual information (MI) or 2)normalised cross-correlation (NCC) as optimisation metrics, affine shape-based using 3)NCC applied to distance-transformed segmentations or 4)iterative closest point algorithm, and deformable weakly supervised deep learning-based using 5)LocalNet co-registration. Percent-changes in Dice coefficients, surface distances, MI, structural similarity index measure and target registration errors were evaluated.Main results:Co-registration using MI or NCC provided similar alignment performance, better than shape-based methods. LocalNet provided accurate co-registration of substructures by optimising subfield deformation throughout the volumes, outperforming other methods, especially in the longitudinal breast cancer xenograft dataset by minimising target registration errors.Significance:We showed the feasibility of co-registering repeatedly or longitudinally imaged vascular networks in photoacoustic mesoscopy, taking a step towards longitudinal quantitative characterisation of these complex structures. These tools open new outlooks for monitoring tumour angiogenesis at the meso-scale and for quantifying treatment-induced co-localised alterations in the vasculature.

Distribution-informed and wavelength-flexible data-driven photoacoustic oximetry.

Significance: Photoacoustic imaging (PAI) promises to measure spatially resolved blood oxygen saturation but suffers from a lack of accurate and robust spectral unmixing methods to deliver on this promise. Accurate blood oxygenation estimation could have important clinical applications from cancer detection to quantifying inflammation. Aim: We address the inflexibility of existing data-driven methods for estimating blood oxygenation in PAI by introducing a recurrent neural network architecture. Approach: We created 25 simulated training dataset variations to assess neural network performance. We used a long short-term memory network to implement a wavelength-flexible network architecture and proposed the Jensen-Shannon divergence to predict the most suitable training dataset. Results: The network architecture can flexibly handle the input wavelengths and outperforms linear unmixing and the previously proposed learned spectral decoloring method. Small changes in the training data significantly affect the accuracy of our method, but we find that the Jensen-Shannon divergence correlates with the estimation error and is thus suitable for predicting the most appropriate training datasets for any given application. Conclusions: A flexible data-driven network architecture combined with the Jensen-Shannon divergence to predict the best training data set provides a promising direction that might enable robust data-driven photoacoustic oximetry for clinical use cases.

An Indocyanine Green-Based Nanoprobe for In Vivo Detection of Cellular Senescence.

There is an urgent need to improve conventional cancer-treatments by preventing detrimental side effects, cancer recurrence and metastases. Recent studies have shown that presence of senescent cells in tissues treated with chemo- or radiotherapy can be used to predict the effectiveness of cancer treatment. However, although the accumulation of senescent cells is one of the hallmarks of cancer, surprisingly little progress has been made in development of strategies for their detection in vivo. To address a lack of detection tools, we developed a biocompatible, injectable organic nanoprobe (NanoJagg), which is selectively taken up by senescent cells and accumulates in the lysosomes. The NanoJagg probe is obtained by self-assembly of indocyanine green (ICG) dimers using a scalable manufacturing process and characterized by a unique spectral signature suitable for both photoacoustic tomography (PAT) and fluorescence imaging. In vitro, ex vivo and in vivo studies all indicate that NanoJaggs are a clinically translatable probe for detection of senescence and their PAT signal makes them suitable for longitudinal monitoring of the senescence burden in solid tumors after chemotherapy or radiotherapy.

Moving Beyond Simulation: Data-Driven Quantitative Photoacoustic Imaging Using Tissue-Mimicking Phantoms.

Accurate measurement of optical absorption coefficients from photoacoustic imaging (PAI) data would enable direct mapping of molecular concentrations, providing vital clinical insight. The ill-posed nature of the problem of absorption coefficient recovery has prohibited PAI from achieving this goal in living systems due to the domain gap between simulation and experiment. To bridge this gap, we introduce a collection of experimentally well-characterised imaging phantoms and their digital twins. This first-of-a-kind phantom data set enables supervised training of a U-Net on experimental data for pixel-wise estimation of absorption coefficients. We show that training on simulated data results in artefacts and biases in the estimates, reinforcing the existence of a domain gap between simulation and experiment. Training on experimentally acquired data, however, yielded more accurate and robust estimates of optical absorption coefficients. We compare the results to fluence correction with a Monte Carlo model from reference optical properties of the materials, which yields a quantification error of approximately 20%. Application of the trained U-Nets to a blood flow phantom demonstrated spectral biases when training on simulated data, while application to a mouse model highlighted the ability of both learning-based approaches to recover the depth-dependent loss of signal intensity. We demonstrate that training on experimental phantoms can restore the correlation of signal amplitudes measured in depth. While the absolute quantification error remains high and further improvements are needed, our results highlight the promise of deep learning to advance quantitative PAI.

Effects of skin tone on photoacoustic imaging and oximetry.

Significance: Photoacoustic imaging (PAI) provides contrast based on the concentration of optical absorbers in tissue, enabling the assessment of functional physiological parameters such as blood oxygen saturation (sO2). Recent evidence suggests that variation in melanin levels in the epidermis leads to measurement biases in optical technologies, which could potentially limit the application of these biomarkers in diverse populations. Aim: To examine the effects of skin melanin pigmentation on PAI and oximetry. Approach: We evaluated the effects of skin tone in PAI using a computational skin model, two-layer melanin-containing tissue-mimicking phantoms, and mice of a consistent genetic background with varying pigmentations. The computational skin model was validated by simulating the diffuse reflectance spectrum using the adding-doubling method, allowing us to assign our simulation parameters to approximate Fitzpatrick skin types. Monte Carlo simulations and acoustic simulations were run to obtain idealized photoacoustic images of our skin model. Photoacoustic images of the phantoms and mice were acquired using a commercial instrument. Reconstructed images were processed with linear spectral unmixing to estimate blood oxygenation. Linear unmixing results were compared with a learned unmixing approach based on gradient-boosted regression. Results: Our computational skin model was consistent with representative literature for in vivo skin reflectance measurements. We observed consistent spectral coloring effects across all model systems, with an overestimation of sO2 and more image artifacts observed with increasing melanin concentration. The learned unmixing approach reduced the measurement bias, but predictions made at lower blood sO2 still suffered from a skin tone-dependent effect. Conclusion: PAI demonstrates measurement bias, including an overestimation of blood sO2, in higher Fitzpatrick skin types. Future research should aim to characterize this effect in humans to ensure equitable application of the technology.

The Potential of Photoacoustic Imaging in Radiation Oncology.

Radiotherapy is recognized globally as a mainstay of treatment in most solid tumors and is essential in both curative and palliative settings. Ionizing radiation is frequently combined with surgery, either preoperatively or postoperatively, and with systemic chemotherapy. Recent advances in imaging have enabled precise targeting of solid lesions yet substantial intratumoral heterogeneity means that treatment planning and monitoring remains a clinical challenge as therapy response can take weeks to manifest on conventional imaging and early indications of progression can be misleading. Photoacoustic imaging (PAI) is an emerging modality for molecular imaging of cancer, enabling non-invasive assessment of endogenous tissue chromophores with optical contrast at unprecedented spatio-temporal resolution. Preclinical studies in mouse models have shown that PAI could be used to assess response to radiotherapy and chemoradiotherapy based on changes in the tumor vascular architecture and blood oxygen saturation, which are closely linked to tumor hypoxia. Given the strong relationship between hypoxia and radio-resistance, PAI assessment of the tumor microenvironment has the potential to be applied longitudinally during radiotherapy to detect resistance at much earlier time-points than currently achieved by size measurements and tailor treatments based on tumor oxygen availability and vascular heterogeneity. Here, we review the current state-of-the-art in PAI in the context of radiotherapy research. Based on these studies, we identify promising applications of PAI in radiation oncology and discuss the future potential and outstanding challenges in the development of translational PAI biomarkers of early response to radiotherapy.