ULTRA-SR Challenge: Assessment of Ultrasound Localization and TRacking Algorithms for Super-Resolution Imaging.

With the widespread interest and uptake of super-resolution ultrasound (SRUS) through localization and tracking of microbubbles, also known as ultrasound localization microscopy (ULM), many localization and tracking algorithms have been developed. ULM can image many centimeters into tissue in-vivo and track microvascular flow non-invasively with sub-diffraction resolution. In a significant community effort, we organized a challenge, Ultrasound Localization and TRacking Algorithms for Super-Resolution (ULTRA-SR). The aims of this paper are threefold: to describe the challenge organization, data generation, and winning algorithms; to present the metrics and methods for evaluating challenge entrants; and to report results and findings of the evaluation. Realistic ultrasound datasets containing microvascular flow for different clinical ultrasound frequencies were simulated, using vascular flow physics, acoustic field simulation and nonlinear bubble dynamics simulation. Based on these datasets, 38 submissions from 24 research groups were evaluated against ground truth using an evaluation framework with six metrics, three for localization and three for tracking. In-vivo mouse brain and human lymph node data were also provided, and performance assessed by an expert panel. Winning algorithms are described and discussed. The publicly available data with ground truth and the defined metrics for both localization and tracking present a valuable resource for researchers to benchmark algorithms and software, identify optimized methods/software for their data, and provide insight into the current limits of the field. In conclusion, Ultra-SR challenge has provided benchmarking data and tools as well as direct comparison and insights for a number of the state-of-the art localization and tracking algorithms.

Comparing a Portable Motion Analysis System against the Gold Standard for Potential Anterior Cruciate Ligament Injury Prevention and Screening.

Knee kinematics during a drop vertical jump, measured by the Kinect V2 (Microsoft, Redmond, WA, USA), have been shown to be associated with an increased risk of non-contact anterior cruciate ligament injury. The accuracy and reliability of the Microsoft Kinect V2 has yet to be assessed specifically for tracking the coronal and sagittal knee angles of the drop vertical jump. Eleven participants performed three drop vertical jumps that were recorded using both the Kinect V2 and a gold standard motion analysis system (Vicon, Los Angeles, CA, USA). The initial coronal, peak coronal, and peak sagittal angles of the left and right knees were measured by both systems simultaneously. Analysis of the data obtained by the Kinect V2 was performed by our software. The differences in the mean knee angles measured by the Kinect V2 and the Vicon system were non-significant for all parameters except for the peak sagittal angle of the right leg with a difference of 7.74 degrees and a p-value of 0.008. There was excellent agreement between the Kinect V2 and the Vicon system, with intraclass correlation coefficients consistently over 0.75 for all knee angles measured. Visual analysis revealed a moderate frame-to-frame variability for coronal angles measured by the Kinect V2. The Kinect V2 can be used to capture knee coronal and sagittal angles with sufficient accuracy during a drop vertical jump, suggesting that a Kinect-based portable motion analysis system is suitable to screen individuals for the risk of non-contact anterior cruciate ligament injury.

SCANED: Siamese collateral assessment network for evaluation of collaterals from ischemic damage.

This study conducts collateral evaluation from ischemic damage using a deep learning-based Siamese network, addressing the challenges associated with a small and imbalanced dataset. The collateral network provides an alternative oxygen and nutrient supply pathway in ischemic stroke cases, influencing treatment decisions. Research in this area focuses on automated collateral assessment using deep learning (DL) methods to expedite decision-making processes and enhance accuracy. Our study employed a 3D ResNet-based Siamese network, referred to as SCANED, to classify collaterals as good/intermediate or poor. Utilizing non-contrast computed tomography (NCCT) images, the network automates collateral identification and assessment by analyzing tissue degeneration around the ischemic site. Relevant features from the left/right hemispheres were extracted, and Euclidean Distance (ED) was employed for similarity measurement. Finally, dichotomized classification of good/intermediate or poor collateral is performed by SCANED using an optimal threshold derived from ROC analysis. SCANED provides a sensitivity of 0.88, a specificity of 0.63, and a weighted F1 score of 0.86 in the dichotomized classification.

On the soft tissue ultrasound elastography using FEM based inversion approach.

Elastography is a medical imaging modality that enables visualization of tissue stiffness. It involves quasi-static or harmonic mechanical stimulation of the tissue to generate a displacement field which is used as input in an inversion algorithm to reconstruct tissue elastic modulus. This paper considers quasi-static stimulation and presents a novel inversion technique for elastic modulus reconstruction. The technique follows an inverse finite element framework. Reconstructed elastic modulus maps produced in this technique do not depend on the initial guess, while it is computationally less involved than iterative reconstruction approaches. The method was first evaluated using simulated data (in-silico) where modulus reconstruction's sensitivity to displacement noise and elastic modulus was assessed. To demonstrate the method's performance, displacement fields of two tissue mimicking phantoms determined using three different motion tracking techniques were used as input to the developed elastography method to reconstruct the distribution of relative elastic modulus of the inclusion to background tissue. In the next stage, the relative elastic modulus of three clinical cases pertaining to liver cancer patient were determined. The obtained results demonstrate reasonably high elastic modulus reconstruction accuracy in comparison with similar direct methods. Also it is associated with reduced computational cost in comparison with iterative techniques, which suffer from convergence and uniqueness issues, following the same formulation concept. Moreover, in comparison with other methods which need initial guess, the presented method does not require initial guess while it is easy to understand and implement.

Homodyned K-Distribution Parameter Estimation in Quantitative Ultrasound: Autoencoder and Bayesian Neural Network Approaches.

Quantitative ultrasound (QUS) analyzes the ultrasound (US) backscattered data to find the properties of scatterers that correlate with the tissue microstructure. Statistics of the envelope of the backscattered radio frequency (RF) data can be utilized to estimate several QUS parameters. Different distributions have been proposed to model envelope data. The homodyned K-distribution (HK-distribution) is one of the most comprehensive distributions that can model US backscattered envelope data under diverse scattering conditions (varying scatterer number density and coherent scattering). The scatterer clustering parameter ( α ) and the ratio of the coherent to diffuse scattering power ( k ) are the parameters of this distribution that have been used extensively for tissue characterization in diagnostic US. The estimation of these two parameters (which we refer to as HK parameters) is done using optimization algorithms in which statistical features such as the envelope point-wise signal-to-noise ratio (SNR), skewness, kurtosis, and the log-based moments have been utilized as input to such algorithms. The optimization methods minimize the difference between features and their theoretical value from the HK model. We propose that the true value of these statistical features is a hyperplane that covers a small portion of the feature space. In this article, we follow two approaches to reduce the effect of sample features' error. We propose a model projection neural network based on denoising autoencoders to project the noisy features into this space based on this assumption. We also investigate if the noise distribution can be learned by the deep estimators. We compare the proposed methods with conventional methods using simulations, an experimental phantom, and data from an in vivo animal model of hepatic steatosis. The network weight and a demo code are available online at ht.tp://code.sonography.ai.

Alternating direction method of multipliers for displacement estimation in ultrasound strain elastography.

BACKGROUND: Ultrasound strain imaging, which delineates mechanical properties to detect tissue abnormalities, involves estimating the time delay between two radio-frequency (RF) frames collected before and after tissue deformation. The existing regularized optimization-based time-delay estimation (TDE) techniques suffer from at least one of the following drawbacks: (1) The regularizer is not aligned with the tissue deformation physics due to taking only the first-order displacement derivative into account; (2) The L 2 $L2$ -norm of the displacement derivatives, which oversmooths the estimated time-delay, is utilized as the regularizer; (3) The modulus function defined mathematically should be approximated by a smooth function to facilitate the optimization of L 1 $L1$ -norm. PURPOSE: Our purpose is to develop a novel TDE technique that resolves the aforementioned shortcomings of the existing algorithms. METHODS: Herein, we propose employing the alternating direction method of multipliers (ADMM) for optimizing a novel cost function consisting of L 2 $L2$ -norm data fidelity term and L 1 $L1$ -norm first- and second-order spatial continuity terms. ADMM empowers the proposed algorithm to use different techniques for optimizing different parts of the cost function and obtain high-contrast strain images with smooth backgrounds and sharp boundaries. We name our technique ADMM for totaL variaTion RegUlarIzation in ultrasound STrain imaging (ALTRUIST). ALTRUIST's efficacy is quantified using absolute error (AE), Structural SIMilarity (SSIM), signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), and strain ratio (SR) with respect to GLUE, OVERWIND, and L 1 $L1$ -SOUL, three recently published energy-based techniques, and UMEN-Net, a state-of-the-art deep learning-based algorithm. Analysis of variance (ANOVA)-led multiple comparison tests and paired t $t$ -tests at 5 % $5\%$ overall significance level were conducted to assess the statistical significance of our findings. The Bonferroni correction was taken into account in all statistical tests. Two simulated layer phantoms, three simulated resolution phantoms, one hard-inclusion simulated phantom, one multi-inclusion simulated phantom, one experimental breast phantom, and three in vivo liver cancer datasets have been used for validation experiments. We have published the ALTRUIST code at http://code.sonography.ai. RESULTS: ALTRUIST substantially outperforms the four state-of-the-art benchmarks in all validation experiments, both qualitatively and quantitatively. ALTRUIST yields up to 573 % ∗ ${573\%}^{*}$ , 41 % ∗ ${41\%}^{*}$ , and 51 % ∗ ${51\%}^{*}$ SNR improvements and 443 % ∗ ${443\%}^{*}$ , 53 % ∗ ${53\%}^{*}$ , and 15 % ∗ ${15\%}^{*}$ CNR improvements over L 1 $L1$ -SOUL, its closest competitor, for simulated, phantom, and in vivo liver cancer datasets, respectively, where the asterisk (*) indicates statistical significance. In addition, ANOVA-led multiple comparison tests and paired t $t$ -tests indicate that ALTRUIST generally achieves statistically significant improvements over GLUE, UMEN-Net, OVERWIND, and L 1 $L1$ -SOUL in terms of AE, SSIM map, SNR, and CNR. CONCLUSIONS: A novel ultrasonic displacement tracking algorithm named ALTRUIST has been developed. The principal novelty of ALTRUIST is incorporating ADMM for optimizing an L 1 $L1$ -norm regularization-based cost function. ALTRUIST exhibits promising performance in simulation, phantom, and in vivo experiments.

Bayesian workflow for the investigation of hierarchical classification models from tau-PET and structural MRI data across the Alzheimer's disease spectrum.

Background: Alzheimer's disease (AD) diagnosis in its early stages remains difficult with current diagnostic approaches. Though tau neurofibrillary tangles (NFTs) generally follow the stereotypical pattern described by the Braak staging scheme, the network degeneration hypothesis (NDH) has suggested that NFTs spread selectively along functional networks of the brain. To evaluate this, we implemented a Bayesian workflow to develop hierarchical multinomial logistic regression models with increasing levels of complexity of the brain from tau-PET and structural MRI data to investigate whether it is beneficial to incorporate network-level information into an ROI-based predictive model for the presence/absence of AD. Methods: This study included data from the Translational Biomarkers in Aging and Dementia (TRIAD) longitudinal cohort from McGill University's Research Centre for Studies in Aging (MCSA). Baseline and 1 year follow-up structural MRI and [18F]MK-6240 tau-PET scans were acquired for 72 cognitive normal (CN), 23 mild cognitive impairment (MCI), and 18 Alzheimer's disease dementia subjects. We constructed the four following hierarchical Bayesian models in order of increasing complexity: (Model 1) a complete-pooling model with observations, (Model 2) a partial-pooling model with observations clustered within ROIs, (Model 3) a partial-pooling model with observations clustered within functional networks, and (Model 4) a partial-pooling model with observations clustered within ROIs that are also clustered within functional brain networks. We then investigated which of the models had better predictive performance given tau-PET or structural MRI data as an input, in the form of a relative annualized rate of change. Results: The Bayesian leave-one-out cross-validation (LOO-CV) estimate of the expected log pointwise predictive density (ELPD) results indicated that models 3 and 4 were substantially better than other models for both tau-PET and structural MRI inputs. For tau-PET data, model 3 was slightly better than 4 with an absolute difference in ELPD of 3.10 ± 1.30. For structural MRI data, model 4 was considerably better than other models with an absolute difference in ELPD of 29.83 ± 7.55 relative to model 3, the second-best model. Conclusion: Our results suggest that representing the data generating process in terms of a hierarchical model that encompasses both ROI-level and network-level heterogeneity leads to better predictive ability for both tau-PET and structural MRI inputs over all other model iterations.

Physics-Inspired Regularized Pulse-Echo Quantitative Ultrasound: Efficient Optimization With ADMM.

Pulse-echo quantitative ultrasound (PEQUS), which estimates the quantitative properties of tissue microstructure, entails estimating the average attenuation and the backscatter coefficient (BSC). Growing recent research has focused on the regularized estimation of these parameters. Herein, we make two contributions to this field: first, we consider the physics of the average attenuation and backscattering to devise regularization terms accordingly. More specifically, since the average attenuation gradually alters in different parts of the tissue, while BSC can vary markedly from tissue to tissue, we apply L2 and L1 norms for the average attenuation and the BSC, respectively. Second, we multiply different frequencies and depths of the power spectra with different weights according to their noise levels. Our rationale is that the high-frequency contents of the power spectra at deep regions have a low signal-to-noise ratio (SNR). We exploit the alternating direction method of multipliers (ADMM) for optimizing the cost function. The qualitative and quantitative evaluations of bias and variance exhibit that our proposed algorithm improves the estimations of the average attenuation and the BSC up to about 100%.

Exploiting Mechanics-Based Priors for Lateral Displacement Estimation in Ultrasound Elastography.

Tracking the displacement between the pre- and post-deformed radio-frequency (RF) frames is a pivotal step of ultrasound elastography, which depicts tissue mechanical properties to identify pathologies. Due to ultrasound's poor ability to capture information pertaining to the lateral direction, the existing displacement estimation techniques fail to generate an accurate lateral displacement or strain map. The attempts made in the literature to mitigate this well-known issue suffer from one of the following limitations: 1) Sampling size is substantially increased, rendering the method computationally and memory expensive. 2) The lateral displacement estimation entirely depends on the axial one, ignoring data fidelity and creating large errors. This paper proposes exploiting the effective Poisson's ratio (EPR)-based mechanical correspondence between the axial and lateral strains along with the RF data fidelity and displacement continuity to improve the lateral displacement and strain estimation accuracies. We call our techniques MechSOUL (Mechanically-constrained Second-Order Ultrasound eLastography) and L1 -MechSOUL ( L1 -norm-based MechSOUL), which optimize L2 - and L1 -norm-based penalty functions, respectively. Extensive validation experiments with simulated, phantom, and in vivo datasets demonstrate that MechSOUL and L1 -MechSOUL's lateral strain and EPR estimation abilities are substantially superior to those of the recently-published elastography techniques. We have published the MATLAB codes of MechSOUL and L1 -MechSOUL at https://code.sonography.ai.

The Big Bang of Deep Learning in Ultrasound-Guided Surgery: A Review.

Ultrasound (US) imaging is a paramount modality in many image-guided surgeries and percutaneous interventions, thanks to its high portability, temporal resolution, and cost-efficiency. However, due to its imaging principles, the US is often noisy and difficult to interpret. Appropriate image processing can greatly enhance the applicability of the imaging modality in clinical practice. Compared with the classic iterative optimization and machine learning (ML) approach, deep learning (DL) algorithms have shown great performance in terms of accuracy and efficiency for US processing. In this work, we conduct a comprehensive review on deep-learning algorithms in the applications of US-guided interventions, summarize the current trends, and suggest future directions on the topic.

Segmentation of Arm Ultrasound Images in Breast Cancer-Related Lymphedema: A Database and Deep Learning Algorithm.

OBJECTIVE: Breast cancer treatment often causes the removal of or damage to lymph nodes of the patient's lymphatic drainage system. This side effect is the origin of Breast Cancer-Related Lymphedema (BCRL), referring to a noticeable increase in excess arm volume. Ultrasound imaging is a preferred modality for the diagnosis and progression monitoring of BCRL because of its low cost, safety, and portability. As the affected and unaffected arms look similar in B-mode ultrasound images, the thickness of the skin, subcutaneous fat, and muscle have been shown to be important biomarkers for this task. The segmentation masks are also helpful in monitoring the longitudinal changes in morphology and mechanical properties of tissue layers. METHODS: For the first time, a publicly available ultrasound dataset containing the Radio-Frequency (RF) data of 39 subjects and manual segmentation masks by two experts, are provided. Inter- and intra-observer reproducibility studies performed on the segmentation maps show a high Dice Score Coefficient (DSC) of 0.94±0.08 and 0.92±0.06, respectively. Gated Shape Convolutional Neural Network (GSCNN) is modified for precise automatic segmentation of tissue layers, and its generalization performance is improved by the CutMix augmentation strategy. RESULTS: We got an average DSC of 0.87±0.11 on the test set, which confirms the high performance of the method. CONCLUSION: Automatic segmentation can pave the way for convenient and accessible staging of BCRL, and our dataset can facilitate development and validation of those methods. SIGNIFICANCE: Timely diagnosis and treatment of BCRL have crucial importance in preventing irreversible damage.

Lateral Strain Imaging Using Self-Supervised and Physically Inspired Constraints in Unsupervised Regularized Elastography.

Convolutional Neural Networks (CNN) have shown promising results for displacement estimation in UltraSound Elastography (USE). Many modifications have been proposed to improve the displacement estimation of CNNs for USE in the axial direction. However, the lateral strain, which is essential in several downstream tasks such as the inverse problem of elasticity imaging, remains a challenge. The lateral strain estimation is complicated since the motion and the sampling frequency in this direction are substantially lower than the axial one, and a lack of carrier signal in this direction. In computer vision applications, the axial and the lateral motions are independent. In contrast, the tissue motion pattern in USE is governed by laws of physics which link the axial and lateral displacements. In this paper, inspired by Hooke's law, we, first propose Physically Inspired ConsTraint for Unsupervised Regularized Elastography (PICTURE), where we impose a constraint on the Effective Poisson's ratio (EPR) to improve the lateral strain estimation. In the next step, we propose self-supervised PICTURE (sPICTURE) to further enhance the strain image estimation. Extensive experiments on simulation, experimental phantom and in vivo data demonstrate that the proposed methods estimate accurate axial and lateral strain maps.

Using an Affordable Motion Capture System to Evaluate the Prognostic Value of Drop Vertical Jump Parameters for Noncontact ACL Injury.

BACKGROUND: Knee kinematic parameters during a drop vertical jump (DVJ) have been demonstrated to be associated with increased risk of noncontact anterior cruciate ligament (ACL) injury. However, standard motion analysis systems are not practical for routine screening. Affordable and practical motion sensor alternatives exist but require further validation in the context of ACL injury risk assessment. PURPOSE/HYPOTHESIS: To prospectively study DVJ parameters as predictors of noncontact ACL injury in collegiate athletes using an affordable motion capture system (Kinect; Microsoft). We hypothesized that athletes who sustained noncontact ACL injury would have larger initial and peak contact coronal abduction angles and smaller peak flexion angles at the knee during a DVJ. STUDY DESIGN: Case-control study; Level of evidence, 3. METHODS: 102 participants were prospectively recruited from a collegiate varsity sports program. A total of 101 of the 102 athletes (99%) were followed for an entire season for noncontact ACL injury. Each athlete performed 3 DVJs, and the data were recorded using the motion capture system. Initial coronal, peak coronal, and peak sagittal angles of the knee were identified by our software. RESULTS: Five of the 101 athletes sustained a noncontact ACL injury. Peak coronal angles were significantly greater and peak sagittal flexion angles were significantly smaller in ACL-injured athletes (P = .049, P = .049, respectively). Receiver operating characteristic (ROC) analysis demonstrated an area under the curve of 0.88, 0.92, and 0.90 for initial coronal, peak coronal, and peak sagittal angle, respectively. An initial coronal angle cutoff of 2.96° demonstrated 80% sensitivity and 72% specificity, a peak coronal angle cutoff of 6.16° demonstrated 80% sensitivity and 72% specificity, and a peak sagittal flexion cutoff of 93.82° demonstrated 80% sensitivity and 74% specificity on the study cohort. CONCLUSION: Increased peak coronal angle and decreased peak sagittal angle during a DVJ were significantly associated with increased risk for noncontact ACL injury. Based on ROC analysis, initial coronal angle showed good prognostic ability, whereas peak coronal angle and peak sagittal flexion provided excellent prognostic ability. Affordable motion capture systems show promise as cost-effective and practical options for large-scale ACL injury risk screening.

Deep learning for collateral evaluation in ischemic stroke with imbalanced data.

PURPOSE: Collateral evaluation is typically done using visual inspection of cerebral images and thus suffers from intra- and inter-rater variability. Large open databases of ischemic stroke patients are rare, limiting the use of deep learning methods in treatment decision-making. METHODS: We adapted a pre-trained EfficientNet B0 network through transfer learning to improve collateral evaluation using slice-based and subject-level classification. Our method uses stacking and overlapping of 2D slices from a patient's 4D computed tomography angiography (CTA) and a majority voting scheme to determine a patient's final collateral grade based on all classified 2D MIPs. Class imbalance is handled in the evaluation process by using the focal loss with class weight to penalize the majority class. RESULTS: We evaluated our method using a nine-fold cross-validation performed with 83 subjects. Mean sensitivity of 0.71, specificity of 0.84, and a weighted F1 score of 0.71 in multi-class (good, intermediate, and poor) classification were obtained. Considering treatment effect, a dichotomized decision is also made for collateral scoring of a subject based on two classes (good/intermediate and poor) which achieves a sensitivity of 0.89 and specificity of 0.96 with a weighted F1 score of 0.95. CONCLUSION: An automatic and robust collateral assessment method that mitigates the issues with the small imbalanced dataset was developed. Computer-aided evaluation of collaterals can help decision-making of ischemic stroke treatment strategy in clinical settings.

Comparison of multifidus muscle intramuscular fat by ultrasound echo intensity and fat-water based MR images in individuals with chronic low back pain.

PURPOSE: The aim of this observational cross-sectional study was to examine correlations of intramuscular fat content in lumbar multifidus (LM) by comparing muscle echo intensity (EI) and percent fat signal fraction (%FSF) generated from ultrasound (US) and magnetic resonance (MR) images, respectively. METHODS: MRI and US images from 25 participants (16 females, 9 males) selected from a cohort of patients with chronic low back pain (CLBP) were used. Images were acquired bilaterally, at the L4 and L5 levels (e.g., 4 sites). EI measurements were acquired by manually tracing the cross-sectional border of LM. Mean EI of three US images per site were analyzed (e.g., raw EI). A correction factor for subcutaneous fat thickness (SFT) was also calculated and applied (e.g., corrected EI). Corresponding fat and water MR images were used to acquire %FSF measurements. Intra-rater reliability was assessed by intraclass coefficients (ICC). Pearson correlations and simple linear regression were used to assess the relationship between %FSF, raw EI and corrected EI measurements. RESULTS: The intra-rater ICCs for all measurements were moderate to excellent. Correlations between %FSF vs. raw EI and corrected EI were moderate to strong (0.40 < r < 0.52) and (0.40 < r < 0.51), respectively. Moderate correlations between SFT and EI were also identified. CONCLUSION: US is a low-cost, non-invasive, accessible, and reliable method to examine muscle composition, and presents a promising solution for assessing and monitoring the effect of different treatment options for CLBP in clinical settings.

Robust landmark-based brain shift correction with a Siamese neural network in ultrasound-guided brain tumor resection.

PURPOSE: In brain tumor surgery, tissue shift (called brain shift) can move the surgical target and invalidate the surgical plan. A cost-effective and flexible tool, intra-operative ultrasound (iUS) with robust image registration algorithms can effectively track brain shift to ensure surgical outcomes and safety. METHODS: We proposed to employ a Siamese neural network, which was first trained using natural images and fine-tuned with domain-specific data to automatically detect matching anatomical landmarks in iUS scans at different surgical stages. An efficient 2.5D approach and an iterative re-weighted least squares algorithm are utilized to perform landmark-based registration for brain shift correction. The proposed method is validated and compared against the state-of-the-art methods using the public BITE and RESECT datasets. RESULTS: Registration of pre-resection iUS scans to during- and post-resection iUS images were executed. The results with the proposed method shows a significant improvement from the initial misalignment ([Formula: see text]) and the method is comparable to the state-of-the-art methods validated on the same datasets. CONCLUSIONS: We have proposed a robust technique to efficiently detect matching landmarks in iUS and perform brain shift correction with excellent performance. It has the potential to improve the accuracy and safety of neurosurgery.

DiffeoRaptor: diffeomorphic inter-modal image registration using RaPTOR.

PURPOSE: Diffeomorphic image registration is essential in many medical imaging applications. Several registration algorithms of such type have been proposed, but primarily for intra-contrast alignment. Currently, efficient inter-modal/contrast diffeomorphic registration, which is vital in numerous applications, remains a challenging task. METHODS: We proposed a novel inter-modal/contrast registration algorithm that leverages Robust PaTch-based cOrrelation Ratio metric to allow inter-modal/contrast image alignment and bandlimited geodesic shooting demonstrated in Fourier-Approximated Lie Algebras (FLASH) algorithm for fast diffeomorphic registration. RESULTS: The proposed algorithm, named DiffeoRaptor, was validated with three public databases for the tasks of brain and abdominal image registration while comparing the results against three state-of-the-art techniques, including FLASH, NiftyReg, and Symmetric image Normalization (SyN). CONCLUSIONS: Our results demonstrated that DiffeoRaptor offered comparable or better registration performance in terms of registration accuracy. Moreover, DiffeoRaptor produces smoother deformations than SyN in inter-modal and contrast registration. The code for DiffeoRaptor is publicly available at https://github.com/nimamasoumi/DiffeoRaptor .

Deep Estimation of Speckle Statistics Parametric Images.

Quantitative Ultrasound (QUS) provides important information about the tissue properties. QUS parametric image can be formed by dividing the envelope data into small overlapping patches and computing different speckle statistics such as parameters of the Nakagami and Homodyned K-distributions (HK-distribution). The calculated QUS parametric images can be erroneous since only a few independent samples are available inside the patches. Another challenge is that the envelope samples inside the patch are assumed to come from the same distribution, an assumption that is often violated given that the tissue is usually not homogenous. In this paper, we propose a method based on Convolutional Neural Networks (CNN) to estimate QUS parametric images without patching. We construct a large dataset sampled from the HK-distribution, having regions with random shapes and QUS parameter values. We then use a well-known network to estimate QUS parameters in a multi-task learning fashion. Our results confirm that the proposed method is able to reduce errors and improve border definition in QUS parametric images.

Vision Transformers for Classification of Breast Ultrasound Images.

Medical ultrasound (US) imaging has become a prominent modality for breast cancer imaging due to its ease of use, low cost, and safety. In the past decade, convolutional neural networks (CNNs) have emerged as the method of choice in vision applications and have shown excellent potential in the automatic classification of US images. Despite their success, their restricted local receptive field limits their ability to learn global context information. Recently, Vision Transformer (ViT) designs, based on self-attention between image patches, have shown great potential to be an alternative to CNNs. In this study, for the first time, we utilize ViT to classify breast US images using different augmentation strategies. We also adopted a weighted cross-entropy loss function since breast ultrasound datasets are often imbalanced. The results are provided as classification accuracy and Area Under the Curve (AUC) metrics, and the performance is compared with the SOTA CNNs. The results indicate that the ViT models have comparable efficiency with or even better than the CNNs in the classification of US breast images. Clinical relevance- This work shows the potential of Vision Transformers in the automatic classification of masses in breast ultrasound, which helps clinicians diagnose and make treatment decisions more precisely.

Inverse Problem of Ultrasound Beamforming With Denoising-Based Regularized Solutions.

During the past few years, inverse problem formulations of ultrasound beamforming have attracted growing interest. They usually pose beamforming as a minimization problem of a fidelity term resulting from the measurement model plus a regularization term that enforces a certain class on the resulting image. Here, we take advantage of alternating direction method of multipliers to propose a flexible framework in which each term is optimized separately. Furthermore, the proposed beamforming formulation is extended to replace the regularization term with a denoising algorithm, based on the recent approaches called plug-and-play (PnP) and regularization by denoising (RED). Such regularizations are shown in this work to better preserve speckle texture, an important feature in ultrasound imaging, than sparsity-based approaches previously proposed in the literature. The efficiency of the proposed methods is evaluated on simulations, real phantoms, and in vivo data available from a plane-wave imaging challenge in medical ultrasound. Furthermore, a comprehensive comparison with existing ultrasound beamforming methods is also provided. These results show that the RED algorithm gives the best image quality in terms of contrast index while preserving the speckle statistics.