A two-dimensional angular interpolation based on radial basis functions for high frame rate ultrafast imaging.

To solve the problem of reduced image quality in plane wave imaging (PWI), coherent plane wave compounding (CPWC) has been introduced, based on a combination of plane wave images from several directions (i.e., with different angles). However, the number of angles needed to reach a reasonable image quality affects the maximum achievable frame rate in CPWC. In this study, we suggest reducing the tradeoff between the image quality and the frame rate in CPWC by employing two-dimensional (2D) interpolation based on radial basis functions. More specifically, we propose constructing a three-dimensional spatio-angular structure to integrate both spatial and angular information into the reconstruction prior to 2D interpolation. The rationale behind our proposal is to reduce the number of transmissions and then apply the 2D interpolation along the angle dimension to reconstruct the missing information corresponding to the angles not selected for CPWC imaging. To evaluate the proposed technique, we applied it to the PWI challenges in the medical ultrasound database. Results show that we can achieve 3× to 4× improvement in frame rate while maintaining acceptable image quality compared to the case of using all the angles.

Time Efficient Ultrasound Localization Microscopy Based on A Novel Radial Basis Function 2D Interpolation.

Ultrasound localization microscopy (ULM) allows for the generation of super-resolved (SR) images of the vasculature by precisely localizing intravenously injected microbubbles. Although SR images may be useful for diagnosing and treating patients, their use in the clinical context is limited by the need for prolonged acquisition times and high frame rates. The primary goal of our study is to relax the requirement of high frame rates to obtain SR images. To this end, we propose a new time-efficient ULM (TEULM) pipeline built on a cutting-edge interpolation method. More specifically, we suggest employing Radial Basis Functions (RBFs) as interpolators to estimate the missing values in the 2-dimensional (2D) spatio-temporal structures. To evaluate this strategy, we first mimic the data acquisition at a reduced frame rate by applying a down-sampling (DS = 2, 4, 8, and 10) factor to high frame rate ULM data. Then, we up-sample the data to the original frame rate using the suggested interpolation to reconstruct the missing frames. Finally, using both the original high frame rate data and the interpolated one, we reconstruct SR images using the ULM framework steps. We evaluate the proposed TEULM using four in vivo datasets, a Rat brain (dataset A), a Rat kidney (dataset B), a Rat tumor (dataset C) and a Rat brain bolus (dataset D), interpolating at the in-phase and quadrature (IQ) level. Results demonstrate the effectiveness of TEULM in recovering vascular structures, even at a DS rate of 10 (corresponding to a frame rate of sub-100Hz). In conclusion, the proposed technique is successful in reconstructing accurate SR images while requiring frame rates of one order of magnitude lower than standard ULM.

Automatic segmentation of 2D echocardiography ultrasound images by means of generative adversarial network.

Automated cardiac segmentation from two-dimensional (2D) echocardiographic images is a crucial step toward improving clinical diagnosis. Anatomical heterogeneity and inherent noise, however, present technical challenges and lower segmentation accuracy. The objective of this study is to propose a method for the automatic segmentation of the ventricular endocardium, the myocardium, and the left atrium, in order to accurately determine clinical indices. Specifically, we suggest using the recently introduced pixel-to-pixel Generative Adversarial Network (Pix2Pix GAN) model for accurate segmentation. To accomplish this, we integrate the backbone PatchGAN model for the discriminator and the UNET for the generator, for building the Pix2Pix GAN. The resulting model produces precisely segmented images, thanks to UNET's capability for precise segmentation and PatchGAN's capability for fine-grained discrimination. For the experimental validation, we use the Cardiac Acquisitions for Multi-structure Ultrasound Segmentation (CAMUS) dataset, which consists of echocardiographic images from 500 patients in 2-chamber (2CH) and 4-chamber (4CH) views at the end-diastolic (ED) and end-systolic (ES) phases. Similarly to state-of-the-art studies on the same dataset, we followed the same train-test splits. Our results demonstrate that the proposed GAN-based technique improves segmentation performance for clinical and geometrical parameters compared to the state-of-the-art methods. More precisely, throughout the ED and ES phases, the mean Dice values for the left ventricular endocardium reached 0.961 and 0.930 for 2CH, and 0.959 and 0.950 for 4CH, respectively. Furthermore, the average ejection fraction correlation and Mean Absolute Error obtained were 0.95 and 3.2ml for 2CH, and 0.98 and 2.1ml for 4CH, outperforming the state-of-the-art results.

Low-complexity lung ultrasound video scoring by means of intensity projection-based video compression.

Since the outbreak of COVID-19, efforts have been made towards semi-quantitative analysis of lung ultrasound (LUS) data to assess the patient's condition. Several methods have been proposed in this regard, with a focus on frame-level analysis, which was then used to assess the condition at the video and prognostic levels. However, no extensive work has been done to analyze lung conditions directly at the video level. This study proposes a novel method for video-level scoring based on compression of LUS video data into a single image and automatic classification to assess patient's condition. The method utilizes maximum, mean, and minimum intensity projection-based compression of LUS video data over time. This enables to preserve hyper- and hypo-echoic data regions, while compressing the video down to a maximum of three images. The resulting images are then classified using a convolutional neural network (CNN). Finally, the worst predicted score given among the images is assigned to the corresponding video. The results show that this compression technique can achieve a promising agreement at the prognostic level (81.62%), while the video-level agreement remains comparable with the state-of-the-art (46.19%). Conclusively, the suggested method lays down the foundation for LUS video compression, shifting from frame-level to direct video-level analysis of LUS data.

High Frame Rate Ultrasound Imaging by Means of Tensor Completion: Application to Echocardiography.

High frame rate ultrasound (US) imaging enables the monitoring of fast-moving organs. In echocardiography, this is especially needed due to the existence of rapidly moving structures, such as the heart valves. In the last two decades, various methods have been proposed to improve the frame rate. Here, we propose a novel method, based on binary coding patterns (BCPs) and tensor completion (TC), to increase the temporal resolution (i.e., frame rate) in the preprocessing stage of conventional focused ultrasound imaging (CFUI). The rationale behind our proposal is to perform, at first, the beamforming of a fraction of the scan lines, randomly selected in each frame based on BCP. Then, we reconstruct the missing scan lines through TC. The latter is an effective technique for recovering missing information from a low-rank tensor, based on a small number of observations using rank minimization. Following our approach, reducing the transmissions events needed to generate an image, the frame rate is increased by the same proportion. We have applied the proposed technique to a pre-beamformed radio frequency (RF) echocardiographic dataset. Our results show that we can improve the frame rate by a factor from 3 to 4, while keeping the structural similarity (SSIM) of the reconstructed tensor and the original one at values higher than 0.98.

Increasing frame rate of echocardiography based on a novel 2D spatio-temporal meshless interpolation.

BACKGROUND: Increasing temporal resolution through numerical methods aids clinicians to evaluate fast moving structures of the heart with more confidence. METHODOLOGY: In this study, a spatio-temporal numerical method is proposed to increase the frame rate based on two-dimensional (2D) interpolation. More specifically, we propose a novel intensity variation time surface (IVTS) strategy to incorporate both temporal and spatial information in the reconstruction. In this regard, we exploit radial basis functions (RBFs) for 2D interpolation. The reason for choosing RBFs for this task is manifold. First, RBFs are able to interpolate on large-scale datasets. Moreover, their mathematical implementation is simple. Another important property of this interpolation technique, which is addressed in this study, is its meshless nature. The meshless property enables higher up-sampling (UpS) rates for echocardiography to improve temporal resolution without noticeably degrading image quality. To evaluate the proposed approach, we tested the RBF interpolation on 2D/3D echocardiography datasets. The reconstructed frames were analyzed using different image quality metrics, and the results were compared with two popular techniques from the literature. RESULTS: The findings demonstrated that, with a down-sampling rate of 3, the proposed technique outperformed the best existing method by 42%, 87%, 8%, and 11%, respectively, in terms of mean square error (MSE), contrast to noise ratio (CNR), peak signal-to-noise ratio (PSNR), and figure of merit (FOM). It should be noted that the proposed method is comparable to the best available method in terms of structural similarity (SSIM) index. Furthermore, when compared to the original images, the results of employing our technique on radio-frequency (RF) level analysis demonstrated that the reconstruction accuracy is satisfactory in terms of image quality criterion. CONCLUSION: Finally, it is worthwhile noting that the proposed method is better than (or comparable to) the other methods in terms of reconstruction performance and processing time. Therefore, the RBF interpolation can be a promising alternative to the existing methods.

Benchmark methodological approach for the application of artificial intelligence to lung ultrasound data from COVID-19 patients: From frame to prognostic-level.

Automated ultrasound imaging assessment of the effect of CoronaVirus disease 2019 (COVID-19) on lungs has been investigated in various studies using artificial intelligence-based (AI) methods. However, an extensive analysis of state-of-the-art Convolutional Neural Network-based (CNN) models for frame-level scoring, a comparative analysis of aggregation techniques for video-level scoring, together with a thorough evaluation of the capability of these methodologies to provide a clinically valuable prognostic-level score is yet missing within the literature. In addition to that, the impact on the analysis of the posterior probability assigned by the network to the predicted frames as well as the impact of temporal downsampling of LUS data are topics not yet extensively investigated. This paper takes on these challenges by providing a benchmark analysis of methods from frame to prognostic level. For frame-level scoring, state-of-the-art deep learning models are evaluated with additional analysis of best performing model in transfer-learning settings. A novel cross-correlation based aggregation technique is proposed for video and exam-level scoring. Results showed that ResNet-18, when trained from scratch, outperformed the existing methods with an F1-Score of 0.659. The proposed aggregation method resulted in 59.51%, 63.29%, and 84.90% agreement with clinicians at the video, exam, and prognostic levels, respectively; thus, demonstrating improved performances over the state of the art. It was also found that filtering frames based on the posterior probability shows higher impact on the LUS analysis in comparison to temporal downsampling. All of these analysis were conducted over the largest standardized and clinically validated LUS dataset from COVID-19 patients.

Coherent Plane Wave Compounding Combined With Tensor Completion Applied for Ultrafast Imaging.

To solve the problem of resolution and contrast in plane wave imaging (PWI), coherent plane wave compounding (CPWC) was introduced, in which scanning was performed at different angles, which can achieve the desired image quality by combining the images obtained from PWI at different angles. However, the application of this idea reduces the frame rate in proportion to the number of plane waves (PWs) or angles, so that in this modality, when dealing with some applications such as shear wave imaging (SWI) and strain imaging, there is always a compromise between the frame rate and the image quality. Tensor completion (TC) is a powerful technique to recover missing information of a low-rank tensor from limited observations based on rank minimization. In this article, we present an idea based on TC to make this compromise lighter; in other words, with a smaller number of angles, we can achieve the desired quality of the output image. To evaluate the proposed idea, plane wave imaging challenge in medical ultrasound (PICMUS) datasets was used, which were recorded at 75 different angles. The results of the resolution evaluation showed that using 20% of the coherent PWs and reconstructing other 80% by TC, compared with the situation of using only 20% of the coherent PWs provided a resolution improvement of 14.97% and 17.4% in the simulated and experimental point targets, respectively. Also, the results of the contrast investigation showed that the contrast ratio (CR) improved by 72.6%, 62.9%, and 111.4% in the simulated cyst target data, experimental cyst targets, and in vivo carotid cross section, respectively. The results confirmed that using 20% of the coherent PWs and reconstructing other 80% by TC, the image quality is very close to that obtained by considering all 75 angles, so that the difference in resolution is less than 2% and the difference in contrast to noise ratio (CNR) is less than 5 dB. Therefore, with this idea, it can be said that less compromise is needed; in other words, despite having a higher frame rate, an acceptable quality can be achieved.

Efficient synthetic transmit aperture ultrasound based on tensor completion.

One of the most important methods in medical ultrasound imaging is the synthetic transmit aperture (STA). Despite the image quality improvement in the STA, this method suffers from several limitations, including a limited data acquisition rate and an increase in the overall time to form a single frame. Tensor completion (TC) is a powerful technique that uses rank minimization to recover missing information from a low-rank tensor. This paper provides a novel random synthetic transmit aperture (RSTA) method based on using only a randomly selected part (a fraction) of the linear array elements in the transmit mode to increase the data acquisition rate and then applying the tensor completion (TC) to improve the image quality. By the proposed method, as it is not necessary to transmit all elements sequentially, the data acquisition rate is improved and the overall time for creating an image is also significantly reduced. We investigated the proposed idea by using several simulated and experimental phantoms. Results showed that the proposed method could increase the data acquisition rate up to three times with the image quality difference of less than 6% compared to the original STA method.

Classification of sleep apnea using EMD-based features and PSO-trained neural networks.

In this study, we propose a method for detecting obstructive sleep apnea (OSA) based on the features extracted from empirical mode decomposition (EMD) and the neural networks trained by particle swarm optimization (PSO) in the classification phase. After extracting the features from the intrinsic mode functions (IMF) of each heart rate variability (HRV) signal of each segment, these features were applied to the input of popular classifiers such as multi-layer perceptron neural networks (MLPNN), Naïve Bayes, linear discriminant analysis (LDA), k-nearest neighborhood (KNN), and support vector machines (SVM) were applied. The results show that the MLPNN learned with back propagation (BP) algorithm has a diagnostic accuracy of less than 90%, and this may be due to being derivative based property of the BP algorithm, which causes trapping in the local minima. For Improving MLPNN's performance, we used the PSO algorithm instead of the BP method in training part. Therefore, the MLPNN's accuracy improved from 89.36 to 97.66% after the application of the PSO algorithm. The proposed method has also reached to 97.78 and 97.96% in sensitivity and specificity, respectively. So, it can be concluded that the proposed method achieves better or comparable results when compared with the previous works in this field.