Laser speckle contrast imaging based on spatial frequency domain filtering.

We proposed a novel method to separate static and dynamic speckles based on spatial frequency domain filtering. First, the raw speckle image sequence is processed frame by frame through 2D Fourier transform, low-pass and high-pass filtering in the spatial frequency domain, and inverse Fourier transform. Then, we can obtain low- and high-frequency image sequences in the spatial domain. Second, we averaged both sequences in the time domain. After the above processing, we obtain the mean intensities of the dynamic and static speckle components in the spatial domain. Finally, we calculated the time-averaged modulation depth to map the 2-D blood flow distribution. Both phantom and vivo experiments demonstrated that the proposed method could effectively suppress the background non-uniformity and has the advantage of high computational efficiency. It also can effectively improve image contrast, contrast-to-noise ratio, and imaging dynamic range.

Automatic cell counting for phase-contrast microscopic images based on a combination of Otsu and watershed segmentation method.

Cell counting plays a vital role in biomedical researches. However, manual cell counting is time-consuming, laborious, and low efficiency and has a high counting error rate problem. An automatic counting approach for Hela cells of phase-contrast microscopic images is proposed based on the combination of Otsu and watershed segmentation methods to solve the mentioned issues. Firstly, image preprocessing is performed. Secondly, the Otsu method was used to obtain an automatic global optimal threshold for segmentation to achieve batch counting of images. Thirdly, the marker watershed was performed to separate adherent cells and to avoid over-segmentation simultaneously. Finally, cells in phase-contrast microscopic images were counted by detecting the numbers of connected domains in the binary image. Taking the manual counting result as the counting standard and MIS, INC, and ACC are used as evaluation indicators. The experimental results showed that the average values of MIS, INC, and ACC of the proposed method are only 3.31%, 3.49%, and 96.69%, respectively. Additionally, each cell image was counted only takes 0.65 s on averagely. To further test the performance of the proposed method, a comparative experiment was carried out by Image J, and the result shows that the proposed method has a better counting performance with a higher average accuracy of 96.55% to Image J with 93.39%.The proposed method for cell counting is simple, feasible, fast and high accurate, and it can be used as an effective method for cell counting of the phase-contrast microscopic images.

Integration of Global and Local Features for Specular Reflection Inpainting in Colposcopic Images.

Objective: To explore an inpainting method that can balance texture details and visual observability to eliminate the specular reflection (SR) regions in the colposcopic image, thus improving the accuracy of clinical diagnosis for cervical cancer. Methods: (1) To ensure smoothness, Gaussian Blur and filling methods are applied to the global image. (2) Striving to preserve the anatomical texture details of the colposcopic image as much as possible, the exemplar-based method is applied to local blocks. (3) The colposcopic images inpainted in the previous two steps are integrated, so that important information of non-SR regions is preserved based on eliminating SR regions. Results: In the subjective visual assessment of inpainting results, the average of 3.55 ranks first in the five comparison sets. As to the clinical test, comparing the diagnosis results of 6 physicians before and after eliminating SR regions, the average accuracy of two kinds of classifications increased by 1.44% and 2.03%, respectively. Conclusions: This method can effectively eliminate the SR regions in the colposcopy image and present a satisfactory visual effect. Significance. As a preprocessing method for computer-aided diagnosis systems, it can also improve physicians' accuracy in clinical diagnosis.

Recognition of Thyroid Ultrasound Standard Plane Images Based on Residual Network.

Ultrasound is one of the critical methods for diagnosis and treatment in thyroid examination. In clinical application, many reasons, such as large outpatient traffic, time-consuming training of sonographers, and uneven professional level of physicians, often cause irregularities during the ultrasonic examination, leading to misdiagnosis or missed diagnosis. In order to standardize the thyroid ultrasound examination process, this paper proposes using a deep learning method based on residual network to recognize the Thyroid Ultrasound Standard Plane (TUSP). At first, referring to multiple relevant guidelines, eight TUSP were determined with the advice of clinical ultrasound experts. A total of 5,500 TUSP images of 8 categories were collected with the approval and review of the Ethics Committee and the patient's informed consent. Then, after desensitizing and filling the images, the 18-layer residual network model (ResNet-18) was trained for TUSP image recognition, and five-fold cross-validation was performed. Finally, through indicators like accuracy rate, we compared the recognition effect of other mainstream deep convolutional neural network models. Experimental results showed that ResNet-18 has the best recognition effect on TUSP images with an average accuracy rate of 91.07%. The average macro precision, average macro recall, and average macro F1-score are 91.39%, 91.34%, and 91.30%, respectively. It proves that the deep learning method based on residual network can effectively recognize TUSP images, which is expected to standardize clinical thyroid ultrasound examination and reduce misdiagnosis and missed diagnosis.

Recognition of Fetal Facial Ultrasound Standard Plane Based on Texture Feature Fusion.

In the process of prenatal ultrasound diagnosis, accurate identification of fetal facial ultrasound standard plane (FFUSP) is essential for accurate facial deformity detection and disease screening, such as cleft lip and palate detection and Down syndrome screening check. However, the traditional method of obtaining standard planes is manual screening by doctors. Due to different levels of doctors, this method often leads to large errors in the results. Therefore, in this study, we propose a texture feature fusion method (LH-SVM) for automatic recognition and classification of FFUSP. First, extract image's texture features, including Local Binary Pattern (LBP) and Histogram of Oriented Gradient (HOG), then perform feature fusion, and finally adopt Support Vector Machine (SVM) for predictive classification. In our study, we used fetal facial ultrasound images from 20 to 24 weeks of gestation as experimental data for a total of 943 standard plane images (221 ocular axial planes, 298 median sagittal planes, 424 nasolabial coronal planes, and 350 nonstandard planes, OAP, MSP, NCP, N-SP). Based on this data set, we performed five-fold cross-validation. The final test results show that the accuracy rate of the proposed method for FFUSP classification is 94.67%, the average precision rate is 94.27%, the average recall rate is 93.88%, and the average F1 score is 94.08%. The experimental results indicate that the texture feature fusion method can effectively predict and classify FFUSP, which provides an essential basis for clinical research on the automatic detection method of FFUSP.

A Benign and Malignant Breast Tumor Classification Method via Efficiently Combining Texture and Morphological Features on Ultrasound Images.

The classification of benign and malignant based on ultrasound images is of great value because breast cancer is an enormous threat to women's health worldwide. Although both texture and morphological features are crucial representations of ultrasound breast tumor images, their straightforward combination brings little effect for improving the classification of benign and malignant since high-dimensional texture features are too aggressive so that drown out the effect of low-dimensional morphological features. For that, an efficient texture and morphological feature combing method is proposed to improve the classification of benign and malignant. Firstly, both texture (i.e., local binary patterns (LBP), histogram of oriented gradients (HOG), and gray-level co-occurrence matrixes (GLCM)) and morphological (i.e., shape complexities) features of breast ultrasound images are extracted. Secondly, a support vector machine (SVM) classifier working on texture features is trained, and a naive Bayes (NB) classifier acting on morphological features is designed, in order to exert the discriminative power of texture features and morphological features, respectively. Thirdly, the classification scores of the two classifiers (i.e., SVM and NB) are weighted fused to obtain the final classification result. The low-dimensional nonparameterized NB classifier is effectively control the parameter complexity of the entire classification system combine with the high-dimensional parametric SVM classifier. Consequently, texture and morphological features are efficiently combined. Comprehensive experimental analyses are presented, and the proposed method obtains a 91.11% accuracy, a 94.34% sensitivity, and an 86.49% specificity, which outperforms many related benign and malignant breast tumor classification methods.

Texture Feature-Based Classification on Transrectal Ultrasound Image for Prostatic Cancer Detection.

Prostate cancer is one of the most common cancers in men. Early detection of prostate cancer is the key to successful treatment. Ultrasound imaging is one of the most suitable methods for the early detection of prostate cancer. Although ultrasound images can show cancer lesions, subjective interpretation is not accurate. Therefore, this paper proposes a transrectal ultrasound image analysis method, aiming at characterizing prostate tissue through image processing to evaluate the possibility of malignant tumours. Firstly, the input image is preprocessed by optical density conversion. Then, local binarization and Gaussian Markov random fields are used to extract texture features, and the linear combination is performed. Finally, the fused texture features are provided to SVM classifier for classification. The method has been applied to data set of 342 transrectal ultrasound images obtained from hospitals with an accuracy of 70.93%, sensitivity of 70.00%, and specificity of 71.74%. The experimental results show that it is possible to distinguish cancerous tissues from noncancerous tissues to some extent.

Multi-Person Pose Estimation via Multi-Layer Fractal Network and Joints Kinship Pattern.

We propose an effective method to boost the accuracy of multi-person pose estimation in images. Initially, the three-layer fractal network was constructed to regress multi-person joints location heatmap that can help to enhance an image region with receptive field and capture more joints local-contextual feature information, thereby producing keypoints heatmap intermediate prediction to optimize human body joints regression results. Subsequently, the hierarchical bi-directional inference algorithm was proposed to calculate the degree of relatedness (call it Kinship) for adjacent joints, and it combines the Kinship between adjacent joints with the spatial constraints, which we refer to as joints kinship pattern matching mechanism, to determine the best matched joints pair. We iterate the above-mentioned joints matching process layer by layer until all joints are assigned to a corresponding individual. Comprehensive experiments demonstrate that the proposed approach outperforms the state-of-the-art schemes and achieves about 1% and 0.6% increase in mAP on MPII multi-person subset and MSCOCO 2016 keypoints challenge.

Multiscale Cooperative Differential Evolution Algorithm.

A multiscale cooperative differential evolution algorithm is proposed to solve the problems of narrow search range at the early stage and slow convergence at the later stage in the performance of the traditional differential evolution algorithms. Firstly, the population structure of multipopulation mechanism is adopted so that each subpopulation is combined with a corresponding mutation strategy to ensure the individual diversity during evolution. Then, the covariance learning among populations is developed to establish a suitable rotating coordinate system for cross operation. Meanwhile, an adaptive parameter adjustment strategy is introduced to balance the population survey and convergence. Finally, the proposed algorithm is tested on the CEC 2005 benchmark function and compared with other state-of-the-art evolutionary algorithms. The experiment results showed that the proposed algorithm has better performance in solving global optimization problems than other compared algorithms.

Automatic segmentation of cervical region in colposcopic images using K-means.

Colposcopy is an important imaging modality for the detection of cervical lesions. The analysis of colposcopic images, especially the effective segmentation of the cervical region, has important clinical value in clinical application. A cervical segmentation method based on the HSV color mode is proposed, which can divide and extract the cervical region in the medical and anatomical sense. Firstly, the histogram threshold method is used to analyze the histogram (Y) of the colposcopic image. In order to achieve the removal of the mirror reflection pretreatment operation in the colposcopy image. Secondly, the Preprocessed RGB images is used. Then, the colposcopic image is converted into the HSV color space, and the V component is extracted using the K-means algorithm. Finally, using the area filter to smooth the edge, the segmented cervical region can be obtained. In our study, 110 standard colposcopy images, which were tagged by experts, were tested and verified. The segmentation results were analyzed and compared using dice coefficients, Jaccard coefficients, structural segmentation accuracy specificity, sensitivity, positive predictive value, and negative predictive value. Our experimental results show that the accuracy, specificity and sensitivity of the method are 87.25%, 81.99% and 96.70%, respectively. The effectiveness of the method in clinical segmentation was verified. Our study has demonstrated that cervical regional segmentation of colposcopic images based on HSV color space using K-means has high clinical utility and can help medical specialists in the diagnosis of cervical cancer.

Fuzzy entropy based on differential evolution for breast gland segmentation.

For the diagnosis and treatment of breast tumors, the automatic detection of glands is a crucial step. The true segmentation of the gland is directly related to effective treatment effect of the patient. Therefore, it is necessary to propose an automatic segmentation algorithm based on mammary gland features. A segmentation method of differential evolution (DE) fuzzy entropy based on mammary gland is proposed in the paper. According to the image fuzzy entropy, the evaluation function of image segmentation is constructed in the first step. Then, the method adopts DE, the image fuzzy entropy parameter is regard as the initial population of individual. After the mutation, crossover and selection of three evolutionary processes to search for the maximum fuzzy entropy of parameters, the optimal threshold of the segmented gland is achieved. Finally, the mammary gland is segmented by the threshold method of maximum fuzzy entropy. Eight breast images with four tissue types are tested 100 times, with accuracy (Acc), sensitivity (Sen), specificity (Spe), positive predictive value (PPV), negative predicted value (NPV), and average structural similarity (Mssim) to measure the segmentation result. The Acc of the proposed algorithm is 98.46 ± 8.02E-03%, 95.93 ± 2.38E-02%, 93.88 ± 6.59E-02%, 94.73 ± 1.82E-01%, 96.19 ± 1.15E-02%, and 97.51 ± 1.36E-02%, 96.64 ± 6.35E-02%, and 94.76 ± 6.21E-02%, respectively. The mean Mssim values of the 100 tests were 0.985, 0.933, 0.924, 0.907, 0.984, 0.928, 0.938, and 0.941, respectively. Our proposed algorithm is more effective and robust in comparison to the other fuzzy entropy based on swarm intelligent optimization algorithms. The experimental results show that the proposed algorithm has higher accuracy in the segmentation of mammary glands, and may serve as a gold standard in the analysis of treatment of breast tumors.

Performance of heterodyne differential phase-shift-keying underwater wireless optical communication systems in gamma-gamma-distributed turbulence.

The analytical expressions for the average bit error rate and the outage probability of a heterodyne differential phase-shift-keying underwater wireless optical communication (UWOC) system are derived with proper consideration of all of the channel-degrading effects, including absorption, scattering, and turbulence-induced fading. The scintillation index of a spherical wave is evaluated in order to quantify the underwater system performance in a strong turbulence regime. The spherical wave propagating through the strong underwater turbulence environment is modeled as gamma-gamma distribution. Then, the system performance is simulated for various variations of the underwater turbulence, i.e., the rate of dissipation of kinetic energy per unit mass of fluid, the ratio of temperature to salinity contributions to the refractive index spectrum, and the UWOC system link length. The results show that the analytical expressions for describing the system performance are valid.

Measurement of M²-Curve for Asymmetric Beams by Self-Referencing Interferometer Wavefront Sensor.

For asymmetric laser beams, the values of beam quality factor M x 2 and M y 2 are inconsistent if one selects a different coordinate system or measures beam quality with different experimental conditionals, even when analyzing the same beam. To overcome this non-uniqueness, a new beam quality characterization method named as M²-curve is developed. The M²-curve not only contains the beam quality factor M x 2 and M y 2 in the x-direction and y-direction, respectively; but also introduces a curve of M x α 2 versus rotation angle α of coordinate axis. Moreover, we also present a real-time measurement method to demonstrate beam propagation factor M²-curve with a modified self-referencing Mach-Zehnder interferometer based-wavefront sensor (henceforth SRI-WFS). The feasibility of the proposed method is demonstrated with the theoretical analysis and experiment in multimode beams. The experimental results showed that the proposed measurement method is simple, fast, and a single-shot measurement procedure without movable parts.

Complex amplitude reconstruction for dynamic beam quality M2 factor measurement with self-referencing interferometer wavefront sensor.

A real-time complex amplitude reconstruction method for determining the dynamic beam quality M2 factor based on a Mach-Zehnder self-referencing interferometer wavefront sensor is developed. By using the proposed complex amplitude reconstruction method, full characterization of the laser beam, including amplitude (intensity profile) and phase information, can be reconstructed from a single interference pattern with the Fourier fringe pattern analysis method in a one-shot measurement. With the reconstructed complex amplitude, the beam fields at any position z along its propagation direction can be obtained by first utilizing the diffraction integral theory. Then the beam quality M2 factor of the dynamic beam is calculated according to the specified method of the Standard ISO11146. The feasibility of the proposed method is demonstrated with the theoretical analysis and experiment, including the static and dynamic beam process. The experimental method is simple, fast, and operates without movable parts and is allowed in order to investigate the laser beam in inaccessible conditions using existing methods.

Imaging and characterizing shear wave and shear modulus under orthogonal acoustic radiation force excitation using OCT Doppler variance method.

We report on a novel acoustic radiation force orthogonal excitation optical coherence elastography (ARFOE-OCE) technique for imaging shear wave and quantifying shear modulus under orthogonal acoustic radiation force (ARF) excitation using the optical coherence tomography (OCT) Doppler variance method. The ARF perpendicular to the OCT beam is produced by a remote ultrasonic transducer. A shear wave induced by ARF excitation propagates parallel to the OCT beam. The OCT Doppler variance method, which is sensitive to the transverse vibration, is used to measure the ARF-induced vibration. For analysis of the shear modulus, the Doppler variance method is utilized to visualize shear wave propagation instead of Doppler OCT method, and the propagation velocity of the shear wave is measured at different depths of one location with the M scan. In order to quantify shear modulus beyond the OCT imaging depth, we move ARF to a deeper layer at a known step and measure the time delay of the shear wave propagating to the same OCT imaging depth. We also quantitatively map the shear modulus of a cross-section in a tissue-equivalent phantom after employing the B scan.

Speckle reduction in optical coherence tomography images based on wave atoms.

Optical coherence tomography (OCT) is an emerging noninvasive imaging technique, which is based on low-coherence interferometry. OCT images suffer from speckle noise, which reduces image contrast. A shrinkage filter based on wave atoms transform is proposed for speckle reduction in OCT images. Wave atoms transform is a new multiscale geometric analysis tool that offers sparser expansion and better representation for images containing oscillatory patterns and textures than other traditional transforms, such as wavelet and curvelet transforms. Cycle spinning-based technology is introduced to avoid visual artifacts, such as Gibbs-like phenomenon, and to develop a translation invariant wave atoms denoising scheme. The speckle suppression degree in the denoised images is controlled by an adjustable parameter that determines the threshold in the wave atoms domain. The experimental results show that the proposed method can effectively remove the speckle noise and improve the OCT image quality. The signal-to-noise ratio, contrast-to-noise ratio, average equivalent number of looks, and cross-correlation (XCOR) values are obtained, and the results are also compared with the wavelet and curvelet thresholding techniques.

Shack-Hartmann centroid detection using the spiral phase transform.

We present a Shack-Hartmann (SH) centroid detection algorithm capable to measure in presence of strong noise, background illumination and spot modulating signals, which are typical limiting factors of traditional centroid detection algorithms. The proposed method is based on performing a normalization of the SH pattern using the spiral phase transform method and Fourier filtering. The spot centroids are then obtained using global thresholding and weighted average methods. We have tested the algorithm with simulations and experimental data obtaining satisfactory results. A complete MATLAB package that can reproduce all the results can be downloaded from [http://goo.gl/o2JhD].

Circular common-path point diffraction interferometer.

A simple and compact point-diffraction interferometer with circular common-path geometry configuration is developed. The interferometer is constructed by a beam-splitter, two reflection mirrors, and a telescope system composed by two lenses. The signal and reference waves travel along the same path. Furthermore, an opaque mask containing a reference pinhole and a test object holder or test window is positioned in the common focal plane of the telescope system. The object wave is divided into two beams that take opposite paths along the interferometer. The reference wave is filtered by the reference pinhole, while the signal wave is transmitted through the object holder. The reference and signal waves are combined again in the beam-splitter and their interference is imaged in the CCD. The new design is compact, vibration insensitive, and suitable for the measurement of moving objects or dynamic processes.