Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology.

Deformable registration of magnetic resonance images between patients with brain tumors and healthy subjects has been an important tool to specify tumor geometry through location alignment and facilitate pathological analysis. Since tumor region does not match with any ordinary brain tissue, it has been difficult to deformably register a patient's brain to a normal one. Many patient images are associated with irregularly distributed lesions, resulting in further distortion of normal tissue structures and complicating registration's similarity measure. In this work, we follow a multi-step context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. The coarse image-to-image translation is applied to make a rough inference of the missing parts. Then, a feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. A symmetry constraint reflecting a large degree of anatomical symmetry in the brain is further proposed to achieve better structure understanding. Deformable registration is applied between inpainted patient images and normal brains, and the resulting deformation field is eventually used to deform original patient data for the final alignment. The method was applied to the Multimodal Brain Tumor Segmentation (BraTS) 2018 challenge database and compared against three existing inpainting methods. The proposed method yielded results with increased peak signal-to-noise ratio, structural similarity index, inception score, and reduced L1 error, leading to successful patient-to-normal brain image registration.

Correction: A method to quantify mechanobiologic forces during zebrafish cardiac development using 4-D light sheet imaging and computational modeling.

[This corrects the article DOI: 10.1371/journal.pcbi.1005828.].

Image Quality Assessment Based on Local Linear Information and Distortion-Specific Compensation.

Image quality assessment (IQA) is a fundamental yet constantly developing task for computer vision and image processing. Most IQA evaluation mechanisms are based on the pertinence of subjective and objective estimation. Each image distortion type has its own property correlated with human perception. However, this intrinsic property may not be fully exploited by existing IQA methods. In this paper, we make two main contributions to the IQA field. First, a novel IQA method is developed based on a local linear model that examines the distortion between the reference and the distorted images for better alignment with human visual experience. Second, a distortion-specific compensation strategy is proposed to offset the negative effect on IQA modeling caused by different image distortion types. These score offsets are learned from several known distortion types. Furthermore, for an image with an unknown distortion type, a convolutional neural network-based method is proposed to compute the score offset automatically. Finally, an integrated IQA metric is proposed by combining the aforementioned two ideas. Extensive experiments are performed to verify the proposed IQA metric, which demonstrate that the local linear model is useful in human perception modeling, especially for individual image distortion, and the overall IQA method outperforms several state-of-the-art IQA approaches.

Automated anterior segment OCT image analysis for Angle Closure Glaucoma mechanisms classification.

BACKGROUND AND OBJECTIVES: Angle closure glaucoma (ACG) is an eye disease prevalent throughout the world. ACG is caused by four major mechanisms: exaggerated lens vault, pupil block, thick peripheral iris roll, and plateau iris. Identifying the specific mechanism in a given patient is important because each mechanism requires a specific medication and treatment regimen. Traditional methods of classifying these four mechanisms are based on clinically important parameters measured from anterior segment optical coherence tomography (AS-OCT) images, which rely on accurate segmentation of the AS-OCT image and identification of the scleral spur in the segmented AS-OCT images by clinicians. METHODS: In this work, a fully automated method of classifying different ACG mechanisms based on AS-OCT images is proposed. Since the manual diagnosis mainly based on the morphology of each mechanism, in this study, a complete set of morphological features is extracted directly from raw AS-OCT images using compound image transforms, from which a small set of informative features with minimum redundancy are selected and fed into a Naïve Bayes Classifier (NBC). RESULTS: We achieved an overall accuracy of 89.2% and 85.12% with a leave-one-out cross-validation and 10-fold cross-validation method, respectively. This study proposes a fully automated way for the classification of different ACG mechanisms, which is without intervention of doctors and less subjective when compared to the existing methods. CONCLUSIONS: We directly extracted the compound image transformed features from the raw AS-OCT images without any segmentation and parameter measurement. Our method provides a completely automated and efficient way for the classification of different ACG mechanisms.

Learning a Combined Model of Visual Saliency for Fixation Prediction.

A large number of saliency models, each based on a different hypothesis, have been proposed over the past 20 years. In practice, while subscribing to one hypothesis or computational principle makes a model that performs well on some types of images, it hinders the general performance of a model on arbitrary images and large-scale data sets. One natural approach to improve overall saliency detection accuracy would then be fusing different types of models. In this paper, inspired by the success of late-fusion strategies in semantic analysis and multi-modal biometrics, we propose to fuse the state-of-the-art saliency models at the score level in a para-boosting learning fashion. First, saliency maps generated by several models are used as confidence scores. Then, these scores are fed into our para-boosting learner (i.e., support vector machine, adaptive boosting, or probability density estimator) to generate the final saliency map. In order to explore the strength of para-boosting learners, traditional transformation-based fusion strategies, such as Sum, Min, and Max, are also explored and compared in this paper. To further reduce the computation cost of fusing too many models, only a few of them are considered in the next step. Experimental results show that score-level fusion outperforms each individual model and can further reduce the performance gap between the current models and the human inter-observer model.

AUTOMATED MULTI-MODALITY REGISTRATION OF 64-SLICE CORONARY CT ANGIOGRAPHY WITH MYOCARDIAL PERFUSION SPECT.

A multi-modality image registration algorithm for the alignment of myocardial perfusion SPECT (MPS) and coronary computed tomography angiography (CTA) scans is presented in this work. Coronary CTA and MPS provides clinically complementary information in the diagnosis of coronary artery disease. An automated registration algorithm is proposed utilizing segmentation results of MPS volumes, where regions of myocardium and blood pools are extracted and used as an anatomical mask. Using a variational framework, we adopt an energy functional with a piecewise constant image model and optimize it numerically with a gradient descent algorithm. The computational efficiency and robustness of the proposed automatic registration of CTA with MPS have been demonstrated by the experiments that yielded an average error smaller than an MPS voxel size.

A multiscale error diffusion technique for digital halftoning.

A new digital halftoning technique based on multiscale error diffusion is examined. We use an image quadtree to represent the difference image between the input gray-level image and the output halftone image. In iterative algorithm is developed that searches the brightest region of a given image via "maximum intensity guidance" for assigning dots and diffuses the quantization error noncausally at each iteration. To measure the quality of halftone images, we adopt a new criterion based on hierarchical intensity distribution. The proposed method provides very good results both visually and in terms of the hierarchical intensity quality measure.