Automated anatomical labeling of a topologically variant abdominal arterial system via probabilistic hypergraph matching.

Automated anatomical vessel labeling of the abdominal arterial system is a crucial topic in medical image processing. One reason for this is the importance of the abdominal arterial system in the human body, and another is that such labeling is necessary for the related disease diagnoses, treatments and epidemiological population analyses. We define a hypergraph representation of the abdominal arterial system as a family tree model with a probabilistic hypergraph matching framework for automated vessel labeling. Then we treat the labelling problem as the convex optimization problem and solve it with the maximum a posteriori(MAP) combined the likelihood obtained by geometric labelling with the family tree topology-based knowledge. Geometrically, we utilize XGBoost ensemble learning with an intrinsic geometric feature importance analysis for branch-level labeling. In topology, the defined family tree model of the abdominal arterial system is transferred as a Markov chain model using a constrained traversal order method and further the Markov chain model is optimized by a hidden Markov model (HMM). The probability distribution of the target branches for each candidate anatomical name is predicted and effectively embedded in the HMM model. This approach is evaluated with the leave-one-out method on 37 clinical patients' abdominal arteries, and the average accuracy is 91.94%. The obtained results are better than those of the state-of-art method with an F1 score of 93.00% and a recall of 93.00%, as the proposed method simultaneously handles the anatomical structural variability and discriminates between the symmetric branches. It is demonstrated to be suitable for labelling branches of the abdominal arterial system and can also be extended to similar tubular organ networks, such as arterial or airway networks.

Skeleton-Based Parametric 2-D Region Representation: Disk B-Spline Curves.

The skeleton, or medial axis, is an important attribute of 2-D shapes. The disk B-spline curve (DBSC) is a skeleton-based parametric freeform 2-D region representation, which is defined in the B-spline form. The DBSC describes not only a 2-D region, which is suitable for describing heterogeneous materials in the region, but also the center curve (skeleton) of the region explicitly, which is suitable for animation, simulation, and recognition. In addition to being useful for error estimation of the B-spline curve, the DBSC can be used in designing and animating freeform 2-D regions. Despite increasing DBSC applications, its theory and fundamentals have not been thoroughly investigated. In this article, we discuss several fundamental properties and algorithms, such as the de Boor algorithm for DBSCs. We first derive the explicit evaluation and derivatives formulas at arbitrary points of a 2-D region (interior and boundary) represented by a DBSC and then provide heterogeneous object representation. We also introduce modeling and interactive heterogeneous object design methods for a DBSC, which consolidates DBSC theory and supports its further applications.

Caricature Expression Extrapolation Based on Kendall Shape Space Theory.

Facial expression editing plays a fundamental role in facial expression generation and has been widely applied in modern film productions and computer games. While the existing 2-D caricature facial expression editing methods are mostly realized by expression interpolation from the original image to the target image, expression extrapolation has rarely been studied before. In this article, we propose a novel expression extrapolation method for caricature facial expressions based on the Kendall shape space, in which the key idea is to introduce a representation for the 3-D expression model to remove rigid transformations, such as translation, scaling, and rotation, from the Kendall shape space. Built upon the proposed representation, the 2-D caricature expression extrapolation process can be controlled by the 3-D model reconstructed from the input 2-D caricature image and the exaggerated expressions of the caricature images generated based on the extrapolated expression of a 3-D model that is robust to facial poses in the Kendall shape space; this 3-D model can be calculated with tools such as exponential mapping in Riemannian space. The experimental results demonstrate that our method can effectively and automatically extrapolate facial expressions in caricatures with high consistency and fidelity. In addition, we derive 3-D facial models with diverse expressions and expand the scale of the original FaceWarehouse database. Furthermore, compared with the deep learning method, our approach is based on standard face datasets and avoids the construction of complicated 3-D caricature training sets.

A Parallel Cerebrovascular Segmentation Algorithm Based on Focused Multi-Gaussians Model and Heterogeneous Markov Random Field.

A complete and detailed cerebrovascular image segmented from time-of-flight magnetic resonance angiography (TOF-MRA) data is essential for the diagnosis and therapy of the cerebrovascular diseases. In recent years, three-dimensional cerebrovascular segmentation algorithms based on statistical models have been widely used, but the existed methods always perform poorly on stenotic vessels and are not robust enough. In this paper, we propose a parallel cerebrovascular segmentation algorithm based on focused multi-Gaussians model and heterogeneous Markov random field. Specifically, we present a focused multi-Gaussians (FMG) model with local fitting region to model the vascular tissue more accurately and introduce the chaotic oscillation particle swarm optimization (CO-PSO) algorithm to improve the global optimization capability in the parameter estimation. Furthermore, we design a heterogeneous Markov Random Field (MRF) in the three-dimensional neighborhood system to incorporate precise local character of image. Finally, the algorithm has been performed parallel optimization based on GPUs and obtain about 60 times speedup compared to serial execution. The experiments show that the proposed algorithm can produce more detailed segmentation result in shorter time and performs well on the stenotic vessels robustly.

A PCA-Based method for determining craniofacial relationship and sexual dimorphism of facial shapes.

Previous studies have used principal component analysis (PCA) to investigate the craniofacial relationship, as well as sex determination using facial factors. However, few studies have investigated the extent to which the choice of principal components (PCs) affects the analysis of craniofacial relationship and sexual dimorphism. In this paper, we propose a PCA-based method for visual and quantitative analysis, using 140 samples of 3D heads (70 male and 70 female), produced from computed tomography (CT) images. There are two parts to the method. First, skull and facial landmarks are manually marked to guide the model's registration so that dense corresponding vertices occupy the same relative position in every sample. Statistical shape spaces of the skull and face in dense corresponding vertices are constructed using PCA. Variations in these vertices, captured in every principal component (PC), are visualized to observe shape variability. The correlations of skull- and face-based PC scores are analysed, and linear regression is used to fit the craniofacial relationship. We compute the PC coefficients of a face based on this craniofacial relationship and the PC scores of a skull, and apply the coefficients to estimate a 3D face for the skull. To evaluate the accuracy of the computed craniofacial relationship, the mean and standard deviation of every vertex between the two models are computed, where these models are reconstructed using real PC scores and coefficients. Second, each PC in facial space is analysed for sex determination, for which support vector machines (SVMs) are used. We examined the correlation between PCs and sex, and explored the extent to which the choice of PCs affects the expression of sexual dimorphism. Our results suggest that skull- and face-based PCs can be used to describe the craniofacial relationship and that the accuracy of the method can be improved by using an increased number of face-based PCs. The results show that the accuracy of the sex classification is related to the choice of PCs. The highest sex classification rate is 91.43% using our method.

The production of digital and printed resources from multiple modalities using visualization and three-dimensional printing techniques.

PURPOSE: Virtual digital resources and printed models have become indispensable tools for medical training and surgical planning. Nevertheless, printed models of soft tissue organs are still challenging to reproduce. This study adopts open source packages and a low-cost desktop 3D printer to convert multiple modalities of medical images to digital resources (volume rendering images and digital models) and lifelike printed models, which are useful to enhance our understanding of the geometric structure and complex spatial nature of anatomical organs. MATERIALS AND METHODS: Neuroimaging technologies such as CT, CTA, MRI, and TOF-MRA collect serial medical images. The procedures for producing digital resources can be divided into volume rendering and medical image reconstruction. To verify the accuracy of reconstruction, this study presents qualitative and quantitative assessments. Subsequently, digital models are archived as stereolithography format files and imported to the bundled software of the 3D printer. The printed models are produced using polylactide filament materials. RESULTS: We have successfully converted multiple modalities of medical images to digital resources and printed models for both hard organs (cranial base and tooth) and soft tissue organs (brain, blood vessels of the brain, the heart chambers and vessel lumen, and pituitary tumor). Multiple digital resources and printed models were provided to illustrate the anatomical relationship between organs and complicated surrounding structures. Three-dimensional printing (3DP) is a powerful tool to produce lifelike and tangible models. CONCLUSIONS: We present an available and cost-effective method for producing both digital resources and printed models. The choice of modality in medical images and the processing approach is important when reproducing soft tissue organs models. The accuracy of the printed model is determined by the quality of organ models and 3DP. With the ongoing improvement of printing techniques and the variety of materials available, 3DP will become an indispensable tool in medical training and surgical planning.

Skeleton-based cerebrovascular quantitative analysis.

BACKGROUND: Cerebrovascular disease is the most common cause of death worldwide, with millions of deaths annually. Interest is increasing toward understanding the geometric factors that influence cerebrovascular diseases, such as stroke. Cerebrovascular shape analyses are essential for the diagnosis and pathological identification of these conditions. The current study aimed to provide a stable and consistent methodology for quantitative Circle of Willis (CoW) analysis and to identify geometric changes in this structure. METHOD: An entire pipeline was designed with emphasis on automating each step. The stochastic segmentation was improved and volumetric data were obtained. The L1 medial axis method was applied to vessel volumetric data, which yielded a discrete skeleton dataset. A B-spline curve was used to fit the skeleton, and geometric values were proposed for a one-dimensional skeleton and radius. The calculations used to derive these values were illustrated in detail. RESULT: In one example(No. 47 in the open dataset) all values for different branches of CoW were calculated. The anterior communicating artery(ACo) was the shortest vessel, with a length of 2.6mm. The range of the curvature of all vessels was (0.3, 0.9) ± (0.1, 1.4). The range of the torsion was (-12.4,0.8) ± (0, 48.7). The mean radius value range was (3.1, 1.5) ± (0.1, 0.7) mm, and the mean angle value range was (2.2, 2.9) ± (0, 0.2) mm. In addition to the torsion variance values in a few vessels, the variance values of all vessel characteristics remained near 1. The distribution of the radii of symmetrical posterior cerebral artery(PCA) and angle values of the symmetrical posterior communicating arteries(PCo) demonstrated a certain correlation between the corresponding values of symmetrical vessels on the CoW. CONCLUSION: The data verified the stability of our methodology. Our method was appropriate for the analysis of large medical image datasets derived from the automated pipeline for populations. This method was applicable to other tubular organs, such as the large intestine and bile duct.

A regional method for craniofacial reconstruction based on coordinate adjustments and a new fusion strategy.

Craniofacial reconstruction recreates a facial outlook from the cranium based on the relationship between the face and the skull to assist identification. But craniofacial structures are very complex, and this relationship is not the same in different craniofacial regions. Several regional methods have recently been proposed, these methods segmented the face and skull into regions, and the relationship of each region is then learned independently, after that, facial regions for a given skull are estimated and finally glued together to generate a face. Most of these regional methods use vertex coordinates to represent the regions, and they define a uniform coordinate system for all of the regions. Consequently, the inconsistence in the positions of regions between different individuals is not eliminated before learning the relationships between the face and skull regions, and this reduces the accuracy of the craniofacial reconstruction. In order to solve this problem, an improved regional method is proposed in this paper involving two types of coordinate adjustments. One is the global coordinate adjustment performed on the skulls and faces with the purpose to eliminate the inconsistence of position and pose of the heads; the other is the local coordinate adjustment performed on the skull and face regions with the purpose to eliminate the inconsistence of position of these regions. After these two coordinate adjustments, partial least squares regression (PLSR) is used to estimate the relationship between the face region and the skull region. In order to obtain a more accurate reconstruction, a new fusion strategy is also proposed in the paper to maintain the reconstructed feature regions when gluing the facial regions together. This is based on the observation that the feature regions usually have less reconstruction errors compared to rest of the face. The results demonstrate that the coordinate adjustments and the new fusion strategy can significantly improve the craniofacial reconstructions.

The Architecture of an Automatic eHealth Platform With Mobile Client for Cerebrovascular Disease Detection.

BACKGROUND: In recent years, cerebrovascular disease has been the leading cause of death and adult disability in the world. This study describes an efficient approach to detect cerebrovascular disease. OBJECTIVE: In order to improve cerebrovascular treatment, prevention, and care, an automatic cerebrovascular disease detection eHealth platform is designed and studied. METHODS: We designed an automatic eHealth platform for cerebrovascular disease detection with a four-level architecture: object control layer, data transmission layer, service supporting layer, and application service layer. The platform has eight main functions: cerebrovascular database management, preprocessing of cerebral image data, image viewing and adjustment model, image cropping compression and measurement, cerebrovascular segmentation, 3-dimensional cerebrovascular reconstruction, cerebrovascular rendering, cerebrovascular virtual endoscope, and automatic detection. Several key technologies were employed for the implementation of the platform. The anisotropic diffusion model was used to reduce the noise. Statistics segmentation with Gaussian-Markov random field model (G-MRF) and Stochastic Estimation Maximization (SEM) parameter estimation method were used to realize the cerebrovascular segmentation. Ball B-Spline curve was proposed to model the cerebral blood vessels. Compute unified device architecture (CUDA) based on ray-casting volume rendering presented by curvature enhancement and boundary enhancement were used to realize the volume rendering model. We implemented the platform with a network client and mobile phone client to fit different users. RESULTS: The implemented platform is running on a common personal computer. Experiments on 32 patients' brain computed tomography data or brain magnetic resonance imaging data stored in the system verified the feasibility and validity of each model we proposed. The platform is partly used in the cranial nerve surgery of the First Hospital Affiliated to the General Hospital of People's Liberation Army and radiology of Beijing Navy General Hospital. At the same time it also gets some applications in medical imaging specialty teaching of Tianjin Medical University. The application results have also been validated by our neurosurgeon and radiologist. CONCLUSIONS: The platform appears beneficial in diagnosis of the cerebrovascular disease. The long-term benefits and additional applications of this technology warrant further study. The research built a diagnosis and treatment platform of the human tissue with complex geometry and topology such as brain vessel based on the Internet of things.