ECG Heartbeat Classification Using Machine Learning and Metaheuristic Optimization for Smart Healthcare Systems.

Early diagnosis and classification of arrhythmia from an electrocardiogram (ECG) plays a significant role in smart healthcare systems for the health monitoring of individuals with cardiovascular diseases. Unfortunately, the nonlinearity and low amplitude of ECG recordings make the classification process difficult. Thus, the performance of most traditional machine learning (ML) classifiers is questionable, as the interrelationship between the learning parameters is not well modeled, especially for data features with high dimensions. To address the limitations of ML classifiers, this paper introduces an automatic arrhythmia classification approach based on the integration of a recent metaheuristic optimization (MHO) algorithm and ML classifiers. The role of the MHO is to optimize the search parameters of the classifiers. The approach consists of three steps: the preprocessing of the ECG signal, the extraction of the features, and the classification. The learning parameters of four supervised ML classifiers were utilized for the classification task; support vector machine (SVM), k-nearest neighbors (kNNs), gradient boosting decision tree (GBDT), and random forest (RF) were optimized using the MHO algorithm. To validate the advantage of the proposed approach, several experiments were conducted on three common databases, including the Massachusetts Institute of Technology (MIT-BIH), the European Society of Cardiology ST-T (EDB), and the St. Petersburg Institute of Cardiological Techniques 12-lead Arrhythmia (INCART). The obtained results showed that the performance of all the tested classifiers were significantly improved after integrating the MHO algorithm, with the average ECG arrhythmia classification accuracy reaching 99.92% and a sensitivity of 99.81%, outperforming the state-of the-art methods.

An Experimental Platform for Real-Time Students Engagement Measurements from Video in STEM Classrooms.

The ability to measure students' engagement in an educational setting may facilitate timely intervention in both the learning and the teaching process in a variety of classroom settings. In this paper, a real-time automatic student engagement measure is proposed through investigating two of the main components of engagement: the behavioral engagement and the emotional engagement. A biometric sensor network (BSN) consisting of web cameras, a wall-mounted camera and a high-performance computing machine was designed to capture students' head poses, eye gaze, body movements, and facial emotions. These low-level features are used to train an AI-based model to estimate the behavioral and emotional engagement in the class environment. A set of experiments was conducted to compare the proposed technology with the state-of-the-art frameworks. The proposed framework shows better accuracy in estimating both behavioral and emotional engagement. In addition, it offers superior flexibility to work in any educational environment. Further, this approach allows a quantitative comparison of teaching methods.

An AI-Based Colonic Polyp Classifier for Colorectal Cancer Screening Using Low-Dose Abdominal CT.

Among the non-invasive Colorectal cancer (CRC) screening approaches, Computed Tomography Colonography (CTC) and Virtual Colonoscopy (VC), are much more accurate. This work proposes an AI-based polyp detection framework for virtual colonoscopy (VC). Two main steps are addressed in this work: automatic segmentation to isolate the colon region from its background, and automatic polyp detection. Moreover, we evaluate the performance of the proposed framework on low-dose Computed Tomography (CT) scans. We build on our visualization approach, Fly-In (FI), which provides "filet"-like projections of the internal surface of the colon. The performance of the Fly-In approach confirms its ability with helping gastroenterologists, and it holds a great promise for combating CRC. In this work, these 2D projections of FI are fused with the 3D colon representation to generate new synthetic images. The synthetic images are used to train a RetinaNet model to detect polyps. The trained model has a 94% f1-score and 97% sensitivity. Furthermore, we study the effect of dose variation in CT scans on the performance of the the FI approach in polyp visualization. A simulation platform is developed for CTC visualization using FI, for regular CTC and low-dose CTC. This is accomplished using a novel AI restoration algorithm that enhances the Low-Dose CT images so that a 3D colon can be successfully reconstructed and visualized using the FI approach. Three senior board-certified radiologists evaluated the framework for the peak voltages of 30 KV, and the average relative sensitivities of the platform were 92%, whereas the 60 KV peak voltage produced average relative sensitivities of 99.5%.

Feature fusion for lung nodule classification.

PURPOSE: This article examines feature-based nodule description for the purpose of nodule classification in chest computed tomography scanning. METHODS: Three features based on (i) Gabor filter, (ii) multi-resolution local binary pattern (LBP) texture features and (iii) signed distance fused with LBP which generates a combinational shape and texture feature are utilized to provide feature descriptors of malignant and benign nodules and non-nodule regions of interest. Support vector machines (SVMs) and k-nearest neighbor (kNN) classifiers in serial and two-tier cascade frameworks are optimized and analyzed for optimal classification results of nodules. RESULTS: A total of 1191 nodule and non-nodule samples from the Lung Image Data Consortium database is used for analysis. Classification using SVM and kNN classifiers is examined. The classification results from the two-tier cascade SVM using Gabor features showed overall better results for identifying non-nodules, malignant and benign nodules with average area under the receiver operating characteristics (AUC-ROC) curves of 0.99 and average f1-score of 0.975 over the two tiers. CONCLUSION: In the results, higher overall AUCs and f1-scores were obtained for the non-nodules cases using any of the three features, showing the greatest distinguishability over nodules (benign/malignant). SVM and kNN classifiers were used for benign, malignant and non-nodule classification, where Gabor proved to be the most effective of the features for classification. The cascaded framework showed the greatest distinguishability between benign and malignant nodules.

Vertebral body segmentation with prior shape constraints for accurate BMD measurements.

We propose a novel vertebral body segmentation approach, which is based on the graph cuts technique with shape constraints. The proposed approach depends on both image appearance and shape information. Shape information is gathered from a set of training shapes. Then we estimate the shape variations using a new distance probabilistic model which approximates the marginal densities of the vertebral body and its background in the variability region using a Poisson distribution refined by positive and negative Gaussian components. To segment a vertebral body, we align its 3D shape with the training 3D shape so we can use the distance probabilistic model. Then its gray level is approximated with a Linear Combination of Gaussians (LCG) with sign-alternate components. The spatial interaction between the neighboring voxels is identified using a new analytical approach. Finally, we formulate an energy function using both appearance models and shape constraints. This function is globally minimized using s/t graph cuts to get the optimal segmentation. Experimental results show that the proposed technique gives promising results compared to other alternatives. Applications on Bone Mineral Density (BMD) measurements of vertebral body are given to illustrate the accuracy of the proposed segmentation approach.

A novel approach for lung nodules segmentation in chest CT using level sets.

A new variational level set approach is proposed for lung nodule segmentation in lung CT scans. A general lung nodule shape model is proposed using implicit spaces as a signed distance function. The shape model is fused with the image intensity statistical information in a variational segmentation framework. The nodule shape model is mapped to the image domain by a global transformation that includes inhomogeneous scales, rotation, and translation parameters. A matching criteria between the shape model and the image implicit representations is employed to handle the alignment process. Transformation parameters evolve through gradient descent optimization to handle the shape alignment process and hence mark the boundaries of the nodule "head." The embedding process takes into consideration the image intensity as well as prior shape information. A nonparametric density estimation approach is employed to handle the statistical intensity representation of the nodule and background regions. The proposed technique does not depend on nodule type or location. Exhaustive experimental and validation results are demonstrated on 742 nodules obtained from four different CT lung databases, illustrating the robustness of the approach.

Automatic Detection of 2D and 3D Lung Nodules in Chest Spiral CT Scans.

Automatic detection of lung nodules is an important problem in computer analysis of chest radiographs. In this paper, we propose a novel algorithm for isolating lung abnormalities (nodules) from spiral chest low-dose CT (LDCT) scans. The proposed algorithm consists of three main steps. The first step isolates the lung nodules, arteries, veins, bronchi, and bronchioles from the surrounding anatomical structures. The second step detects lung nodules using deformable 3D and 2D templates describing typical geometry and gray-level distribution within the nodules of the same type. The detection combines the normalized cross-correlation template matching and a genetic optimization algorithm. The final step eliminates the false positive nodules (FPNs) using three features that robustly define the true lung nodules. Experiments with 200 CT data sets show that the proposed approach provided comparable results with respect to the experts.

Shape Representation and Registration in Vector Implicit Spaces: Adopting a Closed-Form Solution in the Optimization Process.

In this paper, a novel method to solve the shape registration problem covering both global and local deformations is proposed. The vector distance function (VDF) is used to represent source and target shapes. The problem is formulated as an energy optimization process by matching the VDFs of the source and target shapes. The minimization process results in estimating the transformation parameters for the global and local deformation cases. Gradient descent optimization handles the computation of scaling, rotation, and translation matrices used to minimize the global differences between source and target shapes. Nonrigid deformations require a large number of parameters which make the use of the gradient descent minimization a very time-consuming process. We propose to compute the local deformation parameters using a closed-form solution as a linear system of equations derived from approximating an objective function. Extensive experimental validations and comparisons performed on generalized 2D shape data demonstrate the robustness and effectiveness of the method.

Modeling of the lung nodules for detection in LDCT scans.

A novel approach is proposed for generating data driven models of the lung nodules appearing in low dose CT (LDCT) scans of the human chest. Four types of common lung nodules are analyzed using Active Appearance Model methods to create descriptive lung nodule models. The proposed approach is also applicable for automatic classification of nodules into pathologies given a descriptive database. This approach is a major step forward for early diagnosis of lung cancer. We show the performance of the new nodule models on clinical datasets which illustrates significant improvements in both sensitivity and specificity.

Shape modeling of the corpus callosum.

A novel approach for shape modeling of the corpus callosum (cc) is introduced where the contours of the cc are extracted by image/volume segmentation, and a Bezier curve is used to connect the vertices of the sampled contours, generating a parametric polynomial representation. These polynomials are shown to maintain the characteristics of the original cc, thus are suitable for classification of populations. The Bernstein polynomials are used in fitting the Bezier curves. The coefficients of the Bernstein polynomials are shown to capture the geometric features of the cc, and are able to describe deformations. We use these coefficients, in conjunction with the Fourier Descriptors and other features, to discriminate between autistic and normal brains. The approach is tested on T1-weighted MRI scans of 16 normal and 22 autistic subjects and shows its ability to provide perfect classification, suggesting that the approach is worth investigating on a larger population with the hope of providing early identification and intervention of autism using neuroimaging.

Toward precise pulmonary nodule descriptors for nodule type classification.

A framework for nodule feature-based extraction is presented to classify lung nodules in low-dose CT slices (LDCT) into four categories: juxta, well-circumscribed, vascularized and pleural-tail, based on the extracted information. The Scale Invariant Feature Transform (SIFT) and an adaptation to Daugman's Iris Recognition algorithm are used for analysis. The SIFT descriptor results are projected to lower-dimensional subspaces using PCA and LDA. Complex Gabor wavelet nodule response obtained from an adopted Daugman Iris Recognition algorithm revealed improvements from the original Daugman binary iris code. This showed that binarized nodule responses (codes) are inadequate for classification since nodules lack texture concentration as seen in the iris, while the SIFT algorithm projected using PCA showed robustness and precision in classification.

Variational curve skeletons using gradient vector flow.

Representing a 3D shape by a set of 1D curves that are locally symmetric with respect to its boundary (i.e., curve skeletons) is of importance in several machine intelligence tasks. This paper presents a fast, automatic, and robust variational framework for computing continuous, subvoxel accurate curve skeletons from volumetric objects. A reference point inside the object is considered a point source that transmits two wave fronts of different energies. The first front (beta-front) converts the object into a graph, from which the object salient topological nodes are determined. Curve skeletons are tracked from these nodes along the cost field constructed by the second front (alpha-front) until the point source is reached. The accuracy and robustness of the proposed work are validated against competing techniques as well as a database of 3D objects. Unlike other state-of-the-art techniques, the proposed framework is highly robust because it avoids locating and classifying skeletal junction nodes, employs a new energy that does not form medial surfaces, and finally extracts curve skeletons that correspond to the most prominent parts of the shape and hence are less sensitive to noise.

Reduced gyral window and corpus callosum size in autism: possible macroscopic correlates of a minicolumnopathy.

Minicolumnar changes that generalize throughout a significant portion of the cortex have macroscopic structural correlates that may be visualized with modern structural neuroimaging techniques. In magnetic resonance images (MRIs) of fourteen autistic patients and 28 controls, the present study found macroscopic morphological correlates to recent neuropathological findings suggesting a minicolumnopathy in autism. Autistic patients manifested a significant reduction in the aperture for afferent/efferent cortical connections, i.e., gyral window. Furthermore, the size of the gyral window directly correlated to the size of the corpus callosum. A reduced gyral window constrains the possible size of projection fibers and biases connectivity towards shorter corticocortical fibers at the expense of longer association/commisural fibers. The findings may help explain abnormalities in motor skill development, differences in postnatal brain growth, and the regression of acquired functions observed in some autistic patients.

Validation of finite element models of liver tissue using micro-CT.

In this work, we aim at validating some soft tissue deformation models using high-resolution micro-computed tomography (Micro-CT) images. The imaging technique plays a key role in detecting the tissue deformation details in the contact region between the tissue and the surgical tool (probe) for small force loads and provides good capabilities of creating accurate 3-D models of soft tissues. Surgical simulations rely on accurate representation of the mechanical response of soft tissues subjected to surgical manipulations. Several finite-element models have been suggested to characterize soft tissues. However, validating these models for specific tissues still remain a challenge. In this study, ex vivo lamb liver tissue is chosen to validate the linear elastic model (LEM), the linear viscoelastic model (LVEM), and the neo-Hooke hyperelastic model (NHM). We find that the LEM is more applicable to lamb liver than the LVEM for smaller force loads (< 20 g) and that the NHM is closer to reality than the LVEM for the range of force loads from 5 to 40 g.

Graph cuts framework for kidney segmentation with prior shape constraints.

We propose a novel kidney segmentation approach based on the graph cuts technique. The proposed approach depends on both image appearance and shape information. Shape information is gathered from a set of training shapes. Then we estimate the shape variations using a new distance probabilistic model which approximates the marginal densities of the kidney and its background in the variability region using a Poisson distribution refined by positive and negative Gaussian components. To segment a kidney slice, we align it with the training slices so we can use the distance probabilistic model. Then its gray level is approximated with a LCG with sign-alternate components. The spatial interaction between the neighboring pixels is identified using a new analytical approach. Finally, we formulate a new energy function using both image appearance models and shape constraints. This function is globally minimized using s/t graph cuts to get the optimal segmentation. Experimental results show that the proposed technique gives promising results compared to others without shape constraints.

Curve/surface representation and evolution using vector level sets with application to the shape-based segmentation problem.

In this paper, we revisit the implicit front representation and evolution using the vector level set function (VLSF) proposed in [1]. Unlike conventional scalar level sets, this function is designed to have a vector form. The distance from any point to the nearest point on the front has components (projections) in the coordinate directions included in the vector function. This kind of representation is used to evolve closed planar curves and 3D surfaces as well. Maintaining the VLSF property as the distance projections through evolution will be considered together with a detailed derivation of the vector partial differential equation (PDE) for such evolution. A shape-based segmentation framework will be demonstrated as an application of the given implicit representation. The proposed level set function system will be used to represent shapes to give a dissimilarity measure in a variational object registration process. This kind of formulation permits us to better control the process of shape registration, which is an important part in the shape-based segmentation framework. The method depends on a set of training shapes used to build a parametric shape model. The color is taken into consideration besides the shape prior information. The shape model is fitted to the image volume by registration through an energy minimization problem. The approach overcomes the conventional methods problems like point correspondences and weighing coefficients tuning of the evolution (PDEs). It is also suitable for multidimensional data and computationally efficient. Results in 2D and 3D of real and synthetic data will demonstrate the efficiency of the framework.

Precise segmentation of multimodal images.

We propose new techniques for unsupervised segmentation of multimodal grayscale images such that each region-of-interest relates to a single dominant mode of the empirical marginal probability distribution of grey levels. We follow the most conventional approaches in that initial images and desired maps of regions are described by a joint Markov-Gibbs random field (MGRF) model of independent image signals and interdependent region labels. However, our focus is on more accurate model identification. To better specify region borders, each empirical distribution of image signals is precisely approximated by a linear combination of Gaussians (LCG) with positive and negative components. We modify an expectation-maximization (EM) algorithm to deal with the LCGs and also propose a novel EM-based sequential technique to get a close initial LCG approximation with which the modified EM algorithm should start. The proposed technique identifies individual LCG models in a mixed empirical distribution, including the number of positive and negative Gaussians. Initial segmentation based on the LCG models is then iteratively refined by using the MGRF with analytically estimated potentials. The convergence of the overall segmentation algorithm at each stage is discussed. Experiments show that the developed techniques segment different types of complex multimodal medical images more accurately than other known algorithms.

New deformable registration technique using scale space and curve evolution theory and a finite element based validation framework.

In this paper, we present a novel and accurate approach for nonrigid registration. New feature descriptors are built as voxel signatures using scale space theory. These descriptors are used to capture the global motion of the imaged object. Local deformations are modelled through an evolution process of equi-spaced closed curves/surfaces (iso-contours/surfaces) which are generated using fast marching level sets and are matched using the built feature descriptors. The performance of the proposed approach is validated using the finite element method. Both 2D and 3D tissue deformations cases are simulated, and the registration accuracy is quantified by co-registering the deformed images with the original ones and comparing the recovered mesh point displacements with the simulated ones. The evaluation results show the potential of the proposed approach in handling local deformation better than some conventional approaches.

A new CAD system for the evaluation of kidney diseases using DCE-MRI.

Acute rejection is the most common reason of graft failure after kidney transplantation, and early detection is crucial to survive the transplanted kidney function. In this paper, we introduce a new approach for the automatic classification of normal and acute rejection transplants from Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCE-MRI). The proposed algorithm consists of three main steps; the first step isolates the kidney from the surrounding anatomical structures by evolving a deformable model based on two density functions; the first function describes the distribution of the gray level inside and outside the kidney region and the second function describes the prior shape of the kidney. In the second step, a new nonrigid registration approach is employed to account for the motion of the kidney due to patient breathing. To validate our registration approach, we use a simulation of deformations based on biomechanical modelling of the kidney tissue using the finite element method (F.E.M.). Finally, the perfusion curves that show the transportation of the contrast agent into the tissue are obtained from the cortex and used in the classification of normal and acute rejection transplants. Applications of the proposed approach yield promising results that would, in the near future, replace the use of current technologies such as nuclear imaging and ultrasonography, which are not specific enough to determine the type of kidney dysfunction.