Chained Deep Learning Using Generalized Cross-Entropy for Multiple Annotators Classification.

Supervised learning requires the accurate labeling of instances, usually provided by an expert. Crowdsourcing platforms offer a practical and cost-effective alternative for large datasets when individual annotation is impractical. In addition, these platforms gather labels from multiple labelers. Still, traditional multiple-annotator methods must account for the varying levels of expertise and the noise introduced by unreliable outputs, resulting in decreased performance. In addition, they assume a homogeneous behavior of the labelers across the input feature space, and independence constraints are imposed on outputs. We propose a Generalized Cross-Entropy-based framework using Chained Deep Learning (GCECDL) to code each annotator's non-stationary patterns regarding the input space while preserving the inter-dependencies among experts through a chained deep learning approach. Experimental results devoted to multiple-annotator classification tasks on several well-known datasets demonstrate that our GCECDL can achieve robust predictive properties, outperforming state-of-the-art algorithms by combining the power of deep learning with a noise-robust loss function to deal with noisy labels. Moreover, network self-regularization is achieved by estimating each labeler's reliability within the chained approach. Lastly, visual inspection and relevance analysis experiments are conducted to reveal the non-stationary coding of our method. In a nutshell, GCEDL weights reliable labelers as a function of each input sample and achieves suitable discrimination performance with preserved interpretability regarding each annotator's trustworthiness estimation.

A probabilistic framework based on SLIC-superpixel and Gaussian processes for segmenting nerves in ultrasound images.

We deal with an important problem in the field of anesthesiology known as automatic segmentation of nerve structures depicted in ultrasound images. This is important to aid the experts in anesthesiology, in order to carry out Peripheral Nerve Blocking (PNB). Ultrasound imaging has gained recent interest for performing PNB procedures since it offers a non-invasive visualization of the nerve and the anatomical structures around it. However, the location of these nerves in ultrasound images is a difficult task for the specialist due to the artifacts (i.e. speckle noise) that affect the intelligibility of a given image. In this paper, we present a probabilistic approach based on Simple Linear Iterative Clustering (SLIC-superpixels) and Gaussian processes for automatic segmentation of peripheral nerves. First, we use Graph cuts segmentation to define a region of interest (ROI). Such a ROI is divided into several correlated regions using SLIC-superpixels, then, a nonlinear Wavelet transform is applied as feature extraction stage. Finally, we use a classification scheme based on Gaussian Processes in order to predict the label of each parametrized superpixel (the label can be "nerve" or "background"). The accuracy of the proposed method is measured in terms of the Dice coefficient. Results obtained show performances with a Dice coefficient of 0.6524±0.0085 which brings accurate performances in nerve segmentation processes.

Automatic segmentation of nerve structures in ultrasound images using Graph Cuts and Gaussian processes.

Peripheral Nerve Blocking (PNB), is a procedure used for performing regional anesthesia, that comprises the administration of anesthetic in the proximity of a nerve. Several techniques have been used with the purpose of locating nerve structures when the PNB procedure is performed: anatomical surface landmarks, elicitation of paresthesia, nerve stimulation and ultrasound imaging. Among those, ultrasound imaging has gained great attention because it is not invasive and offers an accurate location of the nerve and the structures around it. However, the segmentation of nerve structures in ultrasound images is a difficult task for the specialist, since such images are affected by echo perturbations and speckle noise. The development of systems for the automatic segmentation of nerve structures can aid the specialist for locating nerve structures accurately. In this paper we present a methodology for the automatic segmentation of nerve structures in ultrasound images. An initial step is carried out using Graph Cut segmentation in order to generate regions of interest; we then use machine learning techniques with the aim of segmenting the nerve structure; here, a specific non-linear Wavelet transform is used for the feature extraction stage, and Gaussian processes for the classification step. The methodology performance is measured in terms of accuracy and the dice coefficient. Results show that the implemented methodology can be used for automatically segmenting nerve structures.

Automatic assessment of voice quality in the context of multiple annotations.

Approaches to evaluate voice quality include perceptual analysis, and acoustical analysis. Perceptual analysis is subjective and depends mostly on the ability of a specialist to assess a pathology, whereas acoustical analysis is objective, but highly relies on the quality of the so called annotations that the specialist assigns to the voice signal. The quality of the annotations for acoustical analysis depends heavily on the expertise and knowledge of the specialist. We face a scenario where we have annotations performed by several specialists with different levels of expertise and knowledge. Traditional pattern recognition methods employed in acoustical analysis are no longer applicable, since these methods are designed for scenarios where a "ground-truth" label is assigned by the specialist. In this paper, we apply recent developments in machine learning for taking into account multiple annotators for acoustical analysis of voice signals. For the classification step we compare two techniques, one of them based on Gaussian Processes for regression with multiple annotators, and the other is a multi-class Logistic Regression model that measures the annotator performance in terms of sensitivity and specificity. The performance of classifiers is assessed in terms of Cohen's Kappa index. Results show that the multi-annotator classification schemes have better performance when compared to techniques based on a traditional classifier where the true label is estimated from the multiple annotations available using majority voting.