Automatic lesion border selection in dermoscopy images using morphology and color features.

PURPOSE: We present a classifier for automatically selecting a lesion border for dermoscopy skin lesion images, to aid in computer-aided diagnosis of melanoma. Variation in photographic technique of dermoscopy images makes segmentation of skin lesions a difficult problem. No single algorithm provides an acceptable lesion border to allow further processing of skin lesions. METHODS: We present a random forests border classifier model to select a lesion border from 12 segmentation algorithm borders, graded on a "good-enough" border basis. Morphology and color features inside and outside the automatic border are used to build the model. RESULTS: For a random forests classifier applied to an 802-lesion test set, the model predicts a satisfactory border in 96.38% of cases, in comparison to the best single border algorithm, which detects a satisfactory border in 85.91% of cases. CONCLUSION: The performance of the classifier-based automatic skin lesion finder is found to be better than any single algorithm used in this research.

Analysis of clinical and dermoscopic features for basal cell carcinoma neural network classification.

BACKGROUND: Basal cell carcinoma (BCC) is the most commonly diagnosed cancer in the USA. In this research, we examine four different feature categories used for diagnostic decisions, including patient personal profile (patient age, gender, etc.), general exam (lesion size and location), common dermoscopic (blue-gray ovoids, leaf-structure dirt trails, etc.), and specific dermoscopic lesion (white/pink areas, semitranslucency, etc.). Specific dermoscopic features are more restricted versions of the common dermoscopic features. METHODS: Combinations of the four feature categories are analyzed over a data set of 700 lesions, with 350 BCCs and 350 benign lesions, for lesion discrimination using neural network-based techniques, including evolving artificial neural networks (EANNs) and evolving artificial neural network ensembles. RESULTS: Experiment results based on 10-fold cross validation for training and testing the different neural network-based techniques yielded an area under the receiver operating characteristic curve as high as 0.981 when all features were combined. The common dermoscopic lesion features generally yielded higher discrimination results than other individual feature categories. CONCLUSIONS: Experimental results show that combining clinical and image information provides enhanced lesion discrimination capability over either information source separately. This research highlights the potential of data fusion as a model for the diagnostic process.

Sector expansion and elliptical modeling of blue-gray ovoids for basal cell carcinoma discrimination in dermoscopy images.

BACKGROUND: Blue-gray ovoids (B-GOs), a critical dermoscopic structure for basal cell carcinoma (BCC), offer an opportunity for automatic detection of BCC. Due to variation in size and color, B-GOs can be easily mistaken for similar structures in benign lesions. Analysis of these structures could afford accurate characterization and automatic recognition of B-GOs, furthering the goal of automatic BCC detection. This study utilizes a novel segmentation method to discriminate B-GOs from their benign mimics. METHODS: Contact dermoscopy images of 68 confirmed BCCs with B-GOs were obtained. Another set of 131 contact dermoscopic images of benign lesions possessing B-GO mimics provided a benign competitive set. A total of 22 B-GO features were analyzed for all structures: 21 color features and one size feature. Regarding segmentation, this study utilized a novel sector-based, non-recursive segmentation method to expand the masks applied to the B-GOs and mimicking structures. RESULTS: Logistic regression analysis determined that blue chromaticity was the best feature for discriminating true B-GOs in BCC from benign, mimicking structures. Discrimination of malignant structures was optimal when the final B-GO border was approximated by a best-fit ellipse. Using this optimal configuration, logistic regression analysis discriminated the expanded and fitted malignant structures from similar benign structures with a classification rate as high as 96.5%. CONCLUSIONS: Experimental results show that color features allow accurate expansion and localization of structures from seed areas. Modeling these structures as ellipses allows high discrimination of B-GOs in BCCs from similar structures in benign images.

Automatic dirt trail analysis in dermoscopy images.

BACKGROUND: Basal cell carcinoma (BCC) is the most common cancer in the US. Dermatoscopes are devices used by physicians to facilitate the early detection of these cancers based on the identification of skin lesion structures often specific to BCCs. One new lesion structure, referred to as dirt trails, has the appearance of dark gray, brown or black dots and clods of varying sizes distributed in elongated clusters with indistinct borders, often appearing as curvilinear trails. METHODS: In this research, we explore a dirt trail detection and analysis algorithm for extracting, measuring, and characterizing dirt trails based on size, distribution, and color in dermoscopic skin lesion images. These dirt trails are then used to automatically discriminate BCC from benign skin lesions. RESULTS: For an experimental data set of 35 BCC images with dirt trails and 79 benign lesion images, a neural network-based classifier achieved a 0.902 are under a receiver operating characteristic curve using a leave-one-out approach. CONCLUSION: Results obtained from this study show that automatic detection of dirt trails in dermoscopic images of BCC is feasible. This is important because of the large number of these skin cancers seen every year and the challenge of discovering these earlier with instrumentation.

Detection of atypical texture features in early malignant melanoma.

BACKGROUND: The presence of an atypical (irregular) pigment network (APN) can indicate a diagnosis of melanoma. This study sought to analyze the APN with texture measures. METHODS: For 106 dermoscopy images including 28 melanomas and 78 benign dysplastic nevi, the areas of APN were selected manually. Ten texture measures in the CVIPtools image analysis system were applied. RESULTS: Of the 10 texture measures used, correlation average provided the highest discrimination accuracy, an average of 95.4%. Discrimination of melanomas was optimal at a pixel distance of 20 for the 768 x 512 images, consistent with a melanocytic lesion texel size estimate of 4-5 texels per mm. CONCLUSION: Texture analysis, in particular correlation average at an optimized pixel spacing, may afford automatic detection of an irregular pigment network in early malignant melanoma.

Watershed segmentation of dermoscopy images using a watershed technique.

BACKGROUND/PURPOSE: Automatic lesion segmentation is an important part of computer-based image analysis of pigmented skin lesions. In this research, a watershed algorithm is developed and investigated for adequacy of skin lesion segmentation in dermoscopy images. METHODS: Hair, black border and vignette removal methods are introduced as preprocessing steps. The flooding variant of the watershed segmentation algorithm was implemented with novel features adapted to this domain. An outer bounding box, determined by a difference function derived from horizontal and vertical projection functions, is added to estimate the lesion area, and the lesion area error is reduced by a linear estimation function. As a post-processing step, a second-order B-Spline smoothing method is introduced to smooth the watershed border. RESULTS: Using the average of three sets of dermatologist-drawn borders as the ground truth, an overall error of 15.98% was obtained using the watershed technique. CONCLUSION: The implementation of the flooding variant of the watershed algorithm presented here allows satisfactory automatic segmentation of pigmented skin lesions.

Detection of basal cell carcinoma using color and histogram measures of semitranslucent areas.

BACKGROUND: Semitranslucency, defined as a smooth, jelly-like area with varied, near-skin-tone color, can indicate a diagnosis of basal cell carcinoma (BCC) with high specificity. This study sought to analyze potential areas of semitranslucency with histogram-derived texture and color measures to discriminate BCC from non-semitranslucent areas in non-BCC skin lesions. METHODS: For 210 dermoscopy images, the areas of semitranslucency in 42 BCCs and comparable areas of smoothness and color in 168 non-BCCs were selected manually. Six color measures and six texture measures were applied to the semitranslucent areas of the BCC and the comparable areas in the non-BCC images. RESULTS: Receiver operating characteristic (ROC) curve analysis showed that the texture measures alone provided greater separation of BCC from non-BCC than the color measures alone. Statistical analysis showed that the four most important measures of semitranslucency are three histogram measures: contrast, smoothness, and entropy, and one color measure: blue chromaticity. Smoothness is the single most important measure. The combined 12 measures achieved a diagnostic accuracy of 95.05% based on area under the ROC curve. CONCLUSION: Texture and color analysis measures, especially smoothness, may afford automatic detection of BCC images with semitranslucency.

A basis function feature-based approach for skin lesion discrimination in dermatology dermoscopy images.

BACKGROUND: Skin lesion color is an important feature for diagnosing malignant melanoma. New basis function correlation features are proposed for discriminating malignant melanoma lesions from benign lesions in dermoscopy images. The proposed features are computed based on correlating the luminance histogram of melanoma or benign labeled relative colors from a specified portion of the skin lesion with a set of basis functions. These features extend previously developed statistical and fuzzy logic-based relative color histogram analysis techniques for automated mapping of colors representative of melanoma and benign skin lesions from a training set of lesion images. METHODS: Using the statistical and fuzzy logic-based approaches for relative color mapping, melanoma and benign color features are computed over skin lesion region of interest, respectively. Luminance histograms are obtained from the melanoma and benign mapped colors within the lesion region of interest and are correlated with a set of basis functions to quantify the distribution of colors. The histogram analysis techniques and feature calculations are evaluated using a data set of 279 malignant melanomas and 442 benign dysplastic nevi images. RESULTS: Experimental test results showed that combining existing melanoma and benign color features with the proposed basis function features found from the melanoma mapped colors yielded average correct melanoma and benign lesion discrimination rates as high as 86.45% and 83.35%, respectively. CONCLUSIONS: The basis function features provide an alternative approach to melanoma discrimination that quantifies the variation and distribution of colors characteristic of melanoma and benign skin lesions.

Border detection in dermoscopy images using statistical region merging.

BACKGROUND: As a result of advances in skin imaging technology and the development of suitable image processing techniques, during the last decade, there has been a significant increase of interest in the computer-aided diagnosis of melanoma. Automated border detection is one of the most important steps in this procedure, because the accuracy of the subsequent steps crucially depends on it. METHODS: In this article, we present a fast and unsupervised approach to border detection in dermoscopy images of pigmented skin lesions based on the statistical region merging algorithm. RESULTS: The method is tested on a set of 90 dermoscopy images. The border detection error is quantified by a metric in which three sets of dermatologist-determined borders are used as the ground-truth. The proposed method is compared with four state-of-the-art automated methods (orientation-sensitive fuzzy c-means, dermatologist-like tumor extraction algorithm, meanshift clustering, and the modified JSEG method). CONCLUSION: The results demonstrate that the method presented here achieves both fast and accurate border detection in dermoscopy images.

A methodological approach to the classification of dermoscopy images.

In this paper a methodological approach to the classification of pigmented skin lesions in dermoscopy images is presented. First, automatic border detection is performed to separate the lesion from the background skin. Shape features are then extracted from this border. For the extraction of color and texture related features, the image is divided into various clinically significant regions using the Euclidean distance transform. This feature data is fed into an optimization framework, which ranks the features using various feature selection algorithms and determines the optimal feature subset size according to the area under the ROC curve measure obtained from support vector machine classification. The issue of class imbalance is addressed using various sampling strategies, and the classifier generalization error is estimated using Monte Carlo cross validation. Experiments on a set of 564 images yielded a specificity of 92.34% and a sensitivity of 93.33%.

Enhancements in localized classification for uterine cervical cancer digital histology image assessment.

BACKGROUND: In previous research, we introduced an automated, localized, fusion-based approach for classifying uterine cervix squamous epithelium into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN) based on digitized histology image analysis. As part of the CIN assessment process, acellular and atypical cell concentration features were computed from vertical segment partitions of the epithelium region to quantize the relative distribution of nuclei. METHODS: Feature data was extracted from 610 individual segments from 61 images for epithelium classification into categories of Normal, CIN1, CIN2, and CIN3. The classification results were compared against CIN labels obtained from two pathologists who visually assessed abnormality in the digitized histology images. In this study, individual vertical segment CIN classification accuracy improvement is reported using the logistic regression classifier for an expanded data set of 118 histology images. RESULTS: We analyzed the effects on classification using the same pathologist labels for training and testing versus using one pathologist labels for training and the other for testing. Based on a leave-one-out approach for classifier training and testing, exact grade CIN accuracies of 81.29% and 88.98% were achieved for individual vertical segment and epithelium whole-image classification, respectively. CONCLUSIONS: The Logistic and Random Tree classifiers outperformed the benchmark SVM and LDA classifiers from previous research. The Logistic Regression classifier yielded an improvement of 10.17% in CIN Exact grade classification results based on CIN labels for training-testing for the individual vertical segments and the whole image from the same single expert over the baseline approach using the reduced features. Overall, the CIN classification rates tended to be higher using the training-testing labels for the same expert than for training labels from one expert and testing labels from the other expert. The Exact class fusion- based CIN discrimination results obtained in this study are similar to the Exact class expert agreement rate.

Nuclei-Based Features for Uterine Cervical Cancer Histology Image Analysis With Fusion-Based Classification.

Cervical cancer, which has been affecting women worldwide as the second most common cancer, can be cured if detected early and treated well. Routinely, expert pathologists visually examine histology slides for cervix tissue abnormality assessment. In previous research, we investigated an automated, localized, fusion-based approach for classifying squamous epithelium into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN) based on image analysis of 61 digitized histology images. This paper introduces novel acellular and atypical cell concentration features computed from vertical segment partitions of the epithelium region within digitized histology images to quantize the relative increase in nuclei numbers as the CIN grade increases. Based on the CIN grade assessments from two expert pathologists, image-based epithelium classification is investigated with voting fusion of vertical segments using support vector machine and linear discriminant analysis approaches. Leave-one-out is used for the training and testing for CIN classification, achieving an exact grade labeling accuracy as high as 88.5%.

Detection of solid pigment in dermatoscopy images using texture analysis.

BACKGROUND/AIMS: Epiluminescence microscopy (ELM), also known as dermoscopy or dermatoscopy, is a non-invasive, in vivo technique, that permits visualization of features of pigmented melanocytic neoplasms that are not discernable by examination with the naked eye. ELM offers a completely new range of visual features. One such feature is the solid pigment, also called the blotchy pigment or dark structureless area. Our goal was to automatically detect this feature and determine whether its presence is useful in distinguishing benign from malignant pigmented lesions. METHODS: Here, a texture-based algorithm is developed for the detection of solid pigment. The factors d and a used in calculating neighboring gray level dependence matrix (NGLDM) numbers were chosen as optimum by experimentation. The algorithms are tested on a set of 37 images. A new index is presented for separation of benign and malignant lesions, based on the presence of solid pigment in the periphery. RESULTS: The NGLDM large number emphasis N2 was satisfactory for the detection of the solid pigment. Nine lesions had solid pigment detected, and among our 37 lesions, no melanoma lacked solid pigment. The index for separation of benign and malignant lesions was applied to the nine lesions. We were able to separate the benign lesions with solid pigment from the malignant lesions with the exception of only one lesion, a Spitz nevus that mimicked a malignant melanoma. CONCLUSION: Texture methods may be useful in detecting important dermatoscopy features in digitized images and a new index may be useful in separating benign from malignant lesions. Testing on a larger set of lesions is needed before further conclusions can be made.

Detection of pigment network in dermatoscopy images using texture analysis.

Dermatoscopy, also known as dermoscopy or epiluminescence microscopy (ELM), is a non-invasive, in vivo technique, which permits visualization of features of pigmented melanocytic neoplasms that are not discernable by examination with the naked eye. ELM offers a completely new range of visual features. One such prominent feature is the pigment network. Two texture-based algorithms are developed for the detection of pigment network. These methods are applicable to various texture patterns in dermatoscopy images, including patterns that lack fine lines such as cobblestone, follicular, or thickened network patterns. Two texture algorithms, Laws energy masks and the neighborhood gray-level dependence matrix (NGLDM) large number emphasis, were optimized on a set of 155 dermatoscopy images and compared. Results suggest superiority of Laws energy masks for pigment network detection in dermatoscopy images. For both methods, a texel width of 10 pixels or approximately 0.22 mm is found for dermatoscopy images.

Concentric decile segmentation of white and hypopigmented areas in dermoscopy images of skin lesions allows discrimination of malignant melanoma.

Dermoscopy, also known as dermatoscopy or epiluminescence microscopy (ELM), permits visualization of features of pigmented melanocytic neoplasms that are not discernable by examination with the naked eye. White areas, prominent in early malignant melanoma and melanoma in situ, contribute to early detection of these lesions. An adaptive detection method has been investigated to identify white and hypopigmented areas based on lesion histogram statistics. Using the Euclidean distance transform, the lesion is segmented in concentric deciles. Overlays of the white areas on the lesion deciles are determined. Calculated features of automatically detected white areas include lesion decile ratios, normalized number of white areas, absolute and relative size of largest white area, relative size of all white areas, and white area eccentricity, dispersion, and irregularity. Using a back-propagation neural network, the white area statistics yield over 95% diagnostic accuracy of melanomas from benign nevi. White and hypopigmented areas in melanomas tend to be central or paracentral. The four most powerful features on multivariate analysis are lesion decile ratios. Automatic detection of white and hypopigmented areas in melanoma can be accomplished using lesion statistics. A neural network can achieve good discrimination of melanomas from benign nevi using these areas. Lesion decile ratios are useful white area features.

Modified watershed technique and post-processing for segmentation of skin lesions in dermoscopy images.

In previous research, a watershed-based algorithm was shown to be useful for automatic lesion segmentation in dermoscopy images, and was tested on a set of 100 benign and malignant melanoma images with the average of three sets of dermatologist-drawn borders used as the ground truth, resulting in an overall error of 15.98%. In this study, to reduce the border detection errors, a neural network classifier was utilized to improve the first-pass watershed segmentation; a novel "edge object value (EOV) threshold" method was used to remove large light blobs near the lesion boundary; and a noise removal procedure was applied to reduce the peninsula-shaped false-positive areas. As a result, an overall error of 11.09% was achieved.

Fuzzy logic techniques for blotch feature evaluation in dermoscopy images.

Blotches, also called structureless areas, are critical in differentiating malignant melanoma from benign lesions in dermoscopy skin lesion images. In this paper, fuzzy logic techniques are investigated for the automatic detection of blotch features for malignant melanoma discrimination. Four fuzzy sets representative of blotch size and relative and absolute blotch colors are used to extract blotchy areas from a set of dermoscopy skin lesion images. Five previously reported blotch features are computed from the extracted blotches as well as four new features. Using a neural network classifier, malignant melanoma discrimination results are optimized over the range of possible alpha-cuts and compared with results using crisp blotch features. Features computed from blotches using the fuzzy logic techniques based on three plane relative color and blotch size yield the highest diagnostic accuracy of 81.2%.

Analysis of globule types in malignant melanoma.

OBJECTIVE: To identify and analyze subtypes of globules based on size, shape, network connectedness, pigmentation, and distribution to determine which globule types and globule distributions are most frequently associated with a diagnosis of malignant melanoma. DESIGN: Retrospective case series of dermoscopy images with globules. SETTING: Private dermatology practices. PARTICIPANTS: Patients in dermatology practices. Intervention Observation only. Main Outcome Measure Association of globule types with malignant melanoma. RESULTS: The presence of large globules (odds ratio [OR], 5.25) and globules varying in size (4.72) or shape (5.37) had the highest ORs for malignant melanoma among all globule types and combinations studied. Classical globules (dark, discrete, convex, and 0.10-0.20 mm) had a higher risk (OR, 4.20) than irregularly shaped globules (dark, discrete, and not generally convex) (2.89). Globules connected to other structures were not significant in the diagnosis of malignant melanoma. Of the different configurations studied, asymmetric clusters have the highest risk (OR, 3.02). CONCLUSIONS: The presence of globules of varying size or shape seems to be more associated with a diagnosis of malignant melanoma than any other globule type or distribution in this study. Large globules are of particular importance in the diagnosis of malignant melanoma.

Skin lesion classification using relative color features.

BACKGROUND/PURPOSE: Clinically, it is difficult to differentiate the early stage of malignant melanoma and certain benign skin lesions due to similarity in appearance. Our research uses image analysis of clinical skin images and relative color-based pattern recognition techniques to enhance the images and improve differentiation of these lesions. METHODS: First, the relative color images were created from digitized photographic images. Then, they were segmented into objects and morphologically filtered. Next, the relative color features were extracted from the objects to form two different feature spaces; a lesion feature space and an object feature space. The two feature spaces serve as two data models to be analyzed to determine the best features. Finally, we used a statistical analysis model of relative color features, which better classifies the various types of skin lesions. RESULTS/CONCLUSIONS: The best features found for differentiation of melanoma and benign skin lesions from this study are area, mean in the red and blue bands, standard deviation in the red and green bands, skewness in the green band, and entropy in the red band. With the relative color feature algorithm developed, the best results were obtained with a multi-layer perceptron neural network model. This showed an overall classification success of 79%, with 70% of the benign lesions successfully classified, and 86% of malignant melanoma successfully classified.

Automatic detection of blue-white veil and related structures in dermoscopy images.

Dermoscopy is a non-invasive skin imaging technique, which permits visualization of features of pigmented melanocytic neoplasms that are not discernable by examination with the naked eye. One of the most important features for the diagnosis of melanoma in dermoscopy images is the blue-white veil (irregular, structureless areas of confluent blue pigmentation with an overlying white "ground-glass" film). In this article, we present a machine learning approach to the detection of blue-white veil and related structures in dermoscopy images. The method involves contextual pixel classification using a decision tree classifier. The percentage of blue-white areas detected in a lesion combined with a simple shape descriptor yielded a sensitivity of 69.35% and a specificity of 89.97% on a set of 545 dermoscopy images. The sensitivity rises to 78.20% for detection of blue veil in those cases where it is a primary feature for melanoma recognition.