ABSTRACT
Melanoma is a type of skin cancer that poses significant health risks and requires early detection for effective treatment. This study proposing a novel approach that integrates a transformer-based model with hand-crafted texture features and Gray Wolf Optimization, aiming to enhance efficiency of melanoma classification. Preprocessing involves standardizing image dimensions and enhancing image quality through median filtering techniques. Texture features, including GLCM and LBP, are extracted to capture spatial patterns indicative of melanoma. The GWO algorithm is applied to select the most discriminative features. A transformer-based decoder is then employed for classification, leveraging attention mechanisms to capture contextual dependencies. The experimental validation on the HAM10000 dataset and ISIC2019 dataset showcases the effectiveness of the proposed methodology. The transformer-based model, integrated with hand-crafted texture features and guided by Gray Wolf Optimization, achieves outstanding results. The results showed that the proposed method performed well in melanoma detection tasks, achieving an accuracy and F1-score of 99.54% and 99.11% on the HAM10000 dataset, and an accuracy of 99.47%, and F1-score of 99.25% on the ISIC2019 dataset. ⢠We use the concepts of LBP and GLCM to extract features from the skin lesion images. ⢠The Gray Wolf Optimization (GWO) algorithm is employed for feature selection. ⢠A decoder based on Transformers is utilized for melanoma classification.
ABSTRACT
Melanoma represents an extremely aggressive type of skin lesion. Despite its high mortality rate, when detected in its initial stage, the projected five-year survival rate is notably high. The advancement of Artificial Intelligence in recent years has facilitated the creation of diverse solutions aimed at assisting medical diagnosis. This proposal presents an architecture for melanoma classification.
Subject(s)
Melanoma , Skin Neoplasms , Melanoma/classification , Humans , Skin Neoplasms/classification , Artificial Intelligence , Diagnosis, Computer-Assisted/methodsABSTRACT
Skin is the exposed part of the human body that constantly protected from UV rays, heat, light, dust, and other hazardous radiation. One of the most dangerous illnesses that affect people is skin cancer. A type of skin cancer called melanoma starts in the melanocytes, which regulate the colour in human skin. Reducing the fatality rate from skin cancer requires early detection and diagnosis of conditions like melanoma. In this article, a Self-attention based cycle-consistent generative adversarial network optimized with Archerfish Hunting Optimization Algorithm adopted Melanoma Classification (SACCGAN-AHOA-MC-DI) from dermoscopic images is proposed. Primarily, the input Skin dermoscopic images are gathered via the dataset of ISIC 2019. Then, the input Skin dermoscopic images is pre-processed using adjusted quick shift phase preserving dynamic range compression (AQSP-DRC) for removing noise and increase the quality of Skin dermoscopic images. These pre-processed images are fed to the piecewise fuzzy C-means clustering (PF-CMC) for ROI region segmentation. The segmented ROI region is supplied to the Hexadecimal Local Adaptive Binary Pattern (HLABP) to extract the Radiomic features, like Grayscale statistic features (standard deviation, mean, kurtosis, and skewness) together with Haralick Texture features (contrast, energy, entropy, homogeneity, and inverse different moments). The extracted features are fed to self-attention based cycle-consistent generative adversarial network (SACCGAN) which classifies the skin cancers as Melanocytic nevus, Basal cell carcinoma, Actinic Keratosis, Benign keratosis, Dermatofibroma, Vascular lesion, Squamous cell carcinoma and melanoma. In general, SACCGAN not adapt any optimization modes to define the ideal parameters to assure accurate classification of skin cancer. Hence, Archerfish Hunting Optimization Algorithm (AHOA) is considered to maximize the SACCGAN classifier, which categorizes the skin cancer accurately. The proposed method attains 23.01%, 14.96%, and 45.31% higher accuracy and 32.16%, 11.32%, and 24.56% lesser computational time evaluated to the existing methods, like melanoma prediction method for unbalanced data utilizing optimized Squeeze Net through bald eagle search optimization (CNN-BES-MC-DI), hyper-parameter optimized CNN depending on Grey wolf optimization algorithm (CNN-GWOA-MC-DI), DEANN incited skin cancer finding depending on fuzzy c-means clustering (DEANN-MC-DI). RESEARCH HIGHLIGHTS: This manuscript, self-attention based cycle-consistent. SACCGAN-AHOA-MC-DI method is implemented in Python. (SACCGAN-AHOA-MC-DI) from dermoscopic images is proposed. Adjusted quick shift phase preserving dynamic range compression (AQSP-DRC). Removing noise and increase the quality of Skin dermoscopic images.
Subject(s)
Keratosis, Actinic , Melanoma , Skin Neoplasms , Humans , Melanoma/diagnosis , Skin Neoplasms/diagnosis , Melanocytes/pathology , Algorithms , Diagnosis, Computer-Assisted/methodsABSTRACT
Unraveling the multidimensional complexities of melanoma has required concerted efforts by dedicated community of researchers and clinicians battling against this deadly form of skin cancer. Remarkable advances have been made in the realm of epidemiology, classification, diagnosis, and therapy of melanoma. The treatment of advanced melanomas has entered the golden era as targeted personalized therapies have emerged that have significantly altered the mortality rate. A paradigm shift in the approach to melanoma classification, diagnosis, prognosis, and staging is underway, fueled by discoveries of genetic alterations in melanocytic neoplasms. A morphologic clinicopathologic classification of melanoma is expected to be replaced by a more precise molecular based one. As validated, convenient, and cost-effective molecular-based tests emerge, molecular diagnostics will play a greater role in the clinical and histologic diagnosis of melanoma. Artificial intelligence augmented clinical and histologic diagnosis of melanoma is expected to make the process more streamlined and efficient. A more accurate model of prognosis and staging of melanoma is emerging based on molecular understanding melanoma. This contribution summarizes the recent advances in melanoma epidemiology, classification, diagnosis, and prognosis.
ABSTRACT
Melanoma is known worldwide as a malignant tumor and the fastest-growing skin cancer type. It is a very life-threatening disease with a high mortality rate. Automatic melanoma detection improves the early detection of the disease and the survival rate. In accordance with this purpose, we presented a multi-task learning approach based on melanoma recognition with dermoscopy images. Firstly, an effective pre-processing approach based on max pooling, contrast, and shape filters is used to eliminate hair details and to perform image enhancement operations. Next, the lesion region was segmented with a VGGNet model-based FCN Layer architecture using enhanced images. Later, a cropping process was performed for the detected lesions. Then, the cropped images were converted to the input size of the classifier model using the very deep super-resolution neural network approach, and the decrease in image resolution was minimized. Finally, a deep learning network approach based on pre-trained convolutional neural networks was developed for melanoma classification. We used the International Skin Imaging Collaboration, a publicly available dermoscopic skin lesion dataset in experimental studies. While the performance measures of accuracy, specificity, precision, and sensitivity, obtained for segmentation of the lesion region, were produced at rates of 96.99%, 92.53%, 97.65%, and 98.41%, respectively, the performance measures achieved rates for classification of 97.73%, 99.83%, 99.83%, and 95.67%, respectively.
ABSTRACT
A powerful medical decision support system for classifying skin lesions from dermoscopic images is an important tool to prognosis of skin cancer. In the recent years, Deep Convolutional Neural Network (DCNN) have made a significant advancement in detecting skin cancer types from dermoscopic images, in-spite of its fine grained variability in its appearance. The main objective of this research work is to develop a DCNN based model to automatically classify skin cancer types into melanoma and non-melanoma with high accuracy. The datasets used in this work were obtained from the popular challenges ISIC-2019 and ISIC-2020, which have different image resolutions and class imbalance problems. To address these two problems and to achieve high performance in classification we have used EfficientNet architecture based on transfer learning techniques, which learns more complex and fine grained patterns from lesion images by automatically scaling depth, width and resolution of the network. We have augmented our dataset to overcome the class imbalance problem and also used metadata information to improve the classification results. Further to improve the efficiency of the EfficientNet we have used ranger optimizer which considerably reduces the hyper parameter tuning, which is required to achieve state-of-the-art results. We have conducted several experiments using different transferring models and our results proved that EfficientNet variants outperformed in the skin lesion classification tasks when compared with other architectures. The performance of the proposed system was evaluated using Area under the ROC curve (AUC - ROC) and obtained the score of 0.9681 by optimal fine tuning of EfficientNet-B6 with ranger optimizer.
ABSTRACT
Mucosal melanoma is a rare subtype of melanoma that accounts for 1% of all melanomas. The incidence of nasal mucosal melanomas is 0.3 per million. Desmoplastic melanomas are a subtype of melanoma with a reported incidence of 2.0 per million. Although 50% of desmoplastic melanomas are found in the head and neck region, mucosal desmoplastic melanoma is exceedingly rare. In the present study, we report a case of nasal mucosal desmoplastic melanoma and review the literature. A 79-year-old female presented to an outside otolaryngologist with nasal discomfort accompanied by rhinorrhea and was found to have a nasal vestibule mass. An endonasal incisional biopsy was performed yielding a diagnosis of a SOX-10 positive tumor. The patient was referred to our institution for further management. A blue-tinged lesion was identified at the prior biopsy site, and the mass was resected via an open rhinoplasty approach. Final pathology demonstrated an infiltrative spindle cell neoplasm with immunohistochemical patterns supportive of desmoplastic melanoma arising from the nasal vestibule. Due to positive margins, the patient underwent a re-resection with no tumor identified on the re-resected specimen. To our knowledge, this is the third case of nasal mucosal desmoplastic melanoma. We review the clinicopathologic features and management of this rare entity.
Subject(s)
Melanoma , Nose Neoplasms , Aged , Female , Humans , Nasal MucosaABSTRACT
BACKGROUND: Automatic skin lesion recognition has shown to be effective in increasing access to reliable dermatology evaluation; however, most existing algorithms rely solely on images. Many diagnostic rules, including the 3-point checklist, are not considered by artificial intelligence algorithms, which comprise human knowledge and reflect the diagnosis process of human experts. OBJECTIVE: In this paper, we aimed to develop a semisupervised model that can not only integrate the dermoscopic features and scoring rule from the 3-point checklist but also automate the feature-annotation process. METHODS: We first trained the semisupervised model on a small, annotated data set with disease and dermoscopic feature labels and tried to improve the classification accuracy by integrating the 3-point checklist using ranking loss function. We then used a large, unlabeled data set with only disease label to learn from the trained algorithm to automatically classify skin lesions and features. RESULTS: After adding the 3-point checklist to our model, its performance for melanoma classification improved from a mean of 0.8867 (SD 0.0191) to 0.8943 (SD 0.0115) under 5-fold cross-validation. The trained semisupervised model can automatically detect 3 dermoscopic features from the 3-point checklist, with best performances of 0.80 (area under the curve [AUC] 0.8380), 0.89 (AUC 0.9036), and 0.76 (AUC 0.8444), in some cases outperforming human annotators. CONCLUSIONS: Our proposed semisupervised learning framework can help with the automatic diagnosis of skin disease based on its ability to detect dermoscopic features and automate the label-annotation process. The framework can also help combine semantic knowledge with a computer algorithm to arrive at a more accurate and more interpretable diagnostic result, which can be applied to broader use cases.
ABSTRACT
Melanoma is a skin disease with a high fatality rate. Early diagnosis of melanoma can effectively increase the survival rate of patients. There are three types of dermoscopy images, malignant melanoma, benign nevis, and seborrheic keratosis, so using dermoscopy images to classify melanoma is an indispensable task in diagnosis. However, early melanoma classification works can only use the low-level information of images, so the melanoma cannot be classified efficiently; the recent deep learning methods mainly depend on a single network, although it can extract high-level features, the poor scale and type of the features limited the results of the classification. Therefore, we need an automatic classification method for melanoma, which can make full use of the rich and deep feature information of images for classification. In this study, we propose an ensemble method that can integrate different types of classification networks for melanoma classification. Specifically, we first use U-net to segment the lesion area of images to generate a lesion mask, thus resize images to focus on the lesion; then, we use five excellent classification models to classify dermoscopy images, and adding squeeze-excitation block (SE block) to models to emphasize the more informative features; finally, we use our proposed new ensemble network to integrate five different classification results. The experimental results prove the validity of our results. We test our method on the ISIC 2017 challenge dataset and obtain excellent results on multiple metrics; especially, we get 0.909 on accuracy. Our classification framework can provide an efficient and accurate way for melanoma classification using dermoscopy images, laying the foundation for early diagnosis and later treatment of melanoma.
ABSTRACT
BACKGROUND: Melanoma is one of the most aggressive types of cancer that has become a world-class problem. According to the World Health Organization estimates, 132,000 cases of the disease and 66,000 deaths from malignant melanoma and other forms of skin cancer are reported annually worldwide ( https://apps.who.int/gho/data/?theme=main ) and those numbers continue to grow. In our opinion, due to the increasing incidence of the disease, it is necessary to find new, easy to use and sensitive methods for the early diagnosis of melanoma in a large number of people around the world. Over the last decade, neural networks show highly sensitive, specific, and accurate results. OBJECTIVE: This study presents a review of PubMed papers including requests «melanoma neural network¼ and «melanoma neural network dermatoscopy¼. We review recent researches and discuss their opportunities acceptable in clinical practice. METHODS: We searched the PubMed database for systematic reviews and original research papers on the requests «melanoma neural network¼ and «melanoma neural network dermatoscopy¼ published in English. Only papers that reported results, progress and outcomes are included in this review. RESULTS: We found 11 papers that match our requests that observed convolutional and deep-learning neural networks combined with fuzzy clustering or World Cup Optimization algorithms in analyzing dermatoscopic images. All of them require an ABCD (asymmetry, border, color, and differential structures) algorithm and its derivates (in combination with ABCD algorithm or separately). Also, they require a large dataset of dermatoscopic images and optimized estimation parameters to provide high specificity, accuracy and sensitivity. CONCLUSIONS: According to the analyzed papers, neural networks show higher specificity, accuracy and sensitivity than dermatologists. Neural networks are able to evaluate features that might be unavailable to the naked human eye. Despite that, we need more datasets to confirm those statements. Nowadays machine learning becomes a helpful tool in early diagnosing skin diseases, especially melanoma.
Subject(s)
Deep Learning , Early Detection of Cancer , Image Interpretation, Computer-Assisted/methods , Melanoma/diagnostic imaging , Skin Neoplasms/diagnostic imaging , Data Accuracy , Humans , Sensitivity and Specificity , Melanoma, Cutaneous MalignantABSTRACT
BACKGROUND: State-of-the-art classifiers based on convolutional neural networks (CNNs) were shown to classify images of skin cancer on par with dermatologists and could enable lifesaving and fast diagnoses, even outside the hospital via installation of apps on mobile devices. To our knowledge, at present there is no review of the current work in this research area. OBJECTIVE: This study presents the first systematic review of the state-of-the-art research on classifying skin lesions with CNNs. We limit our review to skin lesion classifiers. In particular, methods that apply a CNN only for segmentation or for the classification of dermoscopic patterns are not considered here. Furthermore, this study discusses why the comparability of the presented procedures is very difficult and which challenges must be addressed in the future. METHODS: We searched the Google Scholar, PubMed, Medline, ScienceDirect, and Web of Science databases for systematic reviews and original research articles published in English. Only papers that reported sufficient scientific proceedings are included in this review. RESULTS: We found 13 papers that classified skin lesions using CNNs. In principle, classification methods can be differentiated according to three principles. Approaches that use a CNN already trained by means of another large dataset and then optimize its parameters to the classification of skin lesions are the most common ones used and they display the best performance with the currently available limited datasets. CONCLUSIONS: CNNs display a high performance as state-of-the-art skin lesion classifiers. Unfortunately, it is difficult to compare different classification methods because some approaches use nonpublic datasets for training and/or testing, thereby making reproducibility difficult. Future publications should use publicly available benchmarks and fully disclose methods used for training to allow comparability.
Subject(s)
Neural Networks, Computer , Skin Neoplasms/classification , Humans , Reproducibility of ResultsABSTRACT
Molecular mechanisms involved in pathogenesis of malignant melanoma have been widely studied and novel therapeutic treatments developed in recent past years. Molecular targets for therapy have mostly been recognized in the RAS-RAF-MEK-ERK and PI3K-AKT signaling pathways; small-molecule inhibitors were drawn to specifically target key kinases. Unfortunately, these targeted drugs may display intrinsic or acquired resistance and various evidences suggest that inhibition of a single effector of the signal transduction cascades involved in melanoma pathogenesis may be ineffective in blocking the tumor growth. In this sense, a wider comprehension of the multiple molecular alterations accounting for either response or resistance to treatments with targeted inhibitors may be helpful in assessing, which is the most effective combination of such therapies. In the present review, we summarize the known molecular mechanisms underlying either intrinsic and acquired drug resistance either alternative roads to melanoma pathogenesis, which may become targets for innovative anticancer approaches.