Collective human intelligence outperforms artificial intelligence in a skin lesion classification task.

BACKGROUND AND OBJECTIVES: Convolutional neural networks (CNN) enable accurate diagnosis of medical images and perform on or above the level of individual physicians. Recently, collective human intelligence (CoHI) was shown to exceed the diagnostic accuracy of individuals. Thus, diagnostic performance of CoHI (120 dermatologists) versus individual dermatologists versus two state-of-the-art CNN was investigated. PATIENTS AND METHODS: Cross-sectional reader study with presentation of 30 clinical cases to 120 dermatologists. Six diagnoses were offered and votes collected via remote voting devices (quizzbox®, Quizzbox Solutions GmbH, Stuttgart, Germany). Dermatoscopic images were classified by a binary and multiclass CNN (FotoFinder Systems GmbH, Bad Birnbach, Germany). Three sets of diagnostic classifications were scored against ground truth: (1) CoHI, (2) individual dermatologists, and (3) CNN. RESULTS: CoHI attained a significantly higher accuracy [95 % confidence interval] (80.0 % [62.7 %-90.5 %]) than individual dermatologists (75.7 % [73.8 %-77.5 %]) and CNN (70.0 % [52.1 %-83.3 %]; all P < 0.001) in binary classifications. Moreover, CoHI achieved a higher sensitivity (82.4 % [59.0 %-93.8 %]) and specificity (76.9 % [49.7 %-91.8 %]) than individual dermatologists (sensitivity 77.8 % [75.3 %-80.2 %], specificity 73.0 % [70.6 %-75.4 %]) and CNN (sensitivity 70.6 % [46.9 %-86.7 %], specificity 69.2 % [42.4 %-87.3 %]). The diagnostic accuracy of CoHI was superior to that of individual dermatologists (P < 0.001) in multiclass evaluation, with the accuracy of the latter comparable to multiclass CNN. CONCLUSIONS: Our analysis revealed that the majority vote of an interconnected group of dermatologists (CoHI) outperformed individuals and CNN in a demanding skin lesion classification task.

Differentiation of combined nevi and melanomas: Case-control study with comparative analysis of dermoscopic features.

BACKGROUND AND OBJECTIVES: Combined nevi (CN) show two or more components of major nevus subtypes and simulate melanomas. We investigated a panel of dermoscopic features and three dermoscopic algorithms for differentiating CN from melanomas. PATIENTS AND METHODS: Retrospective, blinded case-control study using dermoscopic images of 36 CN and 36 melanoma controls. Twenty-one dermoscopic features validated for the diagnosis of melanocytic lesions, the number of colors, and three dermoscopic algorithms were investigated (ABCD rule of dermoscopy, Menzies scoring method, 7-point checklist). RESULTS: Five of seven features indicative of nevi were observed significantly more frequently in CN than in melanomas (all p < 0.05) and two were exclusively found in CN. Eleven out of 14 features indicative of melanomas were observed significantly more frequently in melanomas than in CN (all p < 0.03) and five were exclusively found in melanomas. The mean (± SD) number of colors in CN was lower than in melanomas (2.1 ± 0.6 versus 3.4 ± 0.7; p < 0.001). Among tested algorithms the ABCD rule of dermoscopy performed best (sensitivity 91.7 %, specificity 77.8 %). CONCLUSIONS: The ABCD rule of dermoscopy differentiated CN from melanomas most efficiently. Additional knowledge of dermoscopic features to be expected exclusively in either CN or melanomas should help dermatologists to make a correct clinical diagnosis.

Differenzierung von kombinierten Nävi und Melanomen: Fallkontrollstudie mit komparativer Analyse der dermatoskopischen Merkmale.

HINTERGRUND: Kombinierte Nävi (KN) zeigen zwei oder mehr Komponenten bestimmter Nävustypen und stellen klassische Melanomsimulatoren dar. In dieser Studie wurde eine vorab definierte Auswahl dermatoskopischer Merkmale sowie drei diagnostische Algorithmen hinsichtlich der Differenzierung von KN und Melanomen evaluiert. PATIENTEN UND METHODIK: Retrospektive, verblindete Fallkontrollstudie mit Vergleich dermatoskopischer Bilder von 36 KN sowie 36 Melanomen. Insgesamt wurden 21 dermatoskopische Merkmale, die Anzahl der Farben sowie drei diagnostische Algorithmen (ABCD-Regel, Menzies-Score, 7-Punkte-Checkliste) untersucht. ERGEBNISSE: 5 von 7 typischen Nävus-Merkmalen wurden signifikant häufiger in KN im Vergleich zu Melanomen gefunden (alle p < 0,05) und zwei Merkmale wurden ausschließlich in KN gefunden. 11 von 14 typischen Melanom-Merkmalen wurden signifikant häufiger in Melanomen im Vergleich zu KN gefunden (alle p < 0,03) und fünf Merkmale wurden ausschließlich in Melanomen gefunden. Die mittlere (± SD) Anzahl der Farben in KN war niedriger im Vergleich zu den Melanomen (2,1 ± 0,6 vs. 3,4 ± 0,7; p < 0,001). Bei den untersuchten Algorithmen zeigte die ABCD-Regel der Dermatoskopie die beste diagnostische Leistung (Sensitivität 91,7 %, Spezifität 77,8 %). SCHLUSSFOLGERUNGEN: Die ABCD-Regel der Dermatoskopie erzielte die beste Differenzierung von KN und Melanomen. Zusätzliches Wissen über KN- oder Melanom-spezifische dermatoskopische Merkmale kann zur sicheren klinischen Diagnose beitragen.

The status of dermoscopy in Germany - results of the cross-sectional Pan-Euro-Dermoscopy Study.

BACKGROUND: Survey on the current status of dermoscopy in Germany. METHODS: In the context of a pan-European internet-based study (n = 7,480) conducted by the International Dermoscopy Society, 880 German dermatologists were asked to answer questions with respect to their level of training as well as their use and perceived benefit of dermoscopy. RESULTS: Seven hundred and sixty-two (86.6 %) participants practiced dermatology in a publicly funded health care setting; 98.4 % used a dermoscope in routine clinical practice. About 93 % (n = 814) stated to have had more than five years of experience in the use of dermoscopy. Dermoscopy was considered useful in the diagnosis of melanoma by 93.6 % (n = 824); for pigmented skin tumors, by 92.4 % (n = 813); in the follow-up of melanocytic lesions, by 88.6 % (n = 780); for non-pigmented lesions, by 71.4 % (n = 628), in the follow-up of non-melanocytic lesions, by 52.7 % (n = 464); and for inflammatory skin lesions, by 28.5 % (n = 251). Overall, 86.5 % (n = 761) of participants felt that - compared to naked-eye examination - dermoscopy increased the number of melanomas diagnosed; 77,7 % (n = 684) considered the number of unnecessary excisions of benign lesions to be decreased. Participants who personally felt that dermoscopy improved their ability to diagnose melanoma were significantly i) younger, ii) had been practicing dermatology for a shorter period of time, iii) were less commonly employed by an university-affiliated dermatology department, iv) were more frequently working in an office-based public health care setting, and v) had more frequently been trained in dermoscopy during their dermatology residency. CONCLUSIONS: The findings presented herein ought to be integrated into future residency and continuing medical education programs with the challenge to improve dermato-oncological care and to expand the diagnostic spectrum of dermoscopy to include inflammatory skin diseases.

Standardization of terminology in dermoscopy/dermatoscopy: Results of the third consensus conference of the International Society of Dermoscopy.

BACKGROUND: Evolving dermoscopic terminology motivated us to initiate a new consensus. OBJECTIVE: We sought to establish a dictionary of standardized terms. METHODS: We reviewed the medical literature, conducted a survey, and convened a discussion among experts. RESULTS: Two competitive terminologies exist, a more metaphoric terminology that includes numerous terms and a descriptive terminology based on 5 basic terms. In a survey among members of the International Society of Dermoscopy (IDS) 23.5% (n = 201) participants preferentially use descriptive terminology, 20.1% (n = 172) use metaphoric terminology, and 484 (56.5%) use both. More participants who had been initially trained by metaphoric terminology prefer using descriptive terminology than vice versa (9.7% vs 2.6%, P < .001). Most new terms that were published since the last consensus conference in 2003 were unknown to the majority of the participants. There was uniform consensus that both terminologies are suitable, that metaphoric terms need definitions, that synonyms should be avoided, and that the creation of new metaphoric terms should be discouraged. The expert panel proposed a dictionary of standardized terms taking account of metaphoric and descriptive terms. LIMITATIONS: A consensus seeks a workable compromise but does not guarantee its implementation. CONCLUSION: The new consensus provides a revised framework of standardized terms to enhance the consistent use of dermoscopic terminology.

[Prurigo pigmentosa: Case report of a German adolescent]. / Prurigo pigmentosa: Fallbericht eines deutschen Jugendlichen.

Prurigo pigmentosa is an inflammatory dermatosis that rarely occurs in Europe and mostly affects young women. Here, we describe the typical clinical and dermoscopic criteria so that therapy can be initiated as early as possible. The 17-year-old patient presented here shows that this disease can also be observed in Western Europe and in men, and that doxycycline is a very effective treatment option.

Computerizing the first step of the two-step algorithm in dermoscopy: A convolutional neural network for differentiating melanocytic from non-melanocytic skin lesions.

IMPORTANCE: Convolutional neural networks (CNN) have shown performance equal to trained dermatologists in differentiating benign from malignant skin lesions. To improve clinicians' management decisions, additional classifications into diagnostic categories might be helpful. METHODS: A convenience sample of 100 pigmented/non-pigmented skin lesions was used for a cross-sectional two-level reader study including 96 dermatologists (level I: dermoscopy only; level II: clinical close-up images, dermoscopy, and textual information). Dermoscopic images were classified by a binary CNN trained to differentiate melanocytic from non-melanocytic lesions (FotoFinder Systems, Bad Birnbach, Germany). Primary endpoint was the accuracy of the CNN's classification in comparison with dermatologists reviewing level-II information. Secondary endpoints included dermatologists' accuracies according to their level of experience and the CNN's area under the curve (AUC) of receiver operating characteristics (ROC). RESULTS: The CNN revealed an accuracy and ROC AUC with corresponding 95 % confidence intervals (CI) of 91.0 % (83.8 % to 95.2 %) and 0.981 (0.962 to 1). In level I, dermatologists showed a mean accuracy of 83.7 % (82.5 % to 84.8 %). With level II information, the accuracy improved to 87.8 % (86.7 % to 88.9 %; p < 0.001). When comparing accuracies of CNN and dermatologists in level II, the CNN's accuracy was higher (91.0 % versus 87.8 %, p < 0.001). For experts with level II information results were on par with the CNN (91.0 % versus 90.4 %, p = 0.368). CONCLUSIONS: The tested CNN accurately differentiated melanocytic from non-melanocytic skin lesions and outperformed dermatologists. The CNN may support clinicians and could be used in an ensemble approach combined with other CNN models.

Randomized placebo-controlled human pilot study of cold atmospheric argon plasma on skin graft donor sites.

Cold atmospheric plasma has already been shown to decrease the bacterial load in chronic wounds. However, until now it is not yet known if plasma treatment can also improve wound healing. We aimed to assess the impact of cold atmospheric argon plasma on the process of donor site healing. Forty patients with skin graft donor sites on the upper leg were enrolled in our study. The wound sites were divided into two equally sized areas that were randomly assigned to receive either plasma treatment or placebo (argon gas) for 2 minutes. Donor site healing was evaluated independently by two blinded dermatologists, who compared the wound areas with regard to reepithelialization, blood crusts, fibrin layers, and wound surroundings. From the second treatment day onwards, donor site wound areas treated with plasma (n = 34) showed significantly improved healing compared with placebo-treated areas (day 1, p = 0.25; day 2, p = 0.011; day 3, p < 0.001; day 4, p < 0.001; day 5, p = 0.004; day 6, p = 0.008; day 7, p = 0.031). Positive effects were observed in terms of improved reepithelialization and fewer fibrin layers and blood crusts, whereas wound surroundings were always normal, independent of the type of treatment. Wound infection did not occur in any of the patients, and no relevant side effects were observed. Both types of treatment were well tolerated. The mechanisms contributing to these clinically observed effects should be further investigated.

Observational study investigating the level of support from a convolutional neural network in face and scalp lesions deemed diagnostically 'unclear' by dermatologists.

BACKGROUND: The clinical diagnosis of face and scalp lesions (FSL) is challenging due to overlapping features. Dermatologists encountering diagnostically 'unclear' lesions may benefit from artificial intelligence support via convolutional neural networks (CNN). METHODS: In a web-based classification task, dermatologists (n = 64) diagnosed a convenience sample of 100 FSL as 'benign', 'malignant', or 'unclear' and indicated their management decisions ('no action', 'follow-up', 'treatment/excision'). A market-approved CNN (Moleanalyzer-Pro®, FotoFinder Systems, Germany) was applied for binary classifications (benign/malignant) of dermoscopic images. RESULTS: After reviewing one dermoscopic image per case, dermatologists labelled 562 of 6400 diagnoses (8.8%) as 'unclear' and mostly managed these by follow-up examinations (57.3%, n = 322) or excisions (42.5%, n = 239). Management was incorrect in 58.8% of 291 truly malignant cases (171 'follow-up' or 'no action') and 43.9% of 271 truly benign cases (119 'excision'). Accepting CNN classifications in unclear cases would have reduced false management decisions to 4.1% in truly malignant and 31.7% in truly benign lesions (both p < 0.01). After receiving full case information 239 diagnoses (3.7%) remained 'unclear' to dermatologists, now triggering more excisions (72.0%) than follow-up examinations (28.0%). These management decisions were incorrect in 32.8% of 116 truly malignant cases and 76.4% of 123 truly benign cases. Accepting CNN classifications would have reduced false management decisions to 6.9% in truly malignant lesions and to 38.2% in truly benign cases (both p < 0.01). CONCLUSIONS: Dermatologists mostly managed diagnostically 'unclear' FSL by treatment/excision or follow-up examination. Following CNN classifications as guidance in unclear cases seems suitable to significantly reduce incorrect decisions.

Delphi Consensus Among International Experts on the Diagnosis, Management, and Surveillance for Lentigo Maligna.

INTRODUCTION: Melanoma of the lentigo maligna (LM) type is challenging. There is lack of consensus on the optimal diagnosis, treatment, and follow-up. OBJECTIVES: To obtain general consensus on the diagnosis, treatment, and follow-up for LM. METHODS: A modified Delphi method was used. The invited participants were either members of the International Dermoscopy Society, academic experts, or authors of published articles relating to skin cancer and melanoma. Participants were required to respond across three rounds using a 4-point Likert scale). Consensus was defined as >75% of participants agreeing/strongly agreeing or disagreeing/strongly disagreeing. RESULTS: Of the 31 experts invited to participate in this Delphi study, 29 participants completed Round 1 (89.9% response rate), 25/31 completed Round 2 (77.5% response rate), and 25/31 completed Round 3 (77.5% response rate). Experts agreed that LM diagnosis should be based on a clinical and dermatoscopic approach (92%) followed by a biopsy. The most appropriate primary treatment of LM was deemed to be margin-controlled surgery (83.3%), although non-surgical modalities, especially imiquimod, were commonly used either as alternative off-label primary treatment in selected patients or as adjuvant therapy following surgery; 62% participants responded life-long clinical follow-up was needed for LM. CONCLUSIONS: Clinical and histological diagnosis of LM is challenging and should be based on macroscopic, dermatoscopic, and RCM examination followed by a biopsy. Different treatment modalities and follow-up should be carefully discussed with the patient.

Cold atmospheric air plasma sterilization against spores and other microorganisms of clinical interest.

Physical cold atmospheric surface microdischarge (SMD) plasma operating in ambient air has promising properties for the sterilization of sensitive medical devices where conventional methods are not applicable. Furthermore, SMD plasma could revolutionize the field of disinfection at health care facilities. The antimicrobial effects on Gram-negative and Gram-positive bacteria of clinical relevance, as well as the fungus Candida albicans, were tested. Thirty seconds of plasma treatment led to a 4 to 6 log(10) CFU reduction on agar plates. C. albicans was the hardest to inactivate. The sterilizing effect on standard bioindicators (bacterial endospores) was evaluated on dry test specimens that were wrapped in Tyvek coupons. The experimental D(23)(°)(C) values for Bacillus subtilis, Bacillus pumilus, Bacillus atrophaeus, and Geobacillus stearothermophilus were determined as 0.3 min, 0.5 min, 0.6 min, and 0.9 min, respectively. These decimal reduction times (D values) are distinctly lower than D values obtained with other reference methods. Importantly, the high inactivation rate was independent of the material of the test specimen. Possible inactivation mechanisms for relevant microorganisms are briefly discussed, emphasizing the important role of neutral reactive plasma species and pointing to recent diagnostic methods that will contribute to a better understanding of the strong biocidal effect of SMD air plasma.

Does sex matter? Analysis of sex-related differences in the diagnostic performance of a market-approved convolutional neural network for skin cancer detection.

BACKGROUND: Advances in biomedical artificial intelligence may introduce or perpetuate sex and gender discriminations. Convolutional neural networks (CNN) have proven a dermatologist-level performance in image classification tasks but have not been assessed for sex and gender biases that may affect training data and diagnostic performance. In this study, we investigated sex-related imbalances in training data and diagnostic performance of a market-approved CNN for skin cancer classification (Moleanalyzer Pro®, Fotofinder Systems GmbH, Bad Birnbach, Germany). METHODS: We screened open-access dermoscopic image repositories widely used for CNN training for distribution of sex. Moreover, the sex-related diagnostic performance of the market-approved CNN was tested in 1549 dermoscopic images stratified by sex (female n = 773; male n = 776). RESULTS: Most open-access repositories showed a marked under-representation of images originating from female (40%) versus male (60%) patients. Despite these imbalances and well-known sex-related differences in skin anatomy or skin-directed behaviour, the tested CNN achieved a comparable sensitivity of 87.0% [80.9%-91.3%] versus 87.1% [81.1%-91.4%], specificity of 98.7% [97.4%-99.3%] versus 96.9% [95.2%-98.0%] and ROC-AUC of 0.984 [0.975-0.993] versus 0.979 [0.969-0.988] in dermoscopic images of female versus male origin, respectively. In the sample at hand, sex-related differences in ROC-AUCs were not statistically significant in the per-image analysis nor in an additional per-individual analysis (p ≥ 0.59). CONCLUSION: Design and training of artificial intelligence algorithms for medical applications should generally acknowledge sex and gender dimensions. Despite sex-related imbalances in open-access training data, the diagnostic performance of the tested CNN showed no sex-related bias in the classification of skin lesions.

Indications for Digital Monitoring of Patients With Multiple Nevi: Recommendations from the International Dermoscopy Society.

Introduction: In patients with multiple nevi, sequential imaging using total body skin photography (TBSP) coupled with digital dermoscopy (DD) documentation reduces unnecessary excisions and improves the early detection of melanoma. Correct patient selection is essential for optimizing the efficacy of this diagnostic approach. Objectives: The purpose of the study was to identify, via expert consensus, the best indications for TBSP and DD follow-up. Methods: This study was performed on behalf of the International Dermoscopy Society (IDS). We attained consensus by using an e-Delphi methodology. The panel of participants included international experts in dermoscopy. In each Delphi round, experts were asked to select from a list of indications for TBSP and DD. Results: Expert consensus was attained after 3 rounds of Delphi. Participants considered a total nevus count of 60 or more nevi or the presence of a CDKN2A mutation sufficient to refer the patient for digital monitoring. Patients with more than 40 nevi were only considered an indication in case of personal history of melanoma or red hair and/or a MC1R mutation or history of organ transplantation. Conclusions: Our recommendations support clinicians in choosing appropriate follow-up regimens for patients with multiple nevi and in applying the time-consuming procedure of sequential imaging more efficiently. Further studies and real-life data are needed to confirm the usefulness of this list of indications in clinical practice.

No non-sentinel node involvement in melanoma patients with limited Breslow thickness and low sentinel node tumour load.

AIMS: Most melanoma patients with a positive sentinel node (SN) undergo completion lymph node dissection and frequently experience associated morbidity. However, only 10-30% of SN-positive patients have further lymph node metastases. The aim of the present study was to predict the absence of non-SN metastases in a multicentre study of patients with a positive SN based on primary melanoma features and SN tumour load. METHODS AND RESULTS: Of 70 SN positive patients, 18 had non-SN metastases. Penetrative depth of metastatic cells into the SN and SN tumour load was assessed by morphometry. None of the 14 patients (20%) with a Breslow thickness <2.0 mm and an SN tumour load <0.2 mm2 had non-SN metastases. Similarly, none of the 15 patients (21%) with a Breslow thickness <2.0 mm and SN penetrative depth <600 µm had non-SN metastases. Lastly, none of the 14 patients (20%) with a Breslow thickness <2.0 mm and a diameter of the largest SN deposit <500 µm had non-SN metastases. CONCLUSIONS: A combination of limited Breslow thickness and low SN tumour load predicts absence of non-SN metastases in melanoma patients with a positive SN with high accuracy. We propose that this subgroup may be spared completion lymph node dissection.

Skin lesions of face and scalp - Classification by a market-approved convolutional neural network in comparison with 64 dermatologists.

BACKGROUND: The clinical differentiation of face and scalp lesions (FSLs) is challenging even for trained dermatologists. Studies comparing the diagnostic performance of a convolutional neural network (CNN) with dermatologists in FSL are lacking. METHODS: A market-approved CNN (Moleanalyzer-Pro, FotoFinder Systems) was used for binary classifications of 100 dermoscopic images of FSL. The same lesions were used in a two-level reader study including 64 dermatologists (level I: dermoscopy only; level II: dermoscopy, clinical close-up images, textual information). Primary endpoints were the CNN's sensitivity and specificity in comparison with the dermatologists' management decisions in level II. Generalizability of the CNN results was tested by using four additional external data sets. RESULTS: The CNN's sensitivity, specificity and ROC AUC were 96.2% [87.0%-98.9%], 68.8% [54.7%-80.1%] and 0.929 [0.880-0.978], respectively. In level II, the dermatologists' management decisions showed a mean sensitivity of 84.2% [82.2%-86.2%] and specificity of 69.4% [66.0%-72.8%]. When fixing the CNN's specificity at the dermatologists' mean specificity (69.4%), the CNN's sensitivity (96.2% [87.0%-98.9%]) was significantly higher than that of dermatologists (84.2% [82.2%-86.2%]; p < 0.001). Dermatologists of all training levels were outperformed by the CNN (all p < 0.001). In confirmation, the CNN's accuracy (83.0%) was significantly higher than dermatologists' accuracies in level II management decisions (all p < 0.001). The CNN's performance was largely confirmed in three additional external data sets but particularly showed a reduced specificity in one Australian data set including FSL on severely sun-damaged skin. CONCLUSIONS: When applied as an assistant system, the CNN's higher sensitivity at an equivalent specificity may result in an improved early detection of face and scalp skin cancers.