Agreement Between Experts and an Untrained Crowd for Identifying Dermoscopic Features Using a Gamified App: Reader Feasibility Study.

BACKGROUND: Dermoscopy is commonly used for the evaluation of pigmented lesions, but agreement between experts for identification of dermoscopic structures is known to be relatively poor. Expert labeling of medical data is a bottleneck in the development of machine learning (ML) tools, and crowdsourcing has been demonstrated as a cost- and time-efficient method for the annotation of medical images. OBJECTIVE: The aim of this study is to demonstrate that crowdsourcing can be used to label basic dermoscopic structures from images of pigmented lesions with similar reliability to a group of experts. METHODS: First, we obtained labels of 248 images of melanocytic lesions with 31 dermoscopic "subfeatures" labeled by 20 dermoscopy experts. These were then collapsed into 6 dermoscopic "superfeatures" based on structural similarity, due to low interrater reliability (IRR): dots, globules, lines, network structures, regression structures, and vessels. These images were then used as the gold standard for the crowd study. The commercial platform DiagnosUs was used to obtain annotations from a nonexpert crowd for the presence or absence of the 6 superfeatures in each of the 248 images. We replicated this methodology with a group of 7 dermatologists to allow direct comparison with the nonexpert crowd. The Cohen κ value was used to measure agreement across raters. RESULTS: In total, we obtained 139,731 ratings of the 6 dermoscopic superfeatures from the crowd. There was relatively lower agreement for the identification of dots and globules (the median κ values were 0.526 and 0.395, respectively), whereas network structures and vessels showed the highest agreement (the median κ values were 0.581 and 0.798, respectively). This pattern was also seen among the expert raters, who had median κ values of 0.483 and 0.517 for dots and globules, respectively, and 0.758 and 0.790 for network structures and vessels. The median κ values between nonexperts and thresholded average-expert readers were 0.709 for dots, 0.719 for globules, 0.714 for lines, 0.838 for network structures, 0.818 for regression structures, and 0.728 for vessels. CONCLUSIONS: This study confirmed that IRR for different dermoscopic features varied among a group of experts; a similar pattern was observed in a nonexpert crowd. There was good or excellent agreement for each of the 6 superfeatures between the crowd and the experts, highlighting the similar reliability of the crowd for labeling dermoscopic images. This confirms the feasibility and dependability of using crowdsourcing as a scalable solution to annotate large sets of dermoscopic images, with several potential clinical and educational applications, including the development of novel, explainable ML tools.

Topical treatment of actinic keratoses in organ transplant recipients: a feasibility study for SPOT (Squamous cell carcinoma Prevention in Organ transplant recipients using Topical treatments).

BACKGROUND: The risk of cutaneous squamous cell carcinoma (cSCC) is significantly increased in organ transplant recipients (OTRs). Clearance of actinic keratoses (AKs) is generally regarded as a surrogate biomarker for cSCC prevention. OTR-cSCC chemoprevention with topical AK treatments has not been investigated in randomized controlled trials (RCTs), although there is evidence that 5% 5-fluorouracil (5-FU) may be chemoprotective in immunocompetent patients. OBJECTIVES: To assess the feasibility, activity and evaluation outcomes relevant to the design of a future phase III RCT of topical cSCC chemoprevention in OTRs. METHODS: OTRs with 10 or more AKs in predefined areas were randomized 1 : 1 : 1 to topical 5-FU, 5% imiquimod (IMIQ) or sunscreen (sun-protective factor 30+) in a phase II, open-label RCT over 15 months. Feasibility outcomes included proportions of eligible OTRs randomized, completing treatment and willing to be re-treated. AK activity [AK clearance, new AK development, patient-centred outcomes (toxicity, health-related quality of life, HRQoL)] and evaluation methodology (clinical vs. photographic) were assessed. RESULTS: Forty OTRs with 903 AKs were randomized. All feasibility outcomes were met (56% of eligible OTRs were randomized; 89% completed treatment; 81% were willing to be re-treated). AK activity analyses found 5-FU and IMIQ were superior to sunscreen for AK clearance and prevention of new AKs. 5-FU was more effective than IMIQ in AK clearance and prevention in exploratory analyses. Although toxicity was greater with 5-FU, HRQoL outcomes were similar. CONCLUSIONS: Trials of topical AK treatments in OTRs for cSCC chemoprevention are feasible and AK activity results support further investigation of 5-FU-based treatments in future phase III trials. What is already known about this topic? Cutaneous squamous cell carcinoma (cSCC) is significantly more common in immunocompromised individuals including organ transplant recipients (OTRs) compared with immunocompetent populations. cSCC chemoprevention activity of sunscreen and 5-fluorouracil-based (5-FU) actinic keratosis (AK) treatments has been demonstrated in randomized controlled trials (RCTs) in immunocompetent populations but not in OTRs. AKs are cSCC precursors and their clearance and prevention are generally regarded as surrogate endpoint biomarkers for potential cSCC chemoprevention activity. What does this study add? SPOT (SCC Prevention in OTRs using Topical treatments) has confirmed that RCTs of OTR-cSCC chemoprevention with topical AK treatments are feasible. It also suggests that topical 5-FU may be superior to 5% imiquimod and sunscreen in AK clearance and prevention. Together with recent evidence from several RCTs in the general population, these data provide a compelling rationale for further studies of intervention with 5-FU-based topical chemoprevention approaches in OTR-cSCC prevention.

The burden of cutaneous disease in solid organ transplant recipients of color.

Organ transplant recipients (OTRs) are at increased risk of cutaneous malignancy. Skin disorders in OTRs of color (OTRoC) have rarely been systematically assessed. We aimed to ascertain the burden of skin disease encountered in OTRoC by prospectively collecting data from OTRs attending 2 posttransplant skin surveillance clinics: 1 in London, UK and 1 in Philadelphia, USA. Retrospective review of all dermatological diagnoses was performed. Data from 1766 OTRs were analyzed: 1024 (58%) white, 376 (21%) black, 261 (15%) Asian, 57 (3%) Middle Eastern/Mediterranean (ME/M), and 48 (2.7%) Hispanic; and 1128 (64%) male. Viral infections affected 45.1% of OTRs, and were more common in white and ME/M patients (P < .001). Fungal infections affected 28.1% and were more common in ME/M patients (P < .001). Inflammatory skin disease affected 24.5%, and was most common in black patients (P < .001). In addition, 26.4% of patients developed skin cancer. There was an increased risk of skin cancer in white vs nonwhite OTRs (HR 4.4, 95% CI 3.5-5.7, P < .001): keratinocyte cancers were more common in white OTRs (P < .001) and Kaposi sarcoma was more common in black OTRs (P < .001). These data support the need for programs that promote targeted dermatology surveillance for all OTRs, regardless of race/ethnicity or country of origin.

Current systemic therapeutic options for advanced mycosis fungoides and Sézary syndrome.

Mycosis fungoides (MF) and Sézary syndrome (SS) are the most common cutaneous T-cell lymphomas (CTCLs). Both lack curative options, and advanced-stage carries a poor prognosis. Whilst there are a number of treatments available, achieving and maintaining a durable remission remains challenging. We review current systemic treatment options as monotherapy for advanced-stage MF (IIB-IV), appraising their mechanism of action, analyzing their efficacy, and describing toxicities. Individually, reported overall response rates (ORR) vary widely in the literature and duration of responses are typically short, ranging from 7.5 to 22.4 months. Combined therapy is frequently used in an effort to boost responses, although prospective studies comparing combinations to single agent therapies are rarely conducted. While recent translational research has led to increased understanding of the immunopathogenesis of MF and SS and the development of new treatments, current standard of care therapies are not curative and have low ORR for advanced-stage disease.

The use of a pro forma to improve quality in clerking vascular surgery patients.

At our institution, a large tertiary referral centre for vascular surgery, patients are often admitted directly to the ward and clerked by foundation year one (FY1) doctors. We found that these clerkings frequently fell short of national record keeping standards, potentially leading to an increased risk for patients during their hospital stay. In addition, we found that junior doctors did not feel confident in clerking vascular surgery patients. A literature review found that high quality clerkings were strongly linked to improved patient safety, and that the use of a pro forma was one method to improve compliance with documentation guidelines. We devised a clerking pro forma based on national guidelines and introduced it to the department. We found that the use of a pro forma significantly improved documentation standards across a number of domains, including patient demographics, presenting complaint, and family and social histories (p <0.05). Examinations were significantly more comprehensive, with cardiac and vascular examination as well as peripheral pulses documented (p <0.05). In conclusion, we found that using a pro forma helped to aid junior doctors in clerking new patients, and significantly improved the quality of their history and examinations. This leads to a potential positive impact on patient safety during their inpatient stay, and should be rolled out more widely across the hospital.