Crowdsourcing Skin Demarcations of Chronic Graft-Versus-Host Disease in Patient Photographs: Training Versus Performance Study.

BACKGROUND: Chronic graft-versus-host disease (cGVHD) is a significant cause of long-term morbidity and mortality in patients after allogeneic hematopoietic cell transplantation. Skin is the most commonly affected organ, and visual assessment of cGVHD can have low reliability. Crowdsourcing data from nonexpert participants has been used for numerous medical applications, including image labeling and segmentation tasks. OBJECTIVE: This study aimed to assess the ability of crowds of nonexpert raters-individuals without any prior training for identifying or marking cGHVD-to demarcate photos of cGVHD-affected skin. We also studied the effect of training and feedback on crowd performance. METHODS: Using a Canfield Vectra H1 3D camera, 360 photographs of the skin of 36 patients with cGVHD were taken. Ground truth demarcations were provided in 3D by a trained expert and reviewed by a board-certified dermatologist. In total, 3000 2D images (projections from various angles) were created for crowd demarcation through the DiagnosUs mobile app. Raters were split into high and low feedback groups. The performances of 4 different crowds of nonexperts were analyzed, including 17 raters per image for the low and high feedback groups, 32-35 raters per image for the low feedback group, and the top 5 performers for each image from the low feedback group. RESULTS: Across 8 demarcation competitions, 130 raters were recruited to the high feedback group and 161 to the low feedback group. This resulted in a total of 54,887 individual demarcations from the high feedback group and 78,967 from the low feedback group. The nonexpert crowds achieved good overall performance for segmenting cGVHD-affected skin with minimal training, achieving a median surface area error of less than 12% of skin pixels for all crowds in both the high and low feedback groups. The low feedback crowds performed slightly poorer than the high feedback crowd, even when a larger crowd was used. Tracking the 5 most reliable raters from the low feedback group for each image recovered a performance similar to that of the high feedback crowd. Higher variability between raters for a given image was not found to correlate with lower performance of the crowd consensus demarcation and cannot therefore be used as a measure of reliability. No significant learning was observed during the task as more photos and feedback were seen. CONCLUSIONS: Crowds of nonexpert raters can demarcate cGVHD images with good overall performance. Tracking the top 5 most reliable raters provided optimal results, obtaining the best performance with the lowest number of expert demarcations required for adequate training. However, the agreement amongst individual nonexperts does not help predict whether the crowd has provided an accurate result. Future work should explore the performance of crowdsourcing in standard clinical photos and further methods to estimate the reliability of consensus demarcations.

Prognostic Value of Cutaneous Disease Severity Estimates on Survival Outcomes in Patients With Chronic Graft-vs-Host Disease.

Importance: Prior studies have demonstrated an association between cutaneous chronic graft-vs-host disease (cGVHD) and mortality. Assessment of the prognostic value of different measures of disease severity would assist in risk stratification. Objective: To compare the prognostic value of body surface area (BSA) and National Institutes of Health (NIH) Skin Score on survival outcomes stratified by erythema and sclerosis subtypes of cGVHD. Design, Setting, and Participants: Multicenter prospective cohort study from the Chronic Graft-vs-Host Disease Consortium including 9 medical centers in the US, enrolled from 2007 through 2012 and followed until 2018. Participants were adults and children with a diagnosis of cGVHD requiring systemic immunosuppression and with skin involvement during the study period, who had longitudinal follow-up. Data analysis was performed from April 2019 to April 2022. Exposures: Patients underwent continuous BSA estimation and categorical NIH Skin Score grading of cutaneous cGVHD at enrollment and every 3 to 6 months thereafter. Main Outcomes and Measures: Nonrelapse mortality (NRM) and overall survival (OS), compared between BSA and NIH Skin Score longitudinal prognostic models, adjusted for age, race, conditioning intensity, patient sex, and donor sex. Results: Of 469 patients with cGVHD, 267 (57%) (105 female [39%]; mean [SD] age, 51 [12] years) had cutaneous cGVHD at enrollment, and 89 (19%) developed skin involvement subsequently. Erythema-type disease had earlier onset and was more responsive to treatment compared with sclerosis-type disease. Most cases (77 of 112 [69%]) of sclerotic disease occurred without prior erythema. Erythema-type cGVHD at first follow-up visit was associated with NRM (hazard ratio, 1.33 per 10% BSA increase; 95% CI, 1.19-1.48; P < .001) and OS (hazard ratio, 1.28 per 10% BSA increase; 95% CI, 1.14-1.44; P < .001), while sclerosis-type cGVHD had no significant association with mortality. The model with erythema BSA collected at baseline and first follow-up visits retained 75% of the total prognostic information (from all covariates including BSA and NIH Skin Score) for NRM and 73% for OS, with no statistical difference between prognostic models (likelihood ratio test χ2, 5.9; P = .05). Conversely, NIH Skin Score collected at the same intervals lost significant prognostic information (likelihood ratio test χ2, 14.7; P < .001). The model incorporating NIH Skin Score instead of erythema BSA accounted for only 38% of the total information for NRM and 58% for OS. Conclusions and Relevance: In this prospective cohort study, erythema-type cutaneous cGVHD was associated with increased risk of mortality. Erythema BSA collected at baseline and follow-up predicted survival more accurately than the NIH Skin Score in patients requiring immunosuppression. Accurate assessment of erythema BSA may assist in identifying patients with cutaneous cGVHD at high risk for mortality.

Hyperspectral imaging to accurately segment skin erythema and hyperpigmentation in cutaneous chronic graft-versus-host disease.

In 51 lesions from 15 patients with the inflammatory skin condition chronic graft-versus-host-disease, hyperspectral imaging accurately delineated active erythema and post-inflammatory hyperpigmentation. The method was validated by dermatologist-approved confident delineations of only definitely affected and definitely unaffected areas in photographs. A prototype hyperspectral imaging system acquired a 2.5 × 3.5 cm2 area of skin at 120 wavelengths in the 450-850 nm range. Unsupervised extraction of unknown absorbers by endmember analysis achieved a comparable accuracy to that of supervised extraction of known absorbers (melanin, hemoglobin) by chromophore mapping: 0.78 (IQR: 0.39-0.85) vs. 0.83 (0.53-0.91) to delineate erythema and 0.74 (0.57-0.87) vs. 0.73 (0.52-0.84) to delineate hyperpigmentation. Both algorithms achieved higher specificity than sensitivity. Whereas a trained human confidently marked a median of 7% of image pixels, unsupervised and supervised algorithms delineated a median of 14% and 27% pixels. Hyperspectral imaging could overcome a fundamental practice gap of distinguishing active from inactive manifestations of inflammatory skin disease.

Mpox-A Rapidly Evolving Disease.

The 2022 mpox outbreak has rapidly emerged onto the global medical scene while the world continues to grapple with the COVID-19 pandemic. Unlike COVID-19, however, most patients with mpox present with skin findings, the evolving clinical presentation of which may be mistaken for other common skin diseases, particularly sexually transmitted infections. This Special Communication provides an overview of the evolution of mpox skin findings from its initial description in humans in 1970 to the present-day multinational outbreak.

Effect of camera distance and angle on color of diverse skin tone-based standards in smartphone photos.

Accurate and reproducible color capture is vital in medical photography. Camera distance and angle are particularly important as they are highly variable in a clinical setting. To account for variability in illumination, camera technology, and geometric effects, color standards are often used for color correction. To explore how geometry affects color, we quantified the change in CIELAB color value of a color standard for diverse skin tones at varying smartphone camera distances and angles. Whereas both chromaticity (a* and b*) and lightness (L*) were affected by angle, distance only affected L* (standard error of measurement, SEM > 1 CIELAB unit). Flash usage did not generally reduce distance and angle associated variability. Compared to compressed (JPG) format, raw (DNG) images had decreased median variability across different distances and angles. These findings suggest that in medical photography, inconsistent camera distance and angle can increase variability in photographed skin appearance over time.

Introduction to the Biophotonics Congress 2022 feature issue.

A feature issue is being presented by a team of guest editors containing papers based on studies presented at the Optica Biophotonics Congress: Biomedical Optics held on April 24-27, 2022 in Fort Lauderdale, Florida, USA.

Non-Expert Markings of Active Chronic Graft-Versus-Host Disease Photographs: Optimal Metrics of Training Effects.

Lack of reliable measures of cutaneous chronic graft-versus-host disease (cGVHD) remains a significant challenge. Non-expert assistance in marking photographs of active disease could aid the development of automated segmentation algorithms, but validated metrics to evaluate training effects are lacking. We studied absolute and relative error of marked body surface area (BSA), redness, and the Dice index as potential metrics of non-expert improvement. Three non-experts underwent an extensive training program led by a board-certified dermatologist to mark cGVHD in photographs. At the end of the 4-month training, the dermatologist confirmed that each trainee had learned to accurately mark cGVHD. The trainees' inter- and intra-rater intraclass correlation coefficient estimates were "substantial" to "almost perfect" for both BSA and total redness. For fifteen 3D photos of patients with cGVHD, the trainees' median absolute (relative) BSA error compared to expert marking dropped from 20 cm2 (29%) pre-training to 14 cm2 (24%) post-training. Total redness error decreased from 122 a*·cm2 (26%) to 95 a*·cm2 (21%). By contrast, median Dice index did not reflect improvement (0.76 to 0.75). Both absolute and relative BSA and redness errors similarly and stably reflected improvements from this training program, which the Dice index failed to capture.

Measuring Biomechanical Properties Using a Noninvasive Myoton Device for Lymphedema Detection and Tracking: A Pilot Study.

Background: Improved techniques for lymphedema detection and monitoring of disease progression are needed. This study aims to use the noninvasive MyotonPRO Device to detect differences in biomechanical skin characteristics in patients with breast cancer-related lymphedema (BCRL). Methods: The handheld Myoton device was used to measure skin parameters including dynamic skin stiffness, oscillation frequency (tone), mechanical stress relaxation time, and creep in 11 women diagnosed with BCRL. Seven anatomical sites were measured bilaterally for each participant. The average values in the affected arms were compared with those in the contralateral unaffected arms. Results: Among the 11 female participants with unilateral BCRL Stages 0 to II, the combined averages for dynamic skin stiffness and frequency measurements were decreased in the affected arms when compared with those for the contralateral control arms (ratio < 1). The median ratio of stiffness (affected to unaffected control arm) was 0.91 (interquartile range [IQR] 0.78-1.03) while frequency was 0.94 (IQR 0.89-1.0). Skin relaxation time and creep averages were increased in the affected arms. The relaxation time median ratio (affected to unaffected control arm) was 1.07 (IQR 1.02-1.14) and the median ratio of creep was 1.06 (IQR 1.03-1.16). Conclusions: This study suggests the Myoton can detect differences in skin biomechanical parameters of the affected and unaffected arms in patients with BCRL. Larger studies are needed to draw strong conclusions.

Expanding Personalized, Data-Driven Dermatology: Leveraging Digital Health Technology and Machine Learning to Improve Patient Outcomes.

The current revolution of digital health technology and machine learning offers enormous potential to improve patient care. Nevertheless, it is essential to recognize that dermatology requires an approach different from those of other specialties. For many dermatological conditions, there is a lack of standardized methodology for quantitatively tracking disease progression and treatment response (clinimetrics). Furthermore, dermatological diseases impact patients in complex ways, some of which can be measured only through patient reports (psychometrics). New tools using digital health technology (e.g., smartphone applications, wearable devices) can aid in capturing both clinimetric and psychometric variables over time. With these data, machine learning can inform efforts to improve health care by, for example, the identification of high-risk patient groups, optimization of treatment strategies, and prediction of disease outcomes. We use the term personalized, data-driven dermatology to refer to the use of comprehensive data to inform individual patient care and improve patient outcomes. In this paper, we provide a framework that includes data from multiple sources, leverages digital health technology, and uses machine learning. Although this framework is applicable broadly to dermatological conditions, we use the example of a serious inflammatory skin condition, chronic cutaneous graft-versus-host disease, to illustrate personalized, data-driven dermatology.

Association of Leukocyte Adhesion and Rolling in Skin With Patient Outcomes After Hematopoietic Cell Transplantation Using Noninvasive Reflectance Confocal Videomicroscopy.

Importance: Hematopoietic cell transplantation (HCT) is a potential cure for hematologic cancer but is associated with a risk of relapse and death. Dynamic biomarkers to predict relapse and inform treatment decisions after HCT are a major unmet clinical need. Objective: To identify a quantitative characteristic of leukocyte-endothelial interactions after HCT and test its associations with patient outcomes. Design, Setting, and Participants: In this prospective single-center cohort study from June 2017 to January 2020, patients of any age, sex, race, and ethnicity who had HCT for hematologic cancer were referred by health care professionals as either suspected of having symptoms or not having symptoms of acute graft-vs-host disease between 25 and 161 days after HCT. Patients underwent noninvasive skin videomicroscopy. Videos of dermal microvascular flow were recorded with a reflectance confocal microscope. Two blinded observers (J.R.P. and Z.Z.) counted leukocytes adherent to and rolling along the vessel wall per hour (A&R). Of 57 enrolled patients, 1 relapsed before imaging and was excluded, resulting in 56 patients included in analyses. Main Outcomes and Measures: Relapse of cancer, relapse-free survival, and overall survival. Results: Among the 56 patients (median age, 59 years; 38 [68%] male) who underwent imaging a median of 40 days after HCT, 21 had high A&R and 35 had low A&R. After correcting for the revised Disease Risk Index, patients with high A&R had higher rates of relapse (hazard ratio [HR], 4.24; 95% CI, 1.32-13.58; P = .02), reduced relapse-free survival (HR, 3.29; 95% CI, 1.26-8.55; P = .02), and reduced overall survival (HR, 3.06, 95% CI, 1.02-9.19; P = .05). These associations were preserved after correcting for possible confounders, steroid treatment, and acute graft-vs-host disease status. In the prognostic adequacy calculation by using Cox models, the new imaging biomarker (A&R) accounted for 82% to 95% of the prognostic information to predict each outcome. By contrast, the best existing clinical predictor routinely available, the revised Disease Risk Index, accounted for 10% to 28% of the prognostic information in the same model. Conclusions and Relevance: In this cohort study, leukocyte-endothelial interactions, visualized directly in skin after HCT, were associated with the patient outcomes of relapse, relapse-free survival, and overall survival. Assessing this dynamic marker could help patients at high risk for relapse who may benefit from interventions, such as early withdrawal of immunosuppression.

Checklist for Evaluation of Image-Based Artificial Intelligence Reports in Dermatology: CLEAR Derm Consensus Guidelines From the International Skin Imaging Collaboration Artificial Intelligence Working Group.

IMPORTANCE: The use of artificial intelligence (AI) is accelerating in all aspects of medicine and has the potential to transform clinical care and dermatology workflows. However, to develop image-based algorithms for dermatology applications, comprehensive criteria establishing development and performance evaluation standards are required to ensure product fairness, reliability, and safety. OBJECTIVE: To consolidate limited existing literature with expert opinion to guide developers and reviewers of dermatology AI. EVIDENCE REVIEW: In this consensus statement, the 19 members of the International Skin Imaging Collaboration AI working group volunteered to provide a consensus statement. A systematic PubMed search was performed of English-language articles published between December 1, 2008, and August 24, 2021, for "artificial intelligence" and "reporting guidelines," as well as other pertinent studies identified by the expert panel. Factors that were viewed as critical to AI development and performance evaluation were included and underwent 2 rounds of electronic discussion to achieve consensus. FINDINGS: A checklist of items was developed that outlines best practices of image-based AI development and assessment in dermatology. CONCLUSIONS AND RELEVANCE: Clinically effective AI needs to be fair, reliable, and safe; this checklist of best practices will help both developers and reviewers achieve this goal.

Novel therapies and innovation for systemic sclerosis skin ulceration.

Skin ulceration is an important cause of morbidity in systemic sclerosis and can occur at anytime during disease progression. Incident disease cohorts are important for understanding whether skin ulceration represents active vasculopathy versus resultant damage. Biomarkers for skin ulcer pathogenesis, both serum and imaging, are under investigation to elucidate the functional consequences of the structural abnormalities. Novel therapeutics for the treatment of vasculopathy benefit from reliable biomarkers able to predict the disease evolution remains an important unmet need. Nonetheless, a diagnostic approach that captures early skin ulceration and treatments that restore vascular and immune homeostasis is critical for effective systemic sclerosis (SSc) vasculopathy management.

Optimal biomechanical parameters for measuring sclerotic chronic graft-versus-host disease.

Skin biomechanical parameters (dynamic stiffness, frequency, relaxation time, creep, and decrement) measured using a myotonometer (MyotonPRO) could inform management of sclerotic disease. To determine which biomechanical parameter(s) can accurately differentiate sclerotic chronic graft-versus-host disease (cGVHD) patients from post-hematopoietic cell transplant (post-HCT) controls, 15 sclerotic cGVHD patients and 11 post-HCT controls were measured with the myotonometer on 18 anatomic sites. Logistic regression and two machine learning algorithms, LASSO regression and random forest, were developed to classify subjects. In univariable analysis, frequency had the highest overfit-corrected area under the receiver operating characteristic curve (AUC 0.91). Backward stepwise selection and random forest machine learning identified frequency and relaxation time as the optimal parameters for differentiating sclerotic cGVHD patients from post-HCT controls. LASSO regression selected the combination of frequency and relaxation time (overfit-corrected AUC 0.87). Discriminatory ability was maintained when only the sites accessible while the patient is supine (12 sites) were used. We report the distribution of values for these highly discriminative biomechanical parameters, which could inform assessment of disease severity in future quantitative biomechanical studies of sclerotic cGVHD.

Baseline Photos and Confident Annotation Improve Automated Detection of Cutaneous Graft-Versus-Host Disease.

Cutaneous erythema is used in diagnosis and response assessment of cutaneous chronic graft-versus-host disease (cGVHD). The development of objective erythema evaluation methods remains a challenge. We used a pre-trained neural network to segment cGVHD erythema by detecting changes relative to a patient's registered baseline photo. We fixed this change detection algorithm on human annotations from a single photo pair, by using either a traditional approach or by marking definitely affected ("Do Not Miss", DNM) and definitely unaffected skin ("Do Not Include", DNI). The fixed algorithm was applied to each of the remaining 47 test photo pairs from six follow-up sessions of one patient. We used both the Dice index and the opinion of two board-certified dermatologists to evaluate the algorithm performance. The change detection algorithm correctly assigned 80% of the pixels, regardless of whether it was fixed on traditional (median accuracy: 0.77, interquartile range 0.62-0.87) or DNM/DNI segmentations (0.81, 0.65-0.89). When the algorithm was fixed on markings by different annotators, the DNM/DNI achieved more consistent outputs (median Dice indices: 0.94-0.96) than the traditional method (0.73-0.81). Compared to viewing only rash photos, the addition of baseline photos improved the reliability of dermatologists' scoring. The inter-rater intraclass correlation coefficient increased from 0.19 (95% confidence interval lower bound: 0.06) to 0.51 (lower bound: 0.35). In conclusion, a change detection algorithm accurately assigned erythema in longitudinal photos of cGVHD. The reliability was significantly improved by exclusively using confident human segmentations to fix the algorithm. Baseline photos improved the agreement among two dermatologists in assessing algorithm performance.

Guideline for in vivo assessment of adherent and rolling leukocytes in human skin microvasculature via reflectance confocal videomicroscopy.

OBJECTIVE: To develop a guideline that reliably identifies cutaneous adherent and rolling leukocytes from mimicking scenarios via in vivo reflectance confocal videomicroscopy. METHODS: We used a clinical reflectance confocal microscope, the VivaScope 1500, to acquire 1522 videos of the upper dermal microcirculation from 12 healthy subjects and 60 patients after allogeneic hematopoietic cell transplantation. Blinded to clinical information, two trained raters independently counted the number of adherent and rolling leukocytes in 88 videos. Based on discrepancies in the initial assessments, we developed a guideline to identify both types of leukocyte-endothelial interactions via a modified Delphi method (without anonymity). To test the guideline's ability to improve the inter-rater reliability, the two raters assessed the remaining 1434 videos by using the guideline. RESULTS: We demonstrate a guideline that consists of definitions, a step-by-step flowchart, and corresponding visuals of adherent and rolling leukocytes and mimicking scenarios. The guideline improved the inter-rater reliability of the manual assessment of both interactions. The intraclass correlation coefficient (ICC) of adherent leukocyte counts increased from 0.056 (95% confidence interval: 0-0.236, n = 88 videos, N = 10 subjects) to 0.791 (0.770-0.809, n = 1434, N = 67). The ICC of rolling leukocyte counts increased from 0.385 (0.191-0.550, n = 88, N = 10) to 0.626 (0.593-0.657, n = 1434, N = 67). Intra-rater ICC post-guideline was 0.953 (0.886-0.981, n = 20, N = 12) and 0.956 (0.894-0.983, n = 20, N = 12) for adherent and rolling, respectively. CONCLUSION: The guideline aids in the manual identification of adherent and rolling leukocytes via in vivo reflectance confocal videomicroscopy.

Methods to Assess Disease Activity and Severity in Cutaneous Chronic Graft-versus-Host Disease: A Critical Literature Review.

Chronic graft-versus-host disease (cGVHD), a potentially debilitating complication of hematopoietic cell transplantation, confers increased risk for mortality. Whereas treatment decisions rely on an accurate assessment of disease activity/severity, validated methods of assessing cutaneous cGVHD activity/severity appear to be limited. In this study, we aimed to identify and evaluate current data on the assessment of disease activity/severity in cutaneous cGVHD. Using modified PRISMA methods, we performed a critical literature review for relevant articles. Our literature search identified 1741 articles, of which 1635 were excluded as duplicates or failure to meet inclusion criteria. Of the included studies (n = 106), 39 (37%) addressed clinical and/or histopathologic parameters, 53 (50%) addressed serologic parameters, 8 (7.5%) addressed imaging parameters, and 6 (5.5%) addressed computer-based technologies. The only formally validated metric of disease activity/severity assessment in cutaneous cGVHD is the National Institutes of Health consensus scoring system, which is founded on clinical assessment alone. The lack of an objective marker for cGVHD necessitates further studies. An evaluation of the potential contributions of serologic, imaging, and/or computer-based technologies is warranted.