Artificial intelligence algorithms and 3D volumetric rendering for basal cell carcinoma detection and tumor depth assessment in RCM-OCT images: a pilot study.

The Reflectance Confocal Microscopy - Optical Coherence Tomography (RCM-OCT) device has shown utility in detecting and assessing depth of basal cell carcinoma (BCC) in vivo but is challenging for novices to interpret. Artificial intelligence (AI) applied to RCM-OCT could aid readers. We trained artificial intelligence (AI) models, using OCT rasters of biopsy-confirmed BCC, to detect and create 3D BCC rendering and automatically measure tumor depth. Trained AI models were applied to a separate test set containing rasters of BCC, benign lesions, and normal skin. Blinded reader analysis and tumor depth correlation with histopathology were conducted. BCC detection improved from viewing OCT rasters only (sensitivity 73.3%, specificity 45.5%) to viewing rasters with AI-generated BCC rendering (sensitivity 86.7%, specificity 48.5%). A Pearson Correlation r2 = 0.59 (p=0.02) was achieved for the tumor depth measurement between AI and histologic measured depths. Thus, addition of AI to the RCM-OCT device may expand its utility widely.

Quantitative collagen analysis using second harmonic generation images for the detection of basal cell carcinoma with ex vivo multiphoton microscopy.

Basal cell carcinoma (BCC) is the most common skin cancer, and its incidence is rising. Millions of benign biopsies are performed annually for BCC diagnosis, increasing morbidity, and healthcare costs. Non-invasive in vivo technologies such as multiphoton microscopy (MPM) can aid in diagnosing BCC, reducing the need for biopsies. Furthermore, the second harmonic generation (SHG) signal generated from MPM can classify and prognosticate cancers based on extracellular matrix changes, especially collagen type I. We explored the potential of MPM to differentiate collagen changes associated with different BCC subtypes compared to normal skin structures and benign lesions. Quantitative analysis such as frequency band energy analysis in Fourier domain, CurveAlign and CT-FIRE fibre analysis was performed on SHG images from 52 BCC and 12 benign lesions samples. Our results showed that collagen distribution is more aligned surrounding BCCs nests compared to the skin's normal structures (p < 0.001) and benign lesions (p < 0.001). Also, collagen was orientated more parallelly surrounding indolent BCC subtypes (superficial and nodular) versus those with more aggressive behaviour (infiltrative BCC) (p = 0.021). In conclusion, SHG signal from type I collagen can aid not only in the diagnosis of BCC but could be useful for prognosticating these tumors. Our initial results are limited to a small number of samples, requiring large-scale studies to validate them. These findings represent the groundwork for future in vivo MPM for diagnosis and prognosis of BCC.

Lentigo maligna melanoma mapping using reflectance confocal microscopy correlates with staged excision: A prospective study.

BACKGROUND: Lentigo maligna/lentigo maligna melanoma (LM/LMM) can present with subclinical extension that may be difficult to define preoperatively and lead to incomplete excision and potential recurrence. Preliminarily studies have used reflectance confocal microscopy (RCM) to assess LM/LMM margins. OBJECTIVE: To evaluate the correlation of LM/LMM subclinical extension defined by RCM compared with the gold standard histopathology. METHODS: Prospective study of LM/LMM patients referred for dermatologic surgery. RCM was performed at the clinically defined initial surgical margin followed by margin-controlled staged excision with paraffin-embedded tissue, and histopathology was correlated with RCM results. RESULTS: Seventy-two patients were included. Mean age was 66.8 years (standard deviation, 11.1; range, 38-89); 69.4% were men. Seventy of 72 lesions (97.2%) were located on the head and neck with mean largest clinical diameter of 1.3 cm (range, 0.3-5). Diagnostic accuracy for detection of residual melanoma in the tumor debulk (after biopsy) had a sensitivity of 96.7% and a specificity of 66.7% when compared with histopathology. RCM margin assessment revealed an overall agreement with final histopathology of 85.9% (κ = 0.71; P < .001). LIMITATIONS: No RCM imaging beyond initial planned margins was performed. CONCLUSION: RCM showed moderate to excellent overall agreement between RCM imaging of LM/LMM and histopathology of staged excision margins.

An international 3-center training and reading study to assess basal cell carcinoma surgical margins with ex vivo fluorescence confocal microscopy.

BACKGROUND: Novel solutions are needed for expediting margin assessment to guide basal cell carcinoma (BCC) surgeries. Ex vivo fluorescence confocal microscopy (FCM) is starting to be used in freshly excised surgical specimens to examine BCC margins in real time. Training and educational process are needed for this novel technology to be implemented into clinic. OBJECTIVE: To test a training and reading process, and measure diagnostic accuracy of clinicians with varying expertise level in reading ex vivo FCM images. METHODS: An international three-center study was designed for training and reading to assess BCC surgical margins and residual subtypes. Each center included a lead dermatologic/Mohs surgeon (clinical developer of FCM) and three additional readers (dermatologist, dermatopathologist, dermatologic/Mohs surgeon), who use confocal in clinical practice. Testing was conducted on 30 samples. RESULTS: Overall, the readers achieved 90% average sensitivity, 78% average specificity in detecting residual BCC margins, showing high and consistent diagnostic reading accuracy. Those with expertise in dermatologic surgery and dermatopathology showed the strongest potential for learning to assess FCM images. LIMITATIONS: Small dataset, variability in mosaic quality between centers. CONCLUSION: Suggested process is feasible and effective. This process is proposed for wider implementation to facilitate wider adoption of FCM to potentially expedite BCC margin assessment to guide surgery in real time.

Deep Learning-Based Denoising in High-Speed Portable Reflectance Confocal Microscopy.

BACKGROUND AND OBJECTIVE: Portable confocal microscopy (PCM) is a low-cost reflectance confocal microscopy technique that can visualize cellular details of human skin in vivo. When PCM images are acquired with a short exposure time to reduce motion blur and enable real-time 3D imaging, the signal-to-noise ratio (SNR) is decreased significantly, which poses challenges in reliably analyzing cellular features. In this paper, we evaluated deep learning (DL)-based approach for reducing noise in PCM images acquired with a short exposure time. STUDY DESIGN/MATERIALS AND METHODS: Content-aware image restoration (CARE) network was trained with pairs of low-SNR input and high-SNR ground truth PCM images obtained from 309 distinctive regions of interest (ROIs). Low-SNR input images were acquired from human skin in vivo at the imaging speed of 180 frames/second. The high-SNR ground truth images were generated by registering 30 low-SNR input images obtained from the same ROI and summing them. The CARE network was trained using the Google Colaboratory Pro platform. The denoising performance of the trained CARE network was quantitatively and qualitatively evaluated by using image pairs from 45 unseen ROIs. RESULTS: CARE denoising improved the image quality significantly, increasing similarity with the ground truth image by 1.9 times, reducing noise by 2.35 times, and increasing SNR by 7.4 dB. Banding noise, prominent in input images, was significantly reduced in CARE denoised images. CARE denoising provided quantitatively and qualitatively better noise reduction than non-DL filtering methods. Qualitative image assessment by three confocal readers showed that CARE denoised images exhibited negligible noise more often than input images and non-DL filtered images. CONCLUSIONS: Results showed the potential of using a DL-based method for denoising PCM images obtained at a high imaging speed. The DL-based denoising method needs to be further trained and tested for PCM images obtained from disease-suspicious skin lesions.

Melanoma risk stratification of individuals with a high-risk naevus phenotype - A pilot study.

BACKGROUND/OBJECTIVES: High a naevus counts and atypical naevi are risk factors for cutaneous melanoma. However, many individuals with a high-risk naevus phenotype do not develop melanoma. In this study, we describe the clinical and dermoscopic attributes of naevi associated with melanoma in a high-risk naevus phenotype population. METHODS: This single-centre, hospital-based case-control study included 54 prospectively enrolled adult patients ≥18 years old with a high-risk naevus phenotype (18 cases with a history of melanoma and 36 age- and gender-matched controls without a history of melanoma). We analysed clinical and dermoscopic images of the 20 largest naevi for each participant. RESULTS: Cases had a higher mean age than controls (48.2 vs. 39.1 years, P = 0.007) but there was no difference in the male-to-female ratio between groups. Nearly, all participants (97%) were Fitzpatrick skin type II or III. Naevi in cases were more likely to be truncal, (72.6% vs. 53.6%, P = 0.01), particularly anterior truncal, (29.2% vs. 14.4%, P < 0.001) and larger than 8 mm (17.4% vs. 7.8%%, P = 0.01) compared to controls. CASH score of naevi did not differ between groups. Naevi in cases were more likely to have a multicomponent dermoscopic pattern than in controls (18.4% vs. 12.6%, P = 0.02). CONCLUSION: Larger naevi, truncal naevi, and naevi, with a multicomponent dermoscopic pattern may be risk factors for melanoma among individuals with a high-risk naevus phenotype. Further studies are needed to validate these findings.

Artifacts and landmarks: pearls and pitfalls for in vivo reflectance confocal microscopy of the skin using the tissue-coupled device.

Reflectance confocal microscopy (RCM) is a non-invasive imaging tool for cellular-level examination of skin lesions, typically from the epidermis to the superficial dermis. Clinical studies show RCM imaging is highly sensitive and specific in the diagnosis of skin diseases. RCM is disseminating from academic tertiary care centers with early adopter "experts" into diverse clinical settings, with image acquisition performed by technicians and image interpretation by physicians. In the hands of trained users, RCM serves an aid to accurately diagnose and monitor skin tumors and inflammatory processes. However, exogenous and endogenous artifacts introduced during imaging can obscure RCM images, limiting or prohibiting interpretation. Herein we review the types of artifacts that may occur and techniques for mitigating them during image acquisition, to assist technicians with qualitative image assessment and provide physicians guidance on identifying artifacts that may confound interpretation. Finally, we discuss normal skin "landmarks" and how they can (i) obscure images, (ii) be exploited for additional diagnostic information, and (iii) simulate pathological structures. A deeper understanding of the principles and methods behind RCM imaging and the varying appearance of normal skin structures in the acquired images aids technicians in capturing higher quality image sets and enables physicians to increase interpretation accuracy.

Investigating the physiological effects of 10.5 Tesla static field exposure on anesthetized swine.

PURPOSE: In this work, we investigated the relative effects of static magnetic field exposure (10.5 Tesla [T]) on two physiological parameters; blood pressure (BP) and heart rate (HR). METHODS: In vivo, we recorded both BP and HR in 4 swine (3 female, 1 male) while they were positioned within a 10.5T magnet. All measurements were performed invasively within these anesthetized animals by the placement of pressure catheters into their carotid arteries. RESULTS: We measured average increases of 2.0 mm Hg (standard deviation [SD], 6.9) in systolic BP and an increase of 4.5 mm Hg (SD, 13.7) in the diastolic BPs: We also noted an average increase of 1.2 beats per minute (SD, 2.5) in the HRs during such. CONCLUSION: Data regarding changes in BP and HR in anesthetized swine attributed to whole-body 10.5T exposure are reported. Magn Reson Med 79:511-514, 2018. © 2017 International Society for Magnetic Resonance in Medicine.

A Prospective Double-Blinded Comparison of Reflectance Confocal Microscopy with Conventional Histopathology for In Vivo Assessment in Oral Cancer.

PURPOSE: We investigated reflectance confocal microscopy (RCM) as a possible noninvasive approach for the diagnosis of cancer and real-time assessment of surgical margins. EXPERIMENTAL DESIGN: In a phase I study on 20 patients, we established the RCM imaging morphologic features that distinguish oral squamous cell carcinoma (OSCC) from normal tissue with a newly developed intraoral RCM probe. Our subsequent phase II prospective double-blinded study in 60 patients tested the diagnostic accuracy of RCM against histopathology. Five RCM videos from the tumor and five from normal surrounding mucosa were collected on each patient, followed by a 3-mm punch biopsy of the imaged area. An experienced RCM reader, who was blinded to biopsy location and histologic diagnosis, examined the videos from both regions and classified each as "tumor" or "not tumor" based on RCM features established in phase I. Hematoxylin and eosin slides from the biopsies were read by a pathologist who was blinded to RCM results. Using histology as the gold standard, we calculated the sensitivity and specificity of RCM. RESULTS: We report a high agreement between the blinded readers (95% for normal tissue and 81.7% for tumors), high specificity (98.3%) and negative predictive values (96.6%) for normal tissue identification, and high sensitivity (90%) and positive predictive values (88.2%) for tumor detection. CONCLUSIONS: RCM imaging is a promising technology for noninvasive in vivo diagnosis of OSCC and for real-time intraoperative evaluation of mucosal surgical margins. Its inherent constraint, however, stems from the diminished capability to evaluate structures located at more substantial depths within the tissue.

Expert Agreement on the Presence and Spatial Localization of Melanocytic Features in Dermoscopy.

Dermoscopy aids in melanoma detection; however, agreement on dermoscopic features, including those of high clinical relevance, remains poor. In this study, we attempted to evaluate agreement among experts on exemplar images not only for the presence of melanocytic-specific features but also for spatial localization. This was a cross-sectional, multicenter, observational study. Dermoscopy images exhibiting at least 1 of 31 melanocytic-specific features were submitted by 25 world experts as exemplars. Using a web-based platform that allows for image markup of specific contrast-defined regions (superpixels), 20 expert readers annotated 248 dermoscopic images in collections of 62 images. Each collection was reviewed by five independent readers. A total of 4,507 feature observations were performed. Good-to-excellent agreement was found for 14 of 31 features (45.2%), with eight achieving excellent agreement (Gwet's AC >0.75) and seven of them being melanoma-specific features. These features were peppering/granularity (0.91), shiny white streaks (0.89), typical pigment network (0.83), blotch irregular (0.82), negative network (0.81), irregular globules (0.78), dotted vessels (0.77), and blue-whitish veil (0.76). By utilizing an exemplar dataset, a good-to-excellent agreement was found for 14 features that have previously been shown useful in discriminating nevi from melanoma. All images are public (www.isic-archive.com) and can be used for education, scientific communication, and machine learning experiments.

Self-supervised denoising of Nyquist-sampled volumetric images via deep learning.

Purpose: Deep learning has demonstrated excellent performance enhancing noisy or degraded biomedical images. However, many of these models require access to a noise-free version of the images to provide supervision during training, which limits their utility. Here, we develop an algorithm (noise2Nyquist) that leverages the fact that Nyquist sampling provides guarantees about the maximum difference between adjacent slices in a volumetric image, which allows denoising to be performed without access to clean images. We aim to show that our method is more broadly applicable and more effective than other self-supervised denoising algorithms on real biomedical images, and provides comparable performance to algorithms that need clean images during training. Approach: We first provide a theoretical analysis of noise2Nyquist and an upper bound for denoising error based on sampling rate. We go on to demonstrate its effectiveness in denoising in a simulated example as well as real fluorescence confocal microscopy, computed tomography, and optical coherence tomography images. Results: We find that our method has better denoising performance than existing self-supervised methods and is applicable to datasets where clean versions are not available. Our method resulted in peak signal to noise ratio (PSNR) within 1 dB and structural similarity (SSIM) index within 0.02 of supervised methods. On medical images, it outperforms existing self-supervised methods by an average of 3 dB in PSNR and 0.1 in SSIM. Conclusion: noise2Nyquist can be used to denoise any volumetric dataset sampled at at least the Nyquist rate making it useful for a wide variety of existing datasets.

Paradoxical effect of epinephrine on lesion redness and vascularity.

INTRODUCTION: Epinephrine is commonly used in combination with local anesthetic (lidocaine/epinephrine) due to its beneficial vasoconstrictive properties. Typically, pallor is appreciated after injection as a sign of effect; however, we observed that some cutaneous malignancies paradoxically revealed increased redness and vascularity after injection of lidocaine/epinephrine. In this study, we investigate this phenomenon among a series of biopsied lesions to identify characteristics of lesions associated with increased redness and/or vascularity. OBJECTIVES: To determine characteristics of lesions which become redder or more vascular after injection with lidocaine/epinephrine prior to biopsy. METHODS: This cross-sectional study consisted of a convenience sample of lesions scheduled for biopsy. Lesions were photographed prior to and 7 min after injection of lidocaine/epinephrine as a part of standard care. Two readers blinded to study objectives and histopathological diagnosis assessed lesions for changes in redness and vascular features. RESULTS: Fifty-four lesions from 47 patients-61.7% male, mean age 64.8 years, age-range 24-91 were included. Thirty-six lesions were biopsy confirmed malignant, with 5 in situ and 31 invasive malignancies; the remaining 18 lesions were benign. In comparison with non-malignant lesions, malignant lesions were associated with an increase in clinically appreciable vascular features after injection of lidocaine/epinephrine, X2 (1) = 21.600, p < 0.001. Further stratification into benign, in situ, and invasive lesions strengthened the association, X2 (1) = 23.272, p < 0.001. CONCLUSIONS: Combination lidocaine/epinephrine has been shown to paradoxically increase the visibility of vessels seen in cutaneous malignancies. This is consistent with prior literature suggesting aberrant adrenergic signaling in neoangiogenic vessels.

Improving Artificial Intelligence-Based Diagnosis on Pediatric Skin Lesions.

Artificial intelligence algorithms to classify melanoma are dependent on their training data, which limits generalizability. The objective of this study was to compare the performance of an artificial intelligence model trained on a standard adult-predominant dermoscopic dataset before and after the addition of additional pediatric training images. The performances were compared using held-out adult and pediatric test sets of images. We trained two models: one (model A) on an adult-predominant dataset (37,662 images from the International Skin Imaging Collaboration) and the other (model A+P) on an additional 1,536 pediatric images. We compared performance between the two models on adult and pediatric held-out test images separately using the area under the receiver operating characteristic curve. We then used Gradient-weighted Class Activation Maps and background skin masking to understand the contributions of the lesion versus background skin to algorithm decision making. Adding images from a pediatric population with different epidemiological and visual patterns to current reference standard datasets improved algorithm performance on pediatric images without diminishing performance on adult images. This suggests a way that dermatologic artificial intelligence models can be made more generalizable. The presence of background skin was important to the pediatric-specific improvement seen between models. Our study highlights the importance of carefully curated and labeled data from diverse inputs to improve the generalizability of AI models for dermatology, in this case applied to dermoscopic images of adult and pediatric lesions to improve melanoma detection.

Analyzing the Spatial Randomness in the Distribution of Acquired Melanocytic Neoplasms.

On the basis of the clinical impression and current knowledge, acquired melanocytic nevi and melanomas may not occur in random localizations. The goal of this study was to identify whether their distribution on the back is random and whether the location of melanoma correlates with its adjacent lesions. Therefore, patient-level and lesion-level spatial analyses were performed using the Clark‒Evans test for complete spatial randomness. A total of 311 patients with three-dimensional total body photography (average age of 40.08 [30‒49] years; male/female ratio: 128/183) with 5,108 eligible lesions in total were included in the study (mean sum of eligible lesions per patient of 16.42 [3‒199]). The patient-level analysis revealed that the distributions of acquired melanocytic neoplasms were more likely to deviate toward clustering than dispersion (average z-score of ‒0.55 [95% confidence interval = ‒0.69 to ‒0.41; P < 0.001]). The lesion-level analysis indicated a higher portion of melanomas (n = 57 of 72, 79.2% [95% confidence interval = 69.4‒88.9%]) appearing in proximity to neighboring melanocytic neoplasms than to nevi (n = 2,281 of 5,036, 45.3% [95% confidence interval = 43.9‒46.7%]). In conclusion, the nevi and melanomas' distribution on the back tends toward clustering as opposed to dispersion. Furthermore, melanomas are more likely to appear proximally to their neighboring neoplasms than to nevi. These findings may justify various oncogenic theories and improve diagnostic methodology.

Deep Learning for Basal Cell Carcinoma Detection for Reflectance Confocal Microscopy.

Basal cell carcinoma (BCC) is the most common skin cancer, with over 2 million cases diagnosed annually in the United States. Conventionally, BCC is diagnosed by naked eye examination and dermoscopy. Suspicious lesions are either removed or biopsied for histopathological confirmation, thus lowering the specificity of noninvasive BCC diagnosis. Recently, reflectance confocal microscopy, a noninvasive diagnostic technique that can image skin lesions at cellular level resolution, has shown to improve specificity in BCC diagnosis and reduced the number needed to biopsy by 2-3 times. In this study, we developed and evaluated a deep learning-based artificial intelligence model to automatically detect BCC in reflectance confocal microscopy images. The proposed model achieved an area under the curve for the receiver operator characteristic curve of 89.7% (stack level) and 88.3% (lesion level), a performance on par with that of reflectance confocal microscopy experts. Furthermore, the model achieved an area under the curve of 86.1% on a held-out test set from international collaborators, demonstrating the reproducibility and generalizability of the proposed automated diagnostic approach. These results provide a clear indication that the clinical deployment of decision support systems for the detection of BCC in reflectance confocal microscopy images has the potential for optimizing the evaluation and diagnosis of patients with skin cancer.