Immunohistochemistry for Diagnosing Melanoma in Older Adults.

Importance: Pathologic assessment to diagnose skin biopsies, especially for cutaneous melanoma, can be challenging, and immunohistochemistry (IHC) staining has the potential to aid decision-making. Currently, the temporal trends regarding the use of IHC for the examination of skin biopsies on a national level have not been described. Objective: To illustrate trends in the use of IHC for the examination of skin biopsies in melanoma diagnoses. Design, Setting, and Participants: A retrospective cross-sectional study was conducted to examine incident cases of melanoma diagnosed between January 2000 and December 2017. The analysis used the SEER-Medicare linked database, incorporating data from 17 population-based registries. The study focused on incident cases of in situ or malignant melanoma of the skin diagnosed in patients 65 years or older. Data were analyzed between August 2022 and November 2023. Main Outcomes and Measures: The main outcomes encompassed the identification of claims for IHC within the month of melanoma diagnoses and extending up to 14 days into the month following diagnosis. The SEER data on patients with melanoma comprised demographic, tumor, and area-level characteristics. Results: The final sample comprised 132 547 melanoma tumors in 116 117 distinct patients. Of the 132 547 melanoma diagnoses meeting inclusion criteria from 2000 to 2017, 43 396 cases had accompanying IHC claims (33%). Among these cases, 28 298 (65%) were diagnosed in male patients, 19 019 (44%) were diagnosed in patients aged 65 years to 74 years, 16 444 (38%) in patients aged 75 years to 84 years, and 7933 (18%) in patients aged 85 years and older. In 2000, 11% of melanoma cases had claims for IHC at or near the time of diagnosis. This proportion increased yearly, with 51% of melanoma cases having associated IHC claims in 2017. Increasing IHC use is observed for all stages of melanoma, including in situ melanoma. Claims for IHC in melanomas increased in all 17 SEER registries but at different rates. In 2017, the use of IHC for melanoma diagnosis ranged from 39% to 68% across registries. Conclusions and Relevance: Considering the dramatically rising and variable use of IHC in diagnosing melanoma by pathologists demonstrated in this retrospective cross-sectional study, further investigation is warranted to understand the clinical utility and discern when IHC most improves diagnostic accuracy or helps patients.

Machine learning classification of diagnostic accuracy in pathologists interpreting breast biopsies.

OBJECTIVE: This study explores the feasibility of using machine learning to predict accurate versus inaccurate diagnoses made by pathologists based on their spatiotemporal viewing behavior when evaluating digital breast biopsy images. MATERIALS AND METHODS: The study gathered data from 140 pathologists of varying experience levels who each reviewed a set of 14 digital whole slide images of breast biopsy tissue. Pathologists' viewing behavior, including zooming and panning actions, was recorded during image evaluation. A total of 30 features were extracted from the viewing behavior data, and 4 machine learning algorithms were used to build classifiers for predicting diagnostic accuracy. RESULTS: The Random Forest classifier demonstrated the best overall performance, achieving a test accuracy of 0.81 and area under the receiver-operator characteristic curve of 0.86. Features related to attention distribution and focus on critical regions of interest were found to be important predictors of diagnostic accuracy. Further including case-level and pathologist-level information incrementally improved classifier performance. DISCUSSION: Results suggest that pathologists' viewing behavior during digital image evaluation can be leveraged to predict diagnostic accuracy, affording automated feedback and decision support systems based on viewing behavior to aid in training and, ultimately, clinical practice. They also carry implications for basic research examining the interplay between perception, thought, and action in diagnostic decision-making. CONCLUSION: The classifiers developed herein have potential applications in training and clinical settings to provide timely feedback and support to pathologists during diagnostic decision-making. Further research could explore the generalizability of these findings to other medical domains and varied levels of expertise.

Pathologist Characteristics Associated With Rendering Higher-Grade Diagnoses for Melanocytic Lesions.

Importance: The incidence of melanoma diagnoses has been increasing in recent decades, and controlled studies have indicated high histopathologic discordance across the intermediate range of melanocytic lesions. The respective causes for these phenomena remain incompletely understood. Objective: To identify pathologist characteristics associated with tendencies to diagnose melanocytic lesions as higher grade vs lower grade or to diagnose invasive melanoma vs any less severe diagnosis. Design, Setting, and Participants: This exploratory study used data from 2 nationwide studies (the Melanoma Pathology [M-Path] study, conducted from July 2013 to May 2016, and the Reducing Errors in Melanocytic Interpretations [REMI] study, conducted from August 2018 to March 2021) in which participating pathologists who interpreted melanocytic lesions in their clinical practices interpreted study cases in glass slide format. Each pathologist was randomly assigned to interpret a set of study cases from a repository of skin biopsy samples of melanocytic lesions; each case was independently interpreted by multiple pathologists. Data were analyzed from July 2022 to February 2023. Main Outcomes and Measures: The association of pathologist characteristics with diagnosis of a study case as higher grade (including severely dysplastic and melanoma in situ) vs lower grade (including mild to moderately dysplastic nevi) and diagnosis of invasive melanoma vs any less severe diagnosis was assessed using logistic regression. Characteristics included demographics (age, gender, and geographic region), years of experience, academic affiliation, caseload of melanocytic lesions in their practice, specialty training, and history of malpractice suits. Results: A total of 338 pathologists were included: 113 general pathologists and 74 dermatopathologists from M-Path and 151 dermatopathologists from REMI. The predominant factor associated with rendering more severe diagnoses was specialist training in dermatopathology (board certification and/or fellowship training). Pathologists with this training were more likely to render higher-grade diagnoses (odds ratio [OR], 2.63; 95% CI, 2.10-3.30; P < .001) and to diagnose invasive melanoma (OR, 1.95; 95% CI, 1.53-2.49; P < .001) than pathologists without this training interpreting the same case. Nonmitogenic pT1a diagnoses (stage pT1a melanomas with no mitotic activity) accounted for the observed difference in diagnosis of invasive melanoma; when these lesions, which carry a low risk of metastasis, were grouped with the less severe diagnoses, there was no observed association (OR, 0.95; 95% CI, 0.74-1.23; P = .71). Among dermatopathologists, those with a higher caseload of melanocytic lesions in their practice were more likely to assign higher-grade diagnoses (OR for trend, 1.27; 95% CI, 1.04-1.56; P = .02). Conclusions and Relevance: The findings suggest that specialty training in dermatopathology is associated with a greater tendency to diagnose atypical melanocytic proliferations as pT1a melanomas. These low-risk melanomas constitute a growing proportion of melanomas diagnosed in the US.

Implementing the Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis: Long-term effect of a simple educational intervention.

Background: A standardized pathology management tool for melanocytic skin lesions may improve patient care by simplifying interpretation and categorization of the diverse terminology currently extant. Objective: To assess an online educational intervention that teaches dermatopathologists to use the Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis (MPATH-Dx), a schema collapsing multiple diagnostic terms into 5 classes ranging from benign to invasive melanoma. Methods: Practicing dermatopathologists (N = 149) from 40 US states participated in a 2-year educational intervention study (71% response rate). The intervention involved a brief tutorial followed by practice on 28 melanocytic lesions, with the goal of teaching pathologists how to correctly use the MPATH-Dx schema; competence using the MPATH-Dx tool 12-24 months postintervention was assessed. Participants' self-reported confidence using the MPATH-Dx tool was assessed preintervention and postintervention. Results: At preintervention, confidence using the MPATH-Dx tool was already high, despite 68% lacking prior familiarity with it, and confidence increased postintervention (P = .0003). During the intervention, participants used the MPATH-Dx tool correctly for 90% of their interpretations; postintervention, participants used the MPATH-Dx tool correctly for 88% of their interpretations. Limitations: Future research should examine implementing a standardized pathology assessment schema in actual clinical practice. Conclusion: Dermatopathologists can be taught to confidently and competently use the MPATH-Dx schema with a simple educational tutorial followed by practice.

Pathologist pupil dilation reflects experience level and difficulty in diagnosing medical images.

Purpose: Digital whole slide imaging allows pathologists to view slides on a computer screen instead of under a microscope. Digital viewing allows for real-time monitoring of pathologists' search behavior and neurophysiological responses during the diagnostic process. One particular neurophysiological measure, pupil diameter, could provide a basis for evaluating clinical competence during training or developing tools that support the diagnostic process. Prior research shows that pupil diameter is sensitive to cognitive load and arousal, and it switches between exploration and exploitation of a visual image. Different categories of lesions in pathology pose different levels of challenge, as indicated by diagnostic disagreement among pathologists. If pupil diameter is sensitive to the perceived difficulty in diagnosing biopsies, eye-tracking could potentially be used to identify biopsies that may benefit from a second opinion. Approach: We measured case onset baseline-corrected (phasic) and uncorrected (tonic) pupil diameter in 90 pathologists who each viewed and diagnosed 14 digital breast biopsy cases that cover the diagnostic spectrum from benign to invasive breast cancer. Pupil data were extracted from the beginning of viewing and interpreting of each individual case. After removing 122 trials ( < 10 % ) with poor eye-tracking quality, 1138 trials remained. We used multiple linear regression with robust standard error estimates to account for dependent observations within pathologists. Results: We found a positive association between the magnitude of phasic dilation and subject-centered difficulty ratings and between the magnitude of tonic dilation and untransformed difficulty ratings. When controlling for case diagnostic category, only the tonic-difficulty relationship persisted. Conclusions: Results suggest that tonic pupil dilation may indicate overall arousal differences between pathologists as they interpret biopsy cases and could signal a need for additional training, experience, or automated decision aids. Phasic dilation is sensitive to characteristics of biopsies that tend to elicit higher difficulty ratings and could indicate a need for a second opinion.

From Image to Diagnosis: Characterizing Sources of Error in Histopathologic Interpretation.

An accurate histopathologic diagnosis on surgical biopsy material is necessary for the clinical management of patients and has important implications for research, clinical trial design/enrollment, and public health education. This study used a mixed methods approach to isolate sources of diagnostic error while residents and attending pathologists interpreted digitized breast biopsy slides. Ninety participants, including pathology residents and attending physicians at major United States medical centers reviewed a set of 14 digitized whole-slide images of breast biopsies. Each case had a consensus-defined diagnosis and critical region of interest (cROI) representing the most significant pathology on the slide. Participants were asked to view unmarked digitized slides, draw their participant region of interest (pROI), describe its features, and render a diagnosis. Participants' review behavior was tracked using case viewer software and an eye-tracking device. Diagnostic accuracy was calculated in comparison to the consensus diagnosis. We measured the frequency of errors emerging during 4 interpretive phases: (1) detecting the cROI, (2) recognizing its relevance, (3) using the correct terminology to describe findings in the pROI, and (4) making a diagnostic decision. According to eye-tracking data, trainees and attending pathologists were very likely (∼94% of the time) to find the cROI when inspecting a slide. However, trainees were less likely to consider the cROI relevant to their diagnosis. Pathology trainees (41% of cases) were more likely to use incorrect terminology to describe pROI features than attending pathologists (21% of cases). Failure to accurately describe features was the only factor strongly associated with an incorrect diagnosis. Identifying where errors emerge in the interpretive and/or descriptive process and working on building organ-specific feature recognition and verbal fluency in describing those features are critical steps for achieving competency in diagnostic decision making.

Zoom behavior during visual search modulates pupil diameter and reflects adaptive control states.

Adaptive gain theory proposes that the dynamic shifts between exploration and exploitation control states are modulated by the locus coeruleus-norepinephrine system and reflected in tonic and phasic pupil diameter. This study tested predictions of this theory in the context of a societally important visual search task: the review and interpretation of digital whole slide images of breast biopsies by physicians (pathologists). As these medical images are searched, pathologists encounter difficult visual features and intermittently zoom in to examine features of interest. We propose that tonic and phasic pupil diameter changes during image review may correspond to perceived difficulty and dynamic shifts between exploration and exploitation control states. To examine this possibility, we monitored visual search behavior and tonic and phasic pupil diameter while pathologists (N = 89) interpreted 14 digital images of breast biopsy tissue (1,246 total images reviewed). After viewing the images, pathologists provided a diagnosis and rated the level of difficulty of the image. Analyses of tonic pupil diameter examined whether pupil dilation was associated with pathologists' difficulty ratings, diagnostic accuracy, and experience level. To examine phasic pupil diameter, we parsed continuous visual search data into discrete zoom-in and zoom-out events, including shifts from low to high magnification (e.g., 1× to 10×) and the reverse. Analyses examined whether zoom-in and zoom-out events were associated with phasic pupil diameter change. Results demonstrated that tonic pupil diameter was associated with image difficulty ratings and zoom level, and phasic pupil diameter showed constriction upon zoom-in events, and dilation immediately preceding a zoom-out event. Results are interpreted in the context of adaptive gain theory, information gain theory, and the monitoring and assessment of physicians' diagnostic interpretive processes.

Diagnostic error, uncertainty, and overdiagnosis in melanoma.

Diagnostic error can be defined as deviation from a gold standard diagnosis, typically defined in terms of expert opinion, although sometimes in terms of unexpected events that might occur in follow-up (such as progression and death from disease). Although diagnostic error does exist for melanoma, deviations from gold standard diagnosis, certainly among appropriately trained and experienced practitioners, are likely to be the result of uncertainty and lack of specific criteria, and differences of opinion, rather than lack of diagnostic skills. In this review, the concept of diagnostic error will be considered in relation to diagnostic uncertainty, and the concept of overdiagnosis in melanoma will be presented and discussed.

Prognostic modeling of cutaneous melanoma stage I patients using cancer registry data identifies subsets with very-low melanoma mortality.

BACKGROUND: Evidence exists that escalating melanoma incidence is due in part to overdiagnosis, the diagnosis of lesions that will not lead to symptoms or death. The authors aimed to characterize subsets of melanoma patients with very-low risk of death that may be contributing to overdiagnosis. METHODS: Melanoma patients diagnosed in 2010 and 2011 with stage I lesions ≤1.0 mm thick and negative clinical lymph nodes from the Surveillance, Epidemiology, and End Results database were selected. Classification and regression tree and logistic regression models were developed and validated to identify patients with very-low risk of death from melanoma within 7 years. Logistic models were also used to identify patients at higher risk of death among this group of stage I patients. RESULTS: Compared to an overall 7-year mortality from melanoma of 2.5% in these patients, a subset comprising 25% had a risk below 1%. Younger age at diagnosis and Clark level II were associated with low risk of death in all models. Breslow thickness below 0.4 mm, absence of mitogenicity, absence of ulceration, and female sex were also associated with lower mortality. A small subset of high-risk patients with >20% risk of death was also identified. CONCLUSION: Patients with very-low risk of dying from melanoma within 7 years of diagnosis were identified. Such cases warrant further study and consensus discussion to develop classification criteria, with the potential to be categorized using an alternative term such as "melanocytic neoplasms of low malignant potential." LAY SUMMARY: Although melanoma is the most serious skin cancer, most melanoma patients have high chances of survival. There is evidence that some lesions diagnosed as melanoma would never have caused symptoms or death, a phenomenon known as overdiagnosis. In this study, we used cancer registry data to identify a subset of early-stage melanoma patients with almost no melanoma deaths. Using two statistical approaches, we identified patients with <1% risk of dying from melanoma in 7 years. Such patients tended to be younger with minimal invasion into the skin. We also identified a very small patient subset with higher mortality risk.

Are Pathologists Self-Aware of Their Diagnostic Accuracy? Metacognition and the Diagnostic Process in Pathology.

BACKGROUND: Metacognition is a cognitive process that involves self-awareness of thinking, understanding, and performance. This study assesses pathologists' metacognition by examining the association between their diagnostic accuracy and self-reported confidence levels while interpreting skin and breast biopsies. DESIGN: We studied 187 pathologists from the Melanoma Pathology Study (M-Path) and 115 pathologists from the Breast Pathology Study (B-Path). We measured pathologists' metacognitive ability by examining the area under the curve (AUC), the area under each pathologist's receiver operating characteristic (ROC) curve summarizing the association between confidence and diagnostic accuracy. We investigated possible relationships between this AUC measure, referred to as metacognitive sensitivity, and pathologist attributes. We also assessed whether higher metacognitive sensitivity affected the association between diagnostic accuracy and a secondary diagnostic action such as requesting a second opinion. RESULTS: We found no significant associations between pathologist clinical attributes and metacognitive AUC. However, we found that pathologists with higher AUC showed a stronger trend to request secondary diagnostic action for inaccurate diagnoses and not for accurate diagnoses compared with pathologists with lower AUC. LIMITATIONS: Pathologists reported confidence in specific diagnostic terms, rather than the broader classes into which the diagnostic terms were later grouped to determine accuracy. In addition, while there is no gold standard for the correct diagnosis to determine the accuracy of pathologists' interpretations, our studies achieved a high-quality reference diagnosis by using the consensus diagnosis of 3 experienced pathologists. CONCLUSIONS: Metacognition can affect clinical decisions. If pathologists have self-awareness that their diagnosis may be inaccurate, they can request additional tests or second opinions, providing the opportunity to correct inaccurate diagnoses. HIGHLIGHTS: Metacognitive sensitivity varied across pathologists, with most showing higher sensitivity than expected by chance.None of the demographic or clinical characteristics we examined was significantly associated with metacognitive sensitivity.Pathologists with higher metacognitive sensitivity were more likely to request additional tests or second opinions for their inaccurate diagnoses.

An analysis of pathologists' viewing processes as they diagnose whole slide digital images.

Although pathologists have their own viewing habits while diagnosing, viewing behaviors leading to the most accurate diagnoses are under-investigated. Digital whole slide imaging has enabled investigators to analyze pathologists' visual interpretation of histopathological features using mouse and viewport tracking techniques. In this study, we provide definitions for basic viewing behavior variables and investigate the association of pathologists' characteristics and viewing behaviors, and how they relate to diagnostic accuracy when interpreting whole slide images. We use recordings of 32 pathologists' actions while interpreting a set of 36 digital whole slide skin biopsy images (5 sets of 36 cases; 180 cases total). These viewport tracking data include the coordinates of a viewport scene on pathologists' screens, the magnification level at which that viewport was viewed, as well as a timestamp. We define a set of variables to quantify pathologists' viewing behaviors such as zooming, panning, and interacting with a consensus reference panel's selected region of interest (ROI). We examine the association of these viewing behaviors with pathologists' demographics, clinical characteristics, and diagnostic accuracy using cross-classified multilevel models. Viewing behaviors differ based on clinical experience of the pathologists. Pathologists with a higher caseload of melanocytic skin biopsy cases and pathologists with board certification and/or fellowship training in dermatopathology have lower average zoom and lower variance of zoom levels. Viewing behaviors associated with higher diagnostic accuracy include higher average and variance of zoom levels, a lower magnification percentage (a measure of consecutive zooming behavior), higher total interpretation time, and higher amount of time spent viewing ROIs. Scanning behavior, which refers to panning with a fixed zoom level, has marginally significant positive association with accuracy. Pathologists' training, clinical experience, and their exposure to a range of cases are associated with their viewing behaviors, which may contribute to their diagnostic accuracy. Research in computational pathology integrating digital imaging and clinical informatics opens up new avenues for leveraging viewing behaviors in medical education and training, potentially improving patient care and the effectiveness of clinical workflow.

Effect of Prior Diagnoses on Dermatopathologists' Interpretations of Melanocytic Lesions: A Randomized Controlled Trial.

Importance: Medical second opinions are common, although little is known about the best processes for obtaining them. This study assesses whether knowledge of a prior physician's diagnosis influences consulting physicians' diagnoses. Objective: To measure the extent to which dermatopathologists' diagnoses are influenced by prior diagnostic information from another dermatopathologist. Design, Setting, and Participants: Dermatopathologists were randomly assigned to interpret 1 slide set of 18 melanocytic skin biopsy specimens in 2 phases (5 slide sets totaling 90 cases). Phase 1 interpretations were conducted without prior diagnostic information. After a washout period of 12 or more months, dermatopathologists' phase 2 interpretations were conducted with their identical slide set; for a random subset of cases in phase 2, participants were shown prior diagnoses by other dermatopathologists that were either more or less severe than their own phase 1 diagnosis of the case. Using the Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis tool, cases ranged from class I (benign) to class V (≥pT1b invasive melanoma). Data collection took place from August 2018 to March 2021, and data analysis was performed from March to December 2021. Intervention: Prior diagnoses were actual diagnoses from board-certified and/or fellowship-trained dermatopathologists. A prior diagnosis was always in a more severe or less severe diagnostic class than the participant's phase 1 interpretation; more or less severe was determined by the randomization scheme. In the control condition of no prior diagnostic information, the participants were told that a prior diagnosis was not available. Main Outcomes and Measures: When exposure was to a prior diagnosis in a higher diagnostic class, the primary study outcome was whether a participant's diagnosis in phase 2 was in a higher diagnostic class than the participant's diagnosis in phase 1. When exposure was to a prior diagnosis in a lower diagnostic class, the primary study outcome was whether a participant's diagnosis in phase 2 was in a lower diagnostic class than the participant's diagnosis in phase 1. The effect of prior diagnostic information was measured using the relative risk (RR) of each outcome relative to the control condition of no prior diagnostic information, adjusted for the diagnostic class of the phase 1 diagnosis. Prior to data collection, it was hypothesized that participants would be swayed in the direction of prior diagnostic information. Results: A total of 149 dermatopathologists (median [range] age, 47 years [34-76] years; 101 [68%] were male) provided 5322 interpretations of study cases. Participants were more likely to increase the severity of their diagnosis when the prior diagnosis was of greater severity compared with when no prior diagnosis was provided (RR, 1.52; 95% CI, 1.34-1.73); likewise, participants gave less severe diagnoses when prior diagnoses were of lesser severity (RR, 1.38; 95% CI, 1.19-1.59). Trends were similar among dermatopathologists who had previously stated they were "not at all influenced" by prior diagnoses. Prior diagnoses also swayed dermatopathologists away from correct diagnoses. Conclusions and Relevance: In this randomized controlled trial, despite the preference of most dermatopathologists to receive prior diagnoses when providing second opinions, this information swayed them away from a correct diagnosis to an incorrect diagnosis.

Dermatopathologist Perceptions of Overdiagnosis of Melanocytic Skin Lesions and Association With Diagnostic Behaviors.

Importance: Despite evidence of overdiagnosis of in situ and invasive melanoma, neither the perceptions of practicing dermatopathologists about overdiagnosis nor possible associations between perceptions of overdiagnosis and diagnostic practices have been studied. Objective: To examine practicing US dermatopathologists' perceptions of melanoma overdiagnosis as a public health issue, and to associate diagnostic behaviors of dermatopathologists with perceptions of melanoma overdiagnosis. Design, Setting, and Participants: This survey study included 115 board-certified and/or fellowship-trained dermatopathologists and their diagnostic interpretations on a set of 18 skin biopsy cases (5 slide sets comprising 90 melanocytic skin lesions). Participants interpreted cases remotely using their own microscopes. Survey invitations occurred during 2018 to 2019, with data collection completed 2021. Data analysis was performed from June to September 2021. Main Outcomes and Measures: Agreement vs disagreement that overdiagnosis is a public health issue for atypical nevi, melanoma in situ, and invasive melanoma. Associations between perceptions regarding overdiagnosis and interpretive behavior on study cases. Results: Of 115 dermatopathologists, 68% (95% CI, 59%-76%) agreed that overdiagnosis is a public health issue for atypical nevi; 47% (95% CI, 38%-56%) for melanoma in situ; and 35% (95% CI, 26%-43%) for invasive melanoma. Dermatopathologists with more years in practice were significantly less likely to perceive that atypical nevi are overdiagnosed, eg, 46% of dermatopathologists with 20 or more years of experience agreed that atypical nevi are overdiagnosed compared with 93% of dermatopathologists with 1 to 4 years of experience. Compared with other dermatopathologists, those who agreed that all 3 conditions are overdiagnosed were slightly more likely to diagnose study cases as mild to moderately dysplastic nevi (odds ratio, 1.26; 95% CI, 0.97-1.64; P = .08), but the difference was not statistically significant. Dermatopathologists who agreed that invasive melanoma is overdiagnosed did not significantly differ in diagnosing invasive melanoma for study cases compared with those who disagreed (odds ratio, 1.10; 95% CI, 0.86-1.41; P = .44). Conclusions and Relevance: In this survey study, about two-thirds of dermatopathologists thought that atypical nevi are overdiagnosed, half thought that melanoma in situ is overdiagnosed, and one-third thought that invasive melanoma is overdiagnosed. No statistically significant associations were found between perceptions about overdiagnosis and interpretive behavior when diagnosing skin biopsy cases.

Histopathological diagnosis of cutaneous melanocytic lesions: blinded and nonblinded second opinions offer similar improvement in diagnostic accuracy.

BACKGROUND: Previous studies of second opinions in the diagnosis of melanocytic skin lesions have examined blinded second opinions, which do not reflect usual clinical practice. The current study, conducted in the USA, investigated both blinded and nonblinded second opinions for their impact on diagnostic accuracy. METHODS: In total, 100 melanocytic skin biopsy cases, ranging from benign to invasive melanoma, were interpreted by 74 dermatopathologists. Subsequently, 151 dermatopathologists performed nonblinded second and third reviews. We compared the accuracy of single reviewers, second opinions obtained from independent, blinded reviewers and second opinions obtained from sequential, nonblinded reviewers. Accuracy was defined with respect to a consensus reference diagnosis. RESULTS: The mean case-level diagnostic accuracy of single reviewers was 65.3% (95% CI 63.4-67.2%). Second opinions arising from sequential, nonblinded reviewers significantly improved accuracy to 69.9% (95% CI 68.0-71.7%; P < 0.001). Similarly, second opinions arising from blinded reviewers improved upon the accuracy of single reviewers (69.2%; 95% CI 68.0-71.7%). Nonblinded reviewers were more likely than blinded reviewers to give diagnoses in the same diagnostic classes as the first diagnosis. Nonblinded reviewers tended to be more confident when they agreed with previous reviewers, even with inaccurate diagnoses. CONCLUSION: We found that both blinded and nonblinded second reviewers offered a similar modest improvement in diagnostic accuracy compared with single reviewers. Obtaining second opinions with knowledge of previous reviews tends to generate agreement among reviews, and may generate unwarranted confidence in an inaccurate diagnosis. Combining aspects of both blinded and nonblinded review in practice may leverage the advantages while mitigating the disadvantages of each approach. Specifically, a second pathologist could give an initial diagnosis blinded to the results of the first pathologist, with subsequent nonblinded discussion between the two pathologists if their diagnoses differ.

Epigenome-wide analysis of long-term air pollution exposure and DNA methylation in monocytes: results from the Multi-Ethnic Study of Atherosclerosis.

Air pollution might affect atherosclerosis through DNA methylation changes in cells crucial to atherosclerosis, such as monocytes. We conducted an epigenome-wide study of DNA methylation in CD14+ monocytes and long-term ambient air pollution exposure in adults participating in the Multi-Ethnic Study of Atherosclerosis (MESA). We also assessed the association between differentially methylated signals and cis-gene expression. Using spatiotemporal models, one-year average concentrations of outdoor fine particulate matter (PM2.5) and oxides of nitrogen (NOX) were estimated at participants' homes. We assessed DNA methylation and gene expression using Illumina 450k and HumanHT-12 v4 Expression BeadChips, respectively (n = 1,207). We used bump hunting and site-specific approaches to identify differentially methylated signals (false discovery rate of 0.05) and used linear models to assess associations between differentially methylated signals and cis-gene expression. Four differentially methylated regions (DMRs) located on chromosomes 5, 6, 7, and 16 (within or near SDHAP3, ZFP57, HOXA5, and PRM1, respectively) were associated with PM2.5. The DMRs on chromosomes 5 and 6 also associated with NOX. The DMR on chromosome 5 had the smallest p-value for both PM2.5 (p = 1.4×10-6) and NOX (p = 7.7×10-6). Three differentially methylated CpGs were identified for PM2.5, and cg05926640 (near TOMM20) had the smallest p-value (p = 5.6×10-8). NOX significantly associated with cg11756214 within ZNF347 (p = 5.6×10-8). Several differentially methylated signals were also associated with cis-gene expression. The DMR located on chromosome 7 was associated with the expression of HOXA5, HOXA9, and HOXA10. The DMRs located on chromosomes 5 and 16 were associated with expression of MRPL36 and DEXI, respectively. The CpG cg05926640 was associated with expression of ARID4B, IRF2BP2, and TOMM20. We identified differential DNA methylation in monocytes associated with long-term air pollution exposure. Methylation signals associated with gene expression might help explain how air pollution contributes to cardiovascular disease.

Characterization of multiple diagnostic terms in melanocytic skin lesion pathology reports.

BACKGROUND: Histopathologically ambiguous melanocytic lesions lead some pathologists to list multiple diagnostic considerations in the pathology report. The frequency and circumstance of multiple diagnostic considerations remain poorly characterized. METHODS: Two hundred and forty skin biopsy samples were interpreted by 187 pathologists (8976 independent diagnoses) and classified according to a diagnostic/treatment stratification (MPATH-Dx). RESULTS: Multiple diagnoses in different MPATH-Dx classes were used in n = 1320 (14.7%) interpretations, with 97% of pathologists and 91% of cases having at least one such interpretation. Multiple diagnoses were more common for intermediate risk lesions and are associated with greater subjective difficulty and lower confidence. We estimate that 6% of pathology reports for melanocytic lesions in the United States contain two diagnoses of different MPATH-Dx prognostic classes, and 2% of cases are given two diagnoses with significant treatment implications. CONCLUSIONS: Difficult melanocytic diagnoses in skin may necessitate multiple diagnostic considerations; however, as patients increasingly access their health records and retrieve pathology reports (as mandated by US law), uncertainty should be expressed unambiguously.

More scanning, but not zooming, is associated with diagnostic accuracy in evaluating digital breast pathology slides.

Diagnoses of medical images can invite strikingly diverse strategies for image navigation and visual search. In computed tomography screening for lung nodules, distinct strategies, termed scanning and drilling, relate to both radiologists' clinical experience and accuracy in lesion detection. Here, we examined associations between search patterns and accuracy for pathologists (N = 92) interpreting a diverse set of breast biopsy images. While changes in depth in volumetric images reveal new structures through movement in the z-plane, in digital pathology changes in depth are associated with increased magnification. Thus, "drilling" in radiology may be more appropriately termed "zooming" in pathology. We monitored eye-movements and navigation through digital pathology slides to derive metrics of how quickly the pathologists moved through XY (scanning) and Z (zooming) space. Prior research on eye-movements in depth has categorized clinicians as either "scanners" or "drillers." In contrast, we found that there was no reliable association between a clinician's tendency to scan or zoom while examining digital pathology slides. Thus, in the current work we treated scanning and zooming as continuous predictors rather than categorizing as either a "scanner" or "zoomer." In contrast to prior work in volumetric chest images, we found significant associations between accuracy and scanning rate but not zooming rate. These findings suggest fundamental differences in the relative value of information types and review behaviors across two image formats. Our data suggest that pathologists gather critical information by scanning on a given plane of depth, whereas radiologists drill through depth to interrogate critical features.

Histopathologic synoptic reporting of invasive melanoma: How reliable are the data?

BACKGROUND: Synoptic reporting is recommended by many guideline committees to encourage the thorough histologic documentation necessary for optimal management of patients with melanoma. METHODS: One hundred fifty-one pathologists from 40 US states interpreted 41 invasive melanoma cases. For each synoptic reporting factor, the authors identified cases with "complete agreement" (all participants recorded the same value) versus any disagreement. Pairwise agreement was calculated for each case as the proportion of pairs of responses that agreed, where paired responses were generated by the comparison of each reviewer's response with all others. RESULTS: There was complete agreement among all reviewers for 22 of the 41 cases (54%) on Breslow thickness dichotomized at 0.8 mm, with pairwise agreement ranging from 49% to 100% across the 41 cases. There was complete agreement for "no ulceration" in 24 of the 41 cases (59%), with pairwise agreement ranging from 42% to 100%. Tumor transected at base had complete agreement for 26 of the 41 cases (63%), with pairwise agreement ranging from 31% to 100%. Mitotic rate, categorized as 0/mm2 , 1/mm2 , or 2/mm2 , had complete agreement for 17 of the 41 cases (41%), with pairwise agreement ranging from 36% to 100%. Regression saw complete agreement for 14 of 41 cases (34%), with pairwise agreement ranging from 40% to 100%. Lymphovascular invasion, perineural invasion, and microscopic satellites were rarely reported as present. Respectively, these prognostic factors had complete agreement for 32 (78%), 37 (90%), and 18 (44%) of the 41 cases, and the ranges of pairwise agreement were 47% to 100%, 70% to 100%, and 53% to 100%, respectively. CONCLUSIONS: These findings alert pathologists and clinicians to the problem of interobserver variability in recording critical prognostic factors. LAY SUMMARY: This study addresses variability in the assessment and reporting of critical characteristics of invasive melanomas that are used by clinicians to guide patient care. The authors characterize the diagnostic variability among pathologists and their reporting methods in light of recently updated national guidelines. Results demonstrate considerable variability in the diagnostic reporting of melanoma with regard to the following: Breslow thickness, mitotic rate, ulceration, regression, and microscopic satellites. This work serves to alert pathologists and clinicians to the existence of variability in reporting these prognostic factors.