Evaluating the impact of delayed-phase imaging in Contrast-Enhanced Mammography on breast cancer staging: A comparative study of abbreviated versus complete protocol.

PURPOSE: Contrast-enhanced mammography (CEM) is an innovative imaging tool for breast cancer detection, involving intravenous injection of a contrast medium and the assessment of lesion enhancement in two phases: early and delayed. The aim of the study was to analyze the topographic concordance of lesions detected in the early- versus delayed phase acquisitions. MATERIALS AND METHODS: Approved by the Ethics Committee (No. 118/20), this prospective study included 100 women with histopathological confirmed breast neoplasia (B6) at the Radiodiagnostics Department of the Maggiore della Carità Hospital of Novara, Italy from May 1, 2021, to October 17, 2022. Participants underwent CEM examinations using a complete protocol, encompassing both early- and delayed image acquisitions. Three experienced radiologists blindly analyzed the CEM images for contrast enhancement to determine the topographic concordance of the identified lesions. Two readers assessed the complete study (protocol A), while one reader assessed the protocol without the delayed phase (protocol B). The average glandular dose (AGD) of the entire procedure was also evaluated. RESULTS: The analysis demonstrated high concordance among the three readers in the topographical identification of lesions within individual quadrants of both breasts, with a Cohen's κ > 0.75, except for the lower inner quadrant of the right breast and the retro-areolar region of the left breast. The mean whole AGD was 29.2 mGy. The mean AGD due to CEM amounted to 73% of the whole AGD (21.2 mGy). The AGD attributable to the delayed phase of CEM contributed to 36% of the whole AGD (10.5 mGy). CONCLUSIONS: As we found no significant discrepancy between the readings of the two protocols, we conclude that delayed-phase image acquisition in CEM does not provide essential diagnostic benefits for effective disease management. Instead, it contributes to unnecessary radiation exposure.

Validation of the updated Bosniak classification (2019) in pathologically confirmed CT-categorised cysts.

INTRODUCTION: The updated Bosniak classification in 2019 (v2019) addresses vague imaging terms and revises the criteria with the intent to categorise a higher proportion of cysts in lower-risk groups and reduce benign cyst resections. The aim of the present study was to compare the diagnostic accuracy and inter-observer agreement rate of the original (v2005) and updated classifications (v2019). METHOD: Resected/biopsied cysts were categorised according to Bosniak classifications (v2005 and v2019) and the diagnostic accuracy was assessed with reference to histopathological analysis. The inter-observer agreement of v2005 and v2019 was determined. RESULTS: The malignancy rate of the cohort was 83.6% (51/61). Using v2019, a higher proportion of malignant cysts were categorised as Bosniak ≥ III (88.2% vs 84.3%) and a significantly higher percentage were categorised as Bosniak IV (68.9% vs 47.1%; p = 0.049) in comparison to v2005. v2019 would have resulted in less benign cyst resections (13.5% vs 15.7%). Calcified versus non-calcified cysts had lower rates of malignancy (57.1% vs 91.5%; RR,0.62; p = 0.002). The inter-observer agreement of v2005 was higher than that of v2019 (kappa, 0.70 vs kappa, 0.43). DISCUSSION: The updated classification improves the categorisation of malignant cysts and reduces benign cyst resection. The low inter-observer agreement remains a challenge to the updated classification system.

Pancreatic cancer detection with a non-contrast MR protocol: is it reliable?

PURPOSE: The pancreatic cancer (PC) is the 4th leading cancer-related death, becoming the second one by 2030, with a 5 year survival rate of 8%. Considering its increased incidence in high-risk categories compared to the general population, we aimed to validate a non-contrast MR protocol, to detect PC in its earliest phase, which could be suitable as a screening tool in high-risk patients. MATERIALS AND METHODS: In this retrospective study, we selected 200 patients (> 40 years) from our radiological database, which performed upper abdominal MRI between 2012 and 2017. 100 were negative for pancreatic lesions and 100 positive for pancreatic lesion (< 30 mm). The latter group included: 40 PDAC (pancreatic adenocarcinoma), 42 BD-IPMN (Branch Duct- Intraductal Papillary Mucinous Neoplasm), 10 PNET(pancreatic neuroendocrine tumor), 4 SCN(serous cystic neoplasm), 3 IPS(intrapancreatic spleen), 1 MCN(mucinous cystic neoplasm). Three readers (R1, R2 and R3) with a high, medium and low experience, respectively, analysed, first, the non-contrast MR sequences (single-shot T2w breath-hold, GE T1w FS, DWI and 2D/3D MRCP), and then the standard MR protocol, independently, randomly and anonymously. Readers identified or excluded the presence of pancreatic lesion, in both reading sessions. These results were compared with the histopathological diagnosis, and then divided into 3 different classes of lesions: all lesions, pancreatic adenocarcinoma and solid lesion. Mcnemar's test was used to compare the results. The inter-observer agreement was determined according to the kappa statistic in both protocols, and then the inter-protocol agreement was calculated. RESULTS: The non-contrast MR protocol has reached statistical parameters values ranging between 83% in SE (sensitivity) by R3 and 99% in NPV (negative predictive value) by R1. The standard MR protocol has reported slight increasing statistical parameters compared to those of the proposed one. However, there are not significant statistical differences between the both protocols. The proposed non-contrast MR protocol has reported the highest NPVs in the PDAC group detection (R1: 99%, R2: 99%, R3: 98%). In all groups of lesions, the agreement between the two protocols was excellent for each Reader ranging from 96 to 98%. CONCLUSION: The proposed non-contrast MR protocol showed high PC detection values and a time execution ≤ 20 min. Therefore, it can be proposed as a screening tool in high-risk patients.

Evaluation of inter-observer variability regarding aortic and mitral valve findings on transesophageal echocardiograms ordered for suspected endocarditis.

BACKGROUND: Transesophageal echocardiography (TEE) is the gold standard for the detection of valvular vegetations (VV). Differentiating small VV from degenerative changes is challenging and prone to inter-observer variability. We evaluated inter-observer agreement regarding aortic (AV) and mitral valve (MV) findings on TEEs ordered for suspected infective endocarditis (IE). METHODS: A total of 349 consecutive TEEs were evaluated. Studies were classified as "definite, possible, or no" IE with valve masses classified further by morphology. Nine faculty echocardiographers scored randomly selected TEEs of the AV (N = 38) and MV (N = 35). Inter-reader variability was calculated using the Fleiss/Scott Kappa (Kf). RESULTS: Positive blood cultures were present in 81% and 45% had definite IE by the modified Duke criteria. There was moderate reader agreement regarding the presence of a valvular mass for both the AV (Kf = .41, 95% CI [.30-.53]) and MV (Kf = .49, 95% CI [.34-.65]). For diagnosis of IE, there was fair agreement for the AV (Kf = .29, 95% CI [.18-.42]) and moderate agreement for the MV (Kf = .53, 95% CI [.36-.70]). Masses described as large, multi-lobulated, or pedunculated were more frequently categorized as clinical IE, (p < .006, both valves), however those with filamentous lesions were not (p < .001, both valves). CONCLUSIONS: In a large academic center, the inter-observer agreement for the presence of a left sided valvular mass was moderate and agreement regarding the final diagnosis of IE was fair to moderate, with better agreement among readers evaluating the MV. Lesion morphology is associated with the clinical diagnosis of IE.

Observer agreement in the diagnosis of oral lichen planus using the proposed criteria of the American Academy of Oral and Maxillofacial Pathology.

BACKGROUND: Oral lichen planus (OLP) is a common chronic inflammatory condition with an undefined malignant transformation potential. There have been many attempts at providing a specific definition of OLP without conclusive outcomes. A new set of diagnostic criteria was proposed in 2016 by the American Academy of Oral and Maxillofacial Pathology (AAOMP) in an endeavour to resolve this issue, and this has not yet been evaluated. This study aimed to assess the utility of AAOMP proposed criteria for the diagnosis of OLP. METHODS: Five pathologists blindly assessed a cohort of 215 digital whole slide images (WSI) obtained from haematoxylin and eosin-stained microscopic slides. Forty-six WSI were included twice to assess the intra-observer agreement. Included cases were diagnosed clinically as either OLP or oral lichenoid reaction. Each pathologist was asked to utilize the AAOMP histopathological criteria while assessing slides. The variations in diagnoses were assessed by unweighted kappa statistics. RESULTS: The level of intra-observer agreement was very good (0.801 to 0.899). The level of inter-observer agreement among the observers varied from good (0.658) to very good (0.842) when the responses were categorized as evident/compatible OLP versus no OLP and was good (0.62 to 0.725) when the responses were categorized as evident OLP, versus compatible OLP, versus no OLP. The clinico-pathological correlation was 87.6%. CONCLUSION: A reliable level of agreement can be achieved by pathologists for the diagnosis of OLP using the AAOMP criteria for differentiation between lichenoid and other conditions. There are still limitations in discriminating OLP from oral lichenoid lesions microscopically.

Outcome and diagnostic reproducibility of the thyroid cytology "indeterminate categories" SIAPEC/SIE 2014 in a consecutive series of 302 cases.

PURPOSE: The clinical impact of the SIAPEC/SIE 2014 classification for thyroid cytology has been addressed in few studies that evaluated the malignancy rate and the relative prevalence of each category. No study analyzed its intra-observer and inter-observer reproducibility, so far. METHODS: We retrospectively collected all "indeterminate" lesions diagnosed before (2011-2014) and after (2015-2018) the application of the SIAPEC/SIE 2014 classification at our Institution. Their relative malignancy risks were calculated based on available histological diagnoses. Cytological and clinical features of TIR3A were compared with the surgical outcome. Finally, a large set of samples was re-evaluated in blind of the original cytological and histological diagnoses by two pathologists, independently. RESULTS: The prevalence of "indeterminate" diagnoses increased in years 2015-2018 (302/1482, 21% with 14% of TIR3A and 7% TIR3B categories) compared to years 2011-2014 (261/1680, 16%). Surgery was performed in 27% TIR3A and in 97% TIR3B cases. Malignancy rates were 40% for TIR3B and 17% for TIR3A, but were greatly influenced by the adoption of the WHO 2017 re-classification of encapsulated follicular-patterned lesions (decreasing to 28% and 6%, respectively). No criteria except for tumor size were associated to malignancy in TIR3A category. Intra-observer agreement of the experienced pathologist was 122/141 (86%), whereas inter-observer agreement between the expert and in-training pathologist was 95/141 (67%). CONCLUSIONS: In this real-life experience, the sub-classification of TIR3A and TIR3B slightly increased the overall prevalence of "indeterminate" diagnoses. Malignancy rates were higher than estimated for both TIR3A and TIR3B categories. Agreement among observers highly depended on pathologist's training.

Learning curves in radiological reporting of whole-body MRI in plasma cell disease: a retrospective study.

BACKGROUND: The plasma cell disease is been studying by the whole-body MRI technology. However, the time requested to learn this radiological technique is unknown. PURPOSE: To esteem, quantitatively and qualitatively, the essential time to learn the whole-body MRI diffusion-weighted imaging with background body signal suppression in patients with plasma cell disease. MATERIALS AND METHODS: Between January 2015 and February 2017, three readers in-training with different levels of experience examined the anonymised and randomised whole-body MRI images of 52 patients with a diagnosis of plasma cell disease and analysed their morphological (T1w, T2w with and without fat suppression) and functional sequences. Reports of an expert radiologist were considered the standard of reference. Images were analysed in two sessions, during which each reader was timed. Readers reported the number of segments with lesions and staged the disease using the Durie-Salmon PLUS staging system. Weighted Cohen's ĸ and Z-test were used to compare the trainees' reports with those of the expert radiologist, and learning curves were drawn up to show changes between the two sessions. RESULTS: Weighted Cohen's ĸ of number of lesioned segments increased from 0.536 ± 0.123 to 0.831 ± 0.129 (Prob > Z under 0.005), thus approaching the goal of ĸ > 0.8. Trainees reached the level of experienced radiologist in terms of time by the 33rd patient. Agreement concerning the Durie-Salmon PLUS increased from 0.536 ± 0.123 to 0.831 ± 0.129 (Prob > Z under 0.005). CONCLUSIONS: The findings of this study demonstrate that whole-body MRI with DWIBS can be learned in about 80 reports and leads to a high level of inter-observer concordance when using the Durie-Salmon PLUS staging system.

Should we freeze it? Agreement on fate of borderline blastocysts is poor and does not improve with a modified blastocyst grading system.

STUDY QUESTION: What is the inter-observer agreement among embryologists for decision to freeze blastocysts of borderline morphology and can it be improved with a modified grading system? SUMMARY ANSWER: The inter-observer agreement among embryologists deciding whether to freeze blastocysts of marginal morphology was low and was not improved by a modified grading system. WHAT IS KNOWN ALREADY: While previous research on inter-observer variability on the decision of which embryo to transfer from a cohort of blastocysts is good, the impact of grading variability regarding decision to freeze borderline blastocysts has not been investigated. Agreement for inner cell mass (ICM) and trophectoderm (TE) grade is only fair, factors which contribute to the grade that influences decision to freeze. STUDY DESIGN, SIZE, DURATION: This was a prospective study involving 18 embryologists working at four different IVF clinics within a single organisation between January 2019 and July 2019. PARTICIPANTS/MATERIALS, SETTING, METHODS: All embryologists currently practicing blastocyst grading at a multi-site organisation were invited to participate. The survey was comprised of blastocyst images in three planes and asked (i) the likelihood of freezing and (ii) whether the blastocyst would be frozen based on visual assessment. Blastocysts varied by quality and were categorised as either top (n = 20), borderline (n = 60) or non-viable/degenerate quality (n = 20). A total of 1800 freeze decisions were assessed. To assess the impact of grading criteria on inter-observer agreement for decision to freeze, the survey was taken once when the embryologists used the Gardner criteria and again 6 months after transitioning to a modified Gardner criterion with four grades for ICM and TE. The fourth grade was introduced with the aim to promote higher levels of agreement for the clinical usability decision when the blastocyst was of marginal quality. MAIN RESULTS AND THE ROLE OF CHANCE: The inter-observer agreement for decision to freeze was near perfect (kappa 1.0) for top and non-viable/degenerate quality blastocysts, and this was not affected by the blastocysts grading criteria used (top quality; P = 0.330 and non-viable/degenerate quality; P = 0.18). In contrast, the cohort of borderline blastocysts received a mixed freeze rate (average 52.7%) during the first survey, indicative of blastocysts that showed uncertain viability and promoting significant disagreement for decision to freeze among the embryologists (kappa 0.304). After transitioning to a modified Gardner criteria with an additional grading tier, the average freeze rate increased (64.8%; P < 0.0001); however, the inter-observer agreement for decision to freeze was unchanged (kappa 0.301). Therefore, significant disagreement for decision to freeze among embryologists is an ongoing issue not resolved by the two grading criteria assessed here. LIMITATIONS, REASONS FOR CAUTION: Blastocyst assessment was performed from time-lapse images in three planes, rather than with a microscope in the laboratory. The inter-observer agreement for decision to freeze may be lower for embryologists working in different clinics with different grading protocols. WIDER IMPLICATIONS OF THE FINDINGS: The decision to freeze a blastocyst with borderline morphology is a common clinical issue that has the potential to arise for any patient during blastocyst culture. Disagreement for decision to freeze these blastocysts, and therefore clinical usability in frozen embryo transfer cycles, affects consistency in patient care due to a potential impact on cumulative live birth rates, as well as financial, emotional and time costs associated with the frozen embryo transfer cycles. We demonstrate significant disagreement for decision to freeze borderline blastocysts among embryologists using the same grading scheme within a large multisite organisation, a phenomenon which was not improved with a modified grading system. Decision-making around borderline embryos is an area requiring further research, especially as studies continue to demonstrate the reduced but modest live birth rates for low quality blastocysts (Grade C). These results provide support for emerging technology for embryo assessment, such as artificial intelligence. STUDY FUNDING/COMPETING INTEREST(S): None declared. TRIAL REGISTRATION NUMBER: Not applicable.

Inter-observer agreement and reliability assessment for observational studies of clinical work.

Inter-observer agreement (IOA) is a key aspect of data quality in time-and-motion studies of clinical work. To date, such studies have used simple and ad hoc approaches for IOA assessment, often with minimal reporting of methodological details. The main methodological issues are how to align time-stamped task intervals that rarely have agreeing start and end times, and how to assess IOA for multiple nominal variables. We present a combination of methods that simultaneously addresses both these issues and provides a more appropriate measure by which to assess IOA for time-and-motion studies. The issue of alignment is addressed by converting task-level data into small time windows then aligning data from different observers by time. A method applicable to multivariate nominal data, the iota score, is then applied to the time-aligned data. We illustrate our approach by comparing iota scores to the mean of univariate Cohen's kappa scores through application of these measures to existing data from an observational study of emergency department physicians. While the two scores generated very similar results under certain conditions, iota was more resilient to sparse data issues. Our results suggest that iota applied to time windows considerably improves on previous methods used for IOA assessment in time-and-motion studies, and that Cohen's kappa and other univariate measures should not be considered the gold standard. Rather, there is an urgent need for ongoing explicit discussion of methodological issues and solutions to improve the ways in which data quality is assessed in time-and-motion studies in order to ensure the conclusions drawn from such studies are robust.

Continuous Assessment of "Optimal" Cerebral Perfusion Pressure in Traumatic Brain Injury: A Cohort Study of Feasibility, Reliability, and Relation to Outcome.

BACKGROUND: Guidelines recommend maintaining cerebral perfusion pressure (CPP) between 60 and 70 mmHg in patients with severe traumatic brain injury (TBI), but acknowledge that optimal CPP may vary depending on cerebral blood flow autoregulation. Previous retrospective studies suggest that targeting CPP where the pressure reactivity index (PRx) is optimized (CPPopt) may be associated with improved recovery. METHODS: We performed a retrospective cohort study involving TBI patients who underwent PRx monitoring to assess issues of feasibility relevant to future interventional studies: (1) the proportion of time that CPPopt could be detected; (2) inter-observer variability in CPPopt determination; and (3) agreement between manual and automated CPPopt estimates. CPPopt was determined for consecutive 6-h epochs during the first week following TBI. Sixty PRx-CPP tracings were randomly selected and independently reviewed by six critical care professionals. We also assessed whether greater deviation between actual CPP and CPPopt (ΔCPP) was associated with poor outcomes using multivariable models. RESULTS: In 71 patients, CPPopt could be manually determined in 985 of 1173 (84%) epochs. Inter-observer agreement for detectability was moderate (kappa 0.46, 0.23-0.68). In cases where there was consensus that it could be determined, agreement for the specific CPPopt value was excellent (weighted kappa 0.96, 0.91-1.00). Automated CPPopt was within 5 mmHg of manually determined CPPopt in 93% of epochs. Lower PRx was predictive of better recovery, but there was no association between ΔCPP and outcome. Percentage time spent below CPPopt increased over time among patients with poor outcomes (p = 0.03). This effect was magnified in patients with impaired autoregulation (defined as PRx > 0.2; p = 0.003). CONCLUSION: Prospective interventional clinical trials with regular determination of CPPopt and corresponding adjustment of CPP goals are feasible, but measures to maximize consistency in CPPopt determination are necessary. Although we could not confirm a clear association between ΔCPP and outcome, time spent below CPPopt may be particularly harmful, especially when autoregulation is impaired.

Inter-observer agreement between two observers for bovine digital dermatitis identification in New Zealand using digital photographs.

AIMS: To assess the inter-observer agreement for detecting bovine digital dermatitis (BDD) lesions in digital colour photographs of the hind feet of cows, which had been taken while the animals were standing to be milked, between two trained observers. METHODS: Thirty-six photographs were selected from a total of 184 photographs held by the first author (R1), who had classified them as negative (n=11) or positive (n=25) for BDD. They were delivered to a technician (R2) who had previously visually inspected cattle for BDD lesions, and who then recorded the photographs as being either BDD-positive or BDD-negative. The percentage agreement between R1 and R2, and two other inter-observer agreement statistics, Cohen's κ and Gwet's first-order chance correction agreement coefficient (AC1), were calculated. The cumulative membership probabilities of Cohen's κ and Gwet's AC1 were then calculated for different benchmark ranges of κ. RESULTS: The percentage agreement between R1 and R2 was 33/36 (92%), Cohen's κ was 0.80 (95% CI=0.57-1.0) and Gwet's AC1 was 0.86 (95% CI=0.69-1.0). Based on the cumulative membership probabilities for Gwet's AC1, there was 75% probability that the two observers had almost perfect agreement (κ≥0.81). For both Cohen's κ and Gwet's AC1, there was >95% probability that the two observers had at least substantial agreement (κ≥0.61). CONCLUSIONS: The two trained observers had at least substantial agreement in identifying from a digital photograph as to whether BDD lesions were present or absent. Therefore results from the two could be used interchangeably. CLINICAL RELEVANCE: Visual assessment for BDD lesions in the milking parlour can be subjective. However a high agreement between these two trained BDD inspectors means BDD prevalence reported from different regions in New Zealand by these two can be directly compared.

An assessment of the replicability of a standard and modified sanitary risk protocol for groundwater sources in Greater Accra.

Sanitary risk inspection, the systematic observation of contamination hazards, is often used to manage safety of water sources such as wells and boreholes. However, the replicability of sanitary risk inspections undertaken by different observers has not been studied. This study aimed to assess the replicability of sanitary risk inspections by two different observers in urban and peri-urban neighbourhoods of Greater Accra, Ghana. Two observers independently used a standard protocol to record contamination hazards around 62 groundwater sources, additionally recording urban-specific hazards such as damaged sewage pipes via a modified protocol. We calculated risk scores as the proportion of hazards observed at each source, separately for each observer. Linn's concordance correlation coefficient indicated very high agreement between the two observers' risk scores (n = 62; c = 0.949, 95% confidence limits 0.917-0.968). However, risk scores from urban-specific observations were uncorrelated with those from the standard protocol (r = 0.11, p = 0.41 for observer 1; r = 0.16, p = 0.22 for observer 2). Ours is the first study of replicability of sanitary risk observations and suggests high inter-observer agreement. However, urban contamination hazards were not captured using the standard protocol. In the future, assessment of inter-observer agreement and observations of urban-specific hazards could be incorporated into nationwide or regional sanitary risk surveys.

Reproducibility and predictive value of scoring stromal tumour infiltrating lymphocytes in triple-negative breast cancer: a multi-institutional study.

BACKGROUND: Several studies have demonstrated a prognostic role for stromal tumour infiltrating lymphocytes (sTILs) in triple-negative breast cancer (TNBC). The reproducibility of scoring sTILs is variable with potentially excellent concordance being achievable using a software tool. We examined agreement between breast pathologists across Europe scoring sTILs on H&E-stained sections without software, an approach that is easily applied in clinical practice. The association between sTILs and response to anthracycline-taxane NACT was also examined. METHODOLOGY: Pathologists from the European Working Group for Breast Screening Pathology scored sTILs in 84 slides from 75 TNBCs using the immune-oncology biomarker working group guidance in two circulations. There were 16 participants in the first and 19 in the second circulation. RESULTS: Moderate agreement was achieved for absolute sTILs scores (intraclass correlation coefficient (ICC) = 0.683, 95% CI 0.601-0.767, p-value < 0.001). Agreement was less when a 25% threshold was used (ICC 0.509, 95% CI 0.416-0.614, p-value < 0.001) and for lymphocyte predominant breast cancer (LPBC) (ICC 0.504, 95% CI 0.412-0.610, p-value < 0.001). Intra-observer agreement was strong for absolute sTIL values (Spearman ρ = 0.727); fair for sTILs ≥ 25% (κ = 0.53) and for LPBC (κ = 0.49), but poor for sTILs as 10% increments (κ = 0.24). Increasing sTILs was significantly associated with an increased likelihood of a pathological complete response (pCR) on multivariable analysis. CONCLUSION: Increasing sTILs in TNBCs improves the likelihood of a pCR. However, inter-observer agreement is such that H&E-based assessment is not sufficiently reproducible for clinical application. Other methodologies should be explored, but may be at the cost of ease of application.

Reproducibility and Clinical Correlates of Supine Diaphragmatic Motion Measured by M-Mode Ultrasonography in Healthy Volunteers.

BACKGROUND: Assessing diaphragm mobility is important to detect malfunctions or impending exhaustion and to evaluate the effects of many chest and abdominal conditions on respiratory mechanics. Amongst several imaging methods, ultrasonography represents the only noninvasive, nonionizing imaging technique widely available for the direct assessment of diaphragm excursion. OBJECTIVES: the aim of this study is to prospectively assess the supine diaphragmatic motion amplitude, intra- and inter-observer agreement, and anthropometric correlates of diaphragm motion variability, measured through M-mode ultrasonography, in a sample of healthy volunteers. METHODS: One-hundred healthy volunteers were considered eligible for the study. Instead of B-mode imaging, the M-mode technique was used to achieve a more accurate measurement of diaphragm motion. To assess intra-observer variability, 3 consecutive measurements (M-mode and B-mode) of the right dome motion were obtained at every session. To test for inter-rater reliability, the subjects were asked to provide 2 more diaphragm motion measurements every week, each performed by 2 experienced operators, and 42 subjects accepted. RESULTS: Diaphragmatic motion was positively correlated with height and weight both at quiet (Spearman's coefficient = 0.514, p < 0.001 and 0.314, p = 0.038) and deep breathing (Spearman's coefficient = 0.342, p = 0.001 and 0.225, p = 0.024, respectively) and negatively correlated with age, but only during deep breathing (Spearman's coefficient = -0.272, p = 0.006). Intra-observer agreement degree on all 3 measurements was excellent during both quiet and deep breathing, with a Cronbach's alpha of 0.793 and 0.901, respectively, and an intra-class coefficient of 0.797 and 0.900, respectively. Similarly, the degree of inter-observer agreement achieved a Cronbach's alpha of 0.638 and 0.776, and an inter-class coefficient of 0.632 and 0.778, respectively. Deep breathing was associated with sex only in linear multivariable models (B = -10.14; 95% confidence interval [CI] -17.86, -2.41; p = 0.011), while quiet breathing resulted to be affected by height only (B = 30.05; 95% CI 0.79-59.31; p = 0.044). CONCLUSIONS: Diaphragm excursion measurements using the M-mode technique were accurate and could be reproduced also when obtained in recumbent patients. After adjustments, the main predictors of diaphragmatic motion were sex and height, which should be considered to design a specifically tailored study and to develop normality reference equations.

Training Effect on the Inter-observer Agreement in Endoscopic Diagnosis and Grading of Atrophic Gastritis according to Level of Endoscopic Experience.

BACKGROUND: Endoscopic diagnosis of atrophic gastritis can contribute to risk stratification and thereby tailored screening for gastric cancer. We aimed to evaluate the effect of training on inter-observer agreement in diagnosis and grading of endoscopic atrophic gastritis (EAG) according to the level of endoscopists' experience. METHODS: Twelve endoscopists (six less-experienced and six experienced) participated in this prospective study. The training session consisted of 1) four interventions with two-week intervals, and 2) a follow-up period (two follow-up assessments without feedback). EAG was categorized as C1 to O3 according to the Kimura-Takemoto classification. Kappa statistics were used to calculate inter-observer agreement. RESULTS: At baseline, kappa indexes were 0.18 in the less-experienced group and 0.32 in the experienced group, respectively. After four interventions with feedback, the kappa index improved in both groups and was sustained during the follow-up period. Overall diagnostic yields of EAG were 43.1% ± 10.7% in pre-intervention and 46.8% ± 5.9% in post-intervention. Variability in the rate of diagnosis of EAG significantly decreased in the less-experienced group (r = 0.04, P = 0.003). CONCLUSION: Irrespective of experience level, inter-observer agreement for diagnosis and grading of EAG improved after training and remained stable after intervention.

Reproducible evaluation of tumor-infiltrating lymphocytes (TILs) using the recommendations of International TILs Working Group 2014.

Tumor infiltrating lymphocytes (TILs) in breast cancer play an important role in predicting the outcome of breast cancer. The goal of our current study is to investigate the consistency and reproducibility of the recommendations published by the International TILs Working Group 2014 among pathology trainees and pathologists. Hematoxylin & Eosin (H&E) slides from 129 breast cancer cases (one slide each) from 2009 to 2014 were evaluated. Each case was blindly and independently reviewed by two observers following the International TILs Working Group 2014 recommendations. Three pathology trainees (PGY2, PGY3 and PGY4) and three pathologists (2 general pathologists and 1 breast pathologist) were involved in this study. Of the 129 cases, 10 (10/129, 7.8%) cases had TILs >50%, 90 (90/129, 69.8%) cases had <10% of TILs, and 29 (29/129, 22.4%) cases had TILs ranging from 10 to 50%. Our results showed that in 104 cases (104/129, 80.6%) the TILs percentage was identical between the 2 observers. In 18 cases (18/129, 14%), the difference between the two observers was by 10% and in 7 cases (7/129, 5.4%) there was a difference of 20% or more. The inter-observer kappa value was 0.776 between two observers, and the kappa score improved to 0.86 if using the 3 categoric groups (<10%, 10-50%, and >50%). Our study showed that the recommendations and instructions for TILs evaluation by the International TILs Working Group 2014 were sufficiently detailed to be applied for TILs evaluation in breast cancer.

Inter-observer agreement of the Wagner, University of Texas and PEDIS classification systems for the diabetic foot syndrome.

BACKGROUND: The aim of this cohort study was to assess the inter-observer agreement of three diabetic foot classification systems: the Wagner, the University of Texas and the PEDIS. METHODS: We included 250 consecutive patients diagnosed of diabetic foot syndrome in 2009-2013. Wound scores were recorded at admission and a reevaluation was performed simultaneously or 24h later by a different evaluator. Demographical, laboratory data and associated risk factors were obtained from the patients' medical records. RESULTS: The Kappa coefficient showed a moderate inter-observer agreement between the first evaluation and the reevaluation for Wagner scale (Kappa=0.55; 95% CI: 0.507-0.593), University of Texas scale (Kappa=0.513; 95% CI: 0.463-0.563) and for PEDIS scale (Kappa=0.574; 95% CI: 0.522-0.626). CONCLUSIONS: This moderate agreement shows that these scales should not be used alone for management decisions regarding diabetic foot syndrome and should, therefore, be integrated with other clinical data to ensure an adequate handover.

Accuracy and agreement of PIRADSv2 for prostate cancer mpMRI: A multireader study.

PURPOSE: Multiparametric MRI (mpMRI) improves the detection of clinically significant prostate cancer, but is limited by interobserver variation. The second version of theProstate Imaging Reporting and Data System (PIRADSv2) was recently proposed as a standard for interpreting mpMRI. To assess the performance and interobserver agreement of PIRADSv2 we performed a multi-reader study with five radiologists of varying experience. MATERIALS AND METHODS: Five radiologists (n = 2 prostate dedicated, n = 3 general body) blinded to clinicopathologic results detected and scored lesions on prostate mpMRI using PIRADSv2. The endorectal coil 3 Tesla MRI included T2W, diffusion-weighted imaging (apparent diffusion coefficient, b2000), and dynamic contrast enhancement. Thirty-four consecutive patients were included. Results were correlated with radical prostatectomy whole-mount histopathology produced with patient-specific three-dimensional molds. An index lesion was defined on pathology as the lesion with highest Gleason score or largest volume if equivalent grades. Average sensitivity and positive predictive values (PPVs) for all lesions and index lesions were determined using generalized estimating equations. Interobserver agreement was evaluated using index of specific agreement. RESULTS: Average sensitivity was 91% for detecting index lesions and 63% for all lesions across all readers. PPV was 85% for PIRADS ≥ 3 and 90% for PIRADS ≥ 4. Specialists performed better only for PIRADS ≥ 4 with sensitivity 90% versus 79% (P = 0.01) for index lesions. Index of specific agreement among readers was 93% for the detection of index lesions, 74% for the detection of all lesions, and 85% for scoring index lesions, and 58% for scoring all lesions. CONCLUSION: By using PIRADSv2, general body radiologists and prostate specialists can detect high-grade index prostate cancer lesions with high sensitivity and agreement. LEVEL OF EVIDENCE: 1 J. Magn. Reson. Imaging 2017;45:579-585.

Diagnosis of diffuse idiopathic skeletal hyperostosis with chest computed tomography: inter-observer agreement.

OBJECTIVE: To evaluate and improve the interobserver agreement for the CT-based diagnosis of diffuse idiopathic skeletal hyperostosis (DISH). METHODS: Six hundred participants of the CT arm of a lung cancer screening trial were randomly divided into two groups. The first 300 CTs were scored by five observers for the presence of DISH based on the original Resnick criteria for radiographs. After analysis of the data a consensus meeting was organised and the criteria were slightly modified regarding the definition of 'contiguous', the definition of 'flowing ossifications' and the viewing plane and window level. Subsequently, the second set of 300 CTs was scored by the same observers. κ ≥ 0.61 was considered good agreement. RESULTS: The 600 male participants were on average 63.5 (SD 5.3) years old and had smoked on average 38.0 pack-years. In the first round κ values ranged from 0.32 to 0.74 and 7 out of 10 values were below 0.61. After the consensus meeting the interobserver agreement ranged from 0.51 to 0.86 and 3 out of 10 values were below 0.61. The agreement improved significantly. CONCLUSIONS: This is the first study that reports interobserver agreement for the diagnosis of DISH on chest CT, showing mostly good agreement for modified Resnick criteria. KEY POINTS: • DISH is diagnosed on fluoroscopic and radiographic examinations using Resnick criteria • Evaluation of DISH on chest CT was modestly reproducible with the Resnick criteria • A consensus meeting and Resnick criteria modification improved inter-rater reliability for DISH • Reproducible CT criteria for DISH aids research into this poorly understood entity.

Reliability in cardiotocography interpretation - impact of extended on-site education in addition to web-based learning: an observational study.

INTRODUCTION: Previous studies have shown poor reproducibility in cardiotocography (CTG) interpretation. Studies evaluating the Swedish web-based CTG-education program have not proven to increase accurate CTG assessments. The aim of this study was to evaluate whether an extended education can improve inter- and intra-observer reliability in CTG interpretation. MATERIAL AND METHODS: Six obstetricians from two different departments interpreted 106 CTG tracings on two occasions. Both departments used a Swedish national web-based CTG education and test for training. One department had, in addition, an extended education program consisting of on-site lectures and oral examinations. Inter- and intra-observer agreements were calculated by simple or weighted kappa (κ) values for the five parameters assessed on CTG. RESULTS: In both departments inter-observer and intra-observer κ showed moderate to excellent agreement (ranges for κ 0.41-0.76 and 0.65-0.93, respectively). Obstetricians at the department with extended CTG education had better inter-observer reliability for variability and accelerations. This was also the case for intra-observer reliability with the addition of baseline frequency. Both inter- and intra-observer agreement increased from moderate to substantial in both departments when decelerations were dichotomized into harmless (including early and simple variable decelerations) or hypoxic (including late, severe variable, prolonged and combined decelerations) (κ 0.63-0.78) compared with the current sub-classification of decelerations (κ 0.42-0.65). CONCLUSIONS: Agreement in CTG interpretation was better than expected in both departments, especially when divided into harmless/hypoxic changes. Combination of different learning methods (web-based, on-site lectures and case discussion) might result in a better CTG interpretation agreement compared with web-based learning solely.