Identification of tumour regression in neoadjuvantly treated pancreatic cancer is based on divergent and nonspecific criteria.

AIMS: Following the increased use of neoadjuvant therapy for pancreatic cancer, grading of tumour regression (TR) has become part of routine diagnostics. However, it suffers from marked interobserver variation, which is mainly ascribed to the subjectivity of the defining criteria of the categories in TR grading systems. We hypothesized that a further cause for the interobserver variation is the use of divergent and nonspecific morphological criteria to identify tumour regression. METHODS AND RESULTS: Twenty treatment-naïve pancreatic cancers and 20 pancreatic cancers treated with neoadjuvant chemotherapy were reviewed by three experienced pancreatic pathologists who, blinded for treatment status, categorized each tumour as treatment-naïve or neoadjuvantly treated, and annotated all tissue areas they considered showing tumour regression. Only 50%-65% of the cases were categorized correctly, and the annotated tissue areas were highly discrepant (only 3%-41% overlap). When the prevalence of various morphological features deemed to indicate TR was compared between treatment-naïve and neoadjuvantly treated tumours, only one pattern, characterized by reduced cancer cell density and prominent stroma affecting a large area of the tumour bed, occurred significantly more frequently, but not exclusively, in the neoadjuvantly treated group. Finally, stromal features, both morphological and biological, were investigated as possible markers for tumour regression, but failed to distinguish TR from native tumour stroma. CONCLUSION: There is considerable divergence in opinion between pathologists when it comes to the identification of tumour regression. Reliable identification of TR is only possible if it is extensive, while lesser degrees of treatment effect cannot be recognized with certainty.

The accuracy and intra- and interobserver variability of PSMA PET/CT for the local staging of primary prostate cancer.

PURPOSE: Prostate-specific membrane antigen (PSMA) positron emission tomography/ computed tomography (PET/CT) is recognized as the most accurate imaging modality for detection of metastatic high-risk prostate cancer (PCa). Its role in the local staging of disease is yet unclear. We assessed the intra- and interobserver variability, as well as the diagnostic accuracy of the PSMA PET/CT based molecular imaging local tumour stage (miT-stage) for the local tumour stage assessment in a large, multicentre cohort of patients with intermediate and high-risk primary PCa, with the radical prostatectomy specimen (pT-stage) serving as the reference standard. METHODS: A total of 600 patients who underwent staging PSMA PET/CT before robot-assisted radical prostatectomy was studied. In 579 PSMA positive primary prostate tumours a comparison was made between miT-stage as assessed by four nuclear physicians and the pT-stage according to ISUP protocol. Sensitivity, specificity and diagnostic accuracy were determined. In a representative subset of 100 patients, the intra-and interobserver variability were assessed using Kappa-estimates. RESULTS: The sensitivity and specificity of the PSMA PET/CT based miT-stage were 58% and 59% for pT3a-stage, 30% and 97% for ≥ pT3b-stage, and 68% and 61% for overall ≥ pT3-stage, respectively. No statistically significant differences in diagnostic accuracy were found between tracers. We found a substantial intra-observer agreement for PSMA PET/CT assessment of ≥ T3-stage (k 0.70) and ≥ T3b-stage (k 0.75), whereas the interobserver agreement for the assessment of ≥ T3-stage (k 0.47) and ≥ T3b-stage (k 0.41) were moderate. CONCLUSION: In a large, multicentre study evaluating 600 patients with newly diagnosed intermediate and high-risk PCa, we showed that PSMA PET/CT may have a value in local tumour staging when pathological tumour stage in the radical prostatectomy specimen was used as the reference standard. The intra-observer and interobserver variability of assessment of tumour extent on PSMA PET/CT was moderate to substantial.

MR Elastography of the Pancreas: Bowel Preparation and Repeatability Assessment in Pancreatic Cancer Patients and Healthy Controls.

BACKGROUND: Pancreatic ductal adenocarcinoma (PDAC) stromal viscoelasticity can be measured using MR elastography (MRE). Bowel preparation regimens could affect MRE quality and knowledge on repeatability is crucial for clinical implementation. PURPOSE: To assess effects of four bowel preparation regimens on MRE quality and to evaluate repeatability and differentiate patients from healthy controls. STUDY TYPE: Prospective. POPULATION: 15 controls (41 ± 16 years; 47% female), 16 PDAC patients (one excluded, 66 ± 12 years; 40% female) with 15 age-/sex-matched controls (65 ± 11 years; 40% female). Final sample size was 25 controls and 15 PDAC. FIELD STRENGTH/SEQUENCE: 3-T, spin-echo echo-planar-imaging, turbo spin-echo, and fast field echo gradient-echo. ASSESSMENT: Four different regimens were used: fasting; scopolaminebutyl; drinking 0.5 L water; combination of 0.5 L water and scopolaminebutyl. MRE signal-to-noise ratio (SNR) was compared between all regimens. MRE repeatability (test-retest) and differences in shear wave speed (SWS) and phase angle (ϕ) were assessed in PDAC and controls. Regions-of-interest were defined for tumor, nontumorous (n = 8) tissue in PDAC, and whole pancreas in controls. Two radiologists delineated tumors twice for evaluation of intraobserver and interobserver variability. STATISTICAL TESTS: Repeated measures analysis of variance, coefficients of variation (CoVs), Bland-Altman analysis, (un)paired t-test, Mann-Whitney U-test, and Wilcoxon signed-rank test. P-value<0.05 was considered statistically significant. RESULTS: Preparation regimens did not significantly influence MRE-SNR. Therefore, the least burdensome preparation (fasting only) was continued. CoVs for tumor SWS were: intrasession (12.8%) and intersession (21.7%), and intraobserver (7.9%) and interobserver (10.3%) comparisons. For controls, CoVs were intrasession (4.6%) and intersession (6.4%). Average SWS for tumor, nontumor, and healthy tissue were: 1.74 ± 0.58, 1.38 ± 0.27, and 1.18 ± 0.16 m/sec (ϕ: 1.02 ± 0.17, 0.91 ± 0.07, and 0.85 ± 0.08 rad), respectively. Significant differences were found between all groups, except for ϕ between healthy-nontumor (P = 0.094). DATA CONCLUSION: The proposed bowel preparation regimens may not influence MRE quality. MRE may be able to differentiate between healthy tissue-tumor and tumor-nontumor. LEVEL OF EVIDENCE: 2 TECHNICAL EFFICACY STAGE: 2.

Paris classification of colonic polyps using CT colonography: prospective cohort study of interobserver variation.

BACKGROUND: The Paris classification categorises colorectal polyp morphology. Interobserver agreement for Paris classification has been assessed at optical colonoscopy (OC) but not CT colonography (CTC). We aimed to determine the following: (1) interobserver agreement for the Paris classification using CTC between radiologists; (2) if radiologist experience influenced classification, gross polyp morphology, or polyp size; and (3) the extent to which radiologist classifications agreed with (a) colonoscopy and (b) a combined reference standard. METHODS: Following ethical approval for this non-randomised prospective cohort study, seven radiologists from three hospitals classified 52 colonic polyps using the Paris system. We calculated interobserver agreement using Fleiss kappa and mean pairwise agreement (MPA). Absolute agreement was calculated between radiologists; between CTC and OC; and between CTC and a combined reference standard using all available imaging, colonoscopic, and histopathological data. RESULTS: Overall interobserver agreement between the seven readers was fair (Fleiss kappa 0.33; 95% CI 0.30-0.37; MPA 49.7%). Readers with < 1500 CTC experience had higher interobserver agreement (0.42 (95% CI 0.35-0.48) vs. 0.33 (95% CI 0.25-0.42)) and MPA (69.2% vs 50.6%) than readers with ≥ 1500 experience. There was substantial overall agreement for flat vs protuberant polyps (0.62 (95% CI 0.56-0.68)) with a MPA of 87.9%. Agreement between CTC and OC classifications was only 44%, and CTC agreement with the combined reference standard was 56%. CONCLUSION: Radiologist agreement when using the Paris classification at CT colonography is low, and radiologist classification agrees poorly with colonoscopy. Using the full Paris classification in routine CTC reporting is of questionable value. CLINICAL RELEVANCE STATEMENT: Interobserver agreement for radiologists using the Paris classification to categorise colorectal polyp morphology is only fair; routine use of the full Paris classification at CT colonography is questionable. KEY POINTS: • Overall interobserver agreement for the Paris classification at CT colonography (CTC) was only fair, and lower than for colonoscopy. • Agreement was higher for radiologists with < 1500 CTC experience and for larger polyps. There was substantial agreement when classifying polyps as protuberant vs flat. • Agreement between CTC and colonoscopic polyp classification was low (44%).

Discrepancies between self- and informant-ratings of functional abilities and objective cognition: predictors of bias in mild cognitive impairment.

OBJECTIVE: Self- and informant-ratings of functional abilities are used to diagnose mild cognitive impairment (MCI) and are commonly measured in clinical trials. Ratings are assumed to be accurate, yet they are subject to biases. Biases in self-ratings have been found in individuals with dementia who are older and more depressed and in caregivers with higher distress, burden, and education. This study aimed to extend prior findings using an objective approach to identify determinants of bias in ratings. METHOD: Participants were 118 individuals with MCI and their informants. Three discrepancy variables were generated including the discrepancies between (1) self- and informant-rated functional status, (2) informant-rated functional status and objective cognition (in those with MCI), and (3) self-rated functional status and objective cognition. These variables served as dependent variables in forward linear regression models, with demographics, stress, burden, depression, and self-efficacy as predictors. RESULTS: Informants with higher stress rated individuals with MCI as having worse functional abilities relative to objective cognition. Individuals with MCI with worse self-efficacy rated their functional abilities as being worse compared to objective cognition. Informant-ratings were worse than self-ratings for informants with higher stress and individuals with MCI with higher self-efficacy. CONCLUSION: This study highlights biases in subjective ratings of functional abilities in MCI. The risk for relative underreporting of functional abilities by individuals with higher stress levels aligns with previous research. Bias in individuals with MCI with higher self-efficacy may be due to anosognosia. Findings have implications for the use of subjective ratings for diagnostic purposes and as outcome measures.

An assessment of the informative value of data sharing statements in clinical trial registries.

BACKGROUND: The provision of data sharing statements (DSS) for clinical trials has been made mandatory by different stakeholders. DSS are a device to clarify whether there is intention to share individual participant data (IPD). What is missing is a detailed assessment of whether DSS are providing clear and understandable information about the conditions for data sharing of IPD for secondary use. METHODS: A random sample of 200 COVID-19 clinical trials with explicit DSS was drawn from the ECRIN clinical research metadata repository. The DSS were assessed and classified, by two experienced experts and one assessor with less experience in data sharing (DS), into different categories (unclear, no sharing, no plans, yes but vague, yes on request, yes with specified storage location, yes but with complex conditions). RESULTS: Between the two experts the agreement was moderate to substantial (kappa=0.62, 95% CI [0.55, 0.70]). Agreement considerably decreased when these experts were compared with a third person who was less experienced and trained in data sharing ("assessor") (kappa=0.33, 95% CI [0.25, 0.41]; 0.35, 95% CI [0.27, 0.43]). Between the two experts and under supervision of an independent moderator, a consensus was achieved for those cases, where both experts had disagreed, and the result was used as "gold standard" for further analysis. At least some degree of willingness of DS (data sharing) was expressed in 63.5% (127/200) cases. Of these cases, around one quarter (31/127) were vague statements of support for data sharing but without useful detail. In around half of the cases (60/127) it was stated that IPD could be obtained by request. Only in in slightly more than 10% of the cases (15/127) it was stated that the IPD would be transferred to a specific data repository. In the remaining cases (21/127), a more complex regime was described or referenced, which could not be allocated to one of the three previous groups. As a result of the consensus meetings, the classification system was updated. CONCLUSION: The study showed that the current DSS that imply possible data sharing are often not easy to interpret, even by relatively experienced staff. Machine based interpretation, which would be necessary for any practical application, is currently not possible. Machine learning and / or natural language processing techniques might improve machine actionability, but would represent a very substantial investment of research effort. The cheaper and easier option would be for data providers, data requestors, funders and platforms to adopt a clearer, more structured and more standardised approach to specifying, providing and collecting DSS. TRIAL REGISTRATION: The protocol for the study was pre-registered on ZENODO ( https://zenodo.org/record/7064624#.Y4DIAHbMJD8 ).

Recommendations for Additional Imaging on Head and Neck Imaging Examinations: Interradiologist Variation and Associated Factors.

BACKGROUND. A paucity of relevant guidelines may lead to pronounced variation among radiologists in issuing recommendations for additional imaging (RAI) for head and neck imaging. OBJECTIVE. The purpose of this article was to explore associations of RAI for head and neck imaging examinations with examination, patient, and radiologist factors and to assess the role of individual radiologist-specific behavior in issuing such RAI. METHODS. This retrospective study included 39,200 patients (median age, 58 years; 21,855 women, 17,315 men, 30 with missing sex information) who underwent 39,200 head and neck CT or MRI examinations, interpreted by 61 radiologists, from June 1, 2021, through May 31, 2022. A natural language processing (NLP) tool with manual review of NLP results was used to identify RAI in report impressions. Interradiologist variation in RAI rates was assessed. A generalized mixed-effects model was used to assess associations between RAI and examination, patient, and radiologist factors. RESULTS. A total of 2943 (7.5%) reports contained RAI. Individual radiologist RAI rates ranged from 0.8% to 22.0% (median, 7.1%; IQR, 5.2-10.2%), representing a 27.5-fold difference between minimum and a maximum values and 1.8-fold difference between 25th and 75th percentiles. In multivariable analysis, RAI likelihood was higher for CTA than for CT examinations (OR, 1.32), for examinations that included a trainee in report generation (OR, 1.23), and for patients with self-identified race of Black or African American versus White (OR, 1.25); was lower for male than female patients (OR, 0.90); and was associated with increasing patient age (OR, 1.09 per decade) and inversely associated with radiologist years since training (OR, 0.90 per 5 years). The model accounted for 10.9% of the likelihood of RAI. Of explainable likelihood of RAI, 25.7% was attributable to examination, patient, and radiologist factors; 74.3% was attributable to radiologist-specific behavior. CONCLUSION. Interradiologist variation in RAI rates for head and neck imaging was substantial. RAI appear to be more substantially associated with individual radiologist-specific behavior than with measurable systemic factors. CLINICAL IMPACT. Quality improvement initiatives, incorporating best practices for incidental findings management, may help reduce radiologist preference-sensitive decision-making in issuing RAI for head and neck imaging and associated care variation.

A pilot rating system to evaluate the quality of goal attainment scales used as outcome measures in rehabilitation.

Goal Attainment Scaling (GAS) is a method for writing person-centred approach evaluation scales that can be used as an outcome measure in clinical or research settings in rehabilitation. To be used in a research setting, it requires a high methodological quality approach. The aim of this study was to explore the feasibility and reliability of the GAS quality rating system, to ensure that GAS scales used as outcome measures are valid and reliable. Secondary objectives were: (1) to compare goal attainment scores' reliability according to how many GAS levels are described in the scale; and (2) to explore if GAS scorings are influenced by who scores goal attainment. The GAS scales analysed here were set collaboratively by 57 cognitively impaired adults clients and their occupational therapist. Goals had to be achieved within an inpatient one-month stay, during which clients participated in an intervention aimed at improving planning skills in daily life. The GAS quality rating system proved to be feasible and reliable. Regarding GAS scores, interrater reliability was higher when only three of the five GAS levels were described, i.e., "three milestone GAS" (0.74-0.92), than when all five levels were described (0.5-0.88), especially when scored by the clients (0.5 -0.88).

Inter-observer reproducibility of the 2021 AAGL Endometriosis Classification.

BACKGROUND: Inter-observer agreement for the American Association of Gynecologic Laparoscopists (AAGL) 2021 Endometriosis Classification staging system has not been described. Its predecessor staging system, the revised American Society for Reproductive Medicine (rASRM), has historically demonstrated poor inter-observer agreement. AIMS: We aimed to determine the inter-observer agreement performance of the AAGL 2021 Endometriosis Classification staging system, and compare this with the rASRM staging system. MATERIALS AND METHODS: A database of 317 patients with coded surgical data was retrospectively analysed. Three independent observers allocated AAGL surgical stages (1-4), twice. Observers made their own interpretation of how to apply the tool in the first staging allocation. Consensus rules were then developed for a second staging allocation. RESULTS: First staging allocation: odds ratio (OR) (and 95% CI) for observer 1 to score higher than observer 2 was 8.08 (5.12-12.76). Observer 1 to score higher than observer 3 was 12.98 (7.99-21.11) and observer 2 to score higher than observer 3 was 1.61 (1.03-2.51). This represents poor agreement. Second staging allocation (after consensus): OR for observer 1 to score higher than observer 2 was 1.14 (0.64-2.03), observer 1 to score higher than observer 3 was 1.81 (0.99-3.28) and observer 2 to score higher than observer 3 was 1.59 (0.87-2.89). This represents good agreement. CONCLUSIONS: These findings suggest that in its current format the AAGL 2021 Endometriosis Classification staging system has poor inter-observer agreement, not superior to the rASRM staging system. However, performance improved when additional measures were taken to simplify and clarify areas of ambiguity in interpreting the staging system.

Diagnostic accuracy of non-contrast MRI in frozen shoulder.

INTRODUCTION: Despite being the most used exam today, few studies have evaluated the accuracy of findings on non-contrast magnetic resonance imaging (MRI). The primary objective of the study was to evaluate the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of non-contrast MRI findings in frozen shoulder, isolated and in combination. The secondary objectives were to define the interobserver and intraobserver agreement of the assessments and the odds ratio for frozen shoulder because of the various findings of MRI. METHODS: A retrospective diagnostic accuracy study comparing non-contrast MRI findings between the frozen shoulder group and the control group. Sensitivity, specificity, positive and negative predictive value, accuracy, odds ratio, interobserver and intraobserver agreement were calculated for each finding and their possible associations. RESULTS: The hyperintensity on capsule in the axillary recess presented 84% sensitivity, 94% specificity, and 89% accuracy. The obliteration of the subcoracoid fat triangle in the rotator interval had sensitivity 34%, specificity 82% and accuracy 58%. For coracohumeral ligament thickness ≥ 2 mm had specificity 66%, 48% specificity and 57% accuracy. Capsule thickness in the axillary recess ≥ 4 mm resulted in 54% sensitivity, 82% specificity, and 68% accuracy. Regarding interobserver agreement, only the posteroinferior and posterosuperior quadrants showed moderate results, and all the others showed strong reliability. The odds ratio for hyperintensity in the axillary recess was 82.3 for frozen shoulder. The association of these findings increased specificity (95%). CONCLUSION: The accuracy of non-contrast magnetic resonance imaging is high for diagnosing frozen shoulder, especially when evaluating the hyperintensity of the axillary recess. The exam has high reliability and reproducibility. The presence of an association of signs increases the specificity of the test. LEVEL OF EVIDENCE: Level III, study of diagnostic test.

Chest radiograph classification and severity of suspected COVID-19 by different radiologist groups and attending clinicians: multi-reader, multi-case study.

OBJECTIVES: To quantify reader agreement for the British Society of Thoracic Imaging (BSTI) diagnostic and severity classification for COVID-19 on chest radiographs (CXR), in particular agreement for an indeterminate CXR that could instigate CT imaging, from single and paired images. METHODS: Twenty readers (four groups of five individuals)-consultant chest (CCR), general consultant (GCR), and specialist registrar (RSR) radiologists, and infectious diseases clinicians (IDR)-assigned BSTI categories and severity in addition to modified Covid-Radiographic Assessment of Lung Edema Score (Covid-RALES), to 305 CXRs (129 paired; 2 time points) from 176 guideline-defined COVID-19 patients. Percentage agreement with a consensus of two chest radiologists was calculated for (1) categorisation to those needing CT (indeterminate) versus those that did not (classic/probable, non-COVID-19); (2) severity; and (3) severity change on paired CXRs using the two scoring systems. RESULTS: Agreement with consensus for the indeterminate category was low across all groups (28-37%). Agreement for other BSTI categories was highest for classic/probable for the other three reader groups (66-76%) compared to GCR (49%). Agreement for normal was similar across all radiologists (54-61%) but lower for IDR (31%). Agreement for a severe CXR was lower for GCR (65%), compared to the other three reader groups (84-95%). For all groups, agreement for changes across paired CXRs was modest. CONCLUSION: Agreement for the indeterminate BSTI COVID-19 CXR category is low, and generally moderate for the other BSTI categories and for severity change, suggesting that the test, rather than readers, is limited in utility for both deciding disposition and serial monitoring. KEY POINTS: • Across different reader groups, agreement for COVID-19 diagnostic categorisation on CXR varies widely. • Agreement varies to a degree that may render CXR alone ineffective for triage, especially for indeterminate cases. • Agreement for serial CXR change is moderate, limiting utility in guiding management.

Noninvasive assessment of paediatric hepatic steatosis by using attenuation imaging.

OBJECTIVES: To evaluate the diagnostic performance of attenuation imaging (ATI) with an ultrasound scanner (US) in the detection of paediatric hepatic steatosis. METHODS: Ninety-four prospectively enrolled children were classified into normal weight and overweight/obese (OW/OB) groups according to body mass index (BMI). US findings, including hepatic steatosis grade and ATI value, were examined by two radiologists. Anthropometric and biochemical parameters were obtained, and nonalcoholic fatty liver disease (NAFLD) scores, including the Framingham steatosis index (FSI) and hepatic steatosis index (HSI), were calculated. RESULTS: After screening, 49 OW/OB and 40 normal weight children aged 10-18 years old (55 males and 34 females) participated in this study. The ATI value was significantly higher in the OW/OB group than in the normal weight group and showed a significant positive correlation with BMI, serum alanine transferase (ALT), uric acid, and NAFLD scores (p < 0.05). In the multiple linear regression adjusted for age, sex, BMI, ALT, uric acid, and HSI, ATI showed a significant positive association with BMI and ALT (p < 0.05). The receiver operating characteristic analysis showed a very good ability of ATI to predict hepatic steatosis. The intraclass correlation coefficient (ICC) of interobserver variability was 0.92, and the ICCs of intraobserver variability were 0.96 and 0.93 (p < 0.05). According to the two-level Bayesian latent class model analysis, the diagnostic performance of ATI showed the best performance for predicting hepatic steatosis among other known noninvasive NAFLD predictors. CONCLUSIONS: This study suggests that ATI is an objective and possible surrogate screening test for detecting hepatic steatosis in paediatric patients with obesity. CLINICAL RELEVANCE STATEMENT: Using ATI as a quantitative tool in hepatic steatosis allows clinicians to estimate the extent of the condition and track changes over time. This is helpful for monitoring disease progression and guiding treatment decisions, especially in paediatric practice. KEY POINTS: • Attenuation imaging is a noninvasive US-based method for the quantification of hepatic steatosis. • Attenuation imaging values were significantly higher in the OW/OB and steatosis groups than in the normal weight and no steatosis groups, respectively, with a meaningful correlation with known clinical indicators of nonalcoholic fatty liver disease. • Attenuation imaging performs better than other noninvasive predictive models used to diagnose hepatic steatosis.

Determination of arterial invasion in pancreatic ductal adenocarcinoma: what is the best diagnostic criterion on CT?

OBJECTIVES: To investigate the diagnostic performance and interobserver variability in the determination of arterial invasion in pancreatic ductal adenocarcinoma (PDAC) and determine the best CT imaging criterion. METHODS: We retrospectively evaluated 128 patients with PDAC (73 men and 55 women) who underwent preoperative contrast-enhanced CT. Five board-certified radiologists (expert) and four fellows (non-expert]) independently assessed the arterial invasion (celiac, superior mesenteric, splenic, and common hepatic arteries) using a 6-point score: 1, no tumor contact; 2, hazy attenuation ≤ 180°; 3, hazy attenuation > 180°; 4, solid soft tissue contact ≤ 180°; 5, solid soft tissue contact > 180°; and 6, contour irregularity. ROC analysis was performed to evaluate the diagnostic performance and determine the best diagnostic criterion for arterial invasion, with pathological or surgical findings as references. Interobserver variability was assessed using Fleiss's ĸ statistics. RESULTS: Among the 128 patients, 35.2% (n = 45/128) received neoadjuvant treatment (NTx). Solid soft tissue contact ≤ 180° was the best diagnostic criterion for arterial invasion as defined by the Youden Index both in patients who did and did not receive NTx (sensitivity, 100% vs. 100%; specificity, 90% vs. 93%; and AUC, 0.96 vs. 0.98, respectively). Interobserver variability among the non-expert was not inferior to that among the expert (ĸ = 0.61 vs 0.61; p = .39 and ĸ = 0.59 vs 0.51; p < .001 in patients treated with and without NTx, respectively). CONCLUSIONS: Solid soft tissue contact ≤ 180° was the best diagnostic criterion for the determination of arterial invasion in PDAC. Considerable interobserver variability was seen among the radiologists. KEY POINTS: • Solid soft tissue contact ≤ 180° was the best diagnostic criterion for the determination of arterial invasion in pancreatic ductal adenocarcinoma. • Interobserver agreement among non-expert radiologists was almost comparable to that among expert radiologists.

CT-based Bosniak classification of cystic renal lesions: is version 2019 an improvement on version 2005?

OBJECTIVE: To compare the diagnostic performance and inter-reader agreement of the CT-based v2019 versus v2005 Bosniak classification systems for risk stratification of cystic renal lesions (CRL). METHODS: This retrospective study included adult patients with CRL identified on CT scan between 2005 and 2018. The reference standard was histopathology or a minimum 4-year imaging follow-up. The studies were reviewed independently by five readers (three senior, two junior), blinded to pathology results and imaging follow-up, who assigned Bosniak categories based on the 2005 and 2019 versions. Diagnostic performance of v2005 and v2019 Bosniak classifications for distinguishing benign from malignant lesions was calculated by dichotomizing CRL into the potential for ablative therapy (III-IV) or conservative management (I-IIF). Inter-reader agreement was calculated using Light's Kappa. RESULTS: One hundred thirty-nine patients with 149 CRL (33 malignant) were included. v2005 and v2019 Bosniak classifications achieved similar diagnostic performance with a sensitivity of 91% vs 91% and a specificity of 89% vs 88%, respectively. Inter-reader agreement for overall Bosniak category assignment was substantial for v2005 (κ = 0.78) and v2019 (κ = 0.75) between senior readers but decreased for v2019 when the Bosniak classification was dichotomized to conservative management (I-IIF) or ablative therapy (III-IV) (0.80 vs 0.71, respectively). For v2019, wall thickness was the morphological feature with the poorest inter-reader agreement (κ = 0.43 and 0.18 for senior and junior readers, respectively). CONCLUSION: No significant improvement in diagnostic performance and inter-reader agreement was shown between v2005 and v2019. The observed decrease in inter-reader agreement in v2019 when dichotomized according to management strategy may reflect the more stringent morphological criteria. KEY POINTS: • Versions 2005 and 2019 Bosniak classifications achieved similar diagnostic performance, but the specificity of higher risk categories (III and IV) was not increased while one malignant lesion was downgraded to v2019 Bosniak category II (i.e., not subjected to further follow-up). • Inter-reader agreement was similar between v2005 and v2019 but moderately decreased for v2019 when the Bosniak classification was dichotomized according to the potential need for ablative therapies (I-II-IIF vs III-IV).

A standardized method to measure the membranous urethral length (MUL) on MRI of the prostate with high inter- and intra-observer agreement.

OBJECTIVES: The membranous urethral length (MUL), defined as the length between the apex and penile base as measured on preoperative prostate magnetic resonance imaging (MRI), is an important predictor for urinary incontinence after radical prostatectomy. Literature on inter- and intra - observer agreement of MUL measurement is limited. We studied the inter- and intra-observer agreement between radiologists using a well-defined method to measure the MUL on the prostate MRI. METHODS: Prostate cancer patients underwent a preoperative MRI and robot-assisted radical prostatectomy (RARP) at one high-volume RARP center. MUL measurement was based on well-defined landmarks on sagittal T2-weighted (anatomical) images. Three radiologists independently performed MUL measurements retrospectively in 106 patients blinded to themselves, to each other, and to clinical outcomes. The inter- and intra-observer agreement of MUL measurement between the radiologists were calculated, expressed as intra-class correlation coefficient (ICC). RESULTS: The initial inter-observer agreement was ICC 0.63; 95% confidence interval (CI) 0.28-0.81. Radiologist 3 measured the MUL mean 3.9 mm (SD 3.3) longer than the other readers, interpreting the caudal point of the MUL (penile base) differently. After discussion on the correct anatomical definition, radiologist 3 re-assessed all scans, which resulted in a high inter-observer agreement (ICC 0.84; 95% CI 0.66-0.91). After a subsequent reading by radiologists 1 and 2, the intra-observer agreements were ICC 0.93; 95% CI 0.89-0.96, and ICC 0.98; 95% CI 0.97-0.98, respectively. Limitation is the monocenter design. CONCLUSIONS: The MUL can be measured reliably with high agreement among radiologists. KEY POINTS: • After discussion on the correct anatomical definition, the inter- and intra - observer agreements of membranous urethral length (MUL) measurement on magnetic resonance imaging (MRI) were high. • A reproducible method to measure the MUL can improve the clinical usefulness of prediction models for urinary continence after RARP which may benefit patient counselling.

Automated diagnosis of flatfoot using cascaded convolutional neural network for angle measurements in weight-bearing lateral radiographs.

OBJECTIVES: Diagnosis of flatfoot using a radiograph is subject to intra- and inter-observer variabilities. Here, we developed a cascade convolutional neural network (CNN)-based deep learning model (DLM) for an automated angle measurement for flatfoot diagnosis using landmark detection. METHODS: We used 1200 weight-bearing lateral foot radiographs from young adult Korean males for the model development. An experienced orthopedic surgeon identified 22 radiographic landmarks and measured three angles for flatfoot diagnosis that served as the ground truth (GT). Another orthopedic surgeon (OS) and a general physician (GP) independently identified the landmarks of the test dataset and measured the angles using the same method. External validation was performed using 100 and 17 radiographs acquired from a tertiary referral center and a public database, respectively. RESULTS: The DLM showed smaller absolute average errors from the GT for the three angle measurements for flatfoot diagnosis compared with both human observers. Under the guidance of the DLM, the average errors of observers OS and GP decreased from 2.35° ± 3.01° to 1.55° ± 2.09° and from 1.99° ± 2.76° to 1.56° ± 2.19°, respectively (both p < 0.001). The total measurement time decreased from 195 to 135 min in observer OS and from 205 to 155 min in observer GP. The absolute average errors of the DLM in the external validation sets were similar or superior to those of human observers in the original test dataset. CONCLUSIONS: Our CNN model had significantly better accuracy and reliability than human observers in diagnosing flatfoot, and notably improved the accuracy and reliability of human observers. KEY POINTS: • Development of deep learning model (DLM) that allows automated angle measurements for landmark detection based on 1200 weight-bearing lateral radiographs for diagnosing flatfoot. • Our DLM showed smaller absolute average errors for flatfoot diagnosis compared with two human observers. • Under the guidance of the model, the average errors of two human observers decreased and total measurement time also decreased from 195 to 135 min and from 205 to 155 min.

Anastomotic perfusion assessment with indocyanine green in robot-assisted low-anterior resection, a multicenter study of interobserver variation.

BACKGROUND: Securing sufficient blood perfusion to the anastomotic area after low-anterior resection is a crucial factor in preventing anastomotic leakage (AL). Intra-operative indocyanine green fluorescent imaging (ICG-FI) has been suggested as a tool to assess perfusion. However, knowledge of inter-observer variation among surgeons in the interpretation of ICG-FI is sparse. Our primary objective was to evaluate inter-observer variation among surgeons in the interpretation of bowel blood-perfusion assessed visually by ICG-FI. Our secondary objective was to compare the results both from the visual assessment of ICG and from computer-based quantitative analyses of ICG-FI between patients with and without the development of AL. METHOD: A multicenter study, including patients undergoing robot-assisted low anterior resection with stapled anastomosis. ICG-FI was evaluated visually by the surgeon intra-operatively. Postoperatively, recorded videos were anonymized and exchanged between centers for inter-observer evaluation. Time to visibility (TTV), time to maximum visibility (TMV), and time to wash-out (TWO) were visually assessed. In addition, the ICG-FI video-recordings were analyzed using validated pixel analysis software to quantify blood perfusion. RESULTS: Fifty-five patients were included, and five developed clinical AL. Bland-Altman plots (BA plots) demonstrated wide inter-observer variation for visually assessed fluorescence on all parameters (TTV, TMV, and TWO). Comparing leak-group with no-leak group, we found no significant differences for TTV: Hazard Ratio; HR = 0.82 (CI 0.32; 2.08), TMV: HR = 0.62 (CI 0.24; 1.59), or TWO: HR = 1.11 (CI 0.40; 3.11). In the quantitative pixel analysis, a lower slope of the fluorescence time-curve was found in patients with a subsequent leak: median 0.08 (0.07;0.10) compared with non-leak patients: median 0.13 (0.10;0.17) (p = 0.04). CONCLUSION: The surgeon's visual assessment of the ICG-FI demonstrated wide inter-observer variation, there were no differences between patients with and without AL. However, quantitative pixel analysis showed a significant difference between groups. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04766060.

Reliability and agreement in intrapartum fetal heart rate monitoring interpretation: A systematic review.

INTRODUCTION: Fetal heart rate (FHR) monitoring is routine in intrapartum care worldwide and one of the most common obstetrical procedures. Intrapartum FHR monitoring helps assess fetal wellbeing and interpretation of the FHR help form decisions for clinical management and intervention. It relies on the observers' subjective assessments, with variation in interpretations leading to variations in intrapartum care. The purpose of this systematic review was to summarize and evaluate extant inter- and intrarater reliability research on the human interpretation of intrapartum FHR monitoring. MATERIAL AND METHODS: We searched for the terms "fetal heart rate monitoring," "interpretation agreement" and related concepts on Embase, Medline, Maternity and Infant Care Database and CINAHL. The last search was made on January 31, 2022. The protocol for the study was prospectively registered in PROSPERO (CRD42021260937). Studies that assess inter- and intrarater reliability and agreement of health professionals' intrapartum FHR monitoring were included and studies including other assessment of fetal wellbeing excluded. We extracted data in reviewer pairs using quality appraisal tool for studies of diagnostic reliability (QAREL) forms. The data retrieved from the studies are presented as narrative synthesis and in additional tables. RESULTS: Forty-nine articles concerning continuous FHR monitoring were included in the study. For interrater reliability and agreement, in total 577 raters assessed 6315 CTG tracings. There was considerable heterogeneity in quality and measures across the included articles. We found higher reliability and agreement for the basic FHR features than for overall classification and higher agreement for intrarater reliability and agreement than for their interrater counterparts. CONCLUSIONS: There is great variation in reliability and agreement measures for continuous intrapartum FHR monitoring, implying that intrapartum CTG should be used with caution for clinical decision making given its questionable reliability. We found few high-quality studies and noted methodological concerns in the studies. We recommend a more standardized approach to future reliability studies on FHR monitoring.

Ultrasound attenuation imaging: a reproducible alternative for the noninvasive quantitative assessment of hepatic steatosis in children.

BACKGROUND: Pediatric hepatic steatosis is a global public health concern, as an increasing number of children are affected by this condition. Liver biopsy is the gold standard diagnostic method; however, this procedure is invasive. Magnetic resonance imaging (MRI)-derived proton density fat fraction has been accepted as an alternative to biopsy. However, this method is limited by cost and availability. Ultrasound (US) attenuation imaging is an upcoming tool for noninvasive quantitative assessment of hepatic steatosis in children. A limited number of publications have focused on US attenuation imaging and the stages of hepatic steatosis in children. OBJECTIVE: To analyze the usefulness of ultrasound attenuation imaging for the diagnosis and quantification of hepatic steatosis in children. MATERIAL AND METHODS: Between July and November 2021, 174 patients were included and divided into two groups: group 1, patients with risk factors for steatosis (n = 147), and group 2, patients without risk factors for steatosis (n = 27). In all cases, age, sex, weight, body mass index (BMI), and BMI percentile were determined. B-mode US (two observers) and US attenuation imaging with attenuation coefficient acquisition (two independent sessions, two different observers) were performed in both groups. Steatosis was classified into four grades (0: absent, 1: mild, 2: moderate and 3: severe) using B-mode US. Attenuation coefficient acquisition was correlated with steatosis score according to Spearman's correlation. Attenuation coefficient acquisition measurements' interobserver agreement was assessed using intraclass correlation coefficients (ICC). RESULTS: All attenuation coefficient acquisition measurements were satisfactory without technical failures. The median values for group 1 for the first session were 0.64 (0.57-0.69) dB/cm/MHz and 0.64 (0.60-0.70) dB/cm/MHz for the second session. The median values for group 2 for the first session were 0.54 (0.51-0.56) dB/cm/MHz and 0.54 (0.51-0.56) dB/cm/MHz for the second. The average attenuation coefficient acquisition was 0.65 (0.59-0.69) dB/cm/MHz for group 1 and 0.54 (0.52-0.56) dB/cm/MHz for group 2. There was excellent interobserver agreement at 0.94 (95% CI 0.92-0.96). There was substantial agreement between both observers (κ = 0.77, with a P < 0.001). There was a positive correlation between ultrasound attenuation imaging and B-mode scores for both observers (r = 0.87, P < 0.001 for observer 1; r = 0.86, P < 0.001 for observer 2). Attenuation coefficient acquisition median values were significantly different for each steatosis grade (P < 0.001). In the assessment of steatosis by B-mode US, the agreement between the two observers was moderate (κ = 0.49 and κ = 0.55, respectively, with a P < 0.001 in both cases). CONCLUSION: US attenuation imaging is a promising tool for the diagnosis and follow-up of pediatric steatosis, which provides a more repeatable form of classification, especially at low levels of steatosis detectable in B-mode US.

Interobserver Variability and Accuracy of Preoperative CT and MRI in Pancreatic Ductal Adenocarcinoma Size Estimation: A Retrospective Cohort Study.

Purpose: To assess interobserver variability and accuracy of preoperative computed tomography (CT) and magnetic resonance imaging (MRI) in pancreatic ductal adenocarcinoma (PDAC) size estimation using surgical specimens as standard of reference. Methods: Patients with PDAC who underwent preoperative CT and MRI examinations before surgery were included. PDAC largest axial dimension was measured by 2 readers on 8 MRI sequence and 2 CT imaging phases (pancreatic parenchymal and portal venous). Measurements were compared to actual tumour size at pathologic examination. Interobserver variability was assessed using intraclass correlation coefficients (ICC) and Bland-Altman plots. Differences in tumour size (Δdiameter) between imaging and actual tumour size were searched using Wilcoxon rank sum test. Results: Twenty-nine patients (16 men; median age, 70 years) with surgically resected PDAC were included. Interobserver reproducibility was good to excellent for all MRI sequences and the 2 CT imaging phases with ICCs between .862 (95%CI: .692-.942) for fat-saturated in-phase T1-weighted sequence and .955 (95%CI: .898-.980) for portal venous phase CT images. Best accuracy in PDAC size measurement was obtained with pancreatic parenchymal phase CT images with median Δdiameters of -2 mm for both readers, mean relative differences of -9% and -6% and no significant differences with dimensions at histopathological analysis (P = .051). All MRI sequences led to significant underestimation of PDAC size (median Δdiameters, -6 to -1 mm; mean relative differences, -21% to -11%). Conclusions: Most accurate measurement of PDAC size is obtained with CT images obtained during the pancreatic parenchymal phase. MRI results in significant underestimation of PDAC size.