Evaluation of Fetal Heart Using Fetal Heart Quantification (fetalHQ) Technique in an Indian Cohort.

OBJECTIVE: To evaluate the intra- and interobserver reproducibility of parameters used to determine cardiac morphometry and deformation using FetalHQ in Indian population. METHODOLOGY: Two operators blinded to each other performed FetalHQ analysis independently on 35 normal fetuses of gestational age between 18 + 0 and 37 + 0 weeks and days. Intra- and interobserver correlation coefficient and limits of agreement were ascertained for parameters obtained from HQ analysis. RESULTS: Excellent reproducibility (ICC > 0.9) was observed for global morphometric parameters. Ejection fraction, stroke volume, stroke volume/kg demonstrated excellent reliability (ICC > 0.9), cardiac output, fractional area change showed a lower correlation (ICC < 0.8), and right and left ventricular global strain showed no correlation. Twenty-four segment sphericity index of left ventricle (LV) and right ventricle (RV) showed low to moderate correlation (LV-ICC 0.48-0.79; RV-ICC 0.43-0.82). Fractional shortening (FS) showed poor intraobserver reliability in RV. CONCLUSION: FetalHQ provides reliable estimates of the global cardiac morphometry but not for global cardiac strain. Regional transverse contractility represented by FS has poor correlation in right ventricle, especially in the apical region, possibly due to moderator band. Nevertheless, it is a promising tool which requires technical advancements and validation to improve its accuracy and reliability.

Knowledge, attitudes, and practices of endoscopy among gastroenterologists in diagnosis and management of inflammatory bowel disease in China: a multicenter cross-sectional study.

BACKGROUND: The aim was to assess the knowledge, attitudes, and practices (KAPs) of endoscopy among gastroenterologists in the diagnosis and management of IBD in China. METHODS: A multicenter cross-sectional KAP study was performed. The questionnaire was developed and improved using feedback and opinions from a team of experienced IBD specialist professors and then distributed and collected online. In addition, eight fellow gastroenterologists participated in an IBD endoscopy training program were asked to review endoscopic images, and the consistency of the endoscopic scores before and after training was calculated. RESULTS: A total of 193 participants from 12 provincial-level administrative regions encompassing both the Northern and Southern parts of China completed the study questionnaire. The median age of the participants was 40 (36, 45) years, with the majority being female (70.5%). The median professional experience as gastroenterologists was 11 (7, 17) years, while the median experience as endoscopists was 8 (3, 15) years. The median knowledge score was 8 out of 10 points for single-choice questions; however, most gastroenterologists believed that some concepts in these endoscopic indices were vague, including those regarding deep ulcerations, ulcerated surfaces, affected surfaces and narrowing in open-answer questions. The UCEIS and SES-CD were considered most consistent with clinical activity score in the evaluation of UC and CD, respectively. IBD subspecialists and gastroenterologists who had previously received IBD endoscopy screening training were more likely to use endoscopic indices (p<0.001, p = 0.029, respectively). The Rutgeerts score demonstrated the most significant improvement in consistency before and after training, from 0.407 (95% CI: 0.025-0.999) to 0.909 (95% CI: 0.530-1.000). CONCLUSIONS: We propose the elucidation of ambiguous definitions in endoscopic indices, enhancement of training, and the application of innovative technology to enhance the application of endoscopic evaluation and endoscopic indices in clinical practice.

Optimized target delineation procedure for the radiosurgery treatment of ventricular tachycardia: observer-independent accuracy.

Background: Part of the current stereotactic arrythmia radioablation (STAR) workflow is transfer of findings from the electroanatomic mapping (EAM) to computed tomography (CT). Here, we analyzed inter- and intraobserver variation in a modified EAM-CT registration using automatic registration algorithms designed to yield higher robustness. Materials and methods: This work is based on data of 10 patients who had previously undergone STAR. Two observers participated in this study: (1) an electrophysiologist technician (cardiology) with substatial experience in EAM-CT merge, and (2) a clinical engineer (radiotherapy) with minimum experience with EAM-CT merge. EAM-CT merge consists of 3 main steps: segmentation of left ventricle from CT (CT LV), registration of the CT LV and EAM, clinical target volume (CTV) delineation from EAM specific points. Mean Hausdorff distance (MHD), Dice Similarity Coefficient (DSC) and absolute difference in Center of Gravity (CoG) were used to assess intra/interobserver variability. Results: Intraobserver variability: The mean DSC and MHD for 3 CT LVs altogether was 0.92 ± 0.01 and 1.49 ± 0.23 mm. The mean DSC and MHD for 3 CTVs altogether was 0,82 ± 0,06 and 0,71 ± 0,22 mm. Interobserver variability: Segmented CT LVs showed great similarity (mean DSC of 0,91 ± 0,01, MHD of 1,86 ± 0,47 mm). The mean DSC comparing CTVs from both observers was 0,81 ± 0,11 and MHD was 0,87 ± 0,45 mm. Conclusions: The high interobserver similarity of segmented LVs and delineated CTVs confirmed the robustness of the proposed method. Even an inexperienced user can perform a precise EAM-CT merge following workflow instructions.

Posterior Cruciate Buckling Angle Variations Are Associated with Different Patterns of Medial Meniscus Tears in Anterior-Cruciate-Deficient Knees: Results of a Prospective Comparative Magnetic Imaging Resonance Study.

BACKGROUND: The diagnosis of anterior cruciate ligament (ACL) tear relies on clinical evaluation and magnetic resonance imaging (MRI). Direct and indirect signs of ACL tear have been described with MRI evaluation. Posterior cruciate ligament (PCL) buckling has been described as an indirect radiographic sign of an ACL tear. PURPOSE: The aim of the present study was to assess the variations in PCL buckling angles in patients with ACL tears and in patients with isolated lesions in the posterior horn of the medial meniscus. In addition, the influence of different patterns of medial meniscus tears in ACL-deficient knees was investigated. Finally, the influences of risk factors such as tibial slope, delay from injury to surgery, absence of medial meniscus tear, degree of Lachman and pivot shift testing were also assessed. STUDY DESIGN: This was a cohort study. METHODS: A total of 154 patients (78 in the group with ACL tear and 76 in the control group) were assessed with MRI and lateral weight-bearing X-ray to assess PCL buckling angle and tibial slope by two independent observers. The presence of a medial meniscus bucket handle or ramp lesion of the medial meniscus was assessed and recorded at the time of surgery. RESULTS: PCL buckling angle measurement was highly reliable, with an ICC of 0.866 and 0.894, respectively, in the study group and the control group for interobserver reliability. The intrarater reliability was found to be high in PCL buckling angle for the study group [ICC = 0.955] and the control group [ICC = 0.943]. The mean angle in patients with ACL tear was 110.7 ± 15.2° and 115.3 ± 16.2° (for the two examiners) and 111.4 ± 12° and 114 ± 14.5° (for the two examiners) in patients with an intact, healthy ACL. An association emerged between bucket handle tears of the medial meniscus (p = 0.010) and a decreased PCL buckling angle and between ramp lesions of the medial meniscus and increased PCL buckling angle both (p = 0.024). CONCLUSIONS: Good inter- and intraobserver reliability for the measurement of the PCL buckling angle was observed. Increased PCL buckling angle values were observed in patients with concomitant ACL and bucket handle tears of the medial meniscus, while decreased angle values were observed in those who had ACL tear and ramp lesion of the medial meniscus. No statistically significant difference in the PCL buckling angle emerged between patients with ACL tears and those who had a healthy, intact ACL.

Reliability of In Vivo Creatine-Weighted Chemical Exchange Saturation Transfer (CrCEST) MRI in Calf Skeletal Muscle of Healthy Volunteers at 3 T.

BACKGROUND: Skeletal muscle mitochondrial oxidative phosphorylation (mtOXPHOS) is important for ATP generation and its dysfunction leads to exercise intolerance. Phosphorus magnetic resonance spectroscopy (31P-MRS) is a useful, noninvasive technique for mtOXPHOS assessment but has limitations. Creatine-weighted chemical exchange saturation transfer (CrCEST) MRI is a potential alternative to assess muscle bioenergetics. PURPOSE: To evaluate the interscan repeatability, intra- and interobserver reproducibility of CrCEST during mild plantar flexion exercise. STUDY TYPE: Retrospective. SUBJECTS: Twenty healthy volunteers (age 37.6 ± 12.4 years, 11 females). FIELD STRENGTH/SEQUENCE: 3 T/CEST imaging using gradient echo readout. ASSESSMENT: τCrCEST (postexercise Cr recovery time) was assessed in two scans for each participant, following mild plantar flexion exercises targeting the medial gastrocnemius (MG), lateral gastrocnemius (LG), and soleus (Sol) muscles. Three observers measured τCrCEST for interobserver reproducibility. Three readings by one observer were used to measure intraobserver reproducibility. Two scans were used for within-participant interscan repeatability. STATISTICAL TESTS: Paired t tests, intraclass correlation coefficient (ICC), and Pearson correlation were conducted. Bland-Altman plots were used to analyze the interobserver variability. A P-value of 0.05 was considered statistically significant. RESULTS: There was excellent intra- (ICC ∈ 0.94 - 0.98 $$ \in \left[0.94-0.98\right] $$ ) and interobserver (ICC ∈ 0.9 - 0.98 $$ \in \left[0.9-0.98\right] $$ ) reproducibility, with moderate interscan repeatability for τCrCEST in LG and MG (ICC ∈ 0.54 - 0.74 $$ \in \left[0.54-0.74\right] $$ ) and poor-to-moderate interscan repeatability in Sol (ICC ∈ 0.24 - 0.53 $$ \in \left[0.24-0.53\right] $$ ). Excellent interobserver reproducibility was confirmed by Bland-Altman plots (fixed bias P-value ∈ 0.08 - 0.87 $$ \in \left[0.08-0.87\right] $$ ). DATA CONCLUSION: CrCEST MRI shows promise in assessing muscle bioenergetics by evaluating τCrCEST during mild plantar flexion exercise with reasonable reliability, particularly in LG and MG. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY: Stage 1.

Craniocervical Morphometry in Pomeranians-Part I: Intra-Observer, Interobserver, and Intermodality (CT vs. MRI) Agreement.

BACKGROUND: Currently, there are no diagnostic imaging-based studies that have focused specifically on the craniocervical morphology of Pomeranian dogs in relation to Chiari-like malformation and syringomyelia (CM/SM). The aims of Part I of this two-part study are to assess the intra-observer, interobserver, and intermodality reliability and agreement for various aspects of the craniocervical morphology of Pomeranians with and without CM/SM. METHODS: Prospectively, Pomeranians were included that underwent both CT and MRI studies of the head and cervicothoracic vertebral column. Two observers (experienced and novice) independently performed CM and SM classifications, qualitative assessments, and quantitative measurements. The experienced observer performed these assessments twice. A third observer (experienced) performed CM and SM normal or abnormal classifications. RESULTS: Ninety-nine (99) dogs were included. Interobserver reliability was influenced by observer experience level. For the experienced versus novice observers, substantial interobserver agreement was found for classification of SM as normal or abnormal (Cohen's kappa = 0.63), while interobserver agreement was fair for classification of SM as normal or abnormal (Cohen's kappa = 0.31). Interobserver, intra-observer, and intermodality reliability were variable for different measurements and assessments, and best overall for the CT-based measurements. CONCLUSIONS: Interobserver reliability and agreement results should be taken into account in the evaluation of results of future studies as well as the evaluation of imaging studies of Pomeranians presented clinically.

Understanding interobserver variability of pathologists to improve oral epithelial dysplasia grading.

OBJECTIVE: This study aimed to understand reasons for interobserver variability in the grading of oral epithelial dysplasia (OED) through a survey of pathologists to provide insight for improvements in the reliability and reproducibility of OED diagnoses. METHODS: The study design included quantitative and qualitative methodology. A pre-validated 31-item questionnaire was distributed to general, head and neck, and oral and maxillofacial histopathology specialists worldwide. RESULTS: A total of 132 pathologists participated and completed the questionnaire. Over two-thirds used the three-tier grading system for OED, while about a third used both binary and three-tier systems. Regular reporters of OED preferred the three-tier system and grading architectural features. Continuing education significantly aided recognition of architectural and cytological changes. Irregular epithelial stratification and drop-shaped rete ridges had the lowest prognostic value and recognition scores, while loss of epithelial cell cohesion had the highest. Most participants used clinical information and often sought a second opinion when grading OED. CONCLUSION: Our study has found that frequency of OED reporting and attendance of CME/CPD can play an important role in grading OED. Variations in the prognostic value of individual histological features and the use of clinical information may further contribute to interobserver variability.

Inter- and Intra-Observer Variability of the AMADEUS Tool for Osteochondral Lesions of the Talus.

BACKGROUND: Managing osteochondral cartilage defects (OCDs) of the talus is a common daily challenge in orthopaedics as they predispose patients to further cartilage damage and progression to osteoarthritis. Therefore, the implementation of a reliable tool to quantify the amount of cartilage damage that is present is of the essence. METHODS: We retrospectively identified 15 adult patients diagnosed with uncontained OCDs of the talus measuring <150 mm2, which were treated arthroscopically with bone marrow stimulation. Five independent assessors evaluated the pre-operative MRI scans with the AMADEUS scoring system (i.e., MR-based pre-operative assessment system) and the intra-/inter-observer variability was then calculated by means of the intraclass correlation coefficients (ICC) and Kappa (κ) statistics, respectively. In addition, the correlation between the mean AMADEUS scores and pre-operative self-reported outcomes as measured by the Manchester-Oxford foot questionnaire (MOxFQ) was assessed. RESULTS: The mean ICC and the κ statistic were 0.82 (95% CI [0.71, 0.94]) and 0.42 (95% CI [0.25, 0.59]). The Pearson correlation coefficient was found to be r = -0.618 (p = 0.014). CONCLUSIONS: The AMADEUS tool, which was originally designed to quantify knee osteochondral defect severity prior to cartilage repair surgery, demonstrated good reliability and moderate inter-observer variability for small OCDs of the talar shoulder. Given the strong negative correlation between the AMADEUS tool and pre-operative clinical scores, this tool could be implemented in clinical practise to reliably quantify the extent of the osteochondral defects of the talus.

Evaluation of the Clinical Efficacy and Trust in AI-Assisted Embryo Ranking: Survey-Based Prospective Study.

BACKGROUND: Current embryo assessment methods for in vitro fertilization depend on subjective morphological assessments. Recently, artificial intelligence (AI) has emerged as a promising tool for embryo assessment; however, its clinical efficacy and trustworthiness remain unproven. Simulation studies may provide additional evidence, provided that they are meticulously designed to mitigate bias and variance. OBJECTIVE: The primary objective of this study was to evaluate the benefits of an AI model for predicting clinical pregnancy through well-designed simulations. The secondary objective was to identify the characteristics of and potential bias in the subgroups of embryologists with varying degrees of experience. METHODS: This simulation study involved a questionnaire-based survey conducted on 61 embryologists with varying levels of experience from 12 in vitro fertilization clinics. The survey was conducted via Google Forms (Google Inc) in three phases: (1) phase 1, an initial assessment (December 23, 2022, to January 22, 2023); (2) phase 2, a validation assessment (March 6, 2023, to April 5, 2023); and (3) phase 3 an AI-guided assessment (March 6, 2023, to April 5, 2023). Inter- and intraobserver assessments and the accuracy of embryo selection from 360 day-5 embryos before and after AI guidance were analyzed for all embryologists and subgroups of senior and junior embryologists. RESULTS: With AI guidance, the interobserver agreement increased from 0.355 to 0.527 and from 0.440 to 0.524 for junior and senior embryologists, respectively, thus reaching similar levels of agreement. In a test of accurate embryo selection with 90 questions, the numbers of correct responses by the embryologists only, embryologists with AI guidance, and AI only were 34 (38%), 45 (50%), and 59 (66%), respectively. Without AI, the average score (accuracy) of the junior group was 33.516 (37%), while that of the senior group was 35.967 (40%), with P<.001 in the t test. With AI guidance, the average score (accuracy) of the junior group increased to 46.581 (52%), reaching a level similar to that of the senior embryologists of 44.833 (50%), with P=.34. Junior embryologists had a higher level of trust in the AI score. CONCLUSIONS: This study demonstrates the potential benefits of AI in selecting embryos with high chances of pregnancy, particularly for embryologists with 5 years or less of experience, possibly due to their trust in AI. Thus, using AI as an auxiliary tool in clinical practice has the potential to improve embryo assessment and increase the probability of a successful pregnancy.

Intra- and Interobserver Variability in Ultrasound Measurement of Testicular Volumes in Pubertal Boys.

Accurate measurement of testicular volume (TV) in boys is an important tool in clinical practice, e.g., in varicocele treatment. This study aims to assess the degree of intra- and interobserver variability of testicular volume measurements. In a prospective study, boys between 11 and 17 years of age without testicular pathology were enrolled. Testicular ultrasound was performed by three investigators (A: pediatric radiologist; B: pediatric surgery/urology resident; C: pediatric urologist). Intraobserver variability was calculated in investigators B and C and interobserver variability between all three investigators. A total of 30 boys were enrolled. Mean intraobserver variability in both observers was +0.3% with a range of -39.6 to 51.5%. The proportion of measurements with a difference >20% was 18.6%. The mean interobserver variability was -1.0% (range: -74.1% to 62.8%). The overall proportion of measurements with a difference >20% was 35%. A lower testicular size of < 4 mL showed a significantly higher rate of >20% difference in both the intraobserver group (31.1% vs. 14.4%; p = 0.035) and the interobserver group (63.2% vs. 26.2%; p = 0.000031). Furthermore, the rate of >20% difference was significantly lower in obese compared to non-obese patients in both the intraobserver (2.8% vs. 22.4%; p = 0.0084) and the interobserver group (24% vs. 40.8%, p = 0.0427). Both intraobserver and interobserver variability in ultrasound-based TV measurements in pubertal boys contain a relevant degree of uncertainty that renders them unsuitable for individualized follow-up care. At the cohort level, however, mean differences in ultrasound-based TV measurements are low enough to make ultrasound comparisons reasonable.

When Two Eyes Don't Suffice-Learning Difficult Hyperfluorescence Segmentations in Retinal Fundus Autofluorescence Images via Ensemble Learning.

Hyperfluorescence (HF) and reduced autofluorescence (RA) are important biomarkers in fundus autofluorescence images (FAF) for the assessment of health of the retinal pigment epithelium (RPE), an important indicator of disease progression in geographic atrophy (GA) or central serous chorioretinopathy (CSCR). Autofluorescence images have been annotated by human raters, but distinguishing biomarkers (whether signals are increased or decreased) from the normal background proves challenging, with borders being particularly open to interpretation. Consequently, significant variations emerge among different graders, and even within the same grader during repeated annotations. Tests on in-house FAF data show that even highly skilled medical experts, despite previously discussing and settling on precise annotation guidelines, reach a pair-wise agreement measured in a Dice score of no more than 63-80% for HF segmentations and only 14-52% for RA. The data further show that the agreement of our primary annotation expert with herself is a 72% Dice score for HF and 51% for RA. Given these numbers, the task of automated HF and RA segmentation cannot simply be refined to the improvement in a segmentation score. Instead, we propose the use of a segmentation ensemble. Learning from images with a single annotation, the ensemble reaches expert-like performance with an agreement of a 64-81% Dice score for HF and 21-41% for RA with all our experts. In addition, utilizing the mean predictions of the ensemble networks and their variance, we devise ternary segmentations where FAF image areas are labeled either as confident background, confident HF, or potential HF, ensuring that predictions are reliable where they are confident (97% Precision), while detecting all instances of HF (99% Recall) annotated by all experts.

In Which Cases Do We Operate? Posterior Malleolar Fractures-Intraobserver and Interobserver Reliability of the Bartonícek/Rammelt Classification and Corresponding Surgery Rates.

INTRODUCTION: The Bartonícek/Rammelt classification is established for posterior malleolar fractures. It subdivides the fractures into 5 types and outlines treatment recommendations. This study aims to determine the intraobserver and interobserver reliability of the Bartonícek/Rammelt classification and investigates its applicability regarding treatment recommendations. MATERIALS AND METHODS: Computed tomography (CT) scans of 80 ankle fractures with a posterior malleolar fracture were analyzed by four observers at two different time points 30 days apart (d1 and d2). Intrarater and interrater reliability was measured using kappa values. The corresponding surgery rates of the fracture subtypes were analyzed, and the surgery rates were correlated with fragment sizes and displacements. RESULTS: A moderate interobserver reliability for d1 0.41 (CI 0.35-0.47) and d2 0.42 (CI 0.36-0.48) was detected. Intraobserver reliability was documented as perfect, with a mean kappa of 0.83. Type II fractures were operated on in 50% of cases. In 50% of type II cases, a nonoperative treatment was chosen. Fragment size correlated strongly with the chosen therapy, and osteosynthesis was performed significantly more often when the fragment size exceeded 3 cm3 (P < .01). CONCLUSIONS: The Bartonícek/Rammelt classification system showed moderate interobserver reliability and perfect to substantial intraobserver reliability. In clinical practice of this study cohort, the size of the posterior malleolar fragment rather than the dislocation and joint impaction seemed to have the decision to operate on type II or III fractures. Existing treatment recommendations based on the Bartonícek/Rammelt classification correspond to the therapy algorithm carried out in this cohort of patients.Levels of Evidence: Level III: Retrospective study.

Inter- and intra-observer variability of qualitative visual breast-composition assessment in mammography among Japanese physicians: a first multi-institutional observer performance study in Japan.

BACKGROUND: Visual assessment of mammographic breast composition remains the most common worldwide, although subjective variability limits its reproducibility. This study aimed to investigate the inter- and intra-observer variability in qualitative visual assessment of mammographic breast composition through a multi-institutional observer performance study for the first time in Japan. METHODS: This study enrolled 10 Japanese physicians from five different institutions. They used the new Japanese breast-composition classification system 4th edition to subjectively evaluate the breast composition in 200 pairs of right and left normal mediolateral oblique mammograms (number determined using precise sample size calculations) twice, with a 1-month interval (median patient age: 59 years [range 40-69 years]). The primary endpoint of this study was the inter-observer variability using kappa (κ) value. RESULTS: Inter-observer variability for the four and two classes of breast-composition assessment revealed moderate agreement (Fleiss' κ: first and second reading = 0.553 and 0.587, respectively) and substantial agreement (Fleiss' κ: first and second reading = 0.689 and 0.70, respectively). Intra-observer variability for the four and two classes of breast-composition assessment demonstrated substantial agreement (Cohen's κ, median = 0.758) and almost perfect agreement (Cohen's κ, median = 0.813). Assessments of consensus between the 10 physicians and the automated software Volpara® revealed slight agreement (Cohen's κ; first and second reading: 0.104 and 0.075, respectively). CONCLUSIONS: Qualitative visual assessment of mammographic breast composition using the new Japanese classification revealed excellent intra-observer reproducibility. However, persistent inter-observer variability, presenting a challenge in establishing it as the gold standard in Japan.

The Value of Computed Tomography-Based Planning in Shoulder Arthroplasty Compared to Intra-/Interobserver Reliability of X-ray Planning.

Background: Reversed total shoulder arthroplasty (RTSA) is an established surgery for many pathologies of the shoulder and the demand continues to rise with an aging population. Preoperative planning is mandatory to support the surgeon's understanding of the patient's individual anatomy and, therefore, is crucial for the patient's outcome. Methods: In this observational study, we identified 30 patients who underwent RTSA with two- and three-dimensional preoperative planning. Each patient underwent new two-dimensional planning from a medical student and an orthopedic resident as well as through a mid-volume and high-volume shoulder surgeon, which was repeated after a minimum of 4 weeks. The intra- and interobserver reliability was then analyzed and compared to the 3D planning and the implanted prosthesis. The evaluated parameters were the size of the pegged glenoid baseplate, glenosphere, and humeral short stem. Results: The inter-rater reliability showed higher deviations in all four raters compared to the 3D planning of the base plate, glenosphere, and shaft. The intra-rater reliability showed a better correlation in more experienced raters, especially in the planning of the shaft. Conclusions: Our study shows that 3D planning is more accurate than traditional planning on plain X-rays, despite experienced shoulder surgeons showing better results in 2D planning than inexperienced ones.

The Dejour classification for trochlear dysplasia shows slight interobserver and substantial intraobserver reliability.

PURPOSE: Trochlear dysplasia is one of the main risk factors for recurrent patellar dislocation. The Dejour classification identifies four categories that can be used to classify trochlear dysplasia. The purpose of this study is to evaluate the inter- and intraobserver reliability of the Dejour classification for trochlear dysplasia. The hypothesis was that both intra- and interobserver reliability would be at least moderate. METHODS: This is a cross-sectional, reliability study. Twenty-eight examiners from the International Patellofemoral Study Group 2022 meeting evaluated lateral radiographs of the knee and axial magnetic resonance images from 15 cases of patellofemoral instability with trochlear dysplasia. They classified each case according to Dejour's classification for trochlear dysplasia (A-D). There were three rounds: one with only computed radiograph (CR), one with only magnetic resonance imaging (MRI) and one with both. Inter- and intraobserver reliability were calculated using κ coefficient (0-1). RESULTS: The mean age of patients was: 14.6 years; 60% were female and 53% had open physis. The interobserver reliability κ probabilities were 0.2 (CR), 0.13 (MRI) and 0.12 (CR and MRI). The intraobserver reliability κ probabilities were 0.45 (CR), 0.44 (MRI) and 0.65 (CR and MRI). CONCLUSION: The Dejour classification for trochlear dysplasia has slight interobserver reliability and substantial intraobserver reliability. LEVEL OF EVIDENCE: Level I.

Interobserver and Intraobserver Variability of Four Suprascapular Notch Classification Systems.

INTRODUCTION: Knowledge of the morphology of the suprascapular notch is clinically beneficial in patients with suspected suprascapular nerve compression or palsy. Several classification systems have been proposed for the morphological classification of the suprascapular notch and its several anatomical variations. The purpose of this study was to evaluate the inter- and intraobserver reliability of four different classification systems for suprascapular notch typing analysing shoulder computed tomography (CT) scans. METHODS: Shoulder CT scans from 109 subjects (71.5% males) were examined by three raters of various experience levels, one senior, one experienced, and one junior orthopaedic surgeon. The CT scans were evaluated quantitatively and qualitatively and the suprascapular notch was classified according to four classification systems at two separate timepoints, four weeks apart. To determine consistency among the same or different raters, the Kappa statistic was performed and intrarater reliability for each rater between the first and the second evaluation was assessed using Cohen's kappa. Reliability across all raters at each timepoint was assessed using the Fleiss kappa. RESULTS: Agreement was almost perfect for all the classification systems and amongst all raters, regardless of their experience level. There were no significant differences between the raters on any of the evaluations. The overall interobserver agreement for all classifications was almost perfect. CONCLUSION: The four suprascapular notch classification systems are reliable, and the rater's experience level has no impact on the evaluation.

Inter- and intraobserver agreement of antenatal cardiotocography assessments by maternity care professionals: A prospective study.

OBJECTIVE: In the Netherlands, antenatal cardiotocography (aCTG) to assess fetal well-being is performed in obstetrician-led care. An innovative initiative was started to evaluate whether aCTG for specific indications-reduced fetal movements, external cephalic version, or postdate pregnancy-is feasible in non-obstetrician-led care settings by independent primary care midwives. Quality assessment is essential when reorganizing and shifting tasks and responsibilities. Therefore, we aimed to assess the inter- and intraobserver agreement for aCTG assessments between and within four professional groups involved in Dutch maternity care regarding the overall classification and assessment of the various components of aCTG. METHOD: This was a prospective study among 47 Dutch primary care midwives, hospital-based midwives, residents, and obstetricians. Ten aCTG traces were assessed twice at a 1 month interval. To ensure a representative sample, we used two different sets of 10 aCTG traces each. We calculated the degree of agreement using the proportions of agreement. RESULTS: The proportions of agreement for interobserver agreement on the classification of aCTG between and within the four professional groups varied from 0.82 to 0.94. The proportions of agreement for each professional group were slightly higher for intraobserver (0.86-0.94) than for interobserver agreement. For the various aCTG components, the proportions of agreement for interobserver agreement varied from 0.64 (presence of contractions) to 0.98 (baseline heart frequency). CONCLUSION: The proportion of agreement levels between and within the maternity care professionals in the classification of aCTG traces among healthy women were comparable. This means that these professional groups are equally well able to classify aCTGs in healthy pregnant women.

Mayo classification of olecranon fractures revisited - Assessment of intra- and interobserver reliability based on CT scans.

Purpose: Olecranon fractures are classified using the commonly accepted Mayo classification. Its reliability has been analyzed by means of radiographs. A CT scan is often obtained due to joint involvement. Purpose of this study was to evaluate the intra- and interobserver reliability of the Mayo classification based on CT examination. Methods: Radiographic and CT images of 20 olecranon fractures were classified by four surgeons at two time points 30 days apart. Intra- and interobserver reliability were assessed using kappa coefficients. Results: Mean intraobserver reliability between X-rays was substantial and between CTs almost perfect (0.76 and 0.82, respectively). Mean interobserver reliability was fair for X-rays and moderate for CTs (0.32 and 0.44, respectively). Conclusion: Despite the more detailed imaging compared with radiography only moderate interobserver reliability was found for the classification of olecranon fractures based on CT imaging. This might lead to inconsistent fracture classification in both scientific and clinical setting.

Inter- and Intraobserver Variability on Endoscopic Scoring Systems in Crohn's Disease and Ulcerative Colitis: A Systematic Review and Meta-Analysis.

BACKGROUND: Endoscopy scoring is a key component in the diagnosis of ulcerative colitis (UC) and Crohn's disease (CD). Variability in endoscopic scoring can impact patient trial eligibility and treatment effect measurement. In this study, we examine inter- and intraobserver variability of inflammatory bowel disease endoscopic scoring systems in a systematic review and meta-analysis. METHODS: We included observational studies that evaluated the inter- and intraobserver variability using UC (endoscopic Mayo Score [eMS], Ulcerative Colitis Endoscopic Index of Severity [UCEIS]) or CD (Crohn's Disease Endoscopic Index of Severity [CDEIS], Simple Endoscopic Score for Crohn's Disease [SES-CD]) systems among adults (≥18 years of age) and were published in English. The strength of agreement was categorized as fair, moderate, good, and very good. RESULTS: A total of 6003 records were identified. After screening, 13 studies were included in our analysis. The overall interobserver agreement rates were 0.58 for eMS, 0.66 for UCEIS, 0.80 for CDEIS, and 0.78 for SES-CD. The overall heterogeneity (I2) for these systems ranged from 93.2% to 99.2%. A few studies assessed the intraobserver agreement rate. The overall effect sizes were 0.75 for eMS, 0.87 for UCEIS, 0.89 for CDEIS, and 0.91 for SES-CD. CONCLUSIONS: The interobserver agreement rates for eMS, UCEIS, CDEIS, and SES-CD ranged from moderate to good. The intraobserver agreement rates for eMS, UCEIS, CDEIS, and SES-CD ranged from good to very good. Solutions to improve interobserver agreement could allow for more accurate patient assessment, leading to richer, more accurate clinical management and clinical trial data.

This study examined the inter- and intraobserver variability of inflammatory bowel disease endoscopic scoring systems (endoscopic Mayo Score, Ulcerative Colitis Endoscopic Index of Severity, Crohn's Disease Endoscopic Index of Severity, Simple Endoscopic Score for Crohn's Disease) in a systematic review and meta-analysis.

Classification of intraarticular calcaneal fractures: comparison of two classification systems.

PURPOSE: Accurately classifying displaced intraarticular calcaneal fractures (DIACFs) is essential for orthopedic surgeons to choose optimal treatment methods and provide results evaluation and communication. Many authors studying used Sanders classification reported moderate intra- and interobserver reliability. Taking the software opportunity of 3D virtual exarticulation, Goldzak updated French tri-dimensional Utheza classification, providing an alternative framework for classifying DIACFs. The aim of this study was to compare the intra- and interobserver reliability of Sanders versus Goldzak classification systems. METHODS: The CT scans of 30 patients with displaced intraarticular calcaneal fractures, treated in the same trauma center between 2014-2018, were analyzed by 16 medical doctors (specialists and residents in orthopedic surgery, specialists and residents in radiology), and classified according to Sanders and Goldzak classifications. The same images were sent on two separate sessions, in a randomized order. Interobserver reliability and intraobserver reproducibility were assessed using Kappa statistics and Gwet's AC1 coefficient. RESULTS: Interobserver reliability using Gwet reported a value of 0.36 for Goldzak classification and 0.30 for Sanders classification (corresponding to "fair assessment" in both cases). In absence of subclasses, "substantial assessment" was reported for Goldzak classification (Gwet of 0.61) and "moderate assessment" for Sanders classification (Gwet of 0.46). Goldzak system had a greater interobserver reliability in the group of radiology residents. Intraobserver reliability coefficient was 0.60 for Goldzak classification and 0.69 for Sanders classification, indicating a substantial agreement for both classifications. CONCLUSION: Despite the better view of the fracture lines provided by 3D reconstructions, this study failed to prove the superiority of Goldzak classification compared to Sanders classification for DIACFs.