Standardization of interstitial lung disease assessment by ultrasound: results from a Delphi process and web-reliability exercise by the OMERACT ultrasound working group.

OBJECTIVES: Over the last years ultrasound has shown to be an important tool for evaluating lung involvement, including interstitial lung disease (ILD) a potentially severe systemic involvement in many rheumatic and musculoskeletal diseases (RMD). Despite the potential sensitivity of the technique the actual use is hampered by the lack of consensual definitions of elementary lesions to be assessed and of the scanning protocol to apply. Within the Outcome Measures in Rheumatology (OMERACT) Ultrasound Working Group we aimed at developing consensus-based definitions for ultrasound detected ILD findings in RMDs and assessing their reliability in dynamic images. METHODS: Based on the results from a systematic literature review, several findings were identified for defining the presence of ILD by ultrasound (i.e., Am-lines, B-lines, pleural cysts and pleural line irregularity). Therefore, a Delphi survey was conducted among 23 experts in sonography to agree on which findings should be included and on their definitions. Subsequently, a web-reliability exercise was performed to test the reliability of the agreed definitions on video-clips, by using kappa statistics. RESULTS: After three rounds of Delphi an agreement >75 % was obtained to include and define B-lines and pleural line irregularity as elementary lesions to assess. The reliability in the web-based exercise, consisting of 80 video-clips (30 for pleural line irregularity, 50 for B-lines), showed moderate inter-reader reliability for both B-lines (kappa = 0.51) and pleural line irregularity (kappa = 0.58), while intra-reader reliability was good for both B-lines (kappa = 0.72) and pleural line irregularity (kappa = 0.75). CONCLUSION: Consensus-based ultrasound definitions for B-lines and pleural line irregularity were obtained, with moderate to good reliability to detect these lesions using video-clips. The next step will be testing the reliability in patients with ILD linked to RMDs and to propose a consensual and standardized protocol to scan such patients.

Patient-based reliability of the Outcome Measures in Rheumatology (OMERACT) ultrasound scoring system for salivary gland assessment in patients with Sjögren's syndrome.

BACKGROUND: To assess the reliability of the consensually agreed US definitions of major salivary gland lesions and the US scoring system for salivary gland assessment in patients with SS. METHODS: Nine experienced sonographers scanned and read the US images of both parotid glands (PGs) and submandibular glands (SMGs) in eight patients with primary and secondary SS in two rounds. A consensually agreed four-grade semi-quantitative scoring was applied in B-mode for morphological lesions: grade 0, normal; grade 1, mild inhomogeneity without anechoic or hypoechoic areas; grade 2, moderate inhomogeneity with focal anechoic or hypoechoic areas; grade 3, severe inhomogeneity with diffuse an- or hypoechoic areas occupying the entire gland or fibrous gland. The presence or absence of typical SS lesions, i.e. the Sjögren's signature, was scored binary. Intra- and interreader reliabilities were computed using weighted and unweighted Cohen's and Light's κ coefficients. RESULTS: The mean prevalence of grades 0-3 in PG were 43, 17, 23 and 31% and 28, 14, 33 and 32% for the SMGs, respectively. The weighted κ for intrareader reliability ranged from 0.44 to 1 for grading and 0.64 to 1 for the Sjögren's signature of PG and 0.59 to 1 and -0.09 to 0.6 for SMGs, respectively. The interreader reliability κ for grading in PG was 0.62 (95% CI 0.47, 0.74) and for Sjögren's signature it was 0.36 (95% CI 0, 0.43); in SMG it was 0.62 (95% CI 0.47, 0.72) and 0.03 (95% CI 0, 0.07) respectively. CONCLUSIONS: The consensually agreed novel US scoring system for major salivary gland lesions showed substantial intra- and interreader reliability in patients with SS. The reliability of the Sjögren's signature was moderate.

Ultrasound in the Assessment of Interstitial Lung Disease in Systemic Sclerosis: A Systematic Literature Review by the OMERACT Ultrasound Group.

OBJECTIVE: To provide an overview of the role of lung ultrasound (LUS) in the assessment of interstitial lung disease (ILD) in systemic sclerosis (SSc) and to discuss the state of validation supporting its clinical relevance and application in daily clinical practice. METHODS: Original articles published between January 1997 and October 2017 were included. To identify all available studies, a detailed search pertaining to the topic of review was conducted according to guidelines of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). A systematic search was performed in PubMed and EMBASE. The quality assessment of retrieved articles was performed according to the Oxford Center for Evidence-based Medicine. The methodological quality of the studies was assessed using the Cochrane Handbook for Systematic Reviews and the Quality Assessment of Diagnostic Accuracy Studies-2 tool. RESULTS: From 300 papers identified, 12 were included for the analysis. LUS passed the filter of face, content validity, and feasibility. However, there is insufficient evidence to support criterion validity, reliability, and sensitivity to change. CONCLUSION: Despite a great deal of work supporting the potential role of LUS for the assessment of ILD-SSc, much remains to be done before validating its use as an outcome measure in ILD-SSc.

Video clip assessment of a salivary gland ultrasound scoring system in Sjögren's syndrome using consensual definitions: an OMERACT ultrasound working group reliability exercise.

OBJECTIVE: To develop ultrasound (US) definitions and a US novel scoring system for major salivary gland (SG) lesions in patients with primary Sjögren's syndrome (pSS) and to test their intrareader and inter-reader reliability using US video clips. METHODS: Twenty-five rheumatologists were subjected to a three-round, web-based Delphi process in order to agree on (1) definitions and scanning procedure of salivary gland ultrasonography (SGUS): parotid, submandibular and sublingual glands (PG, SMG and SLG); (2) definitions for the elementary SGUS lesions in patients with Sjögren's syndrome; (3) scoring system for grading changes. The experts rated the statements on a 1-5 Likert scale. In the second step, SGUS video clips of patients with pSS and non-pSS sicca cases were collected containing various spectrums of disease severity followed by an intrareader and inter-reader reliability exercise. Each video clip was evaluated according to the agreed definitions. RESULTS: Consensual definitions were developed after three Delphi rounds. Among the three selected SGs, US assessment of PGs and SMGs was agreed on. Agreement was reached to score only greyscale lesions and to focus on anechoic/hypoechoic foci in a semiquantitative matter or, if not possible on a qualitatively (present/absent) evaluation of fatty or fibrous lesions. Intrareader reliability for detecting and scoring these lesions was excellent (Cohen's kappa 0.81) and inter-reader reliability was good (Light's kappa 0.66). CONCLUSION: New definitions for developing a novel semiquantitative US score in patients with pSS were developed and tested on video clips. Inter-reader and intrareader reliabilities were good and excellent, respectively.

OMERACT Filter 2.1: Elaboration of the Conceptual Framework for Outcome Measurement in Health Intervention Studies.

OBJECTIVE: The Outcome Measures in Rheumatology (OMERACT) Filter 2.0 framework was developed in 2014 to aid core outcome set development by describing the full universe of "measurable aspects of health conditions" from which core domains can be selected. This paper provides elaborations and updated concepts (OMERACT Filter 2.1). METHODS: At OMERACT 2018, we discussed challenges in the framework application caused by unclear or ambiguous wording and terms and incompletely developed concepts. RESULTS: The updated OMERACT Filter 2.1 framework makes benefits and harms explicit, clarifies concepts, and improves naming of various terms. CONCLUSION: We expect that the Filter 2.1 framework will improve the process of core set development.

Improving Benefit-harm Assessment of Therapies from the Patient Perspective: OMERACT Premeeting Toward Consensus on Core Sets for Randomized Controlled Trials.

OBJECTIVE: Outcome Measures in Rheumatology (OMERACT) convened a premeeting in 2018 to bring together patients, regulators, researchers, clinicians, and consumers to build upon previous OMERACT drug safety work, with patients fully engaged throughout all phases. METHODS: Day 1 included a brief introduction to the history of OMERACT and methodology, and an overview of current efforts within and outside OMERACT to identify patient-reported medication safety concerns. On Day 2, two working groups presented results; after each, breakout groups were assembled to discuss findings. RESULTS: Five themes pertaining to drug safety measurement emerged. CONCLUSION: Current approaches have failed to include data from the patient's perspective. A better understanding of how individuals with rheumatic diseases view potential benefits and harms of therapies is essential.

Clinical peripheral enthesitis in the DESIR prospective longitudinal axial spondyloarthritis cohort.

OBJECTIVES: We aimed to describe the prevalence and characteristics of peripheral enthesitis in recent onset axial spondyloarthritis, estimate the incidence of peripheral enthesitis over time, and determine the factors associated with the presence of peripheral enthesitis. METHODS: 708 patients with recent onset axial spondyloarthritis were enrolled in the DESIR cohort ( prospective multi-centre, longitudinal). Data regarding the patients and spondyloarthritis characteristics at baseline with a specific focus on enthesitis and occurrence of peripheral enthesitis were collected during the five years of follow-up. RESULTS: At inclusion, 395 patients (55.8%) reported peripheral enthesitis. The locations were mainly the plantar fascia (53.7%) and the Achilles tendon (38.5%). During the 5-year follow-up period, 109 additional patients developed peripheral enthesitis resulting in an estimated (Kaplan-Meier method) percentage of 71% (95% CI: 68-75). Variables associated with peripheral enthesitis in the univariate analysis were: older age, male gender, absence of HLA B27, MRI sacroiliitis and fulfilled Modified NY criteria, presence of anterior chest wall pain, peripheral arthritis, dactylitis, psoriasis, high BASDAI, BASFI, mean score ASAS-and the use of NSAIDs. Only the history of anterior chest wall pain and of peripheral arthritis were retained in the multivariate analysis (odds ratio (OR)=1.6 [95% confidence interval [1.1-2.3], and OR=2.1 [1.4-3.0], respectively). CONCLUSIONS: This study highlights the high prevalence of peripheral enthesitis in recent onset axial spondyloarthritis, and suggests that in combination with peripheral arthritis, enthesitis might have an impact on the burden of the disease.

Definitions and reliability assessment of elementary ultrasound lesions in giant cell arteritis: a study from the OMERACT Large Vessel Vasculitis Ultrasound Working Group.

OBJECTIVES: To define the elementary ultrasound (US) lesions in giant cell arteritis (GCA) and to evaluate the reliability of the assessment of US lesions according to these definitions in a web-based reliability exercise. METHODS: Potential definitions of normal and abnormal US findings of temporal and extracranial large arteries were retrieved by a systematic literature review. As a subsequent step, a structured Delphi exercise was conducted involving an expert panel of the Outcome Measures in Rheumatology (OMERACT) US Large Vessel Vasculitis Group to agree definitions of normal US appearance and key elementary US lesions of vasculitis of temporal and extracranial large arteries. The reliability of these definitions on normal and abnormal blood vessels was tested on 150 still images and videos in a web-based reliability exercise. RESULTS: Twenty-four experts participated in both Delphi rounds. From originally 25 statements, nine definitions were obtained for normal appearance, vasculitis and arteriosclerosis of cranial and extracranial vessels. The 'halo' and 'compression' signs were the key US lesions in GCA. The reliability of the definitions for normal temporal and axillary arteries, the 'halo' sign and the 'compression' sign was excellent with inter-rater agreements of 91-99% and mean kappa values of 0.83-0.98 for both inter-rater and intra-rater reliabilities of all 25 experts. CONCLUSIONS: The 'halo' and the 'compression' signs are regarded as the most important US abnormalities for GCA. The inter-rater and intra-rater agreement of the new OMERACT definitions for US lesions in GCA was excellent.

Definition and Reliability Assessment of Elementary Ultrasonographic Findings in Calcium Pyrophosphate Deposition Disease: A Study by the OMERACT Calcium Pyrophosphate Deposition Disease Ultrasound Subtask Force.

OBJECTIVE: To define the ultrasonographic characteristics of calcium pyrophosphate crystal (CPP) deposits in joints and periarticular tissues and to evaluate the intra- and interobserver reliability of expert ultrasonographers in the assessment of CPP deposition disease (CPPD) according to the new definitions. METHODS: After a systematic literature review, a Delphi survey was circulated among a group of expert ultrasonographers, who were members of the CPPD Ultrasound (US) Outcome Measures in Rheumatology (OMERACT) subtask force, to obtain definitions of the US characteristics of CPPD at the level of fibrocartilage (FC), hyaline cartilage (HC), tendon, and synovial fluid (SF). Subsequently, the reliability of US in assessing CPPD at knee and wrist levels according to the agreed definitions was tested in static images and in patients with CPPD. Cohen's κ was used for statistical analysis. RESULTS: HC and FC of the knee yielded the highest interobserver κ values among all the structures examined, in both the Web-based (0.73 for HC and 0.58 for FC) and patient-based exercises (0.55 for the HC and 0.64 for the FC). Kappa values for the other structures were lower, ranging from 0.28 in tendons to 0.50 in SF in the static exercise and from 0.09 (proximal patellar tendon) to 0.27 (triangular FC of the wrist) in the patient-based exercise. CONCLUSION: The new OMERACT definitions for the US identification of CPPD proved to be reliable at the level of the HC and FC of the knee. Further studies are needed to better define the US characteristics of CPPD and optimize the scanning technique in other anatomical sites.

Summary Findings of a Systematic Literature Review of the Ultrasound Assessment of Bone Erosions in Rheumatoid Arthritis.

OBJECTIVE: Bone erosions in rheumatoid arthritis (RA) have been studied in an increasing amount of research. Both earlier and present classification criteria of RA contain erosions as a significant classification component. Ultrasound (US) can detect bone changes in accessible surfaces. Therefore, the study group performed a systematic literature review of assessment of RA bone erosions with US. METHODS: A systematic search of PubMed and Embase was performed. Data on the definitions of RA bone erosions, their size, scoring, relation to synovitis, comparators, and elements of the OMERACT (Outcome Measures in Rheumatology Clinical Trials) filter were collected and analyzed. RESULTS: The selection process identified 58 original research papers. The assessed joints were most frequently metacarpophalangeal (MCP; 41 papers), proximal interphalangeal (19 papers), and metatarsophalangeal joints (MTP; 18 papers). The OMERACT definition of RA bone erosion on US was used most often (17 papers). Second and fifth MCP and fifth MTP were recommended as target joints. Conventional radiography was the most frequently used comparator (27 papers), then magnetic resonance imaging (17 papers) and computed tomography (5 papers). Reliability of assessment was presented in 20 papers and sensitivity to change in 11 papers. CONCLUSION: This paper presents results of a systematic literature review of bone erosion assessment in RA with US. The survey suggests that US can be a helpful adjunct to the existing methods of imaging bone erosions in RA. It analyzes definitions, scoring systems, used comparators, and elements of the OMERACT filter. It also presents recommendations for a future research agenda based on the results of the review.

An OMERACT reliability exercise of inflammatory and structural abnormalities in patients with knee osteoarthritis using ultrasound assessment.

OBJECTIVE: To assess whether ultrasonography (US) is reliable for the evaluation of inflammatory and structural abnormalities in patients with knee osteoarthritis (OA). METHODS: Thirteen patients with early knee OA were examined by 11 experienced sonographers during 2 days. Dichotomous and semiquantitative scoring was performed on synovitis characteristics in various aspects of the knee joint. Semiquantitative scoring was done of osteophytes at the medial and lateral femorotibial joint space or cartilage damage of the trochlea and on medial meniscal damage bilaterally. Intra- and interobserver reliability were computed by use of unweighted and weighted κ coefficients. RESULTS: Intra- and interobserver reliability scores were moderate to good for synovitis (mean κ 0.67 and 0.52, respectively) as well as moderate to good for the global synovitis (0.70 and 0.50, respectively). Mean intra- and interobserver reliability κ for cartilage damage, medial meniscal damage and osteophytes ranged from fair to good (0.55 and 0.34, 0.75 and 0.56, 0.73 and 0.60, respectively). CONCLUSIONS: Using a standardised protocol, dichotomous and semiquantitative US scoring of pathological changes in knee OA can be reliable.

Updating the OMERACT filter: implications of filter 2.0 to select outcome instruments through assessment of "truth": content, face, and construct validity.

OBJECTIVE: The Outcome Measures in Rheumatology (OMERACT) Filter provides guidelines for the development and validation of outcome measures for use in clinical research. The "Truth" section of the OMERACT Filter requires that criteria be met to demonstrate that the outcome instrument meets the criteria for content, face, and construct validity. METHODS: Discussion groups critically reviewed a variety of ways in which case studies of current OMERACT Working Groups complied with the Truth component of the Filter and what issues remained to be resolved. RESULTS: The case studies showed that there is broad agreement on criteria for meeting the Truth criteria through demonstration of content, face, and construct validity; however, several issues were identified that the Filter Working Group will need to address. CONCLUSION: These issues will require resolution to reach consensus on how Truth will be assessed for the proposed Filter 2.0 framework, for instruments to be endorsed by OMERACT.

Reproducibility of joint swelling assessment by sonography in patients with long-lasting rheumatoid arthritis (SEA-Repro study part II).

OBJECTIVE: To evaluate the intraobserver and interobserver reproducibility of B-mode and power Doppler (PD) sonography in patients with active long-standing rheumatoid arthritis (RA) comparatively with clinical data. METHODS: In each of 7 patients being considered for a change in their RA treatment regimen, 7 healthcare professionals examined the 28 joints used in the Disease Activity Score 28-joint count (DAS28). Then 7 sonographers examined each of the 7 patients twice, using previously published B-mode and PD grading systems. The clinical reference standard was presence of synovitis according to at least 4/7 examiners. The sonographic reference standard was at least grade 1 (ALG1) or 2 (ALG2) synovitis according to at least 4/7 sonographers. Interobserver reproducibility of sonography was assessed versus the sonographer having the best intraobserver reproducibility. Agreement was measured by Cohen's kappa statistic. RESULTS: Intraobserver and interobserver reproducibility of B-mode and PD used separately was fair to good. Agreement between clinicians and sonographers at all sites using B-mode, PD, and both was 0.46, 0.37, and 0.36, respectively, for grade 1 synovitis; and 0.58, 0.19, and 0.19 for grade 2 synovitis. The number of joints with synovitis was smaller by physical examination (36.7%) than by B-mode with ALG1 (58.6%; p < 0.001). The number of joints with synovitis was higher by physical examination than by PD with both ALG1 (17.8%; p < 0.0001) and ALG2 (6.6%; p < 0.0001). CONCLUSION: PD findings explain most of the difference between clinical and sonographic joint assessments for synovitis in patients with long-standing RA.

Summary findings of a systematic review of the ultrasound assessment of synovitis.

This report presents the results of a recent systematic review performed by the OMERACT Ultrasound Group on the metric properties of ultrasound for the detection of synovitis in inflammatory arthritis. Reviews were conducted for the hand, wrist, elbow, shoulder, knee, ankle, and foot; most reports were related to the hand and knee, and the most common disease process was rheumatoid arthritis. The review highlights the current gaps in the literature, including a lack of reliability data with respect to intra-occasion and intra- and inter-reader reliability. Current work by our group is addressing these issues.

Assessment of peripheral enthesitis in the spondylarthropathies by ultrasonography combined with power Doppler: a cross-sectional study.

OBJECTIVE: To assess the prevalence and severity of peripheral enthesitis among the different subtypes of spondylarthropathy (SpA) by using ultrasonography (US) in B mode with power Doppler. METHODS: One hundred sixty-four consecutive patients with SpA (according to the criteria of the European Spondylarthropathy Study Group) and 64 control patients (34 with mechanical low back pain [MBP] and 30 with rheumatoid arthritis [RA]) underwent US examination of major entheses of their limbs. Particular attention was given to the detection of vascularization at the following sites: cortical bone insertion of entheses, junction between tendon and entheses, body of tendon, and bursa. RESULTS: Abnormal US findings consistent with at least one enthesitis were observed in 161 of 164 SpA patients (98%), affecting 1,131 of 2,952 entheses examined (38%). In contrast, only 132 of 1,152 entheses (11%) were found to be abnormal in 33 of 64 control patients (52%). US enthesitis was most commonly distributed in the distal portion of the lower limbs, irrespective of SpA subtype and of skeletal distribution of clinical symptoms. None of the abnormal entheses in control patients showed vascularization, compared with 916 of 1,131 abnormal entheses in SpA patients (81%), where it was always detected at the cortical bone insertion and sometimes also in the bursa. In SpA patients, the US pattern depended on the clinical presentation, with a higher prevalence of the most severe stages in those with peripheral forms. CONCLUSION: US in B mode combined with power Doppler allowed the detection of peripheral enthesitis in a majority of SpA patients, but not in MBP or RA patients. The presence of entheseal involvement was independent of SpA subtype, but its degree of severity appeared to be greater in peripheral forms. US could be very useful for both the diagnosis and the assessment of SpA activity.