OMERACT definition and reliability assessment of chronic ultrasound lesions of the axillary artery in giant cell arteritis.

OBJECTIVES: To define chronic ultrasound lesions of the axillary artery (AA) in long-standing giant cell arteritis (GCA) and to evaluate the reliability of the new ultrasound definition in a web-based exercise. METHODS: A structured Delphi, involving an expert panel of the Large Vessel Vasculitis subgroup of the Outcome Measures in Rheumatology (OMERACT) Ultrasound Working Group was carried out. The reliability of the new definition was tested in a 2-round web-based exercise involving 23 experts and using 50 still images each from AA of long-standing and acute GCA patients, as well as 50 images from healthy individuals. RESULTS: The final OMERACT ultrasound definition of chronic changes was based on measurement and appearance of the intima-media complex. The overall reliability of the new definition for chronic ultrasound changes in longstanding GCA of the AA was good to excellent with Light's kappa values of 0.79-0.80 for inter-reader reliability and mean Light's-kappa of 0.88 for intra-reader reliability. The mean inter-rater and intra-rater agreements were 86-87% and 92%, respectively. Good reliabilities were observed comparing the vessels with longstanding versus acute GCA with a mean agreement and kappa values of 81% and 0.63, respectively. CONCLUSION: The new OMERACT ultrasound definition for chronic vasculitis of the AA in GCA revealed a good to excellent inter- and intra-reader reliability in a web-based exercise of experts.

Patient-based reliability of the Outcome Measures in Rheumatology (OMERACT) ultrasound scoring system for salivary gland assessment in patients with Sjögren's syndrome.

BACKGROUND: To assess the reliability of the consensually agreed US definitions of major salivary gland lesions and the US scoring system for salivary gland assessment in patients with SS. METHODS: Nine experienced sonographers scanned and read the US images of both parotid glands (PGs) and submandibular glands (SMGs) in eight patients with primary and secondary SS in two rounds. A consensually agreed four-grade semi-quantitative scoring was applied in B-mode for morphological lesions: grade 0, normal; grade 1, mild inhomogeneity without anechoic or hypoechoic areas; grade 2, moderate inhomogeneity with focal anechoic or hypoechoic areas; grade 3, severe inhomogeneity with diffuse an- or hypoechoic areas occupying the entire gland or fibrous gland. The presence or absence of typical SS lesions, i.e. the Sjögren's signature, was scored binary. Intra- and interreader reliabilities were computed using weighted and unweighted Cohen's and Light's κ coefficients. RESULTS: The mean prevalence of grades 0-3 in PG were 43, 17, 23 and 31% and 28, 14, 33 and 32% for the SMGs, respectively. The weighted κ for intrareader reliability ranged from 0.44 to 1 for grading and 0.64 to 1 for the Sjögren's signature of PG and 0.59 to 1 and -0.09 to 0.6 for SMGs, respectively. The interreader reliability κ for grading in PG was 0.62 (95% CI 0.47, 0.74) and for Sjögren's signature it was 0.36 (95% CI 0, 0.43); in SMG it was 0.62 (95% CI 0.47, 0.72) and 0.03 (95% CI 0, 0.07) respectively. CONCLUSIONS: The consensually agreed novel US scoring system for major salivary gland lesions showed substantial intra- and interreader reliability in patients with SS. The reliability of the Sjögren's signature was moderate.

Video clip assessment of a salivary gland ultrasound scoring system in Sjögren's syndrome using consensual definitions: an OMERACT ultrasound working group reliability exercise.

OBJECTIVE: To develop ultrasound (US) definitions and a US novel scoring system for major salivary gland (SG) lesions in patients with primary Sjögren's syndrome (pSS) and to test their intrareader and inter-reader reliability using US video clips. METHODS: Twenty-five rheumatologists were subjected to a three-round, web-based Delphi process in order to agree on (1) definitions and scanning procedure of salivary gland ultrasonography (SGUS): parotid, submandibular and sublingual glands (PG, SMG and SLG); (2) definitions for the elementary SGUS lesions in patients with Sjögren's syndrome; (3) scoring system for grading changes. The experts rated the statements on a 1-5 Likert scale. In the second step, SGUS video clips of patients with pSS and non-pSS sicca cases were collected containing various spectrums of disease severity followed by an intrareader and inter-reader reliability exercise. Each video clip was evaluated according to the agreed definitions. RESULTS: Consensual definitions were developed after three Delphi rounds. Among the three selected SGs, US assessment of PGs and SMGs was agreed on. Agreement was reached to score only greyscale lesions and to focus on anechoic/hypoechoic foci in a semiquantitative matter or, if not possible on a qualitatively (present/absent) evaluation of fatty or fibrous lesions. Intrareader reliability for detecting and scoring these lesions was excellent (Cohen's kappa 0.81) and inter-reader reliability was good (Light's kappa 0.66). CONCLUSION: New definitions for developing a novel semiquantitative US score in patients with pSS were developed and tested on video clips. Inter-reader and intrareader reliabilities were good and excellent, respectively.

Definitions and reliability assessment of elementary ultrasound lesions in giant cell arteritis: a study from the OMERACT Large Vessel Vasculitis Ultrasound Working Group.

OBJECTIVES: To define the elementary ultrasound (US) lesions in giant cell arteritis (GCA) and to evaluate the reliability of the assessment of US lesions according to these definitions in a web-based reliability exercise. METHODS: Potential definitions of normal and abnormal US findings of temporal and extracranial large arteries were retrieved by a systematic literature review. As a subsequent step, a structured Delphi exercise was conducted involving an expert panel of the Outcome Measures in Rheumatology (OMERACT) US Large Vessel Vasculitis Group to agree definitions of normal US appearance and key elementary US lesions of vasculitis of temporal and extracranial large arteries. The reliability of these definitions on normal and abnormal blood vessels was tested on 150 still images and videos in a web-based reliability exercise. RESULTS: Twenty-four experts participated in both Delphi rounds. From originally 25 statements, nine definitions were obtained for normal appearance, vasculitis and arteriosclerosis of cranial and extracranial vessels. The 'halo' and 'compression' signs were the key US lesions in GCA. The reliability of the definitions for normal temporal and axillary arteries, the 'halo' sign and the 'compression' sign was excellent with inter-rater agreements of 91-99% and mean kappa values of 0.83-0.98 for both inter-rater and intra-rater reliabilities of all 25 experts. CONCLUSIONS: The 'halo' and the 'compression' signs are regarded as the most important US abnormalities for GCA. The inter-rater and intra-rater agreement of the new OMERACT definitions for US lesions in GCA was excellent.

Definition and Reliability Assessment of Elementary Ultrasonographic Findings in Calcium Pyrophosphate Deposition Disease: A Study by the OMERACT Calcium Pyrophosphate Deposition Disease Ultrasound Subtask Force.

OBJECTIVE: To define the ultrasonographic characteristics of calcium pyrophosphate crystal (CPP) deposits in joints and periarticular tissues and to evaluate the intra- and interobserver reliability of expert ultrasonographers in the assessment of CPP deposition disease (CPPD) according to the new definitions. METHODS: After a systematic literature review, a Delphi survey was circulated among a group of expert ultrasonographers, who were members of the CPPD Ultrasound (US) Outcome Measures in Rheumatology (OMERACT) subtask force, to obtain definitions of the US characteristics of CPPD at the level of fibrocartilage (FC), hyaline cartilage (HC), tendon, and synovial fluid (SF). Subsequently, the reliability of US in assessing CPPD at knee and wrist levels according to the agreed definitions was tested in static images and in patients with CPPD. Cohen's κ was used for statistical analysis. RESULTS: HC and FC of the knee yielded the highest interobserver κ values among all the structures examined, in both the Web-based (0.73 for HC and 0.58 for FC) and patient-based exercises (0.55 for the HC and 0.64 for the FC). Kappa values for the other structures were lower, ranging from 0.28 in tendons to 0.50 in SF in the static exercise and from 0.09 (proximal patellar tendon) to 0.27 (triangular FC of the wrist) in the patient-based exercise. CONCLUSION: The new OMERACT definitions for the US identification of CPPD proved to be reliable at the level of the HC and FC of the knee. Further studies are needed to better define the US characteristics of CPPD and optimize the scanning technique in other anatomical sites.

The Role of Ultrasound Compared to Biopsy of Temporal Arteries in the Diagnosis and Treatment of Giant Cell Arteritis (TABUL): a diagnostic accuracy and cost-effectiveness study.

BACKGROUND: Giant cell arteritis (GCA) is a relatively common form of primary systemic vasculitis, which, if left untreated, can lead to permanent sight loss. We compared ultrasound as an alternative diagnostic test with temporal artery biopsy, which may be negative in 9-61% of true cases. OBJECTIVE: To compare the clinical effectiveness and cost-effectiveness of ultrasound with biopsy in diagnosing patients with suspected GCA. DESIGN: Prospective multicentre cohort study. SETTING: Secondary care. PARTICIPANTS: A total of 381 patients referred with newly suspected GCA. MAIN OUTCOME MEASURES: Sensitivity, specificity and cost-effectiveness of ultrasound compared with biopsy or ultrasound combined with biopsy for diagnosing GCA and interobserver reliability in interpreting scan or biopsy findings. RESULTS: We developed and implemented an ultrasound training programme for diagnosing suspected GCA. We recruited 430 patients with suspected GCA. We analysed 381 patients who underwent both ultrasound and biopsy within 10 days of starting treatment for suspected GCA and who attended a follow-up assessment (median age 71.1 years; 72% female). The sensitivity of biopsy was 39% [95% confidence interval (CI) 33% to 46%], which was significantly lower than previously reported and inferior to ultrasound (54%, 95% CI 48% to 60%); the specificity of biopsy (100%, 95% CI 97% to 100%) was superior to ultrasound (81%, 95% CI 73% to 88%). If we scanned all suspected patients and performed biopsies only on negative cases, sensitivity increased to 65% and specificity was maintained at 81%, reducing the need for biopsies by 43%. Strategies combining clinical judgement (clinician's assessment at 2 weeks) with the tests showed sensitivity and specificity of 91% and 81%, respectively, for biopsy and 93% and 77%, respectively, for ultrasound; cost-effectiveness (incremental net monetary benefit) was £485 per patient in favour of ultrasound with both cost savings and a small health gain. Inter-rater analysis revealed moderate agreement among sonographers (intraclass correlation coefficient 0.61, 95% CI 0.48 to 0.75), similar to pathologists (0.62, 95% CI 0.49 to 0.76). LIMITATIONS: There is no independent gold standard diagnosis for GCA. The reference diagnosis used to determine accuracy was based on classification criteria for GCA that include clinical features at presentation and biopsy results. CONCLUSION: We have demonstrated the feasibility of providing training in ultrasound for the diagnosis of GCA. Our results indicate better sensitivity but poorer specificity of ultrasound compared with biopsy and suggest some scope for reducing the role of biopsy. The moderate interobserver agreement for both ultrasound and biopsy indicates scope for improving assessment and reporting of test results and challenges the assumption that a positive biopsy always represents GCA. FUTURE WORK: Further research should address the issue of an independent reference diagnosis, standards for interpreting and reporting test results and the evaluation of ultrasound training, and should also explore the acceptability of these new diagnostic strategies in GCA. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Summary Findings of a Systematic Literature Review of the Ultrasound Assessment of Bone Erosions in Rheumatoid Arthritis.

OBJECTIVE: Bone erosions in rheumatoid arthritis (RA) have been studied in an increasing amount of research. Both earlier and present classification criteria of RA contain erosions as a significant classification component. Ultrasound (US) can detect bone changes in accessible surfaces. Therefore, the study group performed a systematic literature review of assessment of RA bone erosions with US. METHODS: A systematic search of PubMed and Embase was performed. Data on the definitions of RA bone erosions, their size, scoring, relation to synovitis, comparators, and elements of the OMERACT (Outcome Measures in Rheumatology Clinical Trials) filter were collected and analyzed. RESULTS: The selection process identified 58 original research papers. The assessed joints were most frequently metacarpophalangeal (MCP; 41 papers), proximal interphalangeal (19 papers), and metatarsophalangeal joints (MTP; 18 papers). The OMERACT definition of RA bone erosion on US was used most often (17 papers). Second and fifth MCP and fifth MTP were recommended as target joints. Conventional radiography was the most frequently used comparator (27 papers), then magnetic resonance imaging (17 papers) and computed tomography (5 papers). Reliability of assessment was presented in 20 papers and sensitivity to change in 11 papers. CONCLUSION: This paper presents results of a systematic literature review of bone erosion assessment in RA with US. The survey suggests that US can be a helpful adjunct to the existing methods of imaging bone erosions in RA. It analyzes definitions, scoring systems, used comparators, and elements of the OMERACT filter. It also presents recommendations for a future research agenda based on the results of the review.

Musculoskeletal ultrasound training and competency assessment program for rheumatology fellows.

OBJECTIVES: The purpose of this study was to establish standards for musculoskeletal ultrasound competency through knowledge and skills testing using criterion-referenced methods. METHODS: Two groups of rheumatology fellows trained in musculoskeletal ultrasound through a standardized curriculum, which required submission of ultrasound studies for review over 8 months. Both groups then completed written and practical examinations in musculoskeletal ultrasound. Instructors, advanced users, and intermediate users of musculoskeletal ultrasound served as comparison groups. A passing score (competency) was established for the written examination by the Angoff procedure and for the practical examination by the borderline method. RESULTS: Thirty-eight fellows (19 in each group) took the final examination. Five fellows failed the written examination, and 1 failed the practical examination, whereas none of the advanced users failed. Written examination scores did not differ between the two fellow groups (74% versus 70%; P > .05), were reliable, and were able to discriminate between the intermediate and advanced groups. Practical and written examination results correlated in both groups (first group, r = 0.70; P = .0008; second group, r = 0.59; P = .009). CONCLUSIONS: Criterion-referenced methods were used for the first time to determine fellow musculoskeletal ultrasound competency. The examination used to determine competency was reproducible, was reliable, and could differentiate musculoskeletal ultrasound users with different levels of experience. Most rheumatology fellows completing our program passed the written and practical examinations, suggesting achievement of basic musculoskeletal ultrasound competency.

What the practising rheumatologist needs to know about the technical fundamentals of ultrasonography.

A transducer generates ultrasound waves and emits them into the body. Boundaries in or between tissues reflect the waves, and the transducer receives the reflected waves. A computer converts the information into images that are displayed on a monitor. Image resolution is greater with higher frequencies, and penetration is greater with lower frequencies. Linear probes with frequencies between 5 and 20 MHz are mainly used for musculoskeletal ultrasound. Image quality and resolution have improved significantly. Tissue harmonic imaging and cross-beam technology aid in differentiating between anatomical structures, although borders appear artificially thickened. Three-dimensional ultrasound provides additional coronary planes, and contrast agents increase the sensitivity for synovial blood flow in inflamed joints. This chapter provides further information regarding which ultrasound technology is the best for purchase by a rheumatology unit, how to organize ultrasound clinics, and how best to perform ultrasonography in daily practice, including the most important indications for ultrasound in rheumatology.

Summary findings of a systematic review of the ultrasound assessment of synovitis.

This report presents the results of a recent systematic review performed by the OMERACT Ultrasound Group on the metric properties of ultrasound for the detection of synovitis in inflammatory arthritis. Reviews were conducted for the hand, wrist, elbow, shoulder, knee, ankle, and foot; most reports were related to the hand and knee, and the most common disease process was rheumatoid arthritis. The review highlights the current gaps in the literature, including a lack of reliability data with respect to intra-occasion and intra- and inter-reader reliability. Current work by our group is addressing these issues.

Use of ultrasonography and positron emission tomography in the diagnosis and assessment of large-vessel vasculitis.

PURPOSE OF REVIEW: Ultrasonography and positron emission tomography have been increasingly studied and, in part, introduced in clinical practice to diagnose large-vessel vasculitides, such as temporal arteritis, Takayasu arteritis, large-vessel giant cell arteritis, and isolated aortitis. RECENT FINDINGS: Ultrasonography reveals characteristic homogenous, concentric wall thickening in vasculitis, often combined with stenoses and, less frequently, with acute occlusions. Thirteen studies describe sensitivities of 40 to 100% (median, 86%) for temporal artery vessel wall edema compared with histology, and of 35 to 86% (median, 70%) compared with clinical diagnosis. If wall edema, stenoses, and occlusions are included, sensitivities increase to 91 to 100% (median, 95%) compared with histology, and to 83 to 100% (median, 88%) compared with clinical diagnosis. Specificities for wall edema are 68 to 100% (median, 93%) compared with histology, and 78 to 100% (median, 97%) compared with clinical diagnosis. One should be aware of large-vessel giant cell arteritis in all patients with temporal arteritis and polymyalgia rheumatica. Ultrasonography reveals characteristic wall thickening, particularly of the distal subclavian, axillary, and proximal brachial arteries. Findings in Takayasu arteritis are similar, but the vessel wall swelling is usually brighter. Positron emission tomography reveals vasculitis in arteries with a diameter of more than 4 mm. Ultrasonography and positron emission tomography agreed completely in the anatomic distribution of changes in patients with large-vessel giant cell arteritis. It reveals asymptomatic large-vessel vasculitis in giant cell arteritis and Takayasu arteritis. Positron emission tomography is not suitable for the assessment of temporal arteries. SUMMARY: Ultrasonography and positron emission tomography are new, promising techniques to assess large-vessel vasculitides.