ABSTRACT
OBJECTIVES: Over the last years ultrasound has shown to be an important tool for evaluating lung involvement, including interstitial lung disease (ILD) a potentially severe systemic involvement in many rheumatic and musculoskeletal diseases (RMD). Despite the potential sensitivity of the technique the actual use is hampered by the lack of consensual definitions of elementary lesions to be assessed and of the scanning protocol to apply. Within the Outcome Measures in Rheumatology (OMERACT) Ultrasound Working Group we aimed at developing consensus-based definitions for ultrasound detected ILD findings in RMDs and assessing their reliability in dynamic images. METHODS: Based on the results from a systematic literature review, several findings were identified for defining the presence of ILD by ultrasound (i.e., Am-lines, B-lines, pleural cysts and pleural line irregularity). Therefore, a Delphi survey was conducted among 23 experts in sonography to agree on which findings should be included and on their definitions. Subsequently, a web-reliability exercise was performed to test the reliability of the agreed definitions on video-clips, by using kappa statistics. RESULTS: After three rounds of Delphi an agreement >75 % was obtained to include and define B-lines and pleural line irregularity as elementary lesions to assess. The reliability in the web-based exercise, consisting of 80 video-clips (30 for pleural line irregularity, 50 for B-lines), showed moderate inter-reader reliability for both B-lines (kappa = 0.51) and pleural line irregularity (kappa = 0.58), while intra-reader reliability was good for both B-lines (kappa = 0.72) and pleural line irregularity (kappa = 0.75). CONCLUSION: Consensus-based ultrasound definitions for B-lines and pleural line irregularity were obtained, with moderate to good reliability to detect these lesions using video-clips. The next step will be testing the reliability in patients with ILD linked to RMDs and to propose a consensual and standardized protocol to scan such patients.
Subject(s)
Delphi Technique , Lung Diseases, Interstitial , Ultrasonography , Humans , Lung Diseases, Interstitial/diagnostic imaging , Ultrasonography/standards , Reproducibility of Results , Lung/diagnostic imaging , ConsensusABSTRACT
OBJECTIVE: To assess the reliability and diagnostic accuracy of new radiographic imaging definitions developed by an international multidisciplinary working group for identification of calcium pyrophosphate deposition (CPPD). METHODS: Patients with knee osteoarthritis scheduled for knee replacement were enrolled. Two radiologists and 2 rheumatologists twice assessed radiographic images for presence or absence of CPPD in menisci, hyaline cartilage, tendons, joint capsule, or synovial membrane, using the new definitions. In case of disagreement, a consensus decision was made and considered for the assessment of diagnostic performance. Histologic examination of postsurgical specimens under compensated polarized light microscopy was the reference standard. Prevalence-adjusted bias-adjusted kappa values were used to assess reliability, and diagnostic performance statistics were calculated. RESULTS: Sixty-seven patients were enrolled for the reliability study. The interobserver reliability was substantial in most of the assessed structures when considering all 4 readers (κ range 0.59-0.90), substantial to almost perfect among radiologists (κ range 0.70-0.91), and moderate to almost perfect among rheumatologists (κ range 0.46-0.88). The intraobserver reliability was substantial to almost perfect for all the observers (κ range 0.70-1). Fifty-one patients were included in the accuracy study. Radiography demonstrated an overall specificity of 92% for CPPD, but sensitivity remained low for all sites and for the overall diagnosis (54%). CONCLUSION: The new radiographic definitions of CPPD are highly specific against the gold standard of histologic diagnosis. When the described radiographic findings are present, these definitions allow for a definitive diagnosis of CPPD, rather than other calcium-containing crystal depositions; however, a negative radiographic finding does not exclude the diagnosis.
Subject(s)
Calcinosis , Chondrocalcinosis , Humans , Calcium Pyrophosphate , Chondrocalcinosis/diagnostic imaging , Reproducibility of Results , Knee Joint/diagnostic imaging , RadiographyABSTRACT
BACKGROUND: The Calcium Pyrophosphate Deposition (CPPD) subgroup of the Outcome Measures in Rheumatology (OMERACT) Ultrasound working group was established to validate ultrasound as an outcome measure instrument for CPPD, and in 2017 has developed and validated standardised definitions for elementary lesions for the detection of calcium pyrophosphate crystals in joints. The aim of this study was to develop and evaluate the reliability of a consensus-based ultrasound scoring system for CPPD extent, representing the next phase in the OMERACT methodology. METHODS: In this study the novel scoring system for CPPD was developed through a stepwise process, following an established OMERACT ultrasound methodology. Following a previous systematic review to gather available evidence on existing scoring systems for CPPD, the novel scoring system was developed through a Delphi survey based on the expert opinion of the members of the OMERACT Ultrasound working group-CPPD subgroup. The reliability of the scoring system was then tested on a web-based and patient-based exercise. Intra-reader and inter-reader reliability of the new scoring system was assessed using weighted Light's κ coefficients. FINDINGS: The four-grade semiquantitative scoring system consisted of: grade 0 (no findings consistent with CPPD), grade 1 (≤3 single spots or 1 small deposit), grade 2 (>3 single spots or >1 small deposit or ≥1 larger deposit occupying ≤50% of the structure under examination in the reference image-ie, the scanning view with the highest grade of depositions), and grade 3 (deposits that occupy more than 50% of the structure under examination in the reference image). The score should be applied to the knee (menisci and hyaline cartilage) and the triangular fibrocartilage complex of the wrist. The intra-reader and inter-reader reliabilities on static images were almost perfect (κ 0·90 [95% CI 0·79-1·00] and κ 0·84 [0·79-0·88]), and on the eight patients recruited (four [50%] female and four [50%] male) were substantial (κ 0·72 [95% CI 0·47 to 0·96] and 0·66 [0·61 to 0·71]). INTERPRETATION: This OMERACT ultrasound scoring system for CPPD was reliable on both static images and patients. The scoring system might be a valuable tool for ensuring valid and comparable results in clinical trials and could help monitor the extent of crystal deposition in patients with CPPD in clinical practice. FUNDING: The Italian Ministry of Health - Ricerca Corrente.
Subject(s)
Calcinosis , Calcium Pyrophosphate , Humans , Female , Male , Reproducibility of Results , Diphosphates , UltrasonographyABSTRACT
OBJECTIVES: This study aimed to determine the prevalence of ultrasound-detected tendon abnormalities in healthy subjects (HS) across the age range. METHODS: Adult HS (age 18-80 years) were recruited in 23 international Outcome Measures in Rheumatology ultrasound centres and were clinically assessed to exclude inflammatory diseases or overt osteoarthritis before undergoing a bilateral ultrasound examination of digit flexors (DFs) 1-5 and extensor carpi ulnaris (ECU) tendons to detect the presence of tenosynovial hypertrophy (TSH), tenosynovial power Doppler (TPD) and tenosynovial effusion (TEF), usually considered ultrasound signs of inflammatory diseases. A comparison cohort of patients with rheumatoid arthritis (RA) was taken from the Birmingham Early Arthritis early arthritis inception cohort. RESULTS: 939 HS and 144 patients with RA were included. The majority of HS (85%) had grade 0 for TSH, TPD and TEF in all DF and ECU tendons examined. There was a statistically significant difference in the proportion of TSH and TPD involvement between HS and subjects with RA (HS vs RA p<0.001). In HS, there was no difference in the presence of ultrasound abnormalities between age groups. CONCLUSIONS: Ultrasound-detected TSH and TPD abnormalities are rare in HS and can be regarded as markers of active inflammatory disease, especially in newly presenting RA.
Subject(s)
Tendons/diagnostic imaging , Tendons/pathology , Tenosynovitis/epidemiology , Adolescent , Adult , Aged , Aged, 80 and over , Cohort Studies , Female , Healthy Volunteers , Humans , Hypertrophy/diagnostic imaging , Hypertrophy/epidemiology , Male , Middle Aged , Prevalence , Tenosynovitis/diagnostic imaging , Ultrasonography , Young AdultABSTRACT
OBJECTIVES: Imaging is one of the most rapidly evolving fields in medicine. Unfortunately, many imaging technologies have been applied as measurement instruments without rigorous evaluation of the evidence supporting their truth, discriminatory capability and feasibility for that context of use. The Outcome Measures in Rheumatology (OMERACT) Filter 2.1 Instrument Selection Algorithm (OFISA) is used to evaluate such evidence for use of an instrument in a research setting. The objectives of this work are to: [1] define and describe the key conceptual aspects that are essential for the evaluation of imaging as an outcome measurement instrument and [2] describe how these aspects can be assessed through OFISA. METHODS: Experts in imaging and/or methodology met to formalize concepts and define key steps. These concepts were discussed with a team of patient research partners with interest in imaging to refine technical and methodological aspects into comprehensible information. A workshop was held at OMERACT2020 and feedback was incorporated into existing OMERACT process for domain and instrument selection. RESULTS: Three key lessons were identified: (1) a clear definition of the domain we want to measure is a necessary prerequisite to the selection of a good instrument, (2) the sources of variability that can directly influence the instrument should be clearly identified, (3) incorporating these first two lessons into OFISA improves the quality of every instrument selection process. CONCLUSIONS: The incorporation of these lessons in the updated OMERACT Filter (now 2.2) will improve the quality of the selection process for all types of outcome measurement instruments.
Subject(s)
Rheumatology , Diagnostic Imaging , HumansABSTRACT
Chronic infection with hepatitis C virus (HCV) is one of the leading causes of cirrhosis and hepatocellular carcinoma (HCC). Surveillance of these patients is an essential strategy in the prevention chain, including in the pre/post-antiviral treatment states. Ultrasound elastography techniques are emerging as key methods in the assessment of liver diseases, with a number of advantages such as their rapid, noninvasive, and cost-effective characters. The present paper critically reviews the performance of vibration-controlled transient elastography (VCTE) in the assessment of HCV patients. VCTE measures liver stiffness (LS) and the ultrasonic attenuation through the embedded controlled attenuation parameter (CAP), providing the clinician with a tool for assessing fibrosis, cirrhosis, and steatosis in a noninvasive manner. Moreover, standardized LS values enable proper staging of the underlying fibrosis, leading to an accurate identification of a subset of HCV patients that present a high risk for complications. In addition, VCTE is a valuable technique in evaluating liver fibrosis prior to HCV therapy. However, its applicability in monitoring fibrosis regression after HCV eradication is currently limited and further studies should focus on extending the boundaries of VCTE in this context. From a different perspective, VCTE may be effective in identifying clinically significant portal hypertension (CSPH). An emerging prospect of clinical significance that warrants further study is the identification of esophageal varices. Our opinion is that the advantages of VCTE currently outweigh those of other surveillance methods.
ABSTRACT
Atherosclerosis is a key pathological process that causes a plethora of pathologies, including coronary artery disease, peripheral artery disease, and ischemic stroke. The silent progression of the atherosclerotic disease prompts for new surveillance tools that can visualize, characterize, and provide a risk evaluation of the atherosclerotic plaque. Conventional ultrasound methods-bright (B)-mode US plus Doppler mode-provide a rapid, cost-efficient way to visualize an established plaque and give a rapid risk stratification of the patient through the Gray-Weale standardization-echolucent plaques with ≥50% stenosis have a significantly greater risk of ipsilateral stroke. Although rather disputed, the measurement of carotid intima-media thickness (C-IMT) may prove useful in identifying subclinical atherosclerosis. In addition, contrast-enhanced ultrasonography (CEUS) allows for a better image resolution and the visualization and quantification of plaque neovascularization, which has been correlated with future cardiovascular events. Newly emerging elastography techniques such as strain elastography and shear-wave elastography add a new dimension to this evaluation-the biomechanics of the arterial wall, which is altered in atherosclerosis. The invasive counterpart, intravascular ultrasound (IVUS), enables an individualized assessment of the anti-atherosclerotic therapies, as well as a direct risk assessment of these lesions through virtual histology IVUS.
ABSTRACT
Global statistics show an increasing percentage of patients that develop non-alcoholic fatty liver disease (NAFLD) and NAFLD-related hepatocellular carcinoma (HCC), even in the absence of cirrhosis. In the present review, we analyzed the diagnostic performance of ultrasonography (US) in the non-invasive evaluation of NAFLD and NAFLD-related HCC, as well as possibilities of optimizing US diagnosis with the help of artificial intelligence (AI) assistance. To date, US is the first-line examination recommended in the screening of patients with clinical suspicion of NAFLD, as it is readily available and leads to a better disease-specific surveillance. However, the conventional US presents limitations that significantly hamper its applicability in quantifying NAFLD and accurately characterizing a given focal liver lesion (FLL). Ultrasound contrast agents (UCAs) are an essential add-on to the conventional B-mode US and to the Doppler US that further empower this method, allowing the evaluation of the enhancement properties and the vascular architecture of FLLs, in comparison to the background parenchyma. The current paper also explores the new universe of AI and the various implications of deep learning algorithms in the evaluation of NAFLD and NAFLD-related HCC through US methods, concluding that it could potentially be a game changer for patient care.
ABSTRACT
BACKGROUND: The MARTE study investigated the demographic, clinical, and therapeutic characteristics of rheumatoid arthritis (RA) patients ongoing methotrexate (MTX) treatment for longer than 8 years. METHODS: This cross-sectional, observational study considered 587 RA patients from 67 Rheumatology Units across Italy. Data collected included demographic, clinical, and therapeutic characteristics, focusing on MTX prescription patterns (route of administration, dosing regimens, treatment duration, and discontinuation). RESULTS: As initial therapy, 90.6% of patients received one conventional synthetic Disease Modifying Anti Rheumatic Drug (csDMARD), with treatment started within the first 3 months from diagnosis in half of the patients. MTX was the first csDMARD in 46.2% of patients. The prevalent route of administration at diagnosis was the intramuscular (60.5%), while at study entry (baseline) 57.6% were receiving subcutaneous MTX. Patients who required a higher MTX dose at study entry were those who received a significantly lower starting MTX dose (P<0.001). Significantly higher MTX doses were currently required in men (P<0.001), current smokers (P=0.013), and overweight patients (P=0.028), whereas patients on oral therapy received significantly lower doses of MTX (P<0.001). CONCLUSIONS: The MARTE study confirms once again the potential of the proper use of MTX in the treatment of RA. Data from our study suggest that a higher dose of MTX should be used since the first stages in overweight patients, men, and smokers.
Subject(s)
Antirheumatic Agents/therapeutic use , Arthritis, Rheumatoid/drug therapy , Methotrexate/therapeutic use , Aged , Antirheumatic Agents/administration & dosage , Cross-Sectional Studies , Female , Humans , Injections, Intramuscular/statistics & numerical data , Injections, Subcutaneous/statistics & numerical data , Italy , Male , Methotrexate/administration & dosage , Postmenopause , Sex Factors , Smokers , Socioeconomic Factors , Time FactorsABSTRACT
OBJECTIVE: To evaluate the discriminatory ability of ultrasound in calcium pyrophosphate deposition disease (CPPD), using microscopic analysis of menisci and knee hyaline cartilage (HC) as reference standard. METHODS: Consecutive patients scheduled for knee replacement surgery, due to osteoarthritis (OA), were enrolled. Each patient underwent ultrasound examination of the menisci and HC of the knee, scoring each site for presence/absence of CPPD. Ultrasound signs of inflammation (effusion, synovial proliferation and power Doppler) were assessed semiquantitatively (0-3). The menisci and condyles, retrieved during surgery, were examined microscopically by optical light microscopy and by compensated polarised microscopy. CPPs were scored as present/absent in six different samples from the surface and from the internal part of menisci and cartilage. Ultrasound and microscopic analysis were performed by different operators, blinded to each other's findings. RESULTS: 11 researchers from seven countries participated in the study. Of 101 enrolled patients, 68 were included in the analysis. In 38 patients, the surgical specimens were insufficient. The overall diagnostic accuracy of ultrasound for CPPD was of 75%-sensitivity of 91% (range 71%-87% in single sites) and specificity of 59% (range 68%-92%). The best sensitivity and specificity were obtained by assessing in combination by ultrasound the medial meniscus and the medial condyle HC (88% and 76%, respectively). No differences were found between patients with and without CPPD regarding ultrasound signs of inflammation. CONCLUSION: Ultrasound demonstrated to be an accurate tool for discriminating CPPD. No differences were found between patents with OA alone and CPPD plus OA regarding inflammation.
Subject(s)
Chondrocalcinosis/diagnostic imaging , Hyaline Cartilage/diagnostic imaging , Meniscus/diagnostic imaging , Osteoarthritis, Knee/diagnostic imaging , Ultrasonography/statistics & numerical data , Aged , Arthroplasty, Replacement, Knee , Calcium Pyrophosphate/analysis , Female , Humans , Hyaline Cartilage/pathology , Male , Meniscus/pathology , Microscopy/methods , Microscopy/statistics & numerical data , Middle Aged , Osteoarthritis, Knee/pathology , Osteoarthritis, Knee/surgery , Preoperative Period , Reference Values , Reproducibility of Results , Sensitivity and SpecificityABSTRACT
The increasing prevalence of non-alcoholic fatty liver disease (NAFLD) in the general population prompts for a quick response from physicians. As NAFLD can progress to liver fibrosis, cirrhosis, and even hepatocellular carcinoma (HCC), new non-invasive, rapid, cost-effective diagnostic methods are needed. In this review, we explore the diagnostic performance of ultrasound elastography for non-invasive assessment of NAFLD and NAFLD-related HCC. Elastography provides a new dimension to the conventional ultrasound examination, by adding the liver stiffness quantification in the diagnostic algorithm. Whilst the most efficient elastographic techniques in staging liver fibrosis in NAFLD are vibration controlled transient elastography (VCTE) and 2D-Shear wave elastography (2D-SWE), VCTE presents the upside of assessing steatosis through the controlled attenuation parameter (CAP). Hereby, we have also critically reviewed the most important elastographic techniques for the quantitative characterization of focal liver lesions (FLLs), focusing on HCC: Point shear wave elastography (pSWE) and 2D-SWE. As our paper shows, elastography should not be considered as a substitute for FLL biopsy because of the stiffness values overlap. Furthermore, by using non-invasive, disease-specific surveillance tools, such as US elastography, a subset of the non-cirrhotic NAFLD patients at risk for developing HCC can be detected early, leading to a better outcome. A recent ultrasomics study exemplified the wide potential of 2D-SWE to differentiate benign FLLs from malignant ones, guiding the clinician towards the next steps of diagnosis and contributing to better long-term disease surveillance.
ABSTRACT
Following publication of the original article [1], it was brought to our attention that the AOSD Consensus Group was incorrectly tagged and therefore not searchable. The publishers apologize for this error.
ABSTRACT
BACKGROUND: Adult-onset Still's disease (AOSD) is a rare inflammatory condition characterized by fever, rash, and arthritis. Because of its rarity, clinical trials are inherently small and often uncontrolled. Our objective was to develop recommendations for the use of interleukin (IL)-1 inhibitors in the management of patients with AOSD, based on the best evidence and expert opinion. METHODS: A panel of 10 experts (9 rheumatologists and 1 pediatrician) was established. The first step was dedicated to a comprehensive literature review and development of statements. Two separate literature searches were performed on the MEDLINE (Pubmed), EMBASE, and BIOSIS databases through April 2018 to identify (1) differences and similarities between AOSD and pediatric Still's disease (systemic juvenile idiopathic arthritis [SJIA]) and (2) the efficacy and safety of IL-1 inhibitors in AOSD treatment. In the second step, the statements were submitted in a Delphi process to a panel of 67 rheumatologists. Consensus threshold was set at 66%: positive, > 66% of voters selected scores 3 to 5; negative, > 66% of voters selected scores 1 or 2. In the third step, the voting results were analyzed, and the statements were finalized. RESULTS: Eleven statements were developed. Forty-six of 67 rheumatologists (72%) participated in the Delphi process. A positive consensus was reached after the first round of voting and was full (> 95%) on the majority of statements. A large consensus was achieved in considering AOSD and SJIA as the same disease. The use of anti-IL-1 therapies in refractory patients was considered quite safe and effective both as the first and as a subsequent line of biologic treatment, especially in systemic patients. Because of the lack of head-to-head comparisons, a different profile of efficacy among IL-1 inhibitors could not be established. There was a large consensus that failure of the first IL-1 inhibitor does not preclude response to another one. The lack of studies comparing early versus late treatment did not allow to draw conclusions; however, data from SJIA suggest a better response in early treatment. CONCLUSIONS: The Delphi method was used to develop recommendations that we hope will help clinicians in the management of patients with AOSD refractory to conventional therapies.
Subject(s)
Antirheumatic Agents/therapeutic use , Interleukin-1/antagonists & inhibitors , Still's Disease, Adult-Onset/drug therapy , Adult , Consensus , Delphi Technique , Female , Humans , MaleABSTRACT
Ultrasound elastography (UE) is a non-invasive imaging method that allows the assessment of tissue elastic property. Different UE techniques are currently available (i.e. strain UE and acoustic radiation force impulse UE), with several potential clinical applications. Recent studies investigated the role of UE in two systemic rheumatic diseases and psoriasis. This research added interesting information to the already known applications of UE in the assessment of tendinopathies. In SS, acoustic radiation force impulse UE has shown a potential role in the diagnosis of the disease, with lower sensitivity than and similar specificity to salivary gland histology. In SSc, a potential use of UE in screening pre-clinical disease has been reported. In psoriasis, the use of strain UE in evaluating treatment response has been highlighted. UE is a promising tool in rheumatology, with a potential role in the evaluation of various tissues and pathologies.
Subject(s)
Elasticity Imaging Techniques/methods , Rheumatic Diseases/diagnostic imaging , Rheumatology/methods , Humans , Salivary Glands/diagnostic imaging , Scleroderma, Systemic/diagnostic imaging , Sensitivity and Specificity , Sjogren's Syndrome/diagnostic imagingABSTRACT
OBJECTIVES: To assess the reliability of the OMERACT ultrasound (US) definitions for the identification of calcium pyrophosphate deposition disease (CPPD) at the metacarpal-phalangeal, triangular fibrocartilage of the wrist (TFC), acromioclavicular (AC) and hip joints. METHODS: A web-based exercise and subsequent patient-based exercise were carried out. A panel of 30 OMERACT members, participated at the web-based exercise by evaluating twice a set of US images for the presence/absence of CPPD. Afterwards, 19 members of the panel met in Siena, Italy, for the patient-based exercise. During the exercise, all sonographers examined twice eight patients for the presence/absence of CPPD at the same joints. Intraoberserver and interobserver kappa values were calculated for both exercises. RESULTS: The web-based exercise yielded high kappa values both in intraobserver and interobserver evaluation for all sites, while in the patient-based exercise, inter-reader agreement was acceptable for the TFC and the AC. TFC reached high interobserver and intraobserver k values in both exercises, ranging from 0.75 to 0.87 (good to excellent agreement). AC reached moderate kappa values, from 0.51 to 0.85 (moderate to excellent agreement) and can readily be used for US CPPD identification. CONCLUSIONS: Based on the results of our exercise, the OMERACT US definitions for the identification of CPPD demonstrated to be reliable when applied to the TFC and AC. Other sites reached good kappa values in the web-based exercise but failed to achieve good reproducibility at the patient-based exercise, meaning the scanning method must be further refined.
Subject(s)
Chondrocalcinosis/diagnostic imaging , Ultrasonography/standards , Acromioclavicular Joint/diagnostic imaging , Aged , Female , Hip Joint/diagnostic imaging , Humans , International Cooperation , Internet , Male , Metacarpophalangeal Joint/diagnostic imaging , Middle Aged , Observer Variation , Radiology Information Systems , Reproducibility of Results , Ultrasonography/methods , Wrist Joint/diagnostic imagingABSTRACT
AIMS: Doppler ultrasonography assessment is mandatory nowadays for the complete description of rheumatic disease activity. Initially it was performed in semi quantitative way but recently the (fully) quantitative assessment is gaining more interest. In quantitative assessment, the ratio between total colorized and total pixels (CTR) is computed for the whole image or just for the region of interest (ROI). The frame with the highest amount of Doppler signal (also called worst case scenario image - WCSI) is usually the only one analyzed. The technique requires a very precise identification of WCSI from a certain number of consecutive frames, captured from the same position of the US probe, (and in most cases this is done manually). Our study examined the ability of both experienced and in-training sonographers to identify WCSI using a computerized analytical system as the gold standard. MATERIALS AND METHODS: The study analyzed 480 frame selections done in two distinct exercises. The WCSI and other 3 images with a 5%, 10% and respectively 20% lower level of CTR compared with WCSI were packed in one selection. All frames emerging from the same video clip were randomly presented to six experienced and six in training sonographers; the request was to select the frame with the highest CTR (WCSI) from each package (twenty packages in total). A similar exercise was performed with CTRs decreasing in steps of 2%. RESULTS: In the first exercise the WCSI was correctly identified in 79.1% cases and in 67% of cases in the 2nd exercise. The interobserver agreement between experienced and in-trainer evaluators for the 1st exercise was 0.78 and 0.4 in the 2nd exercise. CONCLUSION: Using computerized analysis as the gold standard, we demonstrated a large heterogeneity across sonographers regarding their ability to identify the best Doppler image even from a small group of frames.