Solid validity evidence for two tools assessing competences in musculoskeletal ultrasound: a validity study.

OBJECTIVES: Musculoskeletal ultrasound (MSUS) is increasingly used by rheumatologists in daily clinical practice. However, MSUS is only valuable in trained hands, and assessment of trainee competences is therefore essential before independent practice. Thus, this study aimed to establish validity evidence for the EULAR and the Objective Structured Assessment of Ultrasound Skills (OSAUS) tools used for assessing MSUS competences. METHODS: Thirty physicians with different levels of MSUS experience (novices, intermediates, and experienced) performed four MSUS examinations of different joint areas on the same rheumatoid arthritis patient. All examinations were video recorded (n = 120), anonymized, and subsequently assessed in random order by two blinded raters using first the OSAUS assessment tool followed by the EULAR tool 1 month after. RESULTS: The inter-rater reliability between the two raters was high for both the OSAUS and EULAR tools, with a Pearson correlation coefficient (PCC) of 0.807 and 0.848, respectively. Both tools demonstrated excellent inter-case reliability, with a Cronbach's alpha of 0.970 for OSAUS and 0.964 for EULAR. Furthermore, there was a strong linear correlation between the OSAUS and the EULAR performance scores and the participants' experience levels (R2 = 0.897 and R2 = 0.868, respectively) and a significant discrimination between different MSUS experience levels (P < 0.001 for both). CONCLUSIONS: MSUS operator competences can be assessed reliably and valid using either the OSAUS or the EULAR assessment tool, thereby allowing a uniform competency-based MSUS education in the future. Although both tools demonstrated high inter-rater reliability, the EULAR tool was superior to OSAUS. TRIAL REGISTRATION: ClinicalTrials.gov, http://clinicaltrials.gov, NCT05256355.

Development and validation of a new tool for assessment of trainees' interventional musculoskeletal ultrasound skills.

OBJECTIVES: Interventional musculoskeletal ultrasound (MSUS) procedures are routinely performed in rheumatology practice. However, the efficacy and safety of the procedures rely on the competence of the physician, and assessment of skills is crucial. Thus, this study aimed to develop and establish validity evidence for a tool assessing trainees' interventional MSUS skills. METHODS: An expert panel of rheumatologists modified an existing tool for assessing competences in invasive abdominal and thoracic ultrasound procedures. The new tool (the Assessment of Interventional Musculoskeletal Ultrasound Skills (AIMUS) tool) reflects the essential steps in interventional MSUS. To establish validity evidence, physicians with different levels of interventional MSUS experience were enrolled and performed two procedures on a rubber fantom, simulating real patient cases. All performances were video recorded, anonymized, and assessed in random order by two blinded raters using the AIMUS tool. RESULTS: Sixty-five physicians from 21 different countries were included and categorized into groups based on their experience, resulting in 130 videos for analysis. The internal consistency of the tool was excellent, with a Cronbach's alpha of 0.96. The inter-case reliability was good with a Pearson's correlation coefficient (PCC) of 0.74 and the inter-rater reliability was moderate to good (PCC 0.58). The ability to discriminate between different levels of experience was highly significant (p< 0.001). CONCLUSIONS: We have developed and established validity evidence for a new interventional MSUS assessment tool. The tool can be applied in future competency-based educational programs, provide structured feedback to trainees in daily clinical practice, and ensure end-of-training competence.

E-learning and practical performance in musculoskeletal ultrasound: a multicentre randomized study.

OBJECTIVES: To examine the effect of pre-course e-learning on residents' practical performance in musculoskeletal ultrasound (MSUS). METHODS: This was a multicentre, randomized controlled study following the Consolidated Standards of Reporting Trials (CONSORT) statement. Residents with no or little MSUS experience were randomized to either an e-learning group or a traditional group. One week before a 2-day face-to-face MSUS course, the e-learning group received access to an interactive platform consisting of online lectures, assignments, and practical instruction videos aligned with the content of the course. The traditional group only received standard pre-course information (program, venue, and time). All participants performed a pre- and post-course practical MSUS examination and were assessed by two individual raters, blinded to the group allocation, using the validated Objective Structured Assessment of Ultrasound Skills (OSAUS) tool. RESULTS: Twenty-eight participants completed the study. There were no statistically significant differences in the pre- or post-course practical MSUS performance between the e-learning group and the traditional group; the mean pre-course OSAUS score (s.d.) in the -learning group was 5.4 (3.7) compared with 5.2 (2.4) in the traditional group (P = 0.8), whereas the post-course OSAUS score in the e-learning group was 11.1 (2.8) compared with 10.9 (2.4) in the traditional group (P = 0.8). There was a significant difference between the mean pre- and post-course scores (5.74 points, P < 0.001). The OSAUS assessment tool demonstrated good inter-rater reliability (intra-class correlation = 0.84). CONCLUSION: We found no significant impact of pre-course e-learning on novices' acquisition of practical MSUS skills. Hands-on training is of the utmost importance and improves MSUS performance significantly. The OSAUS assessment tool is an applicable tool with high interrater reliability. TRIAL REGISTRATION: https://clinicaltrials.gov/ NCT04959162.

Future use of musculoskeletal ultrasonography and magnetic resonance imaging in rheumatoid arthritis.

PURPOSE OF REVIEW: Musculoskeletal ultrasonography (MSUS) and magnetic resonance imaging (MRI) play important roles in diagnosis, monitoring, and prognostication of rheumatoid arthritis. This review highlights recent literature in this field and aims to provide insight into the future use in clinical practice. RECENT FINDINGS: Recent studies concerning the use of MSUS and MRI in clinical practice show how MSUS and MRI can improve diagnosis and monitoring of rheumatoid arthritis and how they can predict both radiographic progression and clinical outcome (e.g., successful tapering of medical treatment). Moreover, novel technical developments of the two imaging modalities, such as 3D ultrasonography, ultrasound image reading with convolutional neural network, image fusion (MSUS and MRI) and whole-body MRI show promising results. Further validation of these novel techniques is required prior to implementation. SUMMARY: MSUS and MRI will be important parts of the future management of rheumatoid arthritis patients, mostly because of their ability to detect rheumatoid arthritis changes at a very early stage and to predict the course of disease. However, the exact role in routine clinical practice is still to be defined.