Ensuring competence in ultrasound-guided procedures-a validity study of a newly developed assessment tool.

OBJECTIVES: To investigate the validity of the Interventional Ultrasound Skills Evaluation (IUSE) tool for assessment of procedural competence in ultrasound-guided procedures in a clinical environment, including a pass/fail score. METHODS: Novices and experienced radiologists were recruited from four hospitals and were observed and assessed while performing ultrasound-guided procedures. Performances were assessed using the IUSE tool by two independent raters. Validity evidence was gathered in accordance with Messick's framework: response process was ensured by standardisation of written rater instructions. Internal structure was explored using Cronbach's alpha for internal consistency reliability; inter-rater reliability was calculated as Pearson's r independently across all ratings, and test-retest reliability was reported using Cronbach's alpha. Relationship to other variables was investigated by comparing performances of the participants in each group. Consequences evidence was explored by calculating a pass/fail standard using the contrasting groups method. RESULTS: Six novices and twelve experienced radiologists were enrolled. The IUSE tool had high internal consistency (Cronbach's alpha = 0.96, high inter-rater reliability (Pearson's r = 0.95), and high test-retest reliability (Cronbach's alpha = 0.98), and the mean score was 33.28 for novices and 59.25 for experienced with a highly significant difference (p value < 0.001). The pass/fail score was set at 55 resulting in no false positives or false negatives. CONCLUSIONS: Validity evidence from multiple sources supports the use of the IUSE tool for assessment of competence in ultrasound-guided procedures in a clinical environment and its use in high-stakes assessment such as certification. A credible pass/fail criterion was established to inform decision-making. KEY POINTS: • A multi-site validity investigation established that the Interventional Ultrasound Skills Evaluation (IUSE) tool can be used to assess procedural competence in ultrasound-guided procedures. • Validity evidence was gathered according to Messick's framework validity from the following sources: response process, internal structure, relationship to other variables, and consequences evidence. • The IUSE tool can be used for both formative and summative assessment, and a credible pass/fail score was established to help inform decision-making such as certification.

Nonalcoholic Fatty Liver Disease Impairs the Liver-Alpha Cell Axis Independent of Hepatic Inflammation and Fibrosis.

Nonalcoholic fatty liver disease (NAFLD) is associated with impaired hepatic actions of glucagon and insulin. Glucagon and amino acids are linked in an endocrine feedback circuit, the liver-alpha cell axis, that may be disrupted by NAFLD. We investigated how NAFLD severity affects glucagon and insulin resistance in individuals with obesity and whether bariatric surgery improves these parameters. Plasma and liver biopsies from 33 individuals with obesity (collectively, OBE) were obtained before and 12 months after bariatric surgery (Roux-en-Y gastric bypass [RYGB] or sleeve gastrectomy [SG]). Nine healthy control individuals (collectively, CON) undergoing cholecystectomy were used as a comparison group. The NAFLD activity score (NAS) was used to subdivide study participants into the following groups: OBE-no steatosis, OBE+steatosis, and nonalcoholic steatohepatitis (NASH) and/or grade 2 fibrosis (Fib) (OBE-NASH-Fib). Measurements of amino acids by targeted metabolomics and glucagon were performed. Glucagon, amino acids (P < 0.05), and the glucagon-alanine index, a validated surrogate marker of glucagon resistance, were increased in OBE by 60%, 56%, and 61%, respectively, when compared with CON but irrespective of NAFLD severity. In contrast, markers of hepatic insulin resistance increased concomitantly with NAS. Hyperglucagonemia resolved in OBE-no steatosis and OBE+steatosis but not in OBE-NASH-Fib (median, 7.0; interquartile range, 5.0-9.8 pmol/L), regardless of improvement in insulin resistance and NAS. The type of surgery that participants underwent had no effect on metabolic outcomes. Conclusion: Glucagon resistance to amino acid metabolism exists in individuals with NAFLD independent of NAS severity. Patients with NASH showed persistent hyperglucagonemia 12 months after bariatric surgery, indicating that a disrupted liver-alpha cell may remain in NAFLD despite major improvement in liver histology.