Development and validation of metrics for assessment of ultrasound-guided fascial block skills☆.

BACKGROUND: As few anaesthetists provide lumbar erector spinae block for disc surgery, there is a need to provide training to enable a randomised controlled trial investigating analgesia after painful spinal surgery (NIHR153170). The primary objective of the study was to develop and measure the construct validity of a checklist for assessment of skills in performing lumbar and thoracic erector spinae fascial plane injection using soft-embalmed Thiel cadavers. METHODS: Twenty-four UK consultant regional anaesthetists completed two iterations of a Delphi questionnaire. The final checklist consisted of 11 steps conducive to best practice. Thereafter, we validated the checklist by comparing the performance of 12 experts with 12 novices, each performing lumbar and thoracic erector spinae plane injections or fascia iliaca, serrato-pectoral (PEC II) and serratus injections, randomly allocated to the left and right sides of six soft-embalmed Thiel cadavers. Six expert, trained raters blinded to operator and site of block examined 120 videos each. RESULTS: The mean (95% confidence interval) internal consistency of the 11-item checklist for erector spinae plane injection was 0.72 (0.63-0.79) and interclass correlation was 0.88 (0.82-0.93). The checklist showed construct validity for lumbar and thoracic erector spinae injection, experts vs novices {median (interquartile range [range]) 8.0 (7.0-10.0 [1-11]) vs 7.0 (5.0-9.0 [4-11]), difference 1.5 (1.0-2.5), P<0.001}. Global rating scales showed construct validity for lumbar and thoracic erector spinae injection, 28.0 (24.0-31.0 [7-35]) vs 21.0 (17.0-24.0 [7-35]), difference 7.5 (6.0-8.5), P<0.001. The most difficult items to perform were identifying the needle tip before advancing and always visualising the needle tip. Instrument handling and flow of procedure were the areas of greatest difficulty on the global rating scale (GRS). Checklists and GRS scores correlated. There was homogeneity of regression slopes controlling for status, type of injection, and rater. Generalisability analysis showed a high reliability using the checklist and GRS for all fascial plane blocks (Rho [ρ2] 0.93-0.96: Phi [ϕ] 0.84-0.87). CONCLUSIONS: An 11-point checklist developed through a modified Delphi process to provide best practice guidance for fascial plane injection showed construct validity in performing lumbar and thoracic erector spinae fascial plane injection in soft-embalmed Thiel cadavers.

Patterns of Skills Acquisition in Anesthesiologists During Simulated Interscalene Block Training on a Soft Embalmed Thiel Cadaver: Cohort Study.

BACKGROUND: The demand for regional anesthesia for major surgery has increased considerably, but only a small number of anesthesiologists can provide such care. Simulations may improve clinical performance. However, opportunities to rehearse procedures are limited, and the clinical educational outcomes prescribed by the Royal College of Anesthesiologists training curriculum 2021 are difficult to attain. Educational paradigms, such as mastery learning and dedicated practice, are increasingly being used to teach technical skills to enhance skills acquisition. Moreover, high-fidelity, resilient cadaver simulators are now available: the soft embalmed Thiel cadaver shows physical characteristics and functional alignment similar to those of patients. Tissue elasticity allows tissues to expand and relax, fluid to drain away, and hundreds of repeated injections to be tolerated without causing damage. Learning curves and their intra- and interindividual dynamics have not hitherto been measured on the Thiel cadaver simulator using the mastery learning and dedicated practice educational paradigm coupled with validated, quantitative metrics, such as checklists, eye tracking metrics, and self-rating scores. OBJECTIVE: Our primary objective was to measure the learning slopes of the scanning and needling phases of an interscalene block conducted repeatedly on a soft embalmed Thiel cadaver over a 3-hour period of training. METHODS: A total of 30 anesthesiologists, with a wide range of experience, conducted up to 60 ultrasound-guided interscalene blocks over 3 hours on the left side of 2 soft embalmed Thiel cadavers. The duration of the scanning and needling phases was defined as the time taken to perform all the steps correctly. The primary outcome was the best-fit linear slope of the log-log transformed time to complete each phase. Our secondary objectives were to measure preprocedural psychometrics, describe deviations from the learning slope, correlate scanning and needling phase data, characterize skills according to clinical grade, measure learning curves using objective eye gaze tracking and subjective self-rating measures, and use cluster analysis to categorize performance irrespective of grade. RESULTS: The median (IQR; range) log-log learning slopes were -0.47 (-0.62 to -0.32; -0.96 to 0.30) and -0.23 (-0.34 to -0.19; -0.71 to 0.27) during the scanning and needling phases, respectively. Locally Weighted Scatterplot Smoother curves showed wide variability in within-participant performance. The learning slopes of the scanning and needling phases correlated: ρ=0.55 (0.23-0.76), P<.001, and ρ=-0.72 (-0.46 to -0.87), P<.001, respectively. Eye gaze fixation count and glance count during the scanning and needling phases best reflected block duration. Using clustering techniques, fixation count and glance were used to identify 4 distinct patterns of learning behavior. CONCLUSIONS: We quantified learning slopes by log-log transformation of the time taken to complete the scanning and needling phases of interscalene blocks and identified intraindividual and interindividual patterns of variability.

Validity and reliability of metrics for translation of regional anaesthesia performance from cadavers to patients.

BACKGROUND: Our goal is to develop metrics that quantify the translation of performance from cadavers to patients. Our primary objective was to develop steps and error checklists from a Delphi questionnaire. Our second objective was to show that our test scores were valid and reliable. METHODS: Sixteen UK experts identified 15 steps conducive to good performance and 15 errors to be avoided during interscalene block on the soft-embalmed cadaver and patients. Thereafter, six experts and six novices were trained, and then tested. Training consisted of psychometric assessment, an anatomy tutorial, volunteer scanning, and ultrasound-guided needle insertion on a pork phantom and on a soft-embalmed cadaver. For testing, participants conducted a single interscalene block on a dedicated soft-embalmed cadaver whilst wearing eye tracking glasses. RESULTS: We developed a 15-step checklist and a 15-error checklist. The internal consistency of our steps measures were 0.83 (95% confidence interval [CI]: 0.78-0.89) and 0.90 (95% CI: 0.87-0.93) for our error measures. The experts completed more steps (mean difference: 3.2 [95% CI: 1.5-4.8]; P<0.001), had less errors (mean difference: 4.9 [95% CI: 3.5-6.3]; P<0.001), had better global rating scores (mean difference: 6.8 [95% CI: 3.6-10.0]; P<0.001), and more eye-gaze fixations (median of differences: 128 [95% CI: 0-288]; P=0.048). Fixation count correlated negatively with steps (r=-0.60; P=0.04) and with errors (r=0.64; P=0.03). CONCLUSIONS: Our tests to quantify ultrasound-guided interscalene nerve block training and performance were valid and reliable.