A Novel Paradigm for Surgical Skills Training and Assessment of Competency.

Importance: Sustainment of comprehensive procedural skills in trauma surgery is a particular problem for surgeons in rural, global, and combat settings. Trauma care often requires open surgical procedures for low-frequency/high-risk injuries at a time when open surgical experience is declining in general and trauma surgery training. Objective: To determine whether general surgeons participating in a 2-day standardized trauma skills course demonstrate measurable improvement in accuracy and independent performance of specific trauma skills. Design, Setting, and Participants: General surgeons in active surgical practice were enrolled from a simulation center with anatomic laboratory from October 2019 to October 2020. Differences in pretraining/training and posttraining performance outcomes were examined using (1) pretraining/posttraining surveys, (2) pretraining/posttraining knowledge assessment, and (3) training/posttraining faculty assessment. Analysis took place in November 2020. Interventions: A 2-day standardized, immersive, cadaver-based skills course, developed with best practices in instructional design, that teaches and assesses 24 trauma surgical procedures was used. Main Outcomes and Measures: Trauma surgery capability, as measured by confidence, knowledge, abilities, and independent performance of specific trauma surgical procedures; 3-month posttraining skill transfer. Results: The study cohort included 65 active-duty general surgeons, of which 16 (25%) were women and 49 (75%) were men. The mean (SD) age was 38.5 (4.2) years. Before and during training, 1 of 65 participants (1%) were able to accurately perform all 24 procedures without guidance. After course training, 64 participants (99%) met the benchmark performance requirements for the 24 trauma procedures, and 51 (78%) were able to perform them without guidance. Procedural confidence and knowledge increased significantly from before to after the course. At 3 months after training, 37 participants (56%) reported skill transfer to trauma or other procedures. Conclusions and Relevance: In this study, direct measurement of procedural performance following standardized training demonstrated significant improvement in skill performance in a broad array of trauma procedures. This model may be useful for assessment of procedural competence in other specialties.

Scoping Evidence Review on Training and Skills Assessment for Open Emergency Surgery.

OBJECTIVE: Scope evidence on technical performance metrics for open emergency surgery. Identify surgical performance metrics and procedures used in trauma training courses. DESIGN: Structured literature searches of electronic databases were conducted from January 2010 to December 2019 to identify systematic reviews of tools to measure surgical skills employed in vascular or trauma surgery evaluation and training. SETTING AND PARTICIPANTS: Faculty of Shock Trauma Anesthesiology Research Center, University of Maryland School of Medicine, Uniformed Services University of Health Sciences, Bethesda, Maryland and Implementation Science, King's College, London. RESULTS: The evidence from 21 systematic reviews including over 54,000 subjects enrolled into over 840 eligible studies, identified that the Objective Structured Assessment of Technical Skill was used for elective surgery not for emergency trauma and vascular control surgery procedures. The Individual Procedure Score (IPS), used to evaluate emergency trauma procedures performed before and after training, distinguished performance of residents from experts and practicing surgeons. IPS predicted surgeons who make critical errors and need remediation interventions. No metrics showed Kirkpatrick's Level 4 evidence of technical skills training benefit to emergency surgery outcomes. CONCLUSIONS: Expert benchmarks, errors, complication rates, task completion time, task-specific checklists, global rating scales, Objective Structured Assessment of Technical Skills, and IPS were found to identify surgeons, at all levels of seniority, who are in need of remediation of technical skills for open surgical hemorrhage control. Large-scale, multicenter studies are needed to evaluate any benefit of trauma technical skills training on patient outcomes.

A protocol paper: community engagement interventions for cardiovascular disease prevention in socially disadvantaged populations in the UK: an implementation research study.

Background: Cardiovascular disorders (CVD) are the single greatest cause of mortality worldwide. In the UK, the National Health Service (NHS) has launched an initiative of health checks over and above current care to tackle CVD. However, the uptake of Health Checks is poor in disadvantaged communities. This protocol paper sets out a UK-based study (Sussex and Nottingham) aiming to co-produce a community delivered CVD risk assessment and coaching intervention to support community members to reduce their risk of CVD.The overall aim of the project is to implement a tailored-to-context community engagement (CE) intervention on awareness of CVD risks in vulnerable populations in high, middle and low-income countries. The specific objectives of the study are to enhance stakeholder' engagement; to implement lifestyle interventions for cardiovascular primary prevention, in disadvantaged populations and motivate uptake of NHS health checks. Methods: This study uses both qualitative and quantitative methods in three phases of evaluation, including pre-, per- and post-implementation. To ensure contextual appropriateness the 'Scaling-up Packages of Interventions for Cardiovascular disease prevention in selected sites in Europe and Sub-Saharan Africa: An implementation research' (SPICES) project will organize a multi-component community-engagement intervention. For the qualitative component, the pre-implementation phase will involve a contextual assessment and stakeholder mapping, exploring potentials for CVD risk profiling strategies and led by trained Community Health Volunteers (CHV) to identify accessibility and acceptability. The per-implementation phase will involve healthy lifestyle counselling provided by CHVs and evaluation of the outcome to identify fidelity and scalability. The post-implementation phase will involve developing sustainable community-based strategies for CVD risk reduction. All three components will include a process evaluation. A stepped wedge cluster randomised trial of the roll out will focus on implementation outcomes including uptake and engagement and changes in risk profiles. The quantitative component includes pre and post-intervention surveys. The theory of the socio-ecological framework will be applied to analyse the community engagement approach. Discussion: Based on the results ultimately a sustainable community engagement-based strategy for the primary prevention of CVD risk will be developed to enhance the performance of NHS health care in the UK. The Trial Registration number is ISRCTN68334579.

Self-assessment of Skills by Surgeons and Anesthesiologists After a Trauma Surgery Masterclass.

BACKGROUND: In the Netherlands, each year a three-day international multidisciplinary trauma masterclass is organized to provide the knowledge and skills needed to care for critically injured trauma patients. This study was designed to longitudinally evaluate the effect of the course on participant's self-assessment of their own ability and confidence to perform general and specific skills. METHODS: Between 2013 and 2016, all participants were invited to complete a questionnaire before and during follow-up. Participants were asked to self-assess their level of confidence to perform general skills (communication, teamwork, leadership) and specific skills. Mean scores were calculated, and mixed models were used to evaluate correlation. RESULTS: We asked 265 participants to participate. Response rate was 64% for the pre-questionnaire, 63% for the post-questionnaire and for 3 months, 1 year and 2 years, respectively, 40%, 30%, 20%. The surgical group showed a statistically significant increase in self-assessed confidence for general skills (3.82-4.20) and specific technical skills (3.01-3.83; p < 0.001). In the anesthetic group, self-assessed confidence increased significantly in general skills (3.72-4.26) and specific technical skills (3.33-4.08; p < 0.001). For both groups statistical significance remained during follow-up. CONCLUSIONS: This study demonstrated a sustained positive effect of a dedicated multidisciplinary trauma training curriculum on participant's self-assessed confidence to perform both general and specific technical skills necessary for the care of injured patients. Given the known association between confidence and competence, these findings provide evidence that dedicated trauma training curricula can provide positive lasting results. LEVEL OF EVIDENCE: This is a basic science paper and therefore does not require a level of evidence.

Fasciotomy Improvement Through Recognition of Errors Course: A Focused Needs Assessment for Error Management Training for Lower Extremity Fasciotomy Performance.

BACKGROUND: Many injuries from recent wars involve extremity trauma secondary to blasts, which predispose patients to developing extremity compartment syndrome. In military studies, 17% of fasciotomies required revision on arrival to a Role 4 hospital, and 41% of these had missed compartments, which is similar to that seen in civilian centers. While training has decreased this rate to 8%, this number is still too high. We conducted a focused needs assessment to guide the development of lower-extremity fasciotomy training. METHODS: In a predeployment assessment, 42 military surgeons performed a 2-incision, 4-compartment, lower-extremity fasciotomy on simulated lower leg models. Models were assessed for standardized and objectively-assessed major (inadequate skin or fascial incisions, missed compartments) and minor (failure to make an H-shaped incision over the lateral compartments, division of the greater saphenous vein) errors based on joint Trauma System clinical practice guidelines and approved training curricula. RESULTS: Four of 42 (9.5%) models contained no errors. Models averaged 4.3 ± 2.6 major and 0.3 ± 0.5 minor errors. 11 models (26.2%) had at least one missed compartment. The most common missed compartments were the deep posterior (17%) and anterior (14%). 29 (69%) had inadequate or poorly-placed skin incisions, with the most common being inadequate distal extension of the medial (10, 24%) and lateral (14, 33%) incisions, inadequate proximal extension of the lateral incision (6, 14%), medial incision too close to the tibia (7, 17%), and lateral incision over or behind the fibula (12, 29%). A total of 36 (86%) had inadequate fascial incisions. Inadequate fasciotomies were seen in the anterior (57%), lateral (55%), superficial (52%), and deep (34%) posterior compartments CONCLUSIONS: Performance on the models approximates what has been seen in military and civilian settings. This needs assessment will inform development of a simulation curriculum based on error-management and mastery learning theory to reduce the morbidity of lower-extremity compartment syndrome.

Assessment of Anatomical Knowledge and Core Trauma Competency Vascular Skills.

Objectives: Surgical residents express confidence in performing specific vascular exposures before training, but such self-reported confidence did not correlate with co-located evaluator ratings. This study reports residents' self-confidence evaluated before and after Advanced Surgical Skills for Exposure in Trauma (ASSET) cadaver-based training, and 12-18 mo later. We hypothesize that residents will better judge their own skill after ASSET than before when compared with evaluator ratings. Methods: Forty PGY2-7 surgical residents performed four procedures: axillary artery (AA), brachial artery (BA), femoral artery exposure and control (FA), and lower extremity fasciotomy (FAS) at the three evaluations. Using 5-point Likert scales, surgeons self-assessed their confidence in anatomical understanding and procedure performance after each procedure and evaluators rated each surgeon accordingly. Results: For all the three evaluations, residents consistently rated their anatomical understanding (p < 0.04) and surgical performance (p < 0.03) higher than evaluators for both FA and FAS. Residents rated their anatomical understanding and surgical performance higher (p < 0.005) than evaluators for BA after training and up to 18 mo later. Only for third AA evaluation were there no rating differences. Conclusions: Residents overrate their anatomical understanding and performance abilities for BA, FA, and FAS even after performing the procedures and being debriefed three times in 18 mo.

Development and validation of trauma surgical skills metrics: Preliminary assessment of performance after training.

BACKGROUND: Maintaining trauma-specific surgical skills is an ongoing challenge for surgical training programs. An objective assessment of surgical skills is needed. We hypothesized that a validated surgical performance assessment tool could detect differences following a training intervention. METHODS: We developed surgical performance assessment metrics based on discussion with expert trauma surgeons, video review of 10 experts and 10 novice surgeons performing three vascular exposure procedures and lower extremity fasciotomy on cadavers, and validated the metrics with interrater reliability testing by five reviewers blinded to level of expertise and a consensus conference. We tested these performance metrics in 12 surgical residents (Year 3-7) before and 2 weeks after vascular exposure skills training in the Advanced Surgical Skills for Exposure in Trauma (ASSET) course. Performance was assessed in three areas as follows: knowledge (anatomic, management), procedure steps, and technical skills. Time to completion of procedures was recorded, and these metrics were combined into a single performance score, the Trauma Readiness Index (TRI). Wilcoxon matched-pairs signed-ranks test compared pretraining/posttraining effects. RESULTS: Mean time to complete procedures decreased by 4.3 minutes (from 13.4 minutes to 9.1 minutes). The performance component most improved by the 1-day skills training was procedure steps, completion of which increased by 21%. Technical skill scores improved by 12%. Overall knowledge improved by 3%, with 18% improvement in anatomic knowledge. TRI increased significantly from 50% to 64% with ASSET training. Interrater reliability of the surgical performance assessment metrics was validated with single intraclass correlation coefficient of 0.7 to 0.98. CONCLUSION: A trauma-relevant surgical performance assessment detected improvements in specific procedure steps and anatomic knowledge taught during a 1-day course, quantified by the TRI. ASSET training reduced time to complete vascular control by one third. Future applications include assessing specific skills in a larger surgeon cohort, assessing military surgical readiness, and quantifying skill degradation with time since training.