ABSTRACT
BACKGROUND: All military surgeons must maintain trauma capabilities for expeditionary care contexts, yet most are not trauma specialists. Maintaining clinical readiness for trauma and mass casualty care is a significant challenge for military and civilian surgeons. We examined the effect of a prescribed clinical readiness program for expeditionary trauma care on the surgical performance of 12 surgeons during a 60-patient mass-casualty situation (MASCAL). METHODS: The sample included orthopedic (four) and general surgeons (eight) who cared for MASCAL victims at Hamad Karzai International Airport, Kabul, Afghanistan, on August 26, 2021. One orthopedic and two general surgeons had prior deployment experience. The prescribed program included three primary measures of clinical readiness: 1, expeditionary knowledge (examination score); 2, procedural skills competencies (performance assessment score); and 3, clinical activity (operative practice profile metric). Data were attained from program records for each surgeon in the sample. Each of the 60 patient cases was reviewed and rated (performance score) by the Joint Trauma System's Performance Improvement Branch, a military-wide performance improvement organization. All scores were normalized to facilitate direct comparisons using effect size calculations between each predeployment measure and MASCAL surgical care. RESULTS: Predeployment knowledge and clinical activity measures met program benchmarks. Baseline predeployment procedural skills competency scores did not meet program benchmarks; however, those gaps were closed through retraining, ensuring all surgeons met or exceeded the program benchmarks predeployment. There were very large effect sizes (Cohen's d ) between all program measures and surgical care score, confirming the relationship between the program measures and MASCAL trauma care provided by the 12 surgeons. CONCLUSION: The prescribed program measures ensured that all surgeons achieved predeployment performance benchmarks and provided high-quality trauma care to our nation's service members. LEVEL OF EVIDENCE: Prognostic and Epidemiological; Level IV.
Subject(s)
Afghan Campaign 2001- , Clinical Competence , Mass Casualty Incidents , Military Medicine , Humans , Military Medicine/standards , Afghanistan , Surgeons/statistics & numerical data , Surgeons/standards , Male , Military Personnel/statistics & numerical data , FemaleABSTRACT
BACKGROUND: The clinical demands of mass casualty events strain even the most well-equipped trauma centers and are especially challenging in resource-limited rural, remote, or austere environments. Gynecologists and urologists care for patients with pelvic and abdominal injuries, but the extent to which they are able to serve as "force multipliers" for trauma care is unclear. This study examined the abilities of urologists and gynecologists to perform 32 trauma procedures after mentored training by expert trauma educators to inform the potential for these specialists to independently care for trauma patients. METHODS: Urological (6), gynecological surgeons (6), senior (postgraduate year 5) general surgery residents (6), and non-trauma-trained general surgeons (8) completed a rigorous trauma training program (Advanced Surgical Skills Exposure in Trauma Plus). All participants were assessed in their trauma knowledge and surgical abilities performing 32 trauma procedures before/after mentored training by expert trauma surgeons. Performance benchmarks were set for knowledge (80%) and independent accurate completion of all procedural components within a realistic time window (90%). RESULTS: General surgery participants demonstrated greater trauma knowledge than gynecologists and urologists; however, none of the specialties reached the 80% benchmark. Before training, general surgery, and urology participants outperformed gynecologists for overall procedural abilities. After training, only general surgeons met the 90% benchmark. Post hoc analysis revealed no differences between the groups performing most pelvic and abdominal procedures; however, knowledge associated with decision making and judgment in the provision of trauma care was significantly below the benchmark for gynecologists and urologists, even after training. CONCLUSION: For physiologically stable patients with traumatic injuries to the abdomen, pelvis, or retroperitoneum, these specialists might be able to provide appropriate care; however, they would best benefit trauma patients in the capacity of highly skilled assisting surgeons to trauma specialists. These specialists should not be considered for solo resuscitative surgical care. LEVEL OF EVIDENCE: Therapeutic/Care Management; Level IV.
Subject(s)
Clinical Competence , Mass Casualty Incidents , Humans , Female , Male , Traumatology/education , Traumatology/standards , Trauma Centers , Urology/education , Gynecology/education , Adult , Surgeons/education , Internship and ResidencyABSTRACT
Objective: The objective of the study was to compare the use of ordinal scales and interval scales for capturing surgical competency information for general surgeons performing 3 complex trauma procedures. Background: Surgical performance assessment is typically captured using nonparametric data (eg, checklists) that do not support inferential analyses. Interval scales support parametric analyses that are essential for determining competency. We compared assessment outcomes for surgeons performing 3 complex trauma procedures using ordinal and interval scales. Methods: All participants were board-certified or eligible general surgeons. Each participant was assessed by an experienced trauma surgeon while performing 3 trauma procedures on cadavers. All assessors completed a rigorous assessment certification process. We calculated descriptive statistics to examine the differences between interval (parametric) and ordinal (nonparametric) outcomes. Results: Ordinal scales overestimated competence in up to 100% of the participants and did not identify specific performance gaps. Interval scales provided more granularity and identified specific capability gaps. Conclusions: Imprecise instrumentation conveys a false sense of competence and deprives surgeons of opportunities to close capability gaps. Measuring discrete procedural components with interval scales provides a more precise measurement of surgical competency.
ABSTRACT
OBJECTIVES: 1) Evaluate the value and strength of a competency framework for identifying and measuring performance requirements for expeditionary surgeons; 2) Verify psychometric integrity of assessment instrumentation for measuring domain knowledge and skills; 3) Identify gaps in knowledge and skills capabilities using assessment strategies; 4) Examine shared variance between knowledge and skills outcomes, and the volume and diversity of routine surgical practice. BACKGROUND: Expeditionary military surgeons provide care for patients with injuries that extend beyond the care requirements of their routine surgical practice. The readiness of these surgeons to independently provide accurate care in expeditionary contexts is important for casualty care in military and civilian situations. Identifying and closing performance gap areas are essential for assuring readiness. METHODS: We implemented evidence-based processes for identifying and measuring the essential performance competencies for expeditionary surgeons. All assessment instrumentation was rigorously examined for psychometric integrity. Performance outcomes were directly measured for expeditionary surgical knowledge and skills and gap areas were identified. Knowledge and skills assessment outcomes were compared, and also compared to the volume and diversity of routine surgical practice to determine shared variance. RESULTS: Outcomes confirmed the integrity of assessment instrumentation and identified significant performance gaps for knowledge and skills in the domain. CONCLUSIONS: Identification of domain competencies and performance benchmarks, combined with best-practices in assessment instrumentation, provided a rigorous and defensible framework for quantifying domain competencies. By identifying and implementing strategies for closing performance gap areas, we provide a positive process for assuring surgical competency and clinical readiness.
Subject(s)
Clinical Competence , Surgeons , Humans , BenchmarkingABSTRACT
INTRODUCTION: Airway obstruction is the third most common cause of preventable death on the battlefield, accounting for 1%-2% of total combat fatalities. No previous surgical cricothyroidotomy (SC) studies have analyzed the learning curve required to obtain proficiency despite being studied in numerous other surgical technique training experiments. The aims of this study were to establish expert SC performance criteria, develop a novel standardized SC curriculum, and determine the necessary number of practice iterations required by a novice to reach this pre-determined performance goal. MATERIALS AND METHODS: A standardized checklist and SC performance standards were established based on the performance of 12 board certified Military Health System surgeons with prior experience on performing a SC using a simulated trauma mannequin. Expert-level criteria were defined as a SC time to completion of 40 s or less and checklist score of at least 9/10, including all critical steps. Study subjects included 89 novice providers (54 active-duty first- and second-year medical students and 35 Navy corpsmen). Subjects received instruction on performing a SC using the principles of mastery learning and performed a final test of SC proficiency on a trauma mannequin within a realistic simulated MEDEVAC helicopter. The total number of subject practice attempts, checklist scores, and time to completion were measured and/or blindly scored. Learning curve and exponential plateau equations were used to characterize their improvement in mean time to SC completion and checklist scores. RESULTS: Mean pre-test knowledge scores for the entire group were 11.8 ± 3.1 out of 24 points. Total mean practice learning plateaued at checklist scores of 9.9/10 after 7 iterations and at a mean completion time of 30.4 s after 10 iterations. During the final test performance in the helicopter, 67.4% of subjects achieved expert-level performance on the first attempt. All subjects achieved expert-level performance by the end of two additional attempts. While a significantly larger proportion of medical students (79.9%) successfully completed the helicopter test on the first attempt compared to corpsmen (54.3%), there were no statistically significant differences in mean SC completion times and checklist scores between both groups (P > 0.05). Medical students performed a SC only 1.3 s faster and scored only 0.16 points higher than corpsmen. The effect size for differences were small to negligible (Cohen's d range 0.18-0.33 for SC completion time; Cohen's d range 0.45-0.46 for checklist scores). CONCLUSION: This study successfully defined SC checklist scores and completion times based on the performance of experienced surgeons on a simulator. Using these criteria and the principles of mastery learning, novices with little knowledge and experience in SC were successfully trained to the level of experienced providers. All subjects met performance targets after training and overall performance plateaued after approximately seven iterations. Over two-thirds of subjects achieved the performance target on the first testing attempt in a simulated helicopter environment. Performance was comparable between medical student and corpsmen subgroups. Further research will assess the durability of maintaining SC skills and the timing for introducing refresher courses after initial skill acquisition.
Subject(s)
Simulation Training , Surgeons , Humans , Learning Curve , Curriculum , Computer Simulation , Education, Medical, Graduate/methods , Simulation Training/methods , Clinical CompetenceABSTRACT
Acute compartment syndrome (ACS) represents a surgical emergency requiring effective, complete fasciotomy. The purpose of this study is to evaluate cadaver-based training on the ability of practicing general surgeons to effectively perform upper extremity, thigh, and leg fasciotomies. One hundred seventeen general surgeons underwent a 2-day, cadaver-based course with formative and summative assessments based on validated scoring tools. Overall performance and critical item scores were recorded and compared utilizing analysis of variance with repeated measures and eta-squared values to evaluate effect size. For all three procedures, post-training scores were significantly improved when compared with pre-training scores (p < 0.001). Mean pre-training score for lower leg fasciotomy met the standard for competent performance of the procedure (total score > 80), whereas neither thigh nor upper extremity performance scores met this standard before training. This 2-day, cadaver-based course improves the ability of practicing general surgeons to effectively and independently perform upper extremity, thigh, and lower leg fasciotomies. (Journal of Surgical Orthopaedic Advances 32(4):238-241, 2023).
Subject(s)
Compartment Syndromes , Surgeons , Humans , Fasciotomy/education , Fasciotomy/methods , Compartment Syndromes/surgery , Lower Extremity , CadaverABSTRACT
INTRODUCTION: Preservation of life, preservation of limb, and preservation of eyesight are the priorities for military medical personnel when attending to casualties. The incidences of eye injuries in modern warfare have increased significantly, despite personal eye equipment for service members. Serious eye injuries are often overlooked or discovered in a delayed fashion because they accompany other life- and limb-threatening injuries, which are assigned a higher priority. Prehospital military ocular trauma care is to shield the eye and evacuate the casualty to definitive ophthalmic care as soon as possible, with exceptions for treatment of ocular chemical injury and orbital compartment syndrome. Retrospective analysis of eye injuries in recent conflicts identified gaps in clinical capabilities with up to 96% of ocular injuries being suboptimally managed. Ocular compartment syndrome (OCS) is a complication associated with orbital hemorrhage, where significant morbidity occurs as a result of increasing intracompartment pressure. The ischemic tolerance of the retina and optic nerve is approximately 90 minutes, so OCS must be rapidly diagnosed and aggressively treated through lateral canthotomy/cantholysis (LC/C) to prevent permanent vision loss. LC/C procedures consist of using hemostats to crush the lateral canthal fold and cutting the lateral canthal tendon from the inferior crus to relieve increasing intracompartment pressure. The purpose of this study was to examine the baseline capabilities of military physicians and surgeons to accurately and independently perform the LC/C procedures and identify performance gaps that could be closed through focused professional development activities. MATERIALS AND METHODS: This study received institutional review board approval at our institution. A total of 60 subjects voluntarily participated in the study from emergency medicine (15), general surgery (28), and ophthalmology (17). All procedural assessments were performed 1:1 by expert faculty ocular trauma specialists using a high-reliability eye trauma simulator (Sonalysts, Inc.). The competency standard was set at independent and accurate completion of all procedural components and all critical procedural components. Analyses were performed using descriptive statistics and analysis of variance to examine between-group differences (P < 0.05). RESULTS: There was a significant difference between the total score performance and the critical score performance for the three groups (P < 0.001). Outcomes indicate a significant linear relationship between the expertise level of the clinical provider and the procedural performance of LC/C. Outcomes demonstrate the baseline surgical capabilities of the general surgeons transferred to LC/C performance; however, they were unfamiliar with the anatomy and the procedural techniques and requirements. The group of emergency medicine participants demonstrated performance gaps not only in the same areas as the general surgeons but also in their baseline surgical abilities. This suggests that different professional development activities are necessary for surgeons and physicians tasked with performing LC/V procedures. CONCLUSIONS: We identified significant performance gaps among emergency medicine physicians, general surgeons, and ophthalmologists in their abilities to recognize and treat OCS through LC/C procedures. These sight-saving procedures are a critical competency for forward-situated clinicians in expeditionary contexts. We identified the need for targeted approaches to professional development for closing the performance gaps for both emergency medicine physicians and general surgeons.
ABSTRACT
OBJECTIVE: Virtual (VR), augmented (AR), mixed reality (MR) and haptic interfaces make additional avenues available for surgeon assessment, guidance and training. We evaluated applications for open trauma and emergency surgery to address the question: Have new computer-supported interface developments occurred that could improve trauma training for civilian and military surgeons performing open, emergency, non-laparoscopic surgery? DESIGN: Systematic literature review. SETTING AND PARTICIPANTS: Faculty, University of Maryland School of Medicine, Baltimore., Maryland; Womack Army Medical Center, Fort Bragg, North Carolina; Temple University, Philadelphia, Pennsylvania; Uniformed Services University of Health Sciences, and Walter Reed National Military Medical Center, Bethesda, Maryland. METHODS: Structured literature searches identified studies using terms for virtual, augmented, mixed reality and haptics, as well as specific procedures in trauma training courses. Reporting bias was assessed. Study quality was evaluated by the Kirkpatrick's Level of evidence and the Machine Learning to Asses Surgical Expertise (MLASE) score. RESULTS: Of 422 papers identified, 14 met inclusion criteria, included 282 enrolled subjects, 20% were surgeons, the remainder students, medics and non-surgeon physicians. Study design was poor and sample sizes were low. No data analyses were beyond descriptive and the highest outcome types were procedural success, subjective self-reports, except three studies used validated metrics. Among the 14 studies, Kirkpatrick's level of evidence was level zero in five studies, level 1 in 8 and level 2 in one. Only one study had MLASE Score greater than 9/20. There was a high risk of bias in 6 studies, uncertain bias in 5 studies and low risk of bias in 3 studies. CONCLUSIONS: There was inadequate evidence that VR,MR,AR or haptic interfaces can facilitate training for open trauma surgery or replace cadavers. Because of limited testing in surgeons, deficient study and technology design, risk of reporting bias, no current well-designed studies of computer-supported technologies have shown benefit for open trauma, emergency surgery nor has their use shown improved patient outcomes. Larger more rigorously designed studies and evaluations by experienced surgeons are required for a greater variety of procedures and skills. COMPETENCIES: Medical Knowledge, Practice Based Learning and Improvement, Patient Care, Systems-Based Practice.
Subject(s)
Military Personnel , Surgeons , Virtual Reality , Humans , Clinical Competence , Haptic Interfaces , User-Computer InterfaceABSTRACT
INTRODUCTION: In deployed contexts, military medical care is provided through the coordinated efforts of multiple interdisciplinary teams that work across and between a continuum of widely distributed role theaters. The forms these teams take, and functional demands, vary by roles of care, location, and mission requirements. Understanding the requirements for optimal performance of these teams to provide emergency, urgent, and trauma care for multiple patients simultaneously is critical. A team's collective ability to function is dependent on the clinical expertise (knowledge and skills), authority, experience, and affective management capabilities of the team members. Identifying the relative impacts of multiple performance factors on the accuracy of care provided by interdisciplinary clinical teams will inform targeted development requirements. MATERIALS AND METHODS: A regression study design determined the extent to which factors known to influence team performance impacted the effectiveness of small, six to eight people, interdisciplinary teams tasked with concurrently caring for multiple patients with urgent, emergency care needs. Linear regression analysis was used to distinguish which of the 11 identified predictors individually and collectively contributed to the clinical accuracy of team performance in simulated emergency care contexts. RESULTS: All data met the assumptions for regression analyses. Stepwise linear regression analysis of the 11 predictors on team performance yielded a model of five predictors accounting for 82.30% of the variance. The five predictors of team performance include (1) clinical skills, (2) team size, (3) authority profile, (4) clinical knowledge, and (5) familiarity with team members. The analysis of variance confirmed a significant linear relationship between team performance and the five predictors, F(5, 240) = 218.34, P < .001. CONCLUSIONS: The outcomes of this study demonstrate that the collective knowledge, skills, and abilities within an urgent, emergency care team must be developed to the extent that each team member is able to competently perform their role functions and that smaller teams benefit by being composed of clinical authorities who are familiar with each other. Ideally, smaller, forward-deployed military teams will be an expert team of individual experts, with the collective expertise and abilities required for their patients. This expertise and familiarity are advantageous for collective consideration of significant clinical details, potential alternatives for treatment, decision-making, and effective implementation of clinical skills during patient care. Identifying the most influential team performance factors narrows the focus of team development strategies to precisely what is needed for a team to optimally perform.
ABSTRACT
INTRODUCTION: As combat-related trauma decreases, there remains an increasing need to maintain the ability to care for trauma victims from other casualty events around the world (e.g., terrorism, natural disasters, and infrastructure failures). During these events, military surgeons often work closely with their civilian counterparts, often in austere and expeditionary contexts. In these environments, the primary aim of the surgical team is to implement damage control principles to avert blood loss, optimize oxygenation, and improve survival. Upper-extremity vascular injuries are associated with high rates of morbidity and mortality resulting from exsanguination and ischemic complications; however, fatalities may be avoided if hemorrhage is rapidly controlled. In austere contexts, deployed surgical teams typically include one general surgeon and one orthopedic surgeon, neither of which have acquired the expertise to manage these vascular injuries. The purpose of this study was to examine the baseline capabilities of general surgeons and orthopedic surgeons to surgically expose and control axillary and brachial arteries and to determine if the abilities of both groups could be increased through a focused cadaver-based training intervention. METHODS: This study received IRB approval at our institution. Study methods included the use of cadavers for baseline assessment of procedural capabilities to expose and control axillary and brachial vessels, followed by 1:1 procedural training and posttraining re-assessment of procedural capabilities. Inferential analyses included ANOVA/MANOVA for within- and between-group effects (P < .05). Effect sizes were calculated using Cohen's d. RESULTS: Study outcomes demonstrated significant differences between the baseline performance abilities of the two groups, with general surgeons outperforming orthopedic surgeons. Before training, neither group reached performance benchmarks for overall or critical procedural abilities in exposing axillary and brachial vessels. Training led to increased abilities for both groups. There were statistically significant gains for overall procedural abilities, as well as for critical procedural elements that are directly associated with morbidity and mortality. These outcomes were consistent for both general and orthopedic surgeons. Effect sizes ranged between medium (general surgeons) and very large (orthopedic surgeons). CONCLUSION: There was a baseline capability gap for both general surgeons and orthopedic surgeons to surgically expose and control the axillary and brachial vessels. Outcomes from the course suggest that the methodology facilitates the acquisition of accurate and independent vascular procedural capabilities in the management of upper-extremity trauma injuries. The impact of this training for surgeons situated in expeditionary or remote contexts has direct relevance for caring for victims of extremity trauma. These outcomes underscore the need to train all surgeons serving in rural, remote, expeditionary, combat, or global health contexts to be able to competently manage extremity trauma and concurrent vascular injuries to increase the quality of care in those settings.
ABSTRACT
Objectives: The research question asked to what extent do self-rated performance scores of individual surgeons correspond to assessed procedural performance abilities and to peer ratings of procedural performance during a mass casualty (MASCAL) event? Background: Self-assessment using performance rating scales is ubiquitous in surgical education as a proxy for direct measurement of competence. The validity and reliability of self-ratings as competency measures are susceptible to cognitive biases such as Dunning-Kruger effects, which describe how individuals over/underestimate their own performance compared to assessments from independent sources. The ability of surgeons to accurately self-assess their procedural performance remains undetermined. Methods: A purposive sample of military surgeons (N = 13) who collectively cared for trauma patients during a MASCAL event participated in the study. Pre-event performance assessment scores for 32 trauma procedures were compared with post-event self and peer performance ratings using F tests (P < 0.05) and effect sizes (Cohen's d). Results: There were no significant differences between peer ratings and performance assessment scores. There were significant differences between self-ratings and both peer ratings (P < 0.001) and performance assessment scores (P < 0.001). Effect sizes were very large for self to peer rating comparison (Cohen's d = 2.34) and self to performance assessment comparison (Cohen's d = 2.77). Conclusions: The outcomes demonstrate that self-ratings were significantly lower than the independently determined assessment scores for each surgeon, revealing a Dunning-Kruger effect for highly skilled individuals underestimating their abilities. These outcomes underscore the limitations of self-assessment for measuring competence.
ABSTRACT
The management of non-compressible torso hemorrhage in military austere/remote environments is a leading cause of potentially preventable death in the prehospital/battlefield environment that has not shown a decrease in mortality in 26 years. Numerous conceptual innovations to manage non-compressible torso hemorrhage have been developed without proven effectiveness in this setting. This scoping review aims to assess the current literature to define non-compressible torso hemorrhage in civilian and military austere/remote environments, assess current innovations and the effectiveness of these innovations, assess the current knowledge gaps and potential future innovations in the management of non-compressible torso hemorrhage in civilian and military austere/remote environments, and assess the translational health science perspective of the current literature and its potential effect on public health. The Joanna Briggs Institute for evidence synthesis will guide this scoping review to completion. A nine-step development process, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist, will be used to enhance the methodological and reporting quality of this scoping review. The Participant, Concept, Context framework will broaden this scoping review's reach in developing a comprehensive search strategy. Thirty years will be explored to assess all relevant literature to ensure a thorough search. Two researchers will explore all the discovered literature and develop consensus on the selected literature included in this scoping review. The article will undergo review and data extraction for data analysis. The knowledge to action framework will guide the knowledge synthesis and creation of this scoping review. A narrative synthesis will systematically review and synthesize the collected literature to produce and explain a broad conclusion of the selected literature. Lastly, a consultation exercise in the form of qualitative interviews will be conducted to assess the thematic analysis results and validate the result of this scoping review. This scoping review will require Institutional Review Board approval for the expert consultation in the form of qualitative interviews. Consultants' identifying information will remain confidential. The collected and analyzed data from this scoping review will identify gaps in the literature to create an evidence-informed protocol for the management of non-compressible torso hemorrhage of the abdomen in civilian and military austere/remote environments. The results of this scoping review will be distributed in peer-reviewed journals and educational, medical presentations. Scoping Review Protocol, Level IV.
ABSTRACT
Importance: Sustainment of comprehensive procedural skills in trauma surgery is a particular problem for surgeons in rural, global, and combat settings. Trauma care often requires open surgical procedures for low-frequency/high-risk injuries at a time when open surgical experience is declining in general and trauma surgery training. Objective: To determine whether general surgeons participating in a 2-day standardized trauma skills course demonstrate measurable improvement in accuracy and independent performance of specific trauma skills. Design, Setting, and Participants: General surgeons in active surgical practice were enrolled from a simulation center with anatomic laboratory from October 2019 to October 2020. Differences in pretraining/training and posttraining performance outcomes were examined using (1) pretraining/posttraining surveys, (2) pretraining/posttraining knowledge assessment, and (3) training/posttraining faculty assessment. Analysis took place in November 2020. Interventions: A 2-day standardized, immersive, cadaver-based skills course, developed with best practices in instructional design, that teaches and assesses 24 trauma surgical procedures was used. Main Outcomes and Measures: Trauma surgery capability, as measured by confidence, knowledge, abilities, and independent performance of specific trauma surgical procedures; 3-month posttraining skill transfer. Results: The study cohort included 65 active-duty general surgeons, of which 16 (25%) were women and 49 (75%) were men. The mean (SD) age was 38.5 (4.2) years. Before and during training, 1 of 65 participants (1%) were able to accurately perform all 24 procedures without guidance. After course training, 64 participants (99%) met the benchmark performance requirements for the 24 trauma procedures, and 51 (78%) were able to perform them without guidance. Procedural confidence and knowledge increased significantly from before to after the course. At 3 months after training, 37 participants (56%) reported skill transfer to trauma or other procedures. Conclusions and Relevance: In this study, direct measurement of procedural performance following standardized training demonstrated significant improvement in skill performance in a broad array of trauma procedures. This model may be useful for assessment of procedural competence in other specialties.
Subject(s)
Clinical Competence , Education, Medical, Continuing/methods , General Surgery/education , Traumatology/education , Adult , Cadaver , Curriculum , Educational Measurement , Female , Humans , MaleABSTRACT
BACKGROUND: Multiple studies have demonstrated poor performance of lower extremity fasciotomy (LEF), highlighted by missed and/or inadequately released compartments. Incorporating error management training (EMT) into surgical simulation has been promoted as a way to gain deeper understanding of procedural errors and overall performance. The purpose of this study was to evaluate LEF performance using a Fasciotomy Improvement through Recognition of Errors (FIRE) simulation training curriculum to train novice surgical trainees. METHODS: A mastery learning-based EMT curriculum was developed, and surgical residents were enrolled and pretested with a multiple-choice question (MCQ) written test, and a simulated fasciotomy using a lower leg model. Each trainee then watched a 15-minute narrated presentation followed by 2 rounds of fasciotomy error recognition and management training exercises to a mastery standard. During each round, trainees performed hands-on assessment of unique premade fasciotomy leg models containing a variable number of procedural errors. They were required to identify and propose corrective action for all errors. Serial rounds of remediation were implemented until the mastery standard was attained on both error identification rounds. All trainees were post-tested with the same MCQ and another simulated fasciotomy. RESULTS: All 14 residents had minimal experience with only 0.3 ± 0.6 fasciotomies performed prior to instruction. There were 3 ± 1.6 missed or inadequately released compartments on the pretest. Residents examined 14 ± 2.5 legs, including 2 ± 2.5 legs during remediation to attain mastery. All residents demonstrated significant improvement following the FIRE of Error curriculum for the MCQ (57% ± 16% vs 78% ± 13%; pâ¯=â¯0.01; Cohen's dâ¯=â¯1.4), fasciotomy score (10 ± 7.1 vs 28 ± 1.9; p < 0.001; Cohen's dâ¯=â¯3.6), and achieving a complete fasciotomy (14% ± 36% vs 93% ± 27%; p < 0.001; Cohen's dâ¯=â¯2.5). Only a single cumulative compartment was missed on post-testing. CONCLUSIONS: Implementation of a mastery learning-based EMT curriculum for fasciotomy simulation training results in significant improvement in fasciotomy technique without reliance on repeated procedure performance nor clinical fasciotomy exposure. This curriculum is a highly effective option for surgical trainees lacking fasciotomy training during residency.
Subject(s)
Internship and Residency , Simulation Training , Clinical Competence , Curriculum , FasciotomyABSTRACT
OBJECTIVE: Scope evidence on technical performance metrics for open emergency surgery. Identify surgical performance metrics and procedures used in trauma training courses. DESIGN: Structured literature searches of electronic databases were conducted from January 2010 to December 2019 to identify systematic reviews of tools to measure surgical skills employed in vascular or trauma surgery evaluation and training. SETTING AND PARTICIPANTS: Faculty of Shock Trauma Anesthesiology Research Center, University of Maryland School of Medicine, Uniformed Services University of Health Sciences, Bethesda, Maryland and Implementation Science, King's College, London. RESULTS: The evidence from 21 systematic reviews including over 54,000 subjects enrolled into over 840 eligible studies, identified that the Objective Structured Assessment of Technical Skill was used for elective surgery not for emergency trauma and vascular control surgery procedures. The Individual Procedure Score (IPS), used to evaluate emergency trauma procedures performed before and after training, distinguished performance of residents from experts and practicing surgeons. IPS predicted surgeons who make critical errors and need remediation interventions. No metrics showed Kirkpatrick's Level 4 evidence of technical skills training benefit to emergency surgery outcomes. CONCLUSIONS: Expert benchmarks, errors, complication rates, task completion time, task-specific checklists, global rating scales, Objective Structured Assessment of Technical Skills, and IPS were found to identify surgeons, at all levels of seniority, who are in need of remediation of technical skills for open surgical hemorrhage control. Large-scale, multicenter studies are needed to evaluate any benefit of trauma technical skills training on patient outcomes.
Subject(s)
Internship and Residency , Surgeons , Clinical Competence , Humans , London , MarylandABSTRACT
Military medical education and training often utilize theatrical makeup, or moulage, to simulate injuries or pathologies. Traditional methods of moulage application are incredibly realistic when expertly applied. However, moulage can be expensive in terms of supplies, manpower, and time. We proposed that by creating a library of illustrations for use with temporary tattoos, the overall cost of moulage could decrease with little to no impact on training goals and objectives. The development, detailed testing and plans for commercialization are outlined herein.