Factors associated with increased length of stay and risk of complications in 336 patients submitted to spine surgery. The role of a validated capture system (SAVES v2) as a first-line tool to properly face the problem.

PURPOSE: In this study, we analyzed the use of a validated capture system (Spinal Adverse Events Severity system, SAVES V2) as a first non-technical skill to properly face the relevant problem of surgical complications (SCs) and adverse events (AEs) in spinal surgery. METHODS: We retrospectively collected AEs occurring in a tertiary referral center for spine surgery from January 2017 to January 2018 and classified them according to SAVES V2 system. We compared this collection of AEs with a prospective collection performed without any classification system. Univariate and multivariate logistic regression models were used to determined odds ratio (ORs) for selected potential risk factors of AEs and prolonged length of stay. RESULTS: Overall a higher number of AEs was retrospectively recorded using SAVES system compared to the prospective recording without the use of any capture system (97/336 vs 210/336, p < 0.001). The length of stay (LOS) increased in the group of complicated patients for all the procedures examined. In the non-oncological group, LOS was significantly higher for complicated patients compared to uncomplicated patients (F = 44.11, p = 0.0000). Similar results have been obtained in the oncological group of patients. In the multivariate regression model surgical time and postoperative AEs emerged as risk factors for prolonged LOS, while only the presence of previous surgeries was confirmed as risk factor for AEs. CONCLUSION: Considering that the rate of AEs and SCs in spinal surgery is still high despite the improvement of technical skills, we suggest the use of SAVES V2 capture system as a first-line tool to face the problem.

Training and assessment using the LapSim laparoscopic simulator: a scoping review of validity evidence.

INTRODUCTION: The LapSim (Surgical Science, Sweden) laparoscopic simulator is a high-fidelity virtual reality simulator for use in endoscopic surgical training. This review critiques the current validity evidence for the LapSim laparoscopic simulator, specifically with respect to its potential use as a tool and method of training and assessment in surgery. METHODS: A scoping review of the MEDLINE (PubMed), EMBASE, Cochrane and Web of Science databases was conducted in accordance with PRISMA guidelines (2020)-scoping review extension. Articles were included if they presented validity evidence for the use of the LapSim in operative skill training or assessment, in accordance with Messick's validity framework. European Association of Endoscopic Surgeons (EAES) guidelines (2005) were used to provide recommendations for the use of the LapSim in operative performance training and assessments. RESULTS: Forty-nine articles were included. An EAES level 2 recommendation was provided with regard to the internal consistency reliability of automated performance metrics in assessing performance. An EAES recommendation of 2 was awarded with respect to the ability of the LapSim to discriminate based on case volume and overall laparoscopic experience (relationships with other variables). Performance assessment metrics on the LapSim correlate with improved performance in the operating room (EAES level of recommendation 1-consequential validity). CONCLUSION: The LapSim has accumulated substantial evidence supporting the validity of its use in surgical training and assessment. Future studies should explore the relationship between the achievement of performance benchmarks on the LapSim and subsequent patient outcomes, and interrogate the benefits of implementing virtual reality simulation training and assessment curricula in post-graduate surgical training programmes.

Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review.

BACKGROUND: Technical skill assessment in surgery relies on expert opinion. Therefore, it is time-consuming, costly, and often lacks objectivity. Analysis of intraoperative data by artificial intelligence (AI) has the potential for automated technical skill assessment. The aim of this systematic review was to analyze the performance, external validity, and generalizability of AI models for technical skill assessment in minimally invasive surgery. METHODS: A systematic search of Medline, Embase, Web of Science, and IEEE Xplore was performed to identify original articles reporting the use of AI in the assessment of technical skill in minimally invasive surgery. Risk of bias (RoB) and quality of the included studies were analyzed according to Quality Assessment of Diagnostic Accuracy Studies criteria and the modified Joanna Briggs Institute checklists, respectively. Findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. RESULTS: In total, 1958 articles were identified, 50 articles met eligibility criteria and were analyzed. Motion data extracted from surgical videos (n = 25) or kinematic data from robotic systems or sensors (n = 22) were the most frequent input data for AI. Most studies used deep learning (n = 34) and predicted technical skills using an ordinal assessment scale (n = 36) with good accuracies in simulated settings. However, all proposed models were in development stage, only 4 studies were externally validated and 8 showed a low RoB. CONCLUSION: AI showed good performance in technical skill assessment in minimally invasive surgery. However, models often lacked external validity and generalizability. Therefore, models should be benchmarked using predefined performance metrics and tested in clinical implementation studies.

Universal meta-competencies of operative performances: a literature review and qualitative synthesis.

BACKGROUND: Prioritizing patient health is essential, and given the risk of mortality, surgical techniques should be objectively evaluated. However, there is no comprehensive cross-disciplinary system that evaluates skills across all aspects among surgeons of varying levels. Therefore, this study aimed to uncover universal surgical competencies by decomposing and reconstructing specific descriptions in operative performance assessment tools, as the basis of building automated evaluation system using computer vision and machine learning-based analysis. METHODS: The study participants were primarily expert surgeons in the gastrointestinal surgery field and the methodology comprised data collection, thematic analysis, and validation. For the data collection, participants identified global operative performance assessment tools according to detailed inclusion and exclusion criteria. Thereafter, thematic analysis was used to conduct detailed analyses of the descriptions in the tools where specific rules were coded, integrated, and discussed to obtain high-level concepts, namely, "Skill meta-competencies." "Skill meta-competencies" was recategorized for data validation and reliability assurance. Nine assessment tools were selected based on participant criteria. RESULTS: In total, 189 types of skill performances were extracted from the nine tool descriptions and organized into the following five competencies: (1) Tissue handling, (2) Psychomotor skill, (3) Efficiency, (4) Dissection quality, and (5) Exposure quality. The evolutionary importance of these competences' different evaluation targets and purpose over time were assessed; the results showed relatively high reliability, indicating that the categorization was reproducible. The inclusion of basic (tissue handling, psychomotor skill, and efficiency) and advanced (dissection quality and exposure quality) skills in these competencies enhanced the tools' comprehensiveness. CONCLUSIONS: The competencies identified to help surgeons formalize and implement tacit knowledge of operative performance are highly reproducible. These results can be used to form the basis of an automated skill evaluation system and help surgeons improve the provision of care and training, consequently, improving patient prognosis.

An Image Information-Based Objective Assessment Method of Technical Manipulation Skills for Intravascular Interventions.

The clinical success of vascular interventional surgery relies heavily on a surgeon's catheter/guidewire manipulation skills and strategies. An objective and accurate assessment method plays a critical role in evaluating the surgeon's technical manipulation skill level. Most of the existing evaluation methods incorporate the use of information technology to find more objective assessment models based on various metrics. However, in these models, sensors are often attached to the surgeon's hands or to interventional devices for data collection, which constrains the surgeon's operational movements or exerts an influence on the motion trajectory of interventional devices. In this paper, an image information-based assessment method is proposed for the evaluation of the surgeon's manipulation skills without the requirement of attaching sensors to the surgeon or catheters/guidewires. Surgeons are allowed to use their natural bedside manipulation skills during the data collection process. Their manipulation features during different catheterization tasks are derived from the motion analysis of the catheter/guidewire in video sequences. Notably, data relating to the number of speed peaks, slope variations, and the number of collisions are included in the assessment. Furthermore, the contact forces, resulting from interactions between the catheter/guidewire and the vascular model, are sensed by a 6-DoF F/T sensor. A support vector machine (SVM) classification framework is developed to discriminate the surgeon's catheterization skill levels. The experimental results demonstrate that the proposed SVM-based assessment method can obtain an accuracy of 97.02% to distinguish between the expert and novice manipulations, which is higher than that of other existing research achievements. The proposed method has great potential to facilitate skill assessment and training of novice surgeons in vascular interventional surgery.

Study on impact of flexible endoscopy training course for surgeons in India.

Context: Competence in flexible endoscopy is essential for all surgeons during this era of minimal access surgery. However, fewer surgeons have expertise in endoscopy due to a lack of training and interest. The Indian Association of Gastrointestinal Endo Surgeons devised a short-structured training course in the art and science of endoscopy. Aims: This study aimed to find the impact of the endoscopy training course (Endoscopic Fellowship of Indian Association of Gastrointestinal Endo Surgeons [EFIAGES]) in improving the endoscopic skill of surgeons. Settings and Design: Twenty-two-part electronic survey forms were sent to all 375 candidates who took the course between 2016 and 2019 for this retrospective observational study. Subjects and Methods: The following outcome measures were noted, namely technical competence in endoscopy before the course, delegate feedback about the course modules, volume of endoscopies before and after the course and quality indicators such as reaching up to duodenum (D2) and caecum before and after the course. Statistical Analysis Used: Statistical analysis of the impact of the course was done using Chi-square test. Results: Responses from 262 out of a total of 375 candidates were received. Seventy-seven per cent of trainees were pleased with content and mode of conduct of the course. The quality indicator of gastroscopy with the ability to reach D2 in 90% of the caseload was achieved by only 28% of trainees before the EFIAGES. This increased to 72% of candidates after the course and similar results were seen with colonoscopy also. Most of the candidates noted a distinct improvement in their endoscopic navigation skills subsequent to the course. Conclusions: Endoscopy skill transfer was possible with a short-structured endoscopy course. The surgical fraternity should realise the importance of endoscopy skills in the current era of surgical practice.

Virtual Reality Simulation Has Weak Correlation with Overall Trainee Robot-Assisted Laparoscopic Hysterectomy Performance.

STUDY OBJECTIVE: Both simulator practice and intraoperative performance serve to inform surgical trainee training, but the skill transfer from simulation to the intraoperative setting remains unclear. This study evaluates the correlation between trainee performance on virtual reality simulation and (1) overall intraoperative performance during robotic-assisted laparoscopic hysterectomy (RALH) procedures and (2) suturing performance during vaginal cuff closure portion of the case. DESIGN: Retrospective subgroup analysis of randomized controlled trial. SETTING: Academic hospital. PATIENTS: Patients with RALH (N = 29). INTERVENTIONS: Gynecological trainees (N = 21) performed simulation tasks using the da Vinci skills simulator on the day of surgery before performing RALH. Attending surgeons assessed participants' intraoperative performance using Global Evaluative Assessment of Robotic Skills (GEARS). Performance of the vaginal cuff closure step was subsequently assessed using GEARS scoring of anonymized videos. Spearman's correlation was used to quantify the relationship between simulation and intraoperative performances. MEASUREMENTS AND MAIN RESULTS: Trainees achieved a median intraoperative GEARS score of 18.5/30 (interquartile range: 17-22) and a median total simulator score of 84.4/100 (interquartile range: 78.1-87.5). More advanced residents exhibited worse overall simulator performance (median score 86.6/100 compared with 78.8/100, p = .03) and similar intraoperative GEARS scores during overall RALH and vaginal cuff closure compared with less experienced trainees. Total simulation performance score was negatively correlated with GEARS Bimanual Dexterity (ρ = -0.46, p = .02) and Force Sensitivity subscores (ρ = -0.39, p = .05). There was no correlation between total GEARS intraoperative vaginal cuff closure scores and overall simulation performances; however, total Tubes simulation score was correlated with higher GEARS Force Sensitivity subscore (ρ = 0.73, p = .05). CONCLUSIONS: In this study, there was limited correlation between simulation score metrics and trainees' overall intraoperative performance. Furthermore, we identified that GEARS scores could not distinguish between similar trainee skill levels. These findings underscore the need to develop intraoperative assessment tools that can better discriminate different but similar skill levels.

Adult essential extracorporeal membrane oxygenation (ECMO) skills for use in an e-learning program for ICU physicians, nurses and perfusionists: a consensus by a modified Delphi questionnaire.

BACKGROUND: Education in ECMO starts with basic theory and physiology. For this type of training, self-assessment e-learning modules may be beneficial. The aim of this study was to generate consensus on essential ECMO skills involving various professional groups involved in caring for ECMO patients. These skills can be used for educational purposes: development of an e-learning program and fine-tuning of ECMO-simulation programs. METHODS: Experts worldwide received an e-mail inviting them to participate in the modified Delphi questionnaire. A mixture of ECMO experts was contacted. The expert list was formed based on their scientific track record mainly in adult ECMO (research, publications, and invited presentations). This survey consisted of carefully designed questionnaires, organized into three categories, namely knowledge skills, technical skills, and attitudes. Each statement considered a skill and was rated on a 5-point Likert-scale and qualitative comments were made if needed. Based on the summarized information and feedback, the next round Delphi questionnaire was developed. A statement was considered as a key competency when at least 80% of the experts agreed or strongly agreed (rating 4/5 and 5/5) with the statement. Cronbach's Alpha score tested internal consistency. Intraclass correlation coefficient was used as reliability index for interrater consistency and agreement. RESULTS: Consensus was achieved in two rounds. Response rate in the first round was 45.3% (48/106) and 60.4% (29/48) completed the second round. Experts had respectively for the first and second round: a mean age of 43.7 years (8.2) and 43.4 (8.8), a median level of experience of 11.0 years [7.0-15.0] and 12.0 years [8.3-14.8]. Consensus was achieved with 29 experts from Australia (2), Belgium (16), France (1), Germany (1), Italy (1), Russia (2), Spain (1), Sweden, (1), The Netherlands (4). The consensus achieved in the first round was 90.9% for the statements about knowledge, 54.5% about technical skills and 75.0% about attitudes. Consensus increased in the second round: 94.6% about knowledge skills, 90.9% about technical skills and 75.0% about attitudes. CONCLUSION: An expert consensus was accomplished about the content of "adult essential ECMO skills". This consensus was mainly created with participation of physicians, as the response rate for nurses and perfusion decreased in the second round.

10 reasons why surgeons should continue performing flexible endoscopy.

Diagnostic and therapeutic potentials of flexible endoscopy have been increasing. Several surgical procedures are now performed in flexible endoscopic platform. However, it is disturbing to find that only few surgeons are keen to acquire this expertise. Endoscopic skills are not optional but essential for every general surgeon. Sooner the surgical fraternity realise this, it is better for the prospects of future surgeons. Surgical societies should implement measures to highlight the importance of endoscopy training and strive to provide adequate training opportunities.

Change of collective orientation through an interprofessional training with medical students and student nurses depending on presence and professional group.

BACKGROUND: Teamwork is an important success factors for patient treatment. The willingness of a healthcare provider to work in a team can be descripted with the construct of "Collective Orientation" (CO). The level of CO can be trained and is related to team performance. In this study, we investigated the effect of a simulator-based interprofessional training on the subject of patient fall in a hospital setting upon participations CO. To evaluate whether the course could be integrated into a longitudinal education concept, the participants were medical students and student nurses. Since effects of simulations can be influenced by the perceived reality, the results were measured as a function of Presence. METHOD: In this observation study, 62 medical students and student nurses took part in six one-day interprofessional simulation trainings with the topic patient fall. The primary outcome was the mean difference between the CO measured immediately before (T1) and after the training (T2). The Presence of the participants was measured by questionnaire immediately after the course (T2). RESULTS: Cronbach´s alpha for all scales and measurement points was higher than 0.69. CO increases over all professional groups from M = 3.42 (SD = 0.39) to M = 3.68 (SD = 0.54) significantly (p < .00; r = .5). Only the subscale "Dominance" in the professional group of the student nurses did not increase significantly. There was no correlation between Presence and the change in CO. CONCLUSION: The questionnaires of CO and Presence can be applied to medical students and student nurses. The simulation course with the topic patient fall influences the CO and can be integrated in a longitudinal curriculum of teamwork training. The subscale "Dominance" of student nurses did not change. Preparatory learning units may increase the effects. The perceived reality of the scenario is not a main success factor.

Competency-Based Education in Minimally Invasive and Robotic Colorectal Surgery.

Minimally invasive and robotic techniques have become increasingly implemented into surgical practice and are now an essential part of the foundational skills of training colorectal surgeons. Over the past 5 years there has been a shift in the surgical educational paradigm toward competency-based education (CBE). CBE recognizes that trainees learn at different rates but regardless, are required to meet a competent threshold of performance prior to independent practice. Thus, CBE attempts to replace the traditional "time" endpoint of training with "performance." Although conceptually sensible, implementing CBE has proven challenging. This article will define competence, outline appropriate assessment tools to assess technical skill, and review the literature on the number of cases required to achieve competence in colorectal procedures while outlining the barriers to implementing CBE.

A systematic review of sleep deprivation and technical skill in surgery.

BACKGROUND: It is uncertain if sleep deprivation impacts sleepy surgeons' technical skills. Lapses in surgical performance could increase morbidity and mortality. This review concludes if sleep deprivation impacts on technical skill performance in simulated environments. OBJECTIVE: Primary: 1. To identify if sleep deprivation has an impact on technical skill proficiency in surgeons. Secondary: a. To identify if the level of surgical experience, quality of sleep, or quantity of sleep influences technical skill proficiency in sleep deprived surgeons. METHODS: The review was conducted according to PRISMA guidelines utilising the databases Journals Ovid. Validation followed with two independent reviewers utilising an adapted version of BEME. RESULTS: Thirty-three heterogeneous studies were included. Sleep deprivation likely negatively impacts technical performance between 11.9 and 32% decrement in performance. No strong evidence exists with regards to influence of experience, sleep type, or sleep length on technical proficiency. CONCLUSION: Sleepy surgeons' technical skills are, on balance, between 11.9 and 32% negatively impacted in a standardised simulated environment. This is likely to have clinical implications for patient safety.

A Novel Approach to Simulation-Based Perineal Repair in Undergraduate Medical Education.

INTRODUCTION: There is no formalized hands-on teaching of suturing skills for clerkship students during their dedicated obstetrics and gynaecology (OB/GYN) teaching sessions at the University of Toronto. Nevertheless, the students are exposed to suturing during gynaecologic surgery, Caesarean sections, and perineal repairs. As a result, a formal pilot workshop on knot-tying and perineal laceration repair was developed for incorporation into the third-year clerkship curriculum with the goals of increasing students' knowledge and technical skills. METHODS: Participants consisted of students enrolled in their OB/GYN clerkship rotation at St. Michael's Hospital at the University of Toronto from December 2016 to August 2017. Prior to the workshop, students' (n = 82) baseline knowledge of perineal lacerations was assessed with a pre-test quiz and their knot-tying speeds (two hand-ties and two instrument ties) were recorded. Students were then taught perineal anatomy, laceration types and repair techniques, suturing, and knot-tying. Under direct supervision, students practiced the technical skills for 45 minutes. Knowledge and knot-tying speeds were then reassessed following the educational session. RESULTS: There was a statistically significant improvement in both knowledge (51% to 71%; P < 0.05) and technical skills (258.8 seconds to 197.4 seconds; P < 0.05) after the workshop. Importantly, 94% of students "agreed" or "strongly agreed" that this method of learning was more enjoyable than traditional methods. CONCLUSIONS: This pilot project demonstrates that a formal hands-on workshop improves medical knowledge, technical skills, and student satisfaction. This has the potential for students to have increased opportunities at the bedside, with higher patient acceptance and safety.

Objective Assessment of Surgical Technical Skill and Competency in the Operating Room.

Training skillful and competent surgeons is critical to ensure high quality of care and to minimize disparities in access to effective care. Traditional models to train surgeons are being challenged by rapid advances in technology, an intensified patient-safety culture, and a need for value-driven health systems. Simultaneously, technological developments are enabling capture and analysis of large amounts of complex surgical data. These developments are motivating a "surgical data science" approach to objective computer-aided technical skill evaluation (OCASE-T) for scalable, accurate assessment; individualized feedback; and automated coaching. We define the problem space for OCASE-T and summarize 45 publications representing recent research in this domain. We find that most studies on OCASE-T are simulation based; very few are in the operating room. The algorithms and validation methodologies used for OCASE-T are highly varied; there is no uniform consensus. Future research should emphasize competency assessment in the operating room, validation against patient outcomes, and effectiveness for surgical training.

Implementing assessments of robot-assisted technical skill in urological education: a systematic review and synthesis of the validity evidence.

OBJECTIVES: To systematically review and synthesise the validity evidence supporting intraoperative and simulation-based assessments of technical skill in urological robot-assisted surgery (RAS), and make evidence-based recommendations for the implementation of these assessments in urological training. MATERIALS AND METHODS: A literature search of the Medline, PsycINFO and Embase databases was performed. Articles using technical skill and simulation-based assessments in RAS were abstracted. Only studies involving urology trainees or faculty were included in the final analysis. RESULTS: Multiple tools for the assessment of technical robotic skill have been published, with mixed sources of validity evidence to support their use. These evaluations have been used in both the ex vivo and in vivo settings. Performance evaluations range from global rating scales to psychometrics, and assessments are carried out through automation, expert analysts, and crowdsourcing. CONCLUSION: There have been rapid expansions in approaches to RAS technical skills assessment, both in simulated and clinical settings. Alternative approaches to assessment in RAS, such as crowdsourcing and psychometrics, remain under investigation. Evidence to support the use of these metrics in high-stakes decisions is likely insufficient at present.

The role of simulation training in anesthesiology resident education.

An increasing number of reports indicate the efficacy of simulation training in anesthesiology resident education. Simulation education helps learners to acquire clinical skills in a safe learning environment without putting real patients at risk. This useful tool allows anesthesiology residents to obtain medical knowledge and both technical and non-technical skills. For faculty members, simulation-based settings provide the valuable opportunity to evaluate residents' performance in scenarios including airway management and regional, cardiac, and obstetric anesthesiology. However, it is still unclear what types of simulators should be used or how to incorporate simulation education effectively into education curriculums. Whether simulation training improves patient outcomes has not been fully determined. The goal of this review is to provide an overview of the status of simulation in anesthesiology resident education, encourage more anesthesiologists to get involved in simulation education to propagate its influence, and stimulate future research directed toward improving resident education and patient outcomes.

Surgical resident technical skill self-evaluation: increased precision with training progression.

BACKGROUND: Surgical resident ability to accurately evaluate one's own skill level is an important part of educational growth. We aimed to determine if differences exist between self and observer technical skill evaluation of surgical residents performing a single procedure. MATERIALS AND METHODS: We prospectively enrolled 14 categorical general surgery residents (six post-graduate year [PGY] 1-2, three PGY 3, and five PGY 4-5). Over a 6-month period, following each laparoscopic cholecystectomy, residents and seven faculty each completed the Objective Structured Assessment of Technical Skills (OSATS). Spearman's coefficient was calculated for three groups: senior (PGY 4-5), PGY3, and junior (PGY 1-2). Rho (ρ) values greater than 0.8 were considered well correlated. RESULTS: Of the 125 paired assessments (resident-faculty each evaluating the same case), 58 were completed for senior residents, 54 for PGY3 residents, and 13 for junior residents. Using the mean from all OSATS categories, trainee self-evaluations correlated well to faculty (senior ρ 0.97, PGY3 ρ 0.9, junior ρ 0.9). When specific OSATS categories were analyzed, junior residents exhibited poor correlation in categories of respect for tissue (ρ -0.5), instrument handling (ρ 0.71), operative flow (ρ 0.41), use of assistants (ρ 0.05), procedural knowledge (ρ 0.32), and overall comfort with the procedure (ρ 0.73). PGY3 residents lacked correlation in two OSATS categories, operative flow (ρ 0.7) and procedural knowledge (ρ 0.2). Senior resident self-evaluations exhibited strong correlations to observers in all areas. CONCLUSIONS: Surgical residents improve technical skill self-awareness with progressive training. Less-experienced trainees have a tendency to over-or-underestimate technical skill.

Evaluation of crowd-sourced assessment of the critical view of safety in laparoscopic cholecystectomy.

BACKGROUND: Faculty experts (FE) and crowd workers (CW) can assess technical skill, but assessment of operative technique has not been explored. We sought to evaluate if CW could be taught to assess completion of the critical view of safety (CVS) in laparoscopic cholecystectomy. METHODS: We prepared 160 blinded, surgical videos of laparoscopic cholecystectomy from public domain websites. Videos were edited to ≤60 s, ending when a structure was cut/clipped. CW analyzed videos using Global Objective Assessment of Laparoscopic Skills (GOALS) and CVS criteria assessment tools after watching an instructional tutorial. Ten videos were randomly selected from each performance quartile based on GOALS. Five FE rated the 40 videos using GOALS and CVS. Linear mixed effects models derived average CW and FE ratings for GOALS and CVS for each video. Spearman correlation coefficients (SCC) were used to assess the degree of correlation between performance measures. Satisfactory completion of the CVS was defined as scoring an average CVS ≥ 5. Videos with an average GOALS ≥ 15 were considered top technical performers. RESULTS: A high degree of correlation was seen between all performance measures: CVS ratings between CW and FE, SCC 0.89 (p < 0.001); GOALS and CVS ratings SCC 0.77 (p < 0.001) for CW, and SCC 0.71 (p < 0.001) for FE. Sixteen videos were assigned top technical performer ratings by both CW and FE but the average CVS was inadequate (3.8 and 3.6, respectively), and the percentage of satisfactory CVS ≥ 5 was 12.5%. CONCLUSIONS: A high degree of correlation was found between CW and FE in assessment of the CVS. However, in this video analysis, high technical performers did not achieve a complete CVS in most cases. Educating CW to assess operative technique for the identification of low or average performers is feasible and may broaden the application of this assessment and feedback tool.

Do resident's leadership skills relate to ratings of technical skill?

BACKGROUND: This study sought to compare general surgery research residents' survey information regarding self-efficacy ratings to their observed performance during a simulated small bowel repair. Their observed performance ratings were based on their leadership skills in directing their assistant. METHODS: Participants were given 15 min to perform a bowel repair using bovine intestines with standardized injuries. Operative assistants were assigned to help assist with the repair. Before the procedure, participants were asked to rate their expected skills decay, task difficulty, and confidence in addressing the small bowel injury. Interactions were coded to identify the number of instructions given by the participants to the assistant during the repair. Statistical analyses assessed the relationship between the number of directional instructions and participants' perceptions self-efficacy measures. Directional instructions were defined as any dialog by the participant who guided the assistant to perform an action. RESULTS: Thirty-six residents (58.3% female) participated in the study. Participants who rated lower levels of decay in their intraoperative decision-making and small bowel repair skills were noted to use their assistant more by giving more instructions. Similarly, a higher number of instructions correlated with lower perceived difficulty in selecting the correct suture, suture pattern, and completing the entire surgical task. CONCLUSIONS: General surgery research residents' intraoperative leadership skills showed significant correlations to their perceptions of skill decay and task difficulty during a bowel repair. Evaluating resident's directional instructions may provide an additional individualized intraoperative assessment metric. Further evaluation relating to operative performance outcomes is warranted.