Proficiency-based training for robotic surgery: construct validity, workload, and expert levels for nine inanimate exercises.

BACKGROUND: We previously developed nine inanimate training exercises as part of a comprehensive, proficiency-based robotic training curriculum that addressed 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to evaluate construct validity, workload, and expert levels for the nine exercises. METHODS: Expert robotic surgeons (n = 8, fellows and faculty) and novice trainees (n = 4, medical students) each performed three to five consecutive repetitions of nine previously reported exercises (five FLS models with or without modifications and four custom-made models). Each task was scored for time and accuracy using modified FLS metrics; task scores were normalized to a previously established (preliminary) proficiency level and a composite score equaled the sum of the nine normalized task scores. Questionnaires were administered regarding prior experience. After each exercise, participants completed a validated NASA-TLX Workload Scale to rate the mental, physical, temporal, performance, effort, and frustration levels of each task. RESULTS: Experts had performed 119 (range = 15-600) robotic operations; novices had observed ≤ 1 robotic operation. For all nine tasks and the composite score, experts achieved significantly better performance than novices (932 ± 67 vs. 618 ± 111, respectively; P < 0.001). No significant differences in workload between experts and novices were detected (32.9 ± 3.5 vs. 32.0 ± 9.1, respectively; n.s.). Importantly, frustration ratings were relatively low for both groups (4.0 ± 0.7 vs. 3.8 ± 1.6, n.s.). The mean performance of the eight experts was deemed suitable as a revised proficiency level for each task. CONCLUSION: Using objective performance metrics, all nine exercises demonstrated construct validity. Workload was similar between experts and novices and frustration was low for both groups. These data suggest that the nine structured exercises are suitable for proficiency-based robotic training.

Comprehensive proficiency-based inanimate training for robotic surgery: reliability, feasibility, and educational benefit.

BACKGROUND: We previously developed a comprehensive proficiency-based robotic training curriculum demonstrating construct, content, and face validity. This study aimed to assess reliability, feasibility, and educational benefit associated with curricular implementation. METHODS: Over an 11-month period, 55 residents, fellows, and faculty (robotic novices) from general surgery, urology, and gynecology were enrolled in a 2-month curriculum: online didactics, half-day hands-on tutorial, and self-practice using nine inanimate exercises. Each trainee completed a questionnaire and performed a single proctored repetition of each task before (pretest) and after (post-test) training. Tasks were scored for time and errors using modified FLS metrics. For inter-rater reliability (IRR), three trainees were scored by two raters and analyzed using intraclass correlation coefficients (ICC). Data from eight experts were analyzed using ICC and Cronbach's α to determine test-retest reliability and internal consistency, respectively. Educational benefit was assessed by comparing baseline (pretest) and final (post-test) trainee performance; comparisons used Wilcoxon signed-rank test. RESULTS: Of the 55 trainees that pretested, 53 (96 %) completed all curricular components in 9-17 h and reached proficiency after completing an average of 72 ± 28 repetitions over 5 ± 1 h. Trainees indicated minimal prior robotic experience and "poor comfort" with robotic skills at baseline (1.8 ± 0.9) compared to final testing (3.1 ± 0.8, p < 0.001). IRR data for the composite score revealed an ICC of 0.96 (p < 0.001). Test-retest reliability was 0.91 (p < 0.001) and internal consistency was 0.81. Performance improved significantly after training for all nine tasks and according to composite scores (548 ± 176 vs. 914 ± 81, p < 0.001), demonstrating educational benefit. CONCLUSION: This curriculum is associated with high reliability measures, demonstrated feasibility for a large cohort of trainees, and yielded significant educational benefit. Further studies and adoption of this curriculum are encouraged.

Regulation of VEGF-induced endothelial cell migration by mitochondrial reactive oxygen species.

Endothelial migration is a crucial aspect of a variety of physiologic and pathologic conditions including atherosclerosis and vascular repair. Reactive oxygen species (ROS) function as second messengers during endothelial migration. Multiple intracellular sources of ROS are regulated by cellular context, external stimulus, and the microenvironment. However, the predominant source of ROS during endothelial cell (EC) migration and the mechanisms by which ROS regulate cell migration are incompletely understood. In this study, we tested the hypothesis that mitochondria-derived ROS (mtROS) regulate EC migration. In cultured human umbilical vein endothelial cells, VEGF increased mitochondrial metabolism, promoted mtROS production, and induced cell migration. Either the targeted mitochondrial delivery of the antioxidant, vitamin E (Mito-Vit-E), or the depletion of mitochondrial DNA abrogated VEGF-mediated mtROS production. Overexpression of mitochondrial catalase also inhibited VEGF-induced mitochondrial metabolism, Rac activation, and cell migration. Furthermore, these interventions suppressed VEGF-stimulated EC migration and blocked Rac1 activation in endothelial cells. Constitutively active Rac1 reversed Mito-Vit-E-induced inhibition of EC migration. Mito-Vit-E also attenuated carotid artery reendothelialization in vivo. These results provide strong evidence that mtROS regulate EC migration through Rac-1.

Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology.

BACKGROUND: The authors previously developed a comprehensive, proficiency-based robotic training curriculum that aimed to address 23 unique skills identified via task deconstruction of robotic operations. The purpose of this study was to determine the content and face validity of this curriculum. METHODS: Expert robotic surgeons (n = 12) rated each deconstructed skill regarding relevance to robotic operations, were oriented to the curricular components, performed 3 to 5 repetitions on the 9 exercises, and rated each exercise. RESULTS: In terms of content validity, experts rated all 23 deconstructed skills as highly relevant (4.5 on a 5-point scale). Ratings for the 9 inanimate exercises indicated moderate to thorough measurement of designated skills. For face validity, experts indicated that each exercise effectively measured relevant skills (100% agreement) and was highly effective for training and assessment (4.5 on a 5-point scale). CONCLUSIONS: These data indicate that the 23 deconstructed skills accurately represent the appropriate content for robotic skills training and strongly support content and face validity for this curriculum.

Developing a comprehensive, proficiency-based training program for robotic surgery.

INTRODUCTION: Robotically assisted surgery has become very popular for numerous surgical disciplines, yet training practices remain variable with little to no validation. The purpose of this study was to develop a comprehensive, proficiency-based robotic training program. METHODS: A skill deconstruction list was generated by observation of robotic operations and interviews with experts. Available resources were used, and other components were developed as needed to develop a comprehensive, proficiency-based curriculum to teach all deconstructed skills. Preliminary construct and content validity and curriculum feasibility were evaluated. RESULTS: The skill deconstruction list contained 23 items. Curricular components included an online tutorial, a half-day interactive session, and 9 inanimate exercises with objective metrics. Novice (546 ± 26) and expert (923 ± 60) inanimate composite scores were different (P < .001), supporting construct validity, and substantial pre-test to post-test improvement was noted after successful training completion. All 23 deconstructed skills were rated as highly relevant (4.9 ± 0.5; 5-point scale), and no skills were absent from the curriculum, supporting content validity. CONCLUSION: These data suggest that this proficiency-based training curriculum comprehensively addresses the skills necessary to perform robotic operations with early construct and content validity and feasibility demonstrated. Further validation is encouraged.