Content and construct validation of a robotic surgery curriculum using an electromagnetic instrument tracker.

PURPOSE: Rapid adoption of robot-assisted surgery has outpaced our ability to train novice roboticists. Objective metrics are required to adequately assess robotic surgical skills and yet surrogates for proficiency, such as economy of motion and tool path metrics, are not readily accessible directly from the da Vinci® robot system. The trakSTAR™ Tool Tip Tracker is a widely available, cost-effective electromagnetic position sensing mechanism by which objective proficiency metrics can be quantified. We validated a robotic surgery curriculum using the trakSTAR device to objectively capture robotic task proficiency metrics. MATERIALS AND METHODS: Through an institutional review board approved study 10 subjects were recruited from 2 surgical experience groups (novice and experienced). All subjects completed 3 technical skills modules, including block transfer, intracorporeal suturing/knot tying (fundamentals of laparoscopic surgery) and ring tower transfer, using the da Vinci robot with the trakSTAR device affixed to the robotic instruments. Recorded objective metrics included task time and path length, which were used to calculate economy of motion. Student t test statistics were performed using STATA®. RESULTS: The novice and experienced groups consisted of 5 subjects each. The experienced group outperformed the novice group in all 3 tasks. Experienced surgeons described the simulator platform as useful for training and agreed with incorporating it into a residency curriculum. CONCLUSIONS: Robotic surgery curricula can be validated by an off-the-shelf instrument tracking system. This platform allows surgical educators to objectively assess trainees and may provide credentialing offices with a means of objectively assessing any surgical staff member seeking robotic surgery privileges at an institution.

Initial validation of the ProMIS surgical simulator as an objective measure of robotic task performance.

Virtual reality robotic simulation has gained widespread momentum. In order to determine the value of virtual reality robotic simulation and its objective metrics, a reality-based robotic surgical training platform with similar analytic capabilities must be developed and validated. The ProMIS laparoscopic surgical simulator is a widely available reality-based simulation platform that has been previously validated as an objective measure of laparoscopic task performance. In this study, we evaluated the validity of the ProMIS laparoscopic surgical simulator as an objective measure of robotic task performance. Volunteers were recruited from two experience groups (novice and expert). All subjects completed three tasks (peg transfer, precision cutting, intracorporeal suture/knot) in the ProMIS laparoscopic simulator using the da Vinci robotic surgical system. Motion analysis data was obtained by the ProMIS computerized optical tracking system and objective metrics recorded included time, path length, economy of motion, and observer-recorded penalty scores. The novice group consisted of 10 subjects with no previous robotic surgical experience. The expert group consisted of 10 subjects with robotic experience. The expert group outperformed the novice group in all three tasks. Subjects rated this training platform as easy to use, as an accurate measure of their robotic surgical proficiency, and as relevant to robotic surgery. The experts described the simulator platform as useful for training and agreed with incorporating it into a residency curriculum. This study demonstrates that the ProMIS laparoscopic simulator is a face, content, and construct valid reality-based simulation platform that can be used for objectively measuring robotic task performance.