The effect of escalating feedback on the acquisition of psychomotor skills for laparoscopy.

BACKGROUND: In the acquisition of new skills that are difficult to master, such as those required for laparoscopy, feedback is a crucial component of the learning experience. Optimally, feedback should accurately reflect the task performance to be improved and be proximal to the training experience. In surgery, however, feedback typically is in vivo. The development of virtual reality training systems currently offers new training options. This study investigated the effect of feedback type and quality on laparoscopic skills acquisition. METHODS: For this study, 32 laparoscopic novices were prospectively randomized into four training conditions, with 8 in each group. Group 1 (control) had no feedback. Group 2 (buzzer) had audio feedback when the edges were touched. Group 3 (voiced error) had an examiner voicing the word "error" each time the walls were touched. Group 4 (both) received both the audio buzzer and "error" voiced by the examiner All the subjects performed a maze-tracking task with a laparoscopic stylus inserted through a 5-mm port to simulate the fulcrum effect in minimally invasive surgery (MIS). A computer connected to the stylus scored an error each time the edge of the maze was touched, and the subjects were made aware of the error in the aforementioned manner. Ten 2-min trials were performed by the subjects while viewing a monitor. At the conclusion of training, all the subjects completed a 2-min trial of a simple laparoscopic cutting task, with the number of correct and incorrect incisions recorded. RESULTS: Group 4 (both) made significantly more correct incisions than the other three groups (F = 12.13; df = 3, 28; p < 0.001), and also made significantly fewer errors or incorrect incisions (F = 14.4; p < 0.0001). Group 4 also made three times more correct incisions and 7.4 times fewer incorrect incisions than group 1 (control). CONCLUSIONS: The type and quality of feedback during psychomotor skill acquisition for MIS have a large effect on the strength of skills generalization to a simple MIS task and should be given serious consideration in curriculum design for surgical training using simulation tasks.

Attempted establishment of proficiency levels for laparoscopic performance on a national scale using simulation: the results from the 2004 SAGES Minimally Invasive Surgical Trainer-Virtual Reality (MIST-VR) learning center study.

BACKGROUND: The Minimally Invasive Surgical Trainer-Virtual Reality (MIST-VR) has been well validated as a training device for laparoscopic skills. It has been demonstrated that training to a level of proficiency on the simulator significantly improves operating room performance of laparoscopic cholecystectomy. The purpose of this project was to obtain a national standard of proficiency using the MIST-VR based on the performance of experienced laparoscopic surgeons. METHODS: Surgeons attending the Society of American Gastrointestinal Endoscopic Surgeons (SAGES) 2004 Annual Scientific Meeting who had performed more than 100 laparoscopic procedures volunteered to participate. All the subjects completed a demographic questionnaire assessing laparoscopic and MIST-VR experience in the learning center of the SAGES 2004 meeting. Each subject performed two consecutive trials of the MIST-VR Core Skills 1 program at the medium setting. Each trial involved six basic tasks of increasing difficulty: acquire place (AP), transfer place (TP), traversal (TV), withdrawal insert (WI), diathermy task (DT), and manipulate diathermy (MD). Trial 1 was considered a "warm-up," and trial 2 functioned as the test trial proper. Subject performance was scored for time, errors, and economy of instrument movement for each task, and a cumulative total score was calculated. RESULTS: Trial 2 data are expressed as mean time in seconds in Table 2. CONCLUSION: Proficiency levels for laparoscopic skills have now been established on a national scale by experienced laparoscopic surgeons using the MIST-VR simulator. Residency programs, training centers, and practicing surgeons can now use these data as guidelines for performance criterion during MIST-VR skills training.

Construct validation of the ProMIS simulator using a novel laparoscopic suturing task.

BACKGROUND: The use of simulation for minimally invasive surgery (MIS) skills training has many advantages over current traditional methods. One advantage of simulation is that it enables an objective assessment of technical performance. The purpose of this study was to determine whether the ProMIS augmented reality simulator could objectively distinguish between levels of performance skills on a complex laparoscopic suturing task. METHODS: Ten subjects--five laparoscopic experts and five laparoscopic novices--were assessed for baseline perceptual, visio-spatial, and psychomotor abilities using validated tests. After three trials of a novel laparoscopic suturing task were performed on the simulator, measures for time, smoothness of movement, and path distance were analyzed for each trial. Accuracy and errors were evaluated separately by two blinded reviewers to an interrater reliability of >0.8. Comparisons of mean performance measures were made between the two groups using a Mann-Whitney U test. Internal consistency of ProMIS measures was assessed with coefficient alpha. RESULTS: The psychomotor performance of the experts was superior at baseline assessment (p < 0.001). On the laparoscopic suturing task, the experts performed significantly better than the novices across all three trials (p < 0.001). They performed the tasks between three and four times faster (p < 0.0001), had three times shorter instrument path length (p < 0.0001), and had four times greater smoothness of instrument movement (p < 0.009). Experts also showed greater consistency in their performance, as demonstrated by SDs across all measures, which were four times smaller than the novice group. Observed internal consistency of ProMIS measures was high (alpha = 0.95, p < 0.00001). CONCLUSIONS: Preliminary results of construct validation efforts of the ProMIS simulator show that it can distinguish between experts and novices and has promising psychometric properties. The attractive feature of ProMIS is that a wide variety of MIS tasks can be used to train and assess technical skills.