Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy.

BACKGROUND: Touch Surgery™ (TS) is a serious gaming application for cognitive task simulation and rehearsal of key steps in surgical procedures. The aim was to establish face, content, and construct validity of TS for laparoscopic cholecystectomy (LC). Furthermore, learning curves with TS and a virtual reality (VR) trainer were compared in a randomized trial. METHODS: The performance of medical students and general surgeons was compared for all three modules of LC in TS to establish construct validity. Questionnaires assessed face and content validity. For analysis of learning curves, students were randomized to train on VR or TS first, and then switched to the other training modality. Performance data were recorded. RESULTS: 54 Surgeons and 51 medical students completed the validation study. Surgeons outperformed students with TS: patient preparation (students = 45.0 ± 19.1%; surgeons = 57.3 ± 15.2%; p < 0.001), access and laparoscopy (students = 70.2 ± 10.9%; surgeons = 75.9 ± 9.7%; p = 0.008) and LC (students = 69.8 ± 12.4%; surgeons = 77.7 ± 9.6%; p < 0.001). Both groups agreed that TS was a highly useful and realistic application. 46 students were randomized for learning curve analysis. It took them 2-4 attempts to reach a 100% score with TS. Training with TS first did not improve students' performance on the VR trainer; however, students who trained with VR first scored significantly higher in module 3 of TS. CONCLUSION: TS is an accepted serious gaming application for learning cognitive aspects of LC with established construct, face, and content validity. There appeared to be a synergy between TS and the VR trainer. Therefore, the two training modalities should accompany one another in a multimodal training approach to laparoscopy.

Direct Observation versus Endoscopic Video Recording-Based Rating with the Objective Structured Assessment of Technical Skills for Training of Laparoscopic Cholecystectomy.

PURPOSE: The validated Objective Structured Assessment of Technical Skills (OSATS) score is used for evaluating laparoscopic surgical performance. It consists of two subscores, a Global Rating Scale (GRS) and a Specific Technical Skills (STS) scale. The OSATS has accepted construct validity for direct observation ratings by experts to discriminate between trainees' levels of experience. Expert time is scarce. Endoscopic video recordings would facilitate assessment with the OSATS. We aimed to compare video OSATS with direct OSATS. METHODS: We included 79 participants with different levels of experience [58 medical students, 15 junior residents (novices), and 6 experts]. Performance of a cadaveric porcine laparoscopic cholecystectomy (LC) was evaluated with OSATS by blinded expert raters by direct observation and then as an endoscopic video recording. Operative time was recorded. RESULTS: Direct OSATS rating and video OSATS rating correlated significantly (x03C1; = 0.33, p = 0.005). Significant construct validity was found for direct OSATS in distinguishing between students or novices and experts. Students and novices were not different in direct OSATS or video OSATS. Mean operative times varied for students (73.4 ± 9.0 min), novices (65.2 ± 22.3 min), and experts (46.8 ± 19.9 min). Internal consistency was high between the GRS and STS subscores for both direct and video OSATS with Cronbach's α of 0.76 and 0.86, respectively. Video OSATS and operative time in combination was a better predictor of direct OSATS than each single parameter. CONCLUSION: Direct OSATS rating was better than endoscopic video rating for differentiating between students or novices and experts for LC and should remain the standard approach for the discrimination of experience levels. However, in the absence of experts for direct rating, video OSATS supplemented with operative time should be used instead of single parameters for predicting direct OSATS scores.

Virtual reality does not meet expectations in a pilot study on multimodal laparoscopic surgery training.

BACKGROUND: The purpose of the present study was to determine the value of virtual reality (VR) training for a multimodality training program of basic laparoscopic surgery. MATERIALS AND METHODS: Participants in a two-day multimodality training for laparoscopic surgery used box trainers, live animal training, and cadaveric training on the pulsating organ perfusion (POP) trainer in a structured and standardized training program. The participants were divided into two groups. The VR group (n = 13) also practiced with VR training during the program, whereas the control group (n = 14) did not use VR training. The training modalities were assessed using questionnaires with a five-point Likert scale after the program. Concerning VR training, members of the control group assessed their expectations, whereas the VR group assessed the actual experience of using it. Skills performance was evaluated with five standardized test tasks in a live porcine model before (pre-test) and after (post-test) the training program. Laparoscopic skills were measured by task completion time and a general performance score for each task. Baseline tests were compared with laparoscopic experience of all participants for construct validity of the skills test. RESULTS: The expected benefit from VR training of the control group was higher than the experienced benefit of the VR group. Box and POP training received better ratings from the VR group than from the control group for some purposes. Both groups improved their skill parameters significantly from pre-training to post-training tests [score +17 % (P < 0.01), time -29 % (P < 0.01)]. No significant difference was found between the two groups for laparoscopic skills improvement except for the score in the instrument coordination task. Construct validity of the skills test was significant for both time and score. CONCLUSIONS: At its current level of performance, VR training does not meet expectations. No additional benefit was observed from VR training in our multimodality training program.