Transfer of cysto-urethroscopy skills from a virtual-reality simulator to the operating room: a randomized controlled trial.

OBJECTIVE: To assess whether real-time cysto-urethroscopy (CUS) performance improves by simulator-based training (criterion or predictive validity), addressing the research question 'Does practical skills training on the URO Mentor (UM, Simbionix USA Corp., Cleveland, OH, USA) virtual-reality simulator improve the performance of flexible CUS in patients'. SUBJECTS AND METHODS: Participants (71 interns from Catharina Hospital Eindhoven, CHE, and 29 from University Medical Centre Groningen, UMCG) were randomized to carry out CUS in a patient after training on the UM (UM-trained, 50) or without training on UM (control, 50). The assessment of real-time performance consisted of scoring on a Global Rating Scale (GRS) by supervisors unaware of training status. Data were analysed using stepwise multiple linear regression. The effect size (ES) indication for correlations was used to interpret the magnitude of a standard regression coefficient (beta); an ES of 0.10, 0.30 and 0.50 were considered small, moderate and large, respectively. The study was approved by the Medical Review Ethics Committees of the participating hospitals. RESULTS: Overall, the group that received training performed significantly better than the controls (P < or = 0.003, beta range 0.30-0.47). There was no effect of training for participants with a specific preference for a surgical speciality in two of five GRS scores. Participants from CHE obtained higher GRS 3 scores than those from UMCG. Significantly more UMCG trainees indicated having had stress than those from CHE (P < 0.001). CONCLUSIONS: The results showed that interns who had trained on UM outperformed controls for a CUS procedure in a patient. Training for CUS on the UM is to be recommended for learning to respect tissue, procedural knowledge, flow of procedure and forward planning. Use of the UM to train interns with a specific interest in a surgical speciality in handling instruments, and time and motion, seems to be of limited value.

Acquisition of flexible cystoscopy skills on a virtual reality simulator by experts and novices.

OBJECTIVE: To assess the construct validity of the URO Mentor (Simbionix Corp., Cleveland, OH, USA) virtual reality training model for several variables of skills training in cysto-urethroscopy, addressing two research questions: (i) Does training on the URO Mentor significantly improve novices' performance in terms of time, trauma, areas inspected and Global Rating Scale (GRS) score?; (ii) is discrimination between different levels of expertise possible using the URO Mentor? METHODS: Thirty experts and 50 novices performed seven tasks on the URO Mentor during one training session. The first, fourth and seventh tasks were 'test tasks' to evaluate participants' performance. The simulator recorded procedure time and trauma; a supervisor scored which areas were inspected and gave scores on the GRS. A two-way analysis of variance with repeated-measures test was used to analyse experts' and novices' performances, with P < 0.05 considered to indicate statistical significance. Effect sizes (ES) were calculated to quantify the practical significance of the results; ES of 0.10, 0.30, and 0.50 were considered small, medium and large, respectively. RESULTS: Novices' performances showed a significant improvement with large ES in time (linear trend of learning curve P < 0.001, ES 0.66) and mean GRS score (linear trend P < 0.001, ES 0.84, quadratic trend P = 0.018, ES 0.24). There was a medium improvement for trauma (linear trend P < 0.001, ES 0.40) and a small improvement in areas inspected (linear trend P = 0.032, ES 0.21). That the 95% confidence intervals of the measures on the first task of experts and novices did not coincide indicates that differentiation between experts and novices on the four variables measured can be achieved using the URO Mentor. CONCLUSIONS: Training on the URO Mentor appears to result in a medium to large improvement of novices' performances for time, trauma, areas inspected and GRS scores. Moreover, discrimination between different levels of expertise is possible using this simulator.

The virtual reality endourologic simulator is realistic and useful for educational purposes.

PURPOSE: To examine the educational value of URO Mentor, a virtual reality simulator for endourologic procedures, by establishing its face and content validity. MATERIALS AND METHODS: Eighty-nine urologists and residents in urology performed a urethrocystoscopy task (bladder inspection, biopsy, and coagulation) or a ureterorenoscopy task (manipulation of a distal ureter stone) using the URO Mentor. They completed an evaluation questionnaire about these tasks. Questionnaire bias related to task performance on URO Mentor was analyzed as well (Hawthorne effect). RESULTS: The overall rating of the URO Mentor was 7.3 on a 10-point scale (1 = poor, 10 = excellent). Regression analysis showed that ratings were not related to previous experience or task performance using the URO Mentor. Of all subjects, 25% rated the realism of URO Mentor as >or=3.5 on a five-point scale, and 82% rated its usefulness as an educational tool as >or=3.5 on a five-point scale. More than 73% of all participants said they would purchase a URO Mentor if financial means were available; participants who needed more time to complete the task were less positive in their answers to this question. CONCLUSIONS: URO Mentor appears to be a realistic and useful training model for endourologic procedures.