A systematic review of the effect of distraction on surgeon performance: directions for operating room policy and surgical training.

BACKGROUND: Distractions during surgical procedures have been linked to medical error and team inefficiency. This systematic review identifies the most common and most significant forms of distraction in order to devise guidelines for mitigating the effects of distractions in the OR. METHODS: In January 2015, a PubMed and Google Scholar search yielded 963 articles, of which 17 (2 %) either directly observed the occurrence of distractions in operating rooms or conducted a laboratory experiment to determine the effect of distraction on surgical performance. RESULTS: Observational studies indicated that movement and case-irrelevant conversation were the most frequently occurring distractions, but equipment and procedural distractions were the most severe. Laboratory studies indicated that (1) auditory and mental distractions can significantly impact surgical performance, but visual distractions do not incur the same level of effects; (2) task difficulty has an interaction effect with distractions; and (3) inexperienced subjects reduce their speed when faced with distractions, while experienced subjects did not. CONCLUSION: This systematic review suggests that operating room protocols should ensure that distractions from intermittent auditory and mental distractions are significantly reduced. In addition, surgical residents would benefit from training for intermittent auditory and mental distractions in order to develop automaticity and high skill performance during distractions, particularly during more difficult surgical tasks. It is unclear as to whether training should be done in the presence of distractions or distractions should only be used for post-training testing of levels of automaticity.

Haptic Communication in Collaborative Virtual Environments.

OBJECTIVE: To understand the interaction between haptic and verbal communication, we quantified the relative effect of verbal, haptic, and haptic-plus-verbal feedback in a collaborative virtual pointing task. BACKGROUND: Collaborative virtual environments (CVEs) provide a medium for interaction among remote participants. Better understanding of the role of haptic feedback as a supplement to verbalization can improve the design of CVEs. METHODS: Thirty-six participants were randomly paired into 18 dyads to complete a 2-D pointing task in a CVE. In a mixed experimental design, participants completed the task in three communication conditions: haptic only (H), verbal only (V), and haptic plus verbal (HV). The order of the conditions presented to the participants was counterbalanced. RESULTS: The time to task completion, path length, overshoot, and root mean square error were analyzed. Overall, performance in the V and HV conditions was significantly better than in the H condition. H was the least efficient communication channel but elicited response with the shortest reaction time. When verbalization was not available, the use of the haptic device was more likely to be exaggerated to ensure information transmission. When verbalization was used, participants converged on the use of a Cartesian coordinate system for communicating spatial information. CONCLUSION: Haptic communication can be used to complete a collaborative virtual task but is less efficient than verbal communication. A training period may help to improve the efficiency of haptic communication. APPLICATION: These results can be used to design remote collaboration tasks incorporating haptic components and for improving the design of CVEs that support haptic communication.

Validation of the VBLaST: A Virtual Peg Transfer Task in Gynecologic Surgeons.

STUDY OBJECTIVE: To validate the Virtual Basic Laparoscopic Skill Trainer (VBLaST-PT; the peg transfer task) for concurrent validity based on its ability to differentiate between novice, intermediate, and expert groups of gynecologists, and the gynecologists' subjective preference between the physical Fundamentals of Laparoscopic Surgery (FLS) system and the virtual reality system. DESIGN: Prospective study (Canadian Task Force II-2). SETTING: Academic medical center. PARTICIPANTS: Obstetrics and gynecology residents (n = 18) and attending gynecologists (n = 9). INTERVENTIONS: Twenty-seven subjects were divided into 3 groups: novices (n = 9), intermediates (n = 9), and experts (n = 9). All subjects performed 10 trials of the peg transfer on each simulator. Assessment of laparoscopic performance was based on FLS scoring, whereas a questionnaire was used for subjective evaluation. MEASUREMENTS AND MAIN RESULTS: The performance scores in the 2 simulators were nearly identical. Experts performed better than intermediates and novices in both the FLS trainer and the VBLAST, and intermediates performed better than novices in both simulators. The results also show a significant learning effect on both trainers for all subgroups; however, the greatest learning effect was in the novice group for both trainers. Subjectively, 74% participants preferred the FLS over the VBLaST for training laparoscopic surgical skills. CONCLUSION: This study demonstrates that the peg transfer task was reproduced well in the VBLaST in gynecologic surgeons and trainees. The VBLaST has the potential to be a valuable tool in laparoscopic training for gynecologic surgeons.

Effects of sleep hours and fatigue on performance in laparoscopic surgery simulators.

BACKGROUND: Studies on a virtual reality simulator have demonstrated that sleep-deprived residents make more errors. Work-hour restrictions were implemented, among other reasons, to ensure enough sleep time for residents. The objective of this study was to assess the effects of sleep time, perceived fatigue, and experience on surgical performance. We hypothesized that performance would decrease with less sleep and fatigue, and that experienced surgeons would perform better than less experienced surgeons despite sleep deprivation and fatigue. METHODS: Twenty-two surgical residents and attendings performed a peg transfer task on two simulators: the Fundamentals of Laparoscopic Skills (FLS) trainer and the Virtual Basic Laparoscopic Surgical Trainer (VBLaST©), a virtual version of the FLS. Participants also completed questionnaires to assess their fatigue level and recent sleep hours. Each subject performed ten trials on each simulator in a counterbalanced order. Performance was measured using the FLS normalized scores and analyzed using a multiple regression model. RESULTS: The multiple regression analysis showed that sleep hours and perceived fatigue were not covariates. No correlation was found between experience level and sleep hours or fatigue. Sleep hours and fatigue did not appear to affect performance. Expertise level was the only significant determinant of performance in both FLS and VBLaST©. CONCLUSIONS: Restricting resident work hours was expected to result in less fatigue and better clinical performance. In our study, peg transfer task performance was not affected by sleep hours. Experience level was a significant indicator of performance. Further examination of the complex relationship between sleep hour, fatigue, and clinical performance is needed to support the practice of work-hour restriction for surgical residents.

Toward scar-free surgery: an analysis of the increasing complexity from laparoscopic surgery to NOTES.

BACKGROUND: NOTES is an emerging technique for performing surgical procedures, such as cholecystectomy. Debate about its real benefit over the traditional laparoscopic technique is on-going. There have been several clinical studies comparing NOTES to conventional laparoscopic surgery. However, no work has been done to compare these techniques from a Human Factors perspective. This study presents a systematic analysis describing and comparing different existing NOTES methods to laparoscopic cholecystectomy. METHODS: Videos of endoscopic/laparoscopic views from fifteen live cholecystectomies were analyzed to conduct a detailed task analysis of the NOTES technique. A hierarchical task analysis of laparoscopic cholecystectomy and several hybrid transvaginal NOTES cholecystectomies was performed and validated by expert surgeons. To identify similarities and differences between these techniques, their hierarchical decomposition trees were compared. Finally, a timeline analysis was conducted to compare the steps and substeps. RESULTS: At least three variations of the NOTES technique were used for cholecystectomy. Differences between the observed techniques at the substep level of hierarchy and on the instruments being used were found. The timeline analysis showed an increase in time to perform some surgical steps and substeps in NOTES compared to laparoscopic cholecystectomy. CONCLUSION: As pure NOTES is extremely difficult given the current state of development in instrumentation design, most surgeons utilize different hybrid methods-combination of endoscopic and laparoscopic instruments/optics. Results of our hierarchical task analysis yielded an identification of three different hybrid methods to perform cholecystectomy with significant variability among them. The varying degrees to which laparoscopic instruments are utilized to assist in NOTES methods appear to introduce different technical issues and additional tasks leading to an increase in the surgical time. The NOTES continuum of invasiveness is proposed here as a classification scheme for these methods, which was used to construct a clear roadmap for training and technology development.

Face and construct validation of a virtual peg transfer simulator.

BACKGROUND: The Fundamentals of Laparoscopic Surgery (FLS) trainer box is now established as a standard for evaluating minimally invasive surgical skills. A particularly simple task in this trainer box is the peg transfer task which is aimed at testing the surgeon's bimanual dexterity, hand-eye coordination, speed, and precision. The Virtual Basic Laparoscopic Skill Trainer (VBLaST) is a virtual version of the FLS tasks which allows automatic scoring and real-time, subjective quantification of performance without the need of a human proctor. In this article we report validation studies of the VBLaST peg transfer (VBLaST-PT) simulator. METHODS: Thirty-five subjects with medical background were divided into two groups: experts (PGY 4-5, fellows, and practicing surgeons) and novices (PGY 1-3). The subjects were asked to perform the peg transfer task on both the FLS trainer box and the VBLaST-PT simulator; their performance was evaluated based on established metrics of error and time. A new length of trajectory (LOT) metric has also been introduced for offline analysis. A questionnaire was used to rate the realism of the virtual system on a 5-point Likert scale. RESULTS: Preliminary face validation of the VBLaST-PT with 34 subjects rated on a 5-point Likert scale questionnaire revealed high scores for all aspects of simulation, with 3.53 being the lowest mean score across all questions. A two-tailed Mann-Whitney test performed on the total scores showed significant (p = 0.001) difference between the groups. A similar test performed on the task time (p = 0.002) and the LOT (p = 0.004) separately showed statistically significant differences between the experts and the novices (p < 0.05). The experts appear to be traversing shorter overall trajectories in less time than the novices. CONCLUSION: VBLaST-PT showed both face and construct validity and has promise as a substitute for the FLS for training peg transfer skills.

Development and validation of VBLaST-PT© : a virtual peg transfer simulator.

Peg transfer is one of the five tasks in the Fundamentals of Laparoscopic Surgery (FLS), which is now established as a standard for training minimally invasive surgery. In this paper we report development and preliminary validation of Virtual Basic Laparoscopic Skill Trainer-peg transfer (VBLaST-PT© simulator. Face validation of the VBLaST-PT© with 34 subjects revealed high scores for all aspects of simulation. A two-tailed Mann-Whitney performed on the total scores on VBLaST-PT© showed significant (p=0.001) difference between the skill groups.

Achieving Interface and Environment Fidelity in the Virtual Basic Laparoscopic Surgical Trainer.

Virtual reality trainers are educational tools with great potential for laparoscopic surgery. They can provide basic skills training in a controlled environment and free of risks for patients. They can also offer objective performance assessment without the need for proctors. However, designing effective user interfaces that allow the acquisition of the appropriate technical skills on these systems remains a challenge. This paper aims to examine a process for achieving interface and environment fidelity during the development of the Virtual Basic Laparoscopic Surgical Trainer (VBLaST). Two iterations of the design process were conducted and evaluated. For that purpose, a total of 42 subjects participated in two experimental studies in which two versions of the VBLaST were compared to the accepted standard in the surgical community for training and assessing basic laparoscopic skills in North America, the FLS box-trainer. Participants performed 10 trials of the peg transfer task on each trainer. The assessment of task performance was based on the validated FLS scoring method. Moreover, a subjective evaluation questionnaire was used to assess the fidelity aspects of the VBLaST relative to the FLS trainer. Finally, a focus group session with expert surgeons was conducted as a comparative situated evaluation after the first design iteration. This session aimed to assess the fidelity aspects of the early VBLaST prototype as compared to the FLS trainer. The results indicate that user performance on the earlier version of the VBLaST resulting from the first design iteration was significantly lower than the performance on the standard FLS box-trainer. The comparative situated evaluation with domain experts permitted us to identify some issues related to the visual, haptic and interface fidelity on this early prototype. Results of the second experiment indicate that the performance on the second generation VBLaST was significantly improved as compared to the first generation and not significantly different from that of the standard FLS box-trainer. Furthermore, the subjects rated the fidelity features of the modified VBLaST version higher than the early version. These findings demonstrate the value of the comparative situated evaluation sessions entailing hands on reflection by domain experts to achieve the environment and interface fidelity and training objectives when designing a virtual reality laparoscopic trainer. This suggests that this method could be used successfully in the future to enhance the value of VR systems as an alternative to physical trainers for laparoscopic surgery skills. Some recommendations on how to use this method to achieve the environment and interface fidelity of a VR laparoscopic surgical trainer are identified.