Usefulness of Three-Dimensional Modeling in Surgical Planning, Resident Training, and Patient Education.

BACKGROUND: Imaging has a critical impact on surgical decision making and three-dimensional (3D) digital models of patient pathology can now be made commercially. We developed a 3D digital model of a cancer of the head of the pancreas by integrating actual CT data with 3D modeling process. After this process, the virtual pancreatic model was also produced using a high-quality 3D printer. PATIENTS AND METHODS: A 56-year-old female with pancreatic head adenocarcinoma presented with biliary obstruction and jaundice. The CT scan showed a borderline resectable tumor with a clear involvement of the gastroduodenal artery but doubtful relationships with the hepatic artery. Our team in collaboration with the Immersive Touch team used multiple series from the CT and segmented the relevant anatomy to understand the physical location of the tumor. An STL file was then developed and printed. RESULTS: Reconstructing and compositing the different series together enhanced the imaging, which allowed clearer observations of the relationship between the mass and the blood vessels, and evidence that the tumor was unresectable. Data files were converted for printing a 100% size rendering model, used for didactic purposes and to discuss with the patient. CONCLUSIONS: This study showed that (1) reconstructing enhanced traditional imaging by merging and modeling different series together for a 3D view with diverse angles and transparency, allowing the observation of previously unapparent anatomical details; (2) with this new technology surgeons and residents can preobserve their planned surgical intervention, explore the patient-specific anatomy, and sharpen their procedure choices; (3) high-quality 3D printed models are increasingly useful not only in the clinical realm but also for personalized patient education.

Usefulness of a Virtual Reality Percutaneous Trigeminal Rhizotomy Simulator in Neurosurgical Training.

BACKGROUND: Simulation-based training may be incorporated into neurosurgery in the future. OBJECTIVE: To assess the usefulness of a novel haptics-based virtual reality percutaneous trigeminal rhizotomy simulator. METHODS: A real-time augmented reality simulator for percutaneous trigeminal rhizotomy was developed using the ImmersiveTouch platform. Ninety-two neurosurgery residents tested the simulator at American Association of Neurological Surgeons Top Gun 2014. Postgraduate year (PGY), number of fluoroscopy shots, the distance from the ideal entry point, and the distance from the ideal target were recorded by the system during each simulation session. Final performance score was calculated considering the number of fluoroscopy shots and distances from entry and target points (a lower score is better). The impact of PGY level on residents' performance was analyzed. RESULTS: Seventy-one residents provided their PGY-level and simulator performance data; 38% were senior residents and 62% were junior residents. The mean distance from the entry point (9.4 mm vs 12.6 mm, P = .01), the distance from the target (12.0 mm vs 15.2 mm, P = .16), and final score (31.1 vs 37.7, P = .02) were lower in senior than in junior residents. The mean number of fluoroscopy shots (9.8 vs 10.0, P = .88) was similar in these 2 groups. Linear regression analysis showed that increasing PGY level is significantly associated with a decreased distance from the ideal entry point (P = .001), a shorter distance from target (P = .05), a better final score (P = .007), but not number of fluoroscopy shots (P = .52). CONCLUSION: Because technical performance of percutaneous rhizotomy increases with training, we proposed that the skills in performing the procedure in our virtual reality model would also increase with PGY level, if our simulator models the actual procedure. Our results confirm this hypothesis and demonstrate construct validity.

The use of a virtual reality surgical simulator for cataract surgical skill assessment with 6 months of intervening operating room experience.

PURPOSE: To evaluate a haptic-based simulator, MicroVisTouch™, as an assessment tool for capsulorhexis performance in cataract surgery. The study is a prospective, unmasked, nonrandomized dual academic institution study conducted at the Wilmer Eye Institute at Johns Hopkins Medical Center (Baltimore, MD, USA) and King Khaled Eye Specialist Hospital (Riyadh, Saudi Arabia). METHODS: This prospective study evaluated capsulorhexis simulator performance in 78 ophthalmology residents in the US and Saudi Arabia in the first round of testing and 40 residents in a second round for follow-up. RESULTS: Four variables (circularity, accuracy, fluency, and overall) were tested by the simulator and graded on a 0-100 scale. Circularity (42%), accuracy (55%), and fluency (3%) were compiled to give an overall score. Capsulorhexis performance was retested in the original cohort 6 months after baseline assessment. Average scores in all measured metrics demonstrated statistically significant improvement (except for circularity, which trended toward improvement) after baseline assessment. A reduction in standard deviation and improvement in process capability indices over the 6-month period was also observed. CONCLUSION: An interval objective improvement in capsulorhexis skill on a haptic-enabled cataract surgery simulator was associated with intervening operating room experience. Further work investigating the role of formalized simulator training programs requiring independent simulator use must be studied to determine its usefulness as an evaluation tool.

Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback.

BACKGROUND: With the decrease in the number of cerebral aneurysms treated surgically and the increase of complexity of those treated surgically, there is a need for simulation-based tools to teach future neurosurgeons the operative techniques of aneurysm clipping. OBJECTIVE: To develop and evaluate the usefulness of a new haptic-based virtual reality simulator in the training of neurosurgical residents. METHODS: A real-time sensory haptic feedback virtual reality aneurysm clipping simulator was developed using the ImmersiveTouch platform. A prototype middle cerebral artery aneurysm simulation was created from a computed tomographic angiogram. Aneurysm and vessel volume deformation and haptic feedback are provided in a 3-dimensional immersive virtual reality environment. Intraoperative aneurysm rupture was also simulated. Seventeen neurosurgery residents from 3 residency programs tested the simulator and provided feedback on its usefulness and resemblance to real aneurysm clipping surgery. RESULTS: Residents thought that the simulation would be useful in preparing for real-life surgery. About two-thirds of the residents thought that the 3-dimensional immersive anatomic details provided a close resemblance to real operative anatomy and accurate guidance for deciding surgical approaches. They thought the simulation was useful for preoperative surgical rehearsal and neurosurgical training. A third of the residents thought that the technology in its current form provided realistic haptic feedback for aneurysm surgery. CONCLUSION: Neurosurgical residents thought that the novel immersive VR simulator is helpful in their training, especially because they do not get a chance to perform aneurysm clippings until late in their residency programs.

Comparison of the anterior capsulotomy edge created by manual capsulorhexis and 2 femtosecond laser platforms: Scanning electron microscopy study.

PURPOSE: To compare the scanning electron microscopy (SEM) features of the anterior capsule edge created by continuous curvilinear capsulorhexis (CCC) and femtosecond laser-assisted capsulotomy using angular second moment and contrast. SETTING: King Khaled Eye Specialist Hospital, Riyadh, Kingdom of Saudi Arabia. DESIGN: Prospective comparative series. METHODS: Anterior capsule specimens following CCC (n = 10) or femtosecond laser-assisted capsulotomy using 2 platforms (Lensx, n = 9, and Victus, n = 10) were studied by SEM. Irregularity of the capsule edge was quantified using 2 parameters (angular second moment and contrast) using ImageJ software. The clinical features and laser parameters were correlated with angular second moment and contrast. RESULTS: By SEM, the femtosecond laser-assisted capsulotomy edge surfaces created by both lasers showed marked irregularity compared with the smooth edge of the CCC. The angular second moment and contrast measures for both lasers differed significantly from those obtained for CCC (P<.001). There was no between-laser difference in angular second moment and contrast measures. The angular second moment showed only a weak negative correlation with increasing laser power, whereas contrast showed a weak positive correlation with increasing power. CONCLUSIONS: Both laser platforms created an irregular capsulotomy edge. The angular second moment and contrast quantified capsule edge irregularities for further comparisons. These measures could be used to quantify efforts to reduce capsule-edge irregularity from femtosecond laser-lens capsule interaction.

Percutaneous spinal fixation simulation with virtual reality and haptics.

BACKGROUND: In this study, we evaluated the use of a part-task simulator with 3-dimensional and haptic feedback as a training tool for percutaneous spinal needle placement. OBJECTIVE: To evaluate the learning effectiveness in terms of entry point/target point accuracy of percutaneous spinal needle placement on a high-performance augmented-reality and haptic technology workstation with the ability to control the duration of computer-simulated fluoroscopic exposure, thereby simulating an actual situation. METHODS: Sixty-three fellows and residents performed needle placement on the simulator. A virtual needle was percutaneously inserted into a virtual patient's thoracic spine derived from an actual patient computed tomography data set. RESULTS: Ten of 126 needle placement attempts by 63 participants ended in failure for a failure rate of 7.93%. From all 126 needle insertions, the average error (15.69 vs 13.91), average fluoroscopy exposure (4.6 vs 3.92), and average individual performance score (32.39 vs 30.71) improved from the first to the second attempt. Performance accuracy yielded P = .04 from a 2-sample t test in which the rejected null hypothesis assumes no improvement in performance accuracy from the first to second attempt in the test session. CONCLUSION: The experiments showed evidence (P = .04) of performance accuracy improvement from the first to the second percutaneous needle placement attempt. This result, combined with previous learning retention and/or face validity results of using the simulator for open thoracic pedicle screw placement and ventriculostomy catheter placement, supports the efficacy of augmented reality and haptics simulation as a learning tool.

Concurrent and face validity of a capsulorhexis simulation with respect to human patients.

A prototype version of the ImmersiveTouch® virtual reality simulator was applied to capsulorhexis, the creation of circular tear or "rhexis" in the lens capsule of the eye during cataract surgery. Virtual and live surgery scores by residents were compared. The same three metrics are used in each mode: circularity of the rhexis, duration of surgery (sec), and number of forceps grabs of the capsule per completed rhexis (fewer is better). The average simulator circularity score correlated closely with the average live score (P = 0.0002; N = 4), establishing "concurrent validity" for this metric. Individuals performed similarly to each other in both modes, as shown by the low standard deviations for average circularity (virtual 0.92 ± 0.04; live 0.88 ± 0.04). By contrast, the standard deviations are high for the other two metrics, capsulorhexis duration (virtual 96.91 ± 44.23 sec; live 94.42 ± 65.74 sec, N = 8) and number of forceps grabs (virtual 10.66 ± 4.81; live 10.31 ± 5.23, N = 8). Nevertheless, the simulator was able to demonstrate that the surgeons with wide variations in total duration and number of capsular grabs in 2 to 4 trials of simulated surgery also had similar variations in live surgery, so that the simulator retains some realism or "face validity."

Virtual reality training in neurosurgery: Review of current status and future applications.

BACKGROUND: Over years, surgical training is changing and years of tradition are being challenged by legal and ethical concerns for patient safety, work hour restrictions, and the cost of operating room time. Surgical simulation and skill training offer an opportunity to teach and practice advanced techniques before attempting them on patients. Simulation training can be as straightforward as using real instruments and video equipment to manipulate simulated "tissue" in a box trainer. More advanced virtual reality (VR) simulators are now available and ready for widespread use. Early systems have demonstrated their effectiveness and discriminative ability. Newer systems enable the development of comprehensive curricula and full procedural simulations. METHODS: A PubMed review of the literature was performed for the MESH words "Virtual reality, "Augmented Reality", "Simulation", "Training", and "Neurosurgery". Relevant articles were retrieved and reviewed. A review of the literature was performed for the history, current status of VR simulation in neurosurgery. RESULTS: Surgical organizations are calling for methods to ensure the maintenance of skills, advance surgical training, and credential surgeons as technically competent. The number of published literature discussing the application of VR simulation in neurosurgery training has evolved over the last decade from data visualization, including stereoscopic evaluation to more complex augmented reality models. With the revolution of computational analysis abilities, fully immersive VR models are currently available in neurosurgery training. Ventriculostomy catheters insertion, endoscopic and endovascular simulations are used in neurosurgical residency training centers across the world. Recent studies have shown the coloration of proficiency with those simulators and levels of experience in the real world. CONCLUSION: Fully immersive technology is starting to be applied to the practice of neurosurgery. In the near future, detailed VR neurosurgical modules will evolve to be an essential part of the curriculum of the training of neurosurgeons.

Learning retention of thoracic pedicle screw placement using a high-resolution augmented reality simulator with haptic feedback.

BACKGROUND: We evaluated the use of a part-task simulator with 3D and haptic feedback as a training tool for a common neurosurgical procedure--placement of thoracic pedicle screws. OBJECTIVE: To evaluate the learning retention of thoracic pedicle screw placement on a high-performance augmented reality and haptic technology workstation. METHODS: Fifty-one fellows and residents performed thoracic pedicle screw placement on the simulator. The virtual screws were drilled into a virtual patient's thoracic spine derived from a computed tomography data set of a real patient. RESULTS: With a 12.5% failure rate, a 2-proportion z test yielded P = .08. For performance accuracy, an aggregate Euclidean distance deviation from entry landmark on the pedicle and a similar deviation from the target landmark in the vertebral body yielded P = .04 from a 2-sample t test in which the rejected null hypothesis assumes no improvement in performance accuracy from the practice to the test sessions, and the alternative hypothesis assumes an improvement. CONCLUSION: The performance accuracy on the simulator was comparable to the accuracy reported in literature on recent retrospective evaluation of such placements. The failure rates indicated a minor drop from practice to test sessions, and also indicated a trend (P = .08) toward learning retention resulting in improvement from practice to test sessions. The performance accuracy showed a 15% mean score improvement and more than a 50% reduction in standard deviation from practice to test. It showed evidence (P = .04) of performance accuracy improvement from practice to test session.

A high performance graphic and haptic curvilinear capsulorrhexis simulation system.

A computer based curvilinear capsulorrhexis simulation system known as Virtual Phaco Trainer is presented. Interested residents and surgeons can use this system to navigate through the capsulorrhexis procedures and practice their skills. Performance data is presented after each practice with built in objective performance evaluation metrics. The system makes a number of important contributions A mass-spring model based anisotropic mesh is used to simulate a deformable capsule model along with a smooth curvilinear capsulorrhexis path. To navigate precisely, a Phantom haptic device is used to track positions as well as to provide snag-free haptic feedback. Solutions to conflicting requirements between a high density mesh update frequency and a high haptic feedback update frequency are addressed. Promising evaluation results from a group of ophthalmology residents and attending surgeons are presented and discussed.

Virtual ventriculostomy with 'shifted ventricle': neurosurgery resident surgical skill assessment using a high-fidelity haptic/graphic virtual reality simulator.

Based on a study of 48 neurological residents using a high fidelity haptic/graphic virtual reality simulator to perform ventricular cannulation, we recorded absolute Euclidean distance from the catheter tip to the foramen of Monroe within the ventricle. The data suggest that as expected, successful first attempts to cannulate the virtual 'shifted ventricle' are much less frequent than previous assessments with normal virtual ventricular anatomy. Furthermore, the significant improvement observed by the second attempt implies that the learning curve has been affected and the process 'jump started'.

Accuracy of ventriculostomy catheter placement using a head- and hand-tracked high-resolution virtual reality simulator with haptic feedback.

OBJECT: The purpose of this study was to evaluate the accuracy of ventriculostomy catheter placement on a head- and hand-tracked high-resolution and high-performance virtual reality and haptic technology workstation. METHODS: Seventy-eight fellows and residents performed simulated ventriculostomy catheter placement on an ImmersiveTouch system. The virtual catheter was placed into a virtual patient's head derived from a computed tomography data set. Participants were allowed one attempt each. The distance from the tip of the catheter to the Monro foramen was measured. RESULTS: The mean distance (+/- standard deviation) from the final position of the catheter tip to the Monro foramen was 16.09 mm (+/- 7.85 mm). CONCLUSIONS: The accuracy of virtual ventriculostomy catheter placement achieved by participants using the simulator is comparable to the accuracy reported in a recent retrospective evaluation of free-hand ventriculostomy placements in which the mean distance from the catheter tip to the Monro foramen was 16 mm (+/- 9.6 mm).

Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback.

OBJECTIVE: Mastery of the neurosurgical skill set involves many hours of supervised intraoperative training. Convergence of political, economic, and social forces has limited neurosurgical resident operative exposure. There is need to develop realistic neurosurgical simulations that reproduce the operative experience, unrestricted by time and patient safety constraints. Computer-based, virtual reality platforms offer just such a possibility. The combination of virtual reality with dynamic, three-dimensional stereoscopic visualization, and haptic feedback technologies makes realistic procedural simulation possible. Most neurosurgical procedures can be conceptualized and segmented into critical task components, which can be simulated independently or in conjunction with other modules to recreate the experience of a complex neurosurgical procedure. METHODS: We use the ImmersiveTouch (ImmersiveTouch, Inc., Chicago, IL) virtual reality platform, developed at the University of Illinois at Chicago, to simulate the task of ventriculostomy catheter placement as a proof-of-concept. Computed tomographic data are used to create a virtual anatomic volume. RESULTS: Haptic feedback offers simulated resistance and relaxation with passage of a virtual three-dimensional ventriculostomy catheter through the brain parenchyma into the ventricle. A dynamic three-dimensional graphical interface renders changing visual perspective as the user's head moves. The simulation platform was found to have realistic visual, tactile, and handling characteristics, as assessed by neurosurgical faculty, residents, and medical students. CONCLUSION: We have developed a realistic, haptics-based virtual reality simulator for neurosurgical education. Our first module recreates a critical component of the ventriculostomy placement task. This approach to task simulation can be assembled in a modular manner to reproduce entire neurosurgical procedures.

Virtual reality simulations.

The current virtual reality and haptic technologies being researched for potential use in high-fidelity simulations in anesthesiology are attempting to overcome a number of limitations, such as low resolution, low visual acuity, and lack of robust haptics-graphics collocation. A new prototype device invented by the authors, known as ImmersiveTouch, addresses how to overcome these technologic limitations.

Virtual reality and haptic interface for cellular injection simulation.

This paper presents the application of virtual reality and haptics to the simulation of cellular micromanipulation for research, training and automation purposes. A collocated graphic/haptic working volume provides a realistic visual and force feedback to guide the user in performing a cell injection procedure. A preliminary experiment shows promising results.