Cranial implant design using augmented reality immersive system.

Software tools that utilize haptics for sculpting precise fitting cranial implants are utilized in an augmented reality immersive system to create a virtual working environment for the modelers. The virtual environment is designed to mimic the traditional working environment as closely as possible, providing more functionality for the users. The implant design process uses patient CT data of a defective area. This volumetric data is displayed in an implant modeling tele-immersive augmented reality system where the modeler can build a patient specific implant that precisely fits the defect. To mimic the traditional sculpting workspace, the implant modeling augmented reality system includes stereo vision, viewer centered perspective, sense of touch, and collaboration. To achieve optimized performance, this system includes a dual-processor PC, fast volume rendering with three-dimensional texture mapping, the fast haptic rendering algorithm, and a multi-threading architecture. The system replaces the expensive and time consuming traditional sculpting steps such as physical sculpting, mold making, and defect stereolithography. This augmented reality system is part of a comprehensive tele-immersive system that includes a conference-room-sized system for tele-immersive small group consultation and an inexpensive, easily deployable networked desktop virtual reality system for surgical consultation, evaluation and collaboration. This system has been used to design patient-specific cranial implants with precise fit.

New tools for sculpting cranial implants in a shared haptic augmented reality environment.

New volumetric tools were developed for the design and fabrication of high quality cranial implants from patient CT data. These virtual tools replace time consuming physical sculpting, mold making and casting steps. The implant is designed by medical professionals in tele-immersive collaboration. Virtual clay is added in the virtual defect area on the CT data using the adding tool. With force feedback the modeler can feel the edge of the defect and fill only the space where no bone is present. A carving tool and a smoothing tool are then used to sculpt and refine the implant. To make a physical evaluation, the skull with simulated defect and the implant are fabricated via stereolithography to allow neurosurgeons to evaluate the quality of the implant. Initial tests demonstrate a very high quality fit. These new haptic volumetric sculpting tools are a critical component of a comprehensive tele-immersive system.

Haptic rendering of volumetric data for cranial implant modeling.

A force feedback algorithm for cranial implant design is presented in this paper. The algorithm is applied directly on volumetric data. It is a proxy-based algorithm, and a spherical proxy is used to accurately calculate the force between the sculpting tool and the skull. Based on this algorithm a cranial implant modeling system is implemented, and an implant for a simulated defect is designed.

Virtual reality: new method of teaching anorectal and pelvic floor anatomy.

PURPOSE: A clear understanding of the intricate spatial relationships among the structures of the pelvic floor, rectum, and anal canal is essential for the treatment of numerous pathologic conditions. Virtual-reality technology allows improved visualization of three-dimensional structures over conventional media because it supports stereoscopic-vision, viewer-centered perspective, large angles of view, and interactivity. We describe a novel virtual reality-based model designed to teach anorectal and pelvic floor anatomy, pathology, and surgery. METHODS: A static physical model depicting the pelvic floor and anorectum was created and digitized at 1-mm intervals in a CT scanner. Multiple software programs were used along with endoscopic images to generate a realistic interactive computer model, which was designed to be viewed on a networked, interactive, virtual-reality display (CAVE or ImmersaDesk). A standard examination of ten basic anorectal and pelvic floor anatomy questions was administered to third-year (n = 6) and fourth-year (n = 7) surgical residents. A workshop using the Virtual Pelvic Floor Model was then given, and the standard examination was readministered so that it was possible to evaluate the effectiveness of the Digital Pelvic Floor Model as an educational instrument. RESULTS: Training on the Virtual Pelvic Floor Model produced substantial improvements in the overall average test scores for the two groups, with an overall increase of 41 percent (P = 0.001) and 21 percent (P = 0.0007) for third-year and fourth-year residents, respectively. Resident evaluations after the workshop also confirmed the effectiveness of understanding pelvic anatomy using the Virtual Pelvic Floor Model. CONCLUSION: This model provides an innovative interactive educational framework that allows educators to overcome some of the barriers to teaching surgical and endoscopic principles based on understanding highly complex three-dimensional anatomy. Using this collaborative, shared virtual-reality environment, teachers and students can interact from locations world-wide to manipulate the components of this model to achieve the educational goals of this project along with the potential for virtual surgery.