Facilitating real-time volume interaction.

We report on efforts to provide high-level intuitive tools that exploit commodity-based computing to facilitate real-time and distributed interactions with volumetric data. These efforts include an open source volume-rendering library, a portable volume visualization application framework, and parallel volume-rendering exploiting commodity-based hardware. We present our design and implementations, as well as examples of some of the various groups currently utilizing these tools, and discuss the tradeoffs of our developments versus existing techniques.

Temporal bone dissection simulation--an update.

We report on our continued development of a virtual simulation for temporal bone dissection that provides stereoscopic display, haptic feedback, and aural simulation into a straightforward, comprehensive learning environment. The multimodal interface provides a seamless simulation for non-deterministic drilling and cutting of bone in the surgical context, as well as an intuitive interface for the intelligent tutor for learning regional anatomy. We present novel methodologies for integrating multimodal and multiresolution data sets, including extension to functional and structural segmentation. We will present our initial efforts to validate this environment. Through continued iterations, it is our hope that the system will provide a valuable tool for training future otologic surgeons as well as an environment for the quantitative evaluation of surgical skill.

Interactive medical data on demand: a high-performance imaged-based approach across heterogeneous environments.

Medical data in image format continues to increase in both size and complexity. We have integrated advanced techniques in visualization, networked computing, and interface design to improve methods for accessing medical data comprising high-resolution images for reconstructions into three-dimensional volumetric representations. We present two approaches to handle the range of low to high-end client platforms, support visualization functionality, and provide the ability to manipulate very large data over heterogeneous computing and networking environments. We present examples of its use for clinical, research, and educational purposes and discuss future extensions.

Virtual temporal bone dissection simulation.

We have developed a working prototype system for the virtual simulation of temporal bone dissection. The system offers a paradigm from traditional practices by integrating technological advances to provide a safer and more cost effective way to learn fundamental techniques used in temporal bone surgeries. We present our methods to provide a real-time interactive volumetric system that obviates the need for physical materials in initial training, and provides a more accessible way for residents to practice and to increase exposure to pathological variance. Finally, we discuss ways to extend this work to more advanced resident training, presurgical planning, and surgical documentation.

Interactive volume visualizations for synchronous and asynchronous remote collaboration.

The value of information acquisition is not simply to acquire data at increased precision, but to make these data both available and usable to as many specialists as possible. We have developed a working prototype for intuitive realtime interaction over the Internet. Current scenarios include use by expert head and neck surgeons, for use in preoperative assessment of head and neck cancers, and remote synchronous collaboration scenarios such as expert-expert and expert-referring physician. This prototype demonstrates a shared virtual environment that allows multiple users to interactively manipulate large volumetric data sets across long distances. The system is easily extensible to many other applications that utilize discrete data sampling and thus is readily extensible to a wide range of scientific investigations.

Functional endoscopic sinus surgery training simulator.

OBJECTIVE/HYPOTHESIS: To determine the efficacy of a haptic (force feedback) device and to compare isosurface and volumetric models of a functional endoscopic sinus surgery (FESS) training simulator. STUDY DESIGN: A pilot study involving faculty and residents from the Department of Otolaryngology at The Ohio State University. METHODS: Objective trials evaluated the haptic device's ability to perceive three-dimensional shapes (stereognosis) without the aid of image visualization. Ethmoidectomy tasks were performed with both isosurface and volumetric FESS simulators, and surveys compared the two models. RESULTS: The haptic device was 77% effective for stereognosis tasks. There was a preference toward the isosurface model over the volumetric model in terms of visual representation, comfort, haptic-visual fidelity, and overall performance. CONCLUSIONS: The FESS simulator uses both visual and haptic feedback to create a virtual reality environment to teach paranasal sinus anatomy and basic endoscopic sinus surgery techniques to ear, nose, and throat residents. The results of the current study showed that the haptic device was accurate in and of itself, within its current physical limitations, and that the isosurface-based simulator was preferred.

Using advanced simulation technology for cranial base tumor evaluation.

Skull base tumors are considered one of the most difficult pathologic entities to diagnose and treat. The physician is heavily dependent on imaging studies to determine the best form of treatment. As imaging technology becomes more advanced, the physician will need to be able to intuitively explore the complex data. Such intuitive exploration requires the use of high performance computer hardware and software. Issues related to this concept and a summary of current work in this area are presented.

A comparative analysis of integrating visual representations with haptic displays.

As further advances in visual display technologies and force feedback devices are integrated in virtual systems, questions remain: What level of reality does the system provide to the user? Is the environment convincing enough to engage the user and to maximize transfer? Are the visual and haptic displays fully integrated to provide seamless operation in the simulated environment? Does the system provide not only the ability to navigate through a simulated environment, but also realistic interaction with instrumentation and structures? We report on our advances in developing a virtual simulation system for training in functional endoscopic sinus surgery (FESS). Specifically, we will present work on subject trials exploring the realism provided by integrated visual and haptic displays, and compare and contrast surface vs. volume representation for presenting realistic models of the anatomy for surgical interaction.

Visualization of compression neuropathies through volume deformation.

This paper describes an interdisciplinary effort to simulate and visualize the mechanisms involved in compression neuropathies, specifically tissue deformation occurring during vaginal delivery. These neuropathies often evolve into chronic pelvic pain. We present our methodologies of using high resolution magnetic resonance acquisitions from submillimeter pulse sequences to develop interactive computer simulations based on physically plausible volume models to drive 3D simulations of childbirth. This effort will elucidate tissue movements and mechanics involved in pain disorders and better explain the etiology of these disorders.

A volumetric approach to virtual simulation of functional endoscopic sinus surgery.

Advanced display technologies have made the virtual exploration of relatively complex models feasible in many applications. Unfortunately, only a few human interfaces allow natural interaction with the environment. Moreover, in surgical applications, such realistic interaction requires real-time rendering of volumetric data-placing an overwhelming performance burden on the system. We report on a collaboration of an interdisciplinary group developing a virtual reality system that provides intuitive interaction with volume data by employing real-time volume rendering and force feedback (haptic) sensations. We describe our rendering methods and the haptic devices and explain its utility of this system in the real-world application of Endoscopic Sinus Surgery (ESS) simulation.

ENT endoscopic surgical training simulator.

This paper describes work in progress on the design and development of a prototype simulator for minimally invasive otolaryngology surgical training. The anatomy of the paranasal sinuses is geometrically complex and dangerously close to the brain and orbits, making this procedure challenging to practice and difficult to learn. We discuss the potential role of computer simulation to enhance and accelerate acquisition of surgical skills. The design goals of the prototype include high-fidelity simulation of the endoscopic imagery and haptic cues of surgical palpation. The prototype enables endoscopic navigation and limited interactive tissue manipulation and dissection tasks on a virtual patient using realistic replicas of surgical tools. We present an overview of the system architecture with a discussion of the technological challenges, design issues and current status of the efforts.