Evaluating mental workload of two-dimensional and three-dimensional visualization for anatomical structure localization.

Visualization of medical data in three-dimensional (3D) or two-dimensional (2D) views is a complex area of research. In many fields 3D views are used to understand the shape of an object, and 2D views are used to understand spatial relationships. It is unclear how 2D/3D views play a role in the medical field. Using 3D views can potentially decrease the learning curve experienced with traditional 2D views by providing a whole representation of the patient's anatomy. However, there are challenges with 3D views compared with 2D. This current study expands on a previous study to evaluate the mental workload associated with both 2D and 3D views. Twenty-five first-year medical students were asked to localize three anatomical structures--gallbladder, celiac trunk, and superior mesenteric artery--in either 2D or 3D environments. Accuracy and time were taken as the objective measures for mental workload. The NASA Task Load Index (NASA-TLX) was used as a subjective measure for mental workload. Results showed that participants viewing in 3D had higher localization accuracy and a lower subjective measure of mental workload, specifically, the mental demand component of the NASA-TLX. Results from this study may prove useful for designing curricula in anatomy education and improving training procedures for surgeons.

Development of a customizable software application for medical imaging analysis and visualization.

Graphics technology has extended medical imaging tools to the hands of surgeons and doctors, beyond the radiology suite. However, a common issue in most medical imaging software is the added complexity for non-radiologists. This paper presents the development of a unique software toolset that is highly customizable and targeted at the general physicians as well as the medical specialists. The core functionality includes features such as viewing medical images in two-and three-dimensional representations, clipping, tissue windowing, and coloring. Additional features can be loaded in the form of 'plug-ins' such as tumor segmentation, tissue deformation, and surgical planning. This allows the software to be lightweight and easy to use while still giving the user the flexibility of adding the necessary features, thus catering to a wide range of user population.

Tumor segmentation from computed tomography image data using a probabilistic pixel selection approach.

Automatic segmentation of tumors is a complicated and difficult process as most tumors are rarely clearly delineated from healthy tissues. A new method for probabilistic segmentation to efficiently segment tumors within CT data and to improve the use of digital medical data in diagnosis has been developed. Image data are first enhanced by manually setting the appropriate window center and width, and if needed a sharpening or noise removal filter is applied. To initialize the segmentation process, a user places a seed point within the object of interest and defines a search region for segmentation. Based on the pixels' spatial and intensity properties, a probabilistic selection criterion is used to extract pixels with a high probability of belonging to the object. To facilitate the segmentation of multiple slices, an automatic seed selection algorithm was developed to keep the seeds in the object as its shape and/or location changes between consecutive slices. The seed selection algorithm performs a greedy search by searching for pixels with matching intensity close to the location of the original seed point. A total of ten CT datasets were used as test cases, each with varying difficulty in terms of automatic segmentation. Five test cases had mean false positive error rates less than 10%, and four test cases had mean false negative error rates less than 10% when compared to manual segmentation of those tumors by radiologists.

Three-dimensional segmentation of tumors from CT image data using an adaptive fuzzy system.

A new segmentation method using a fuzzy rule based system to segment tumors in a three-dimensional CT data was developed. To initialize the segmentation process, the user selects a region of interest (ROI) within the tumor in the first image of the CT study set. Using the ROI's spatial and intensity properties, fuzzy inputs are generated for use in the fuzzy rules inference system. With a set of predefined fuzzy rules, the system generates a defuzzified output for every pixel in terms of similarity to the object. Pixels with the highest similarity values are selected as tumor. This process is automatically repeated for every subsequent slice in the CT set without further user input, as the segmented region from the previous slice is used as the ROI for the current slice. This creates a propagation of information from the previous slices, used to segment the current slice. The membership functions used during the fuzzification and defuzzification processes are adaptive to the changes in the size and pixel intensities of the current ROI. The method is highly customizable to suit different needs of a user, requiring information from only a single two-dimensional image. Test cases success in segmenting the tumor from seven of the 10 CT datasets with <10% false positive errors and five test cases with <10% false negative errors. The consistency of the segmentation results statistics also showed a high repeatability factor, with low values of inter- and intra-user variability for both methods.

A collaborative interaction and visualization multi-modal environment for surgical planning.

The proliferation of virtual reality visualization and interaction technologies has changed the way medical image data is analyzed and processed. This paper presents a multi-modal environment that combines a virtual reality application with a desktop application for collaborative surgical planning. Both visualization applications can function independently but can also be synced over a network connection for collaborative work. Any changes to either application is immediately synced and updated to the other. This is an efficient collaboration tool that allows multiple teams of doctors with only an internet connection to visualize and interact with the same patient data simultaneously. With this multi-modal environment framework, one team working in the VR environment and another team from a remote location working on a desktop machine can both collaborate in the examination and discussion for procedures such as diagnosis, surgical planning, teaching and tele-mentoring.

A virtual reality environment for patient data visualization and endoscopic surgical planning.

Visualizing patient data in a three-dimensional (3D) representation can be an effective surgical planning tool.As medical imaging technologies improve with faster and higher resolution scans, the use of virtual reality for interacting with medical images adds another level of realism to a 3D representation. The software framework presented in this paper is designed to load and display any DICOM/PACS-compatible 3D image data for visualization and interaction in an immersive virtual environment. In "examiner" mode, the surgeon can interact with a 3D virtual model of the patient by using an intuitive set of controls designed to allow slicing, coloring,and windowing of the image to show different tissue densities and enhance important structures. In the simulated"endoscopic camera" mode, the surgeon can see through the point of view of a virtual endoscopic camera to navigate inside the patient. These tools allow the surgeon to perform virtual endoscopy on any suitable structure.The software is highly scalable, as it can be used on a single desktop computer to a cluster of computers in an immersive multiprojection virtual environment. By wearing a pair of stereo glasses, a surgeon becomes immersed within the model itself, thus providing a sense of realism, as if the surgeon is "inside" the patient.

A framework for interactive visualization of digital medical images.

The visualization of medical images obtained from scanning techniques such as computed tomography and magnetic resonance imaging is a well-researched field. However, advanced tools and methods to manipulate these data for surgical planning and other tasks have not seen widespread use among medical professionals. Radiologists have begun using more advanced visualization packages on desktop computer systems, but most physicians continue to work with basic two-dimensional grayscale images or not work directly with the data at all. In addition, new display technologies that are in use in other fields have yet to be fully applied in medicine. It is our estimation that usability is the key aspect in keeping this new technology from being more widely used by the medical community at large. Therefore, we have a software and hardware framework that not only make use of advanced visualization techniques, but also feature powerful, yet simple-to-use, interfaces. A virtual reality system was created to display volume-rendered medical models in three dimensions. It was designed to run in many configurations, from a large cluster of machines powering a multiwalled display down to a single desktop computer. An augmented reality system was also created for, literally, hands-on interaction when viewing models of medical data. Last, a desktop application was designed to provide a simple visualization tool, which can be run on nearly any computer at a user's disposal. This research is directed toward improving the capabilities of medical professionals in the tasks of preoperative planning, surgical training, diagnostic assistance, and patient education.

A framework for interactive examination of automatic segmented tumors in a virtual environment.

An immersive virtual environment for viewing and interacting with three-dimensional representations of medical image data is presented. Using a newly developed automatic segmentation method, a segmented object (e.g., tumor or organ) can also be viewed in the context of the original patient data. Real time interaction is established using joystick movements and button presses on a wireless gamepad. Several open-source platforms have been utilized, such as DCMTK for processing of DICOM formatted data, Coin3D for scenegraph management, SimVoleon for volume rendering, and VRJuggler to handle the immersive visualization. The application allows the user to manipulate representations with features such as fast pseudo-coloring to highlight details of the patient data, windowing to select a range of tissue densities for display, and multiple clipping planes to allow the user to slice into the patient.