Haptic, Virtual Interaction and Motor Imagery: Entertainment Tools and Psychophysiological Testing.

In this work, the perception of affordances was analysed in terms of cognitive neuroscience during an interactive experience in a virtual reality environment. In particular, we chose a virtual reality scenario based on the Leap Motion controller: this sensor device captures the movements of the user's hand and fingers, which are reproduced on a computer screen by the proper software applications. For our experiment, we employed a sample of 10 subjects matched by age and sex and chosen among university students. The subjects took part in motor imagery training and immersive affordance condition (a virtual training with Leap Motion and a haptic training with real objects). After each training sessions the subject performed a recognition task, in order to investigate event-related potential (ERP) components. The results revealed significant differences in the attentional components during the Leap Motion training. During Leap Motion session, latencies increased in the occipital lobes, which are entrusted to visual sensory; in contrast, latencies decreased in the frontal lobe, where the brain is mainly activated for attention and action planning.

Virtual model of the human brain for neurosurgical simulation.

The aim of this work is to develop a realistic virtual model of the human brain that could be used in a neurosurgical simulation for both educational and preoperative planning purposes. The goal of such a system would be to enhance the practice of surgery students, avoiding the use of animals, cadavers and plastic phantoms. A surgeon, before carrying out the real procedure, will, with this system, be able to rehearse by using a surgical simulator based on detailed virtual reality models of the human brain, reconstructed with real patient's medical images. In order to obtain a realistic and useful simulation we focused our research on the physical modelling of the brain as a deformable body and on the interactions with surgical instruments. The developed prototype is based on the mass-spring-damper model and, in order to obtain deformations similar to the real ones, a three tiered structure has been built. In this way, we have obtained local and realistic deformations using an ad-hoc point distribution in the volume where the contact between the brain surface and a surgical instrument takes place.

A virtual interface for interactions with 3D models of the human body.

The developed system is the first prototype of a virtual interface designed to avoid contact with the computer so that the surgeon is able to visualize 3D models of the patient's organs more effectively during surgical procedure or to use this in the pre-operative planning. The doctor will be able to rotate, to translate and to zoom in on 3D models of the patient's organs simply by moving his finger in free space; in addition, it is possible to choose to visualize all of the organs or only some of them. All of the interactions with the models happen in real-time using the virtual interface which appears as a touch-screen suspended in free space in a position chosen by the user when the application is started up. Finger movements are detected by means of an optical tracking system and are used to simulate touch with the interface and to interact by pressing the buttons present on the virtual screen.