Examining How Interaural Differences Owing to Head Rotation during Walking Improve the Distance of Auditory Obstacle Perceptions among Individuals with Visual Impairment: A Case Study in Small-Scale Blind Group.

The ability of individuals with visual impairment to recognize an obstacle by hearing is called "obstacle sense". This ability is facilitated while they are moving, though the exact reason remains unknown. This study aims to clarify which acoustical factors may contribute to obstacle sense, especially obstacle distance perception. First, we conducted a comparative experiment regarding obstacle distance localization by individuals who are blind (N = 5, five men with blindness aged 22-42 (average: 29.8)) while they were standing and walking. The results indicate that the localized distance was more accurate while walking than while standing. Subsequently, the head rotation angle while walking and acoustic characteristics with respect to obstacle distance and head rotation angle were investigated. The peaks of the absolute head rotation angle during walking ranged from 2.78° to 11.11° (average: 6.55°, S.D.: 2.05°). Regarding acoustic characteristics, acoustic coloration occurred, and spectral interaural differences and interaural intensity differences were observed in the blind participants (N = 4, four men including two blind and two control sighted persons aged 25-38 (average: 30.8)). To determine which acoustic factors contribute, we examined the threshold of changes for interaural differences in time (ITD) and intensity (IID) (N = 11, seven men and four women with blindness aged 21-35 (average: 27.4)), as well as coloration (ICD) (N = 6, seven men and a woman with blindness aged 21-38 (average: 29.9))-depending on the head rotation. Notably, ITD and IID thresholds were 86.2 µs and 1.28 dB; the corresponding head rotation angles were 23.5° and 9.17°, respectively. The angle of the ICD threshold was 6.30° on average. Consequently, IID might be a contributing factor and ICD can be utilized as the cue facilitating the obstacle distance perception while walking.

Binaural Listening with Head Rotation Helps Persons with Blindness Perceive Narrow Obstacles.

Orientation and mobility (O&M) are important abilities that people with visual impairments use in their independent performance of daily activities. In orientation, people with total blindness pinpoint nonsounding objects and sounding objects. The ability to perceive nonsounding objects is called obstacle sense, wherein people with blindness recognize the various characteristics of an obstacle using acoustic cues. Although body movement and listening style may enhance the sensing of obstacles, experimental studies on this topic are lacking. Elucidating their contributions to obstacle sense may lead to the further systematization of techniques of O&M training. This study sheds light on the contribution of head rotation and binaural hearing to obstacle sense among people with blindness. We conducted an experiment on the perceived presence and distance of nonsounding obstacles, which varied width and distance, for participants with blindness under the conditions of binaural or monaural hearing, with or without head rotation. The results indicated that head rotation and binaural listening can enhance the localization of nonsounding obstacles. Further, when people with blindness are unable to perform head rotation or use binaural hearing, their judgment can become biased in favor of the presence of an obstacle due to risk avoidance.

A case study of new assessment and training of unilateral spatial neglect in stroke patients: effect of visual image transformation and visual stimulation by using a Head Mounted Display system (HMD).

BACKGROUND: Unilateral spatial neglect (USN) is most damaging to an older stroke patient who also has a lower performance in their activities of daily living or those elderly who are still working. The purpose of this study was to understand more accurately pathology of USN using a new HMD system. METHODS: Two stroke patients (Subject A and B) participated in this study after gaining their informed consent and they all had Left USN as determined by clinical tests. Assessments of USN were performed by using the common clinical test (the line cancellation test) and six special tests by using HMD system in the object-centered coordinates (OC) condition and the egocentric coordinates (EC) condition. OC condition focused the test sheet only by a CCD. EC condition was that CCD can always follow the subject's movement. Moreover, the study focused on the effect of the reduced image condition of real image and the arrows. RESULTS: In Patient A who performed the common test and special tests of OC and EC conditions, the results showed that for the line cancellation test under the common condition, both of the percentage of the correct answers at the right and left sides in the test sheet was 100 percent. However, in the OC condition, the percentage of the correct answers at the left side in the test sheet was 44 percent and the right side was 94 percent. In the EC condition, the left side was 61 percent and the right side was 67 percent. In Patient B, according to the result of the use of reduced image condition and the arrows condition by HMD system, these line cancellation scores more increased than the score of the common test. CONCLUSIONS: The results showed that the assessment of USN using an HMD system may clarify the left neglect area which cannot be easily observed in the clinical evaluation for USN. HMD may be able to produce an artificially versatile environment as compared to the common clinical evaluation and treatment.

Artificial organs: recent progress in artificial hearing and vision.

Artificial sensory organs are a prosthetic means of sending visual or auditory information to the brain by electrical stimulation of the optic or auditory nerves to assist visually impaired or hearing-impaired people. However, clinical application of artificial sensory organs, except for cochlear implants, is still a trial-and-error process. This is because how and where the information transmitted to the brain is processed is still unknown, and also because changes in brain function (plasticity) remain unknown, even though brain plasticity plays an important role in meaningful interpretation of new sensory stimuli. This article discusses some basic unresolved issues and potential solutions in the development of artificial sensory organs such as cochlear implants, brainstem implants, artificial vision, and artificial retinas.

A preliminary study of clinical assessment of left unilateral spatial neglect using a head mounted display system (HMD) in rehabilitation engineering technology.

PURPOSE: Unilateral spatial neglect (USN) is a common syndrome in which a patient fails to report or respond to stimulation from the side of space opposite a brain lesion, where these symptoms are not due to primary sensory or motor deficits. The purpose of this study was to analyze an evaluation process system of USN in various visual fields using HMD in order to understand more accurately any faults of USN operating in the object-centred co-ordinates. METHOD: Eight stroke patients participated in this study and they had Left USN in clinical test, and right hemisphere damage was checked by CT scan. Assessments of USN were performed the BIT common clinical test (the line and the stars cancellation tests) and special tests the zoom-in condition (ZI) condition and the zoom-out condition (ZO) condition. The subjects were first evaluated by the common clinical test without HMD and then two spatial tests with HMD. Moreover, we used a video-recording for all tests to analyze each subject's movements. RESULTS: For the line cancellation test under the common condition, the mean percentage of the correct answers at the left side in the test paper was 94.4%. In the ZI condition, the left side was 61.8.% and the right side was 92.4.%. In the ZO condition, the left side was 79.9% and the right side was 91.7.%. There were significant differences among the three conditions. The results of the stars cancellation test also showed the same tendency as the line bisection test. CONCLUSION: The results showed that the assessment of USN using a technique of HMD system may indicate the disability of USN more than the common clinical tests. Moreover, it might be hypothesized that the three dimensional for USN test may be more related to various damage and occurrence of USN than only the two dimensional test.

Effects of an eyeglass-free 3-D display on the human visual system.

PURPOSE: To investigate the effect on the human visual system of viewing 3-dimensional (3-D) computer graphics (CG) images with an eyeglass-free rear-cross-lenticular-type 3-D display. METHODS: Positive accommodation velocity (GRAD) during the accommodative step response was measured in ten healthy young adults before and after they viewed CG images. Although the distance between the viewer and the 3-D display was 600 mm, the apparent distance between the viewer and the virtual object was varied (515, 600, and 722 mm) by changing the visual disparity. RESULTS: A significant slowdown of average GRAD was observed by 60 min after a 30-min 3-D viewing of 3-D CG images [P<0.05, analysis of variance (ANOVA)] but not after a 30-min viewing of the CG images on a 2-D display or after a 15-min 3-D viewing. When the virtual object was at 722 mm, a significant slowdown of average GRAD was observed only at 30 min after the 30-min 3-D viewing (P<0.05, ANOVA). When the virtual object was at 515 mm, a significant slowdown of average GRAD was observed at 30 and 60 min after the 3-D viewing (P<0.05, ANOVA). CONCLUSIONS: The effect on the human visual system of 3-D viewing of 3-D CG images depends on both the duration of the viewing and the apparent distance between the viewer and the virtual objects.

Standardization of thresholding for binary conversion of vocal tract modeling in computed tomography.

Postoperative head and neck cancer patients suffer from speech disorders, which are the result of changes in their vocal tracts. Making a solid vocal tract model and measuring its transmission characteristics will provide one of the most useful tools to resolve the problem. In binary conversion of X-ray computed tomographic (CT) images for vocal tract reconstruction, nonobjective methods have been used by many researchers. We hypothesized that a standardized vocal tract model could be reconstructed by adopting the Hounsfield number of fat tissue as a criterion for thresholding of binary conversion, because its Hounsfield number is the nearest to air in the human body. The purpose of this study was to establish a new standardized method for binary conversion in reconstructing three-dimensional (3-D) vocal tract models. CT images for postoperative diagnosis were secondarily obtained from a CT scanner. Each patient's minimum settings of Hounsfield number for the buccal fat-pad regions were measured. Thresholds were set every 50 Hounsfield units (HU) from the bottom line of the buccal fat-pad region to -1024 HU, the images were converted into binary values, and were evaluated according to the three-grade system based on anatomically defined criteria. The optimal threshold between tissue and air was determined by nonlinear multiple regression analyses. Each patient's minimum settings of the buccal fat-pad regions were obtained. The optimal threshold was determined to be -165 HU from each patient's minimum settings of the Hounsfield number for the buccal fat-pad regions. To conclude, a method of 3-D standardized vocal tract modeling was established.

A preliminary study of MR sickness evaluation using visual motion aftereffect for advanced driver assistance systems.

Mixed Reality (MR) technologies have recently been explored in many areas of Human-Machine Interface (HMI) such as medicine, manufacturing, entertainment and education. However MR sickness, a kind of motion sickness is caused by sensory conflicts between the real world and virtual world. The purpose of this paper is to find out a new evaluation method of motion and MR sickness. This paper investigates a relationship between the whole-body vibration related to MR technologies and the motion aftereffect (MAE) phenomenon in the human visual system. This MR environment is modeled after advanced driver assistance systems in near-future vehicles. The seated subjects in the MR simulator were shaken in the pitch direction ranging from 0.1 to 2.0 Hz. Results show that MAE is useful for evaluation of MR sickness incidence. In addition, a method to reduce the MR sickness by auditory stimulation is proposed.

Development of a wearable electro-larynx for laryngectomees and its evaluation.

An electro-larynx is one of speech-substitute devices for patients who have lost laryngeal function. Unfortunately, the voices produced by a conventional electro-larynx are completely flat, unlike a human voice. In order to improve it, we developed a pitch-controlled electro-larynx that allows patients to control a voice intonation using their exhalation. The pitch-controlled electro-larynx has been manufactured in Japan and about 3500 patients have used the device since 1998. However, most patients have strongly requested a further advanced electro-larynx so that they can use it without their hands occupied. We designed a wearable electro-larynx so that it contributes to increase their quality of life. The new electro-larynx can be attached to the patient's neck using a thermo-plastic brace on which a thin-vibrator can be mounted. In this report, we mentioned how to design the wearable electro-larynx and the new electro-larynx was evaluated from a view-point of its sound quality and the usability. Although our wearable electro-larynx has not yet been equipped with the pitch-control function, it was ascertained that it works well while the users are moving their head in the various direction.

Development of a piezoelectric actuator for presentation of various tactile stimulation patterns to fingerpad skin.

In order to investigate tactile perception characteristics of the human fingerpad for the optimal design of a sensory substitution system, we have developed a small piezoelectric bimorph actuator that possesses flat frequency characteristics in the vibratory frequency of tactilely perceivable bandwidth. The parameters for the design of the bimorph were determined by using a mechanical simulation model of a piezoelectric bimorph and a fingerpad skin. To evaluate the performance of the bimorph, we measured frequency-displacement relationships when the skin of a fingerpad was vibrated by the piezoelectric bimorph. The experimental results showed that the frequency-displacement relationships were almost the same as the estimation obtained from the mechanical simulation model.