Schizotypy and perceptual span in a non-clinical sample: a virtual reality study.

INTRODUCTION: Individuals with high schizotypy or schizophrenia exhibit difficulties in distributing their attention across space, leading to a reduction in their "perceptual span" - the extent of visual space that can be attended to at once. In this study, we aim to explore the correlation between schizotypy and perceptual span in a non-clinical sample to investigate whether perceptual span correlates with schizotypy across its range. METHODS: Schizotypy was assessed in fifty-five participants using the Schizotypy Personality Questionnaire (SPQ; Raine, 1991). Participants were required to attend to two dynamic targets displayed in a head-mounted virtual reality display. Perceptual span was estimated as the lateral angle of separation between the two targets beyond which performance in the task dropped to threshold. RESULTS: Participants with higher schizotypy scores performed significantly worse on the task. Of all the factors associated with schizotypy, the shared variance between Disorganisation and Cognitive/Perceptual Factors was most predictive of task performance. CONCLUSION: The results support the hypothesis that schizotypy predicts perceptual span in non-clinical samples. Furthermore, the demonstration of a reduced perceptual span in individuals with higher trait schizotypy shows that variations in an individual's capacity to divide attention across space can be accurately captured using a virtual reality head-mounted display.

Differences in the detail: Metacognition is better for seen than sensed changes to visual scenes.

Metacognition is the process by which we know what we know. Knowing has both declarative and sensed components. Differences exist in the information that moves to our conscious awareness and how it is synthesised with existing knowledge. The current study measured metacognition by extending a visual change detection paradigm that promoted explicit or implicit detection by either a local or global manipulation of a scene. A within-subjects design was used to investigate how 91 participants detected change and made metacognitive judgements. Cognitive modelling, based on confidence judgements, estimated the relative contributions of discrete and continuous cognitive processes to change detection, and to metacognition. Metacognition was sensitive to both the discrete and continuous processes underlying change detection, but was more sensitive to the discrete process. These results demonstrate that metacognition attunes confidence differentially to explicit and implicit processes, and support direct-access theories for discrete processing and meta-representation theories for continuous processing.

Visual-haptic integration, action and embodiment in virtual reality.

The current generation of virtual reality (VR) technologies has improved substantially from legacy systems, particularly in the resolution and latency of their visual display. The presentation of haptic cues remains challenging, however, because haptic systems do not generalise well over the range of stimuli (both tactile and proprioceptive) normally present when interacting with objects in the world. This study investigated whether veridical tactile and proprioceptive cues lead to more efficient interaction with a virtual environment. Interaction in the world results in spatial and temporal correlation of tactile, proprioceptive and visual cues. When cues in VR are similarly correlated, observers experience a sense of embodiment and agency of their avatars. We investigated whether sensorimotor performance was mediated by embodiment of the avatar hands. Participants performed a Fitts' tapping task in different conditions (VR with no haptics, active haptics, passive haptics, and on a real touchscreen). The active-haptic condition provided abstract tactile cues and the passive haptic condition provided veridical tactile and proprioceptive cues. An additional (hybrid haptics) condition simulated an ideal passive haptic system. Movement efficiency (throughput) and embodiment were higher for the passive than for the active and no-haptics conditions. However, components of embodiment (perceived agency and ownership) did not predict unique variance in throughput. Improved sensorimotor performance and ratings of presence and realism support the use of passive haptics in VR environments where objects are in known and stable locations, regardless of whether performance was mediated by the sense of embodiment.

Source monitoring and proneness to auditory-verbal hallucinations: a signal detection analysis.

INTRODUCTION: It has been suggested that a bias to misattribute self-generated thoughts to a nonself source underlies the experience of auditory-verbal hallucinations (AVH). We tested this hypothesis with healthy participants prone or not prone to AVH. METHOD: Participants (N=133) were presented with 96 words for subsequent recognition (half positively, half negatively valenced). For self-generated trials, participants generated a sentence containing the word. For other-generated trials, participants heard a prerecorded sentence containing the word. At test, studied words were re-presented visually, intermixed with 96 matched lures. Participants indicated the study status (old or new) and source (self or other) for each item. Sensitivity and bias measures were derived for item and source memory using signal detection theory. The 20 participants scoring highest on questions relating to AVH from the revised Launay-Slade Hallucination Scale formed the high-AVH group and the 20 scoring lowest formed the low-AVH group. RESULTS: ANOVAs revealed no significant differences between the two participant groups in sensitivity or bias of source memory, regardless of item valence. There was a trend for the sensitivity of item memory to be lower in the high-AVH group, compared with the low-AVH group. The bias of item memory was not significantly different between groups. CONCLUSIONS: Although we found no evidence that source-monitoring problems underlie the experience of AVHs in the general population, we recommend that signal detection measures be applied in future investigations of source monitoring in at-risk and clinical populations.

Hearing voices inside and outside the head: spatial source monitoring in participants prone to auditory hallucinations.

INTRODUCTION: Previous studies of source monitoring and auditory hallucinations (AH) have often conflated spatial source (internal-external) with source agency (self-other). Other studies have used suboptimal manipulations of auditory space (e.g., imagine saying vs. saying aloud). We avoided these problems by presenting experimenter-generated stimuli over headphones in the voice of another person so that the location of the voice sounded either internal or external to the participant's head. METHODS: Participants (N=121) studied 96 words and indicated for each whether it was presented internally or externally (online spatial source monitoring). At test, studied words were presented visually, intermixed randomly with 96 unstudied words. Participants indicated whether each item was old or new (item memory) and whether it was presented internally or externally during study (spatial source memory). Independent measures of memory accuracy and response bias were derived for online source monitoring, item memory and source memory using signal detection theory. Performance on these measures was compared between two groups of 30 participants who scored low or high on a measure of AH proneness. RESULTS: ANOVAs revealed no differences between the high- and low-AH groups in online spatial source monitoring, item memory, or spatial source memory. CONCLUSIONS: We found no evidence that proneness to AH in a sample of healthy volunteers was related to any of the measures of spatial source monitoring performance. We recommend that the methods introduced be applied to future investigations of spatial source monitoring with patient groups and with individuals at-risk for psychosis.

Spatial release from speech-on-speech masking in the median sagittal plane.

Several studies have described a release from speech-on-speech masking associated with separation of target and masker sources in the median sagittal plane. Some have excluded the possibility that small differences between target and masker interaural time disparities can fully account for this release. This study explored the mechanisms underlying the spatial release from speech-on-speech masking that can be obtained in the absence of such differences. In one condition, interaural time disparities were removed from the nominal median-sagittal-plane, head-related impulse responses used to generate the virtual auditory space within which competing sentences were presented. In other conditions, interaural level and spectral disparities also were manipulated by presenting competing sentences monaurally or diotically after convolution with one ear's head-related impulse responses. It was found that substantial spatial release from masking can be obtained in the absence of any interaural disparities and that such disparities probably make a relatively minor contribution to spatial release from speech-on-speech masking in the median sagittal plane. It is argued that this release from masking is driven primarily by a reduction in informational masking that occurs when monaural information at one, or both, of the listener's ears facilitates differentiation of competing sentences that emanate from spatially separated sources.

Memory for the locations of environmental sounds.

The accuracy with which a single source of sound can be localized has been examined in many studies, but very few studies have examined the ability of participants to determine the absolute locations of multiple sources of sound. The current study assessed participants' abilities to determine and remember the locations of up to six sources of environmental sound that were positioned at a range of azimuths and elevations in virtual auditory space. In experiment 1, a sequence of one to six sounds was presented one, three, or five times in each trial and the target sound was nominated following presentation of the last sequence. In experiment 2, memory load was held constant by nominating the target sound prior to a single sequence presentation. Localization accuracy was observed to decrease as the number of sounds was increased to three or more under the conditions of experiment 1, but not those of experiment 2. In experiment 1, localization was more accurate when sequences were presented more than once. Pronounced primacy and recency effects were observed for the six sound conditions in experiment 1. An analysis of errors for those conditions indicated that immediate temporal errors, but not immediate spatial errors, were over-represented.

Directed attention eliminates 'change deafness' in complex auditory scenes.

In natural environments that contain multiple sound sources, acoustic energy arising from the different sources sums to produce a single complex waveform at each of the listener's ears. The auditory system must segregate this waveform into distinct streams to permit identification of the objects from which the signals emanate [1]. Although the processes involved in stream segregation are now reasonably well understood [1, 2 and 3], little is known about the nature of our perception of complex auditory scenes. Here, we examined complex scene perception by having listeners detect a discrete change to an auditory scene comprising multiple concurrent naturalistic sounds. We found that listeners were remarkably poor at detecting the disappearance of an individual auditory object when listening to scenes containing more than four objects, but they performed near perfectly when their attention was directed to the identity of a potential change. In the absence of directed attention, this "change deafness" [4] was greater for objects arising from a common location in space than for objects separated in azimuth. Change deafness was also observed for changes in object location, suggesting that it may reflect a general effect of the dependence of human auditory perception on attention.

Sound localisation during illusory self-rotation.

Auditory elevation localisation was investigated under conditions of illusory self-rotation (i.e., vection) induced by movement of wide-field visual stimuli around participants' z-axes. Contrary to previous findings which suggest that auditory cues to sound-source elevation are discounted during vection, we found little evidence that vection affects judgements of source elevation. Our results indicate that the percept of auditory space during vection is generally consistent with the available head-centered auditory cues to source elevation. Auditory information about the head-centered location of a source appears to be integrated, without modification, with visual information about head motion to determine the perceived exocentric location of the source.

Spectral integration time of the auditory localisation system.

For the elevation and front-versus-back hemifield of a sound source to be accurately determined, the sound must contain a broad range of frequencies. Experiment 1 of this study examined the spectral integration time of the auditory localisation system by measuring the accuracy with which frequency-modulated (FM) tones of modulation periods ranging from 0.5 to 200 ms can be localised. For each of the four participants, judgements of sound-source elevation and front-back hemifield were most accurate for a modulation period of 5 ms. Accuracy levels for the 5 ms modulation period approached those for a pink-noise stimulus. This suggests that the spectral integration time of the auditory localisation system is around 5 ms. Supporting evidence for this conclusion was sought in experiment 2, in which two participants localised noise stimuli that had magnitude spectra identical to those of 5 ms equivalent-rectangular-duration samples of the FM tones from experiment 1. For both participants, functions relating localisation error measures (i.e., elevation error and frequency of front-back confusion) to modulation period for spectrally matched noises were similar to those for FM tones.

The role of spatial location in auditory search.

The majority of research findings to date indicate that spatial cues play a minor role in enhancing listeners' ability to parse and detect a sound of interest when it is presented in a complex auditory scene comprising multiple simultaneous sounds. Frequency and temporal differences between sound streams provide more reliable cues for scene analysis as well as for directing attention to relevant auditory 'objects' in complex displays. The present study used naturalistic sounds with varying spectro-temporal profiles to examine whether spatial separation of sound sources can enhance target detection in an auditory search paradigm. The arrays of sounds were presented in virtual auditory space over headphones. The results of Experiment 1 suggest that target detection is enhanced when sound sources are spatially separated relative to when they are presented at the same location. Experiment 2 demonstrated that this effect is most prominent within the first 250 ms of exposure to the array of sounds. These findings suggest that spatial cues may be effective for enhancing early processes such as stream segregation, rather than simply directing attention to objects that have already been segmented.

Localization of sound presented via a spatial audio display during visually induced vection in pitch, roll, and yaw.

INTRODUCTION: There is growing interest in the potential application of 3D audio displays to impart spatial information to aircraft pilots. As the aviation environment is dynamic, the effect on sound localization of the visual and vestibular stimulation resulting from motion during flight needs to be assessed. In this study, we investigated whether sound localization is affected by visual cues to self-motion. METHOD: Participants localized bursts of broadband acoustic noise presented from the frontal hemifield under conditions of yaw, pitch, and roll vection (around the z-, y-, and x-axis, respectively) induced by wide-field visual motion of a projected sinusoidal grating. Lateral and elevation components of localization errors were measured. RESULTS: Average signed lateral and elevation errors were less than 1.6 degrees for all vection conditions. The effects of vection condition on lateral and elevation errors were not statistically significant. Also, the interactions between vection condition and sound-source location for these errors were not significant. The magnitudes of the 95% confidence intervals for the differences in lateral and elevation errors between the no-vection condition and each of the other vection conditions did not exceed 3 degrees. CONCLUSION: In the presence of visual cues to yawing, pitching, or rolling self-motion, the perception of auditory space is generally consistent with the available head-centered auditory cues to sound-source location. These results support the application of 3D audio displays in dynamic visual environments such as that experienced during flight.

Inference in the Wild: A Framework for Human Situation Assessment and a Case Study of Air Combat.

Situation awareness is a key construct in human factors and arises from a process of situation assessment (SA). SA comprises the perception of information, its integration with existing knowledge, the search for new information, and the prediction of the future state of the world, including the consequences of planned actions. Causal models implemented as Bayesian networks (BNs) are attractive for modeling all of these processes within a single, unified framework. We elicited declarative knowledge from two Royal Australian Air Force (RAAF) fighter pilots about the information sources used in the identification (ID) of airborne entities and the causal relationships between these sources. This knowledge was represented in a BN (the declarative model) that was evaluated against the performance of 19 RAAF fighter pilots in a low-fidelity simulation. Pilot behavior was well predicted by a simple associative model (the behavioral model) with only three attributes of ID. Search for information by pilots was largely compensatory and was near-optimal with respect to the behavioral model. The average revision of beliefs in response to evidence was close to Bayesian, but there was substantial variability. Together, these results demonstrate the value of BNs for modeling human SA.

Metacognitive monitoring and control in visual change detection: Implications for situation awareness and cognitive control.

Metacognitive monitoring and control of situation awareness (SA) are important for a range of safety-critical roles (e.g., air traffic control, military command and control). We examined the factors affecting these processes using a visual change detection task that included representative tactical displays. SA was assessed by asking novice observers to detect changes to a tactical display. Metacognitive monitoring was assessed by asking observers to estimate the probability that they would correctly detect a change, either after study of the display and before the change (judgement of learning; JOL) or after the change and detection response (judgement of performance; JOP). In Experiment 1, observers failed to detect some changes to the display, indicating imperfect SA, but JOPs were reasonably well calibrated to objective performance. Experiment 2 examined JOLs and JOPs in two task contexts: with study-time limits imposed by the task or with self-pacing to meet specified performance targets. JOPs were well calibrated in both conditions as were JOLs for high performance targets. In summary, observers had limited SA, but good insight about their performance and learning for high performance targets and allocated study time appropriately.

Modelling Visual Change Detection and Identification under Free Viewing Conditions.

We examined whether the abilities of observers to perform an analogue of a real-world monitoring task involving detection and identification of changes to items in a visual display could be explained better by models based on signal detection theory (SDT) or high threshold theory (HTT). Our study differed from most previous studies in that observers were allowed to inspect the initial display for 3s, simulating the long inspection times typical of natural viewing, and their eye movements were not constrained. For the majority of observers, combined change detection and identification performance was best modelled by a SDT-based process that assumed that memory resources were distributed across all eight items in our displays. Some observers required a parameter to allow for sometimes making random guesses at the identities of changes they had missed. However, the performance of a small proportion of observers was best explained by a HTT-based model that allowed for lapses of attention.

Localization of virtual sound at 4 Gz.

INTRODUCTION: Acceleration directed along the body's z-axis (Gz) leads to misperception of the elevation of visual objects (the "elevator illusion"), most probably as a result of errors in the transformation from eye-centered to head-centered coordinates. We have investigated whether the location of sound sources is misperceived under increased Gz. METHOD: Visually guided localization responses were made, using a remotely controlled laser pointer, to virtual auditory targets under conditions of 1 and 4 Gz induced in a human centrifuge. As these responses would be expected to be affected by the elevator illusion, we also measured the effect of Gz on the accuracy with which subjects could point to the horizon. RESULTS: Horizon judgments were lower at 4 Gz than at 1 Gz, so sound localization responses at 4 Gz were corrected for this error in the transformation from eye-centered to head-centered coordinates. We found that the accuracy and bias of sound localization are not significantly affected by increased Gz. CONCLUSION: The auditory modality is likely to provide a reliable means of conveying spatial information to operators in dynamic environments in which Gz can vary.

Utility of monaural spectral cues is enhanced in the presence of cues to sound-source lateral angle.

The contention that normally binaural listeners can localize sound under monaural conditions has been challenged by Wightman and Kistler (J. Acoust. Soc. Am. 101:1050-1063, 1997), who found that listeners are almost completely unable to localize virtual sources of sound when sound is presented to only one ear. Wightman and Kistler's results raise the question of whether monaural spectral cues are used by listeners to localize sound under binaural conditions. We have examined the possibility that monaural spectral cues provide useful information regarding sound-source elevation and front-back hemifield when interaural time differences are available to specify sound-source lateral angle. The accuracy with which elevation and front-back hemifield could be determined was compared between a monaural condition and a binaural condition in which a wide-band signal was presented to the near ear and a version of the signal that had been lowpass-filtered at 2.5 kHz was presented to the far ear. It was found that accuracy was substantially greater in the latter condition, suggesting that information regarding sound-source lateral angle is required for monaural spectral cues to elevation and front-back hemifield to be correctly interpreted.

Contrast sensitivity in subgroups of developmental dyslexia.

It has been proposed that developmental dyslexia is associated with a deficit in the magnocellular pathway of the visual system. Other research focuses upon the heterogeneous nature of developmental dyslexia, and evidence that subgroups of dyslexia may be identified based on selective deficits in specific component reading skills. This study tested the hypothesis that visual processing deficits may be present in different subgroups of developmental dyslexia by comparing the visual contrast sensitivity of three subgroups of dyslexic children (phonological, surface and mixed) and controls. The stimulus designed to measure magnocellular visual function was a low spatial frequency Gaussian blob, flickered sinusoidally at a temporal frequency of 8.33 Hz. The control stimulus, designed to measure parvocellular visual function, was a relatively high spatial frequency Gaussian windowed grating (8 c/deg) slowly ramped on and off. There were no significant differences between the groups of dyslexic and control children in contrast sensitivity to either stimulus. The findings do not support the existence of a magnocellular system deficit in dyslexia.

The overlay interference task and object-selective visual attention.

A series of experiments was carried out to examine object-based visual attention in an interference task. Observers were presented with two transparently overlapping equilateral triangles forming a "Star of David". One of these triangles was darker than the background, the other was lighter than the background. The observers were required to make a speeded choice response to the orientation of the darker triangle. The presence of the light triangle produced a robust interference effect that manifested as a slower response time. This effect was strongly modulated by the relative contrast of the target and distractor triangles. It was reduced when the light distractor triangle was separated in depth from the target triangle. Since the configuration rules out the possibility of 2-D spatial selection, it is concluded that object-based selection occurs in interference tasks and that the effectiveness of this selection is modulated by visual attributes that are not directly relevant to the task.

Timing of finger tapping to frequency modulated acoustic stimuli.

This study examined the timing of synchronous finger tapping to continuous frequency modulation (FM) and to click trains. Tapping to click trains was found to statistically significantly anticipate the acoustic stimulus. Tapping to continuous FM occurred before the instantaneous frequency rose through its mean value (i.e. at zero phase of the sinusoidal FM). The anticipation of zero phase of the FM was similar in magnitude to the anticipation of the click stimuli. However, there was a systematic departure from this timing when the FM depth was varied, the cause of which is unclear. The perceived timing of acoustic stimuli will influence the timing of motor responses to the stimuli. These results may therefore be relevant to the timing of perceptual centres of acoustic stimuli including speech.