The precision of signals encoding active self-movement.

Everyday actions like moving the head, walking around and grasping objects are typically self-controlled. This presents a problem when studying the signals encoding such actions because active self-movement is difficult to control experimentally. Available techniques demand repeatable trials, but each action is unique, making it difficult to measure fundamental properties like psychophysical thresholds. We present a novel paradigm that recovers both precision and bias of self-movement signals with minimal constraint on the participant. The paradigm relies on linking image motion to previous self-movement, and two experimental phases to extract the signal encoding the latter. The paradigm takes care of a hidden source of external noise not previously accounted for in techniques that link display motion to self-movement in real time (e.g. virtual reality). We use head rotations as an example of self-movement, and show that the precision of the signals encoding head movement depends on whether they are being used to judge visual motion or auditory motion. We find that perceived motion is slowed during head movement in both cases. The 'non-image' signals encoding active head rotation (motor commands, proprioception and vestibular cues) are therefore biased towards lower speeds and/or displacements. In a second experiment, we trained participants to rotate their heads at different rates and found that the imprecision of the head rotation signal rises proportionally with head speed (Weber's Law). We discuss the findings in terms of the different motion cues used by vision and hearing, and the implications they have for Bayesian models of motion perception.

Practical utility of a head-mounted gaze-directed beamforming system.

Assistive auditory devices that enhance signal-to-noise ratio must follow the user's changing attention; errors could lead to the desired source being suppressed as noise. A method for measuring the practical benefit of attention-following speech enhancement is described and used to show a benefit for gaze-directed beamforming over natural binaural hearing. First, participants watched a recorded video conference call between two people with six additional interfering voices in different directions. The directions of the target voices corresponded to the spatial layout of their video streams. A simulated beamformer was yoked to the participant's gaze direction using an eye tracker. For the control condition, all eight voices were spatially distributed in a simulation of unaided binaural hearing. Participants completed questionnaires on the content of the conversation, scoring twice as high in the questionnaires for the beamforming condition. Sentence-by-sentence intelligibility was then measured using new participants who viewed the same audiovisual stimulus for each isolated sentence. Participants recognized twice as many words in the beamforming condition. The results demonstrate the potential practical benefit of gaze-directed beamforming for hearing aids and illustrate how detailed intelligibility data can be retrieved from an experiment that involves behavioral engagement in an ongoing listening task.

Acoustic analysis of the effect of personal protective equipment on speech understanding: lessons for clinical environments.

OBJECTIVE: The use of various types of filtering facepiece class 3 (FFP3) mask have become commonplace since the Covid-19 outbreak. These have been evaluated in terms of efficacy regarding aerosol filtration but less emphasis has been placed on the acoustic effects of such masks and their consequences for clinical communication. DESIGN: A microphone 65 cm from a sound-producing Head and Torso Simulator (wearing the masks) was used to measure attenuation via a tone sweep. Predicted impact on speech reception in noise was assessed by weighting the attenuations of cochlear excitation patterns by the frequency importance function of the Speech Intelligibility Index. STUDY SAMPLE: We evaluated acoustic attenuation properties of seven FFP3 masks and a Type IIR surgical mask (as a comparator). RESULTS: The Type IIR mask had the smallest impact on SNR (2.6 dB with visor). Most FFP3s with an addition of a visor (if not already face covering) impacted SNR by approximately 6 dB. The 3 M 6000 was significantly worse (15.8 dB). CONCLUSIONS: Mouth-and-nose covering FFP3s masks had similar effects on SNR (≈6.2 dB with visor). The Tecmen TM-H2 had several advantages over other masks evaluated. It was reusable, allowed lipreading clues and the attenuation was similar to other FFP3s.

The pinna enhances angular discrimination in the frontal hemifield.

Human sound localization in the horizontal dimension is thought to be dominated by binaural cues, particularly interaural time delays, because monaural localization in this dimension is relatively poor. Remaining ambiguities of front versus back and up versus down are distinguished by high-frequency spectral cues generated by the pinna. The experiments in this study show that this account is incomplete. Using binaural listening throughout, the pinna substantially enhanced horizontal discrimination in the frontal hemifield, making discrimination in front better than discrimination at the rear, particularly for directions away from the median plane. Eliminating acoustic effects of the pinna by acoustically bypassing them or low-pass filtering abolished the advantage at the front without affecting the rear. Acoustic measurements revealed a pinna-induced spectral prominence that shifts smoothly in frequency as sounds move from 0° to 90° azimuth. The improved performance is discussed in terms of the monaural and binaural changes induced by the pinna.

Unilateral crosstalk cancellation in normal hearing participants using bilateral bone transducers.

It is possible to psychophysically measure the phase and level of bone conducted sound at the cochleae using two bone transducers (BTs) [Mcleod and Culling (2019). J. Acoust Soc. Am. 146, 3295 - 3301]. The present work uses such measurements to improve masked thresholds by using the phase and level values to create a unilateral crosstalk cancellation system. To avoid changes in the coupling of the BT to the head, testing of tone and speech reception thresholds with and without crosstalk cancellation had to be performed immediately following the measurements without adjustment of the BT. To achieve this, a faster measurement method was created. Previously measured phase and level results were interpolated to predict likely results for new test frequencies. Testing time to collect the necessary phase and level values was reduced to approximately 15 min by exploiting listeners' previous measurements. The inter-cochlear phase difference and inter-cochlear level difference were consistent between experimental sittings in the same participant but different between participants. Addition of a crosstalk cancellation signal improved tone and speech reception thresholds for tones/speech presented with one BT and noise presented on the other by an average of 12.1 dB for tones and 13.67 dB for speech.

Psychoacoustic measurement of phase and level for cross-talk cancellation using bilateral bone transducers: Comparison of methods.

Two bone-conduction hearing aids (BCHAs) could deliver improved stereo separation using cross-talk cancellation. Sound vibrations from each BCHA would be cancelled at the contralateral cochlea by an out-of-phase signal of the same level from the ipsilateral BCHA. A method to measure the level and phase required for these cancellation signals was developed and cross-validated with an established technique that combines air- and bone-conducted sound. Three participants with normal hearing wore bone transducers (BTs) on each mastoid and insert earphones. Both BTs produced a pure tone and the level and phase were adjusted in the right BT in order to cancel all perceived sound at that ear. To cross-validate, one BT was stimulated with a pure tone and participants cancelled the resultant signal at both cochleae via adjustment of the phase and level of signals from the earphones. Participants achieved cancellation using both methods between 1.5 and 8 kHz. Levels measured with each method differed by <1 dB between 3 and 5 kHz. The phase results also corresponded well for the cancelled ear (11° mean difference) but poorly for the contralateral ear (38.4° mean difference). The first method is transferable to patients with middle-ear dysfunction, but covers a limited frequency range.

Measurements of inter-cochlear level and phase differences of bone-conducted sound.

Bone-anchored hearing aids are a widely used method of treating conductive hearing loss, but the benefit of bilateral implantation is limited due to interaural cross-talk. The present study measured the phase and level of pure tones reaching each cochlea from a single, mastoid placed bone transducer on normal hearing participants. In principle, the technique could be used to implement a cross-talk cancellation system in those with bilateral bone conductors. The phase and level of probe tones over two insert earphones was adjusted until they canceled sound from a bone transducer (i.e., resulting in perceived silence). Testing was performed in 50-Hz steps between 0.25 and 8 kHz. Probe phase and level results were used to calculate inter-cochlear level and phase differences. The inter-cochlear phase differences of the bone-conducted sound were similar for all three participants showing a relatively linear increase between 4 and 8 kHz. The attenuation characteristics were highly variable over the frequency range as well as between participants. This variability was thought to be related to differences in skull dynamics across the ears. Repeated measurements of cancellation phase and level of the same frequency produced good consistency across sessions from the same participant.

Cochlear implant simulator with independent representation of the full spiral ganglion.

In cochlear implant simulation with vocoders, narrow-band carriers deliver the envelopes from each analysis band to the cochlear positions of the simulated electrodes. However, this approach does not faithfully represent the continuous nature of the spiral ganglion. The proposed "SPIRAL" vocoder simulates current spread by mixing all envelopes across many tonal carriers. SPIRAL demonstrated that the classic finding of reduced speech-intelligibility benefit with additional electrodes could be due to current spread. SPIRAL produced lower speech reception thresholds than an equivalent noise vocoder. These thresholds are stable for between 20 and 160 carriers.

Binaural Loudness Constancy.

In binaural loudness summation, diotic presentation of a sound usually produces greater loudness than monaural presentation. However, experiments using loudspeaker presentation with and without earplugs find that magnitude estimates of loudness are little altered by the earplug, suggesting a form of loudness constancy. We explored the significance of controlling stimulation of the second ear using meatal occlusion as opposed to the deactivation of one earphone. We measured the point of subjective loudness equality (PSLE) for monaural vs. binaural presentation using an adaptive technique for both speech and noise. These stimuli were presented in a reverberant room over a loudspeaker to the right of the listener, or over lightweight headphones. Using the headphones, stimuli were either presented dry, or matched to those of the loudspeaker by convolution with impulse responses measured from the loudspeaker to the listener position, using an acoustic manikin. The headphone response was also compensated. Using the loudspeaker, monaural presentation was achieved by instructing the listener to block the left ear with a finger. Near perfect binaural loudness constancy was observed using loudspeaker presentation, while there was a summation effect of 3-6 dB for both headphone conditions. However, only partial constancy was observed when meatal occlusion was simulated. These results suggest that there may be contributions to binaural loudness constancy from residual low frequencies at the occluded ear as well as a cognitive element, which is activated by the knowledge that one ear is occluded.

Speech Intelligibility for Target and Masker with Different Spectra.

The speech intelligibility index (SII) calculation is based on the assumption that the effective range of signal-to-noise ratio (SNR) regarding speech intelligibility is [- 15 dB; +15 dB]. In a specific frequency band, speech intelligibility would remain constant by varying the SNRs above + 15 dB or below - 15 dB. These assumptions were tested in four experiments measuring speech reception thresholds (SRTs) with a speech target and speech-spectrum noise, while attenuating target or noise above or below 1400 Hz, with different levels of attenuation in order to test different SNRs in the two bands. SRT varied linearly with attenuation at low-attenuation levels and an asymptote was reached for high-attenuation levels. However, this asymptote was reached (intelligibility was not influenced by further attenuation) for different attenuation levels across experiments. The - 15-dB SII limit was confirmed for high-pass filtered targets, whereas for low-pass filtered targets, intelligibility was further impaired by decreasing the SNR below - 15 dB (until - 37 dB) in the high-frequency band. For high-pass and low-pass filtered noises, speech intelligibility kept improving when increasing the SNR in the rejected band beyond + 15 dB (up to 43 dB). Before reaching the asymptote, a 10-dB increase of SNR obtained by filtering the noise resulted in a larger decrease of SRT than a corresponding 10-dB decrease of SNR obtained by filtering the target (the slopes SRT/attenuation were different depending on which source was filtered). These results question the use of the SNR range and the importance function adopted by the SII when considering sharply filtered signals.

Speech intelligibility in virtual restaurants.

Speech reception thresholds (SRTs) for a target voice on the same virtual table were measured in various restaurant simulations under conditions of masking by between one and eight interferers at other tables. Results for different levels of reverberation and different simulation techniques were qualitatively similar. SRTs increased steeply with the number of interferers, reflecting progressive failure to perceptually unmask the target speech as the acoustic scene became more complex. For a single interferer, continuous noise was the most effective masker, and a single interfering voice of either gender was least effective. With two interferers, evidence of informational masking emerged as a difference in SRT between forward and reversed speech, but SRTs for all interferer types progressively converged at four and eight interferers. In simulation based on a real room, this occurred at a signal-to-noise ratio of around -5 dB.

Head orientation benefit to speech intelligibility in noise for cochlear implant users and in realistic listening conditions.

Cochlear implant (CI) users suffer from elevated speech-reception thresholds and may rely on lip reading. Traditional measures of spatial release from masking quantify speech-reception-threshold improvement with azimuthal separation of target speaker and interferers and with the listener facing the target speaker. Substantial benefits of orienting the head away from the target speaker were predicted by a model of spatial release from masking. Audio-only and audio-visual speech-reception thresholds in normal-hearing (NH) listeners and bilateral and unilateral CI users confirmed model predictions of this head-orientation benefit. The benefit ranged 2-5 dB for a modest 30° orientation that did not affect the lip-reading benefit. NH listeners' and CI users' lip-reading benefit measured 3 and 5 dB, respectively. A head-orientation benefit of ∼2 dB was also both predicted and observed in NH listeners in realistic simulations of a restaurant listening environment. Exploiting the benefit of head orientation is thus a robust hearing tactic that would benefit both NH listeners and CI users in noisy listening conditions.

The benefit of head orientation to speech intelligibility in noise.

Spatial release from masking is traditionally measured with speech in front. The effect of head-orientation with respect to the speech direction has rarely been studied. Speech-reception thresholds (SRTs) were measured for eight head orientations and four spatial configurations. Benefits of head orientation away from the speech source of up to 8 dB were measured. These correlated with predictions of a model based on better-ear listening and binaural unmasking (r = 0.96). Use of spontaneous head orientations was measured when listeners attended to long speech clips of gradually diminishing speech-to-noise ratio in a sound-deadened room. Speech was presented from the loudspeaker that initially faced the listener and noise from one of four other locations. In an undirected paradigm, listeners spontaneously turned their heads away from the speech in 56% of trials. When instructed to rotate their heads in the diminishing speech-to-noise ratio, all listeners turned away from the speech and reached head orientations associated with lower SRTs. Head orientation may prove valuable for hearing-impaired listeners.

Speech intelligibility prediction in reverberation: Towards an integrated model of speech transmission, spatial unmasking, and binaural de-reverberation.

Room acoustic indicators of intelligibility have focused on the effects of temporal smearing of speech by reverberation and masking by diffuse ambient noise. In the presence of a discrete noise source, these indicators neglect the binaural listener's ability to separate target speech from noise. Lavandier and Culling [(2010). J. Acoust. Soc. Am. 127, 387-399] proposed a model that incorporates this ability but neglects the temporal smearing of speech, so that predictions hold for near-field targets. An extended model based on useful-to-detrimental (U/D) ratios is presented here that accounts for temporal smearing, spatial unmasking, and binaural de-reverberation in reverberant environments. The influence of the model parameters was tested by comparing the model predictions with speech reception thresholds measured in three experiments from the literature. Accurate predictions were obtained by adjusting the parameters to each room. Room-independent parameters did not lead to similar performances, suggesting that a single U/D model cannot be generalized to any room. Despite this limitation, the model framework allows to propose a unified interpretation of spatial unmasking, temporal smearing, and binaural de-reverberation.

Phase effects in masking by harmonic complexes: detection of bands of speech-shaped noise.

When phase relationships between partials of a complex masker produce highly modulated temporal envelopes on the basilar membrane, listeners may detect speech information from temporal dips in the within-channel masker envelopes. This source of masking release (MR) is however located in regions of unresolved masker partials and it is unclear how much of the speech information in these regions is really needed for intelligibility. Also, other sources of MR such as glimpsing in between resolved masker partials may provide sufficient information from regions that disregard phase relationships. This study simplified the problem of speech recognition to a masked detection task. Target bands of speech-shaped noise were restricted to frequency regions containing either only resolved or only unresolved masker partials, as a function of masker phase relationships (sine or random), masker fundamental frequency (F0) (50, 100, or 200 Hz), and masker spectral profile (flat-spectrum or speech-shaped). Although masker phase effects could be observed in unresolved regions at F0s of 50 and 100 Hz, it was only at 50-Hz F0 that detection thresholds were ever lower in unresolved than in resolved regions, suggesting little role of envelope modulations for harmonic complexes with F0s in the human voice range and at moderate level.

A model that predicts the binaural advantage to speech intelligibility from the mixed target and interferer signals.

A model is presented that predicts the binaural advantage to speech intelligibility by analyzing the right and left recordings at the two ears containing mixed target and interferer signals. This auditory-inspired model implements an equalization-cancellation stage to predict the binaural unmasking (BU) component, in conjunction with a modulation-frequency estimation block to estimate the "better ear" effect (BE) component of the binaural advantage. The model's performance was compared to experimental data obtained under anechoic and reverberant conditions using a single speech-shaped noise interferer paradigm. The internal BU and BE components were compared to those of the speech intelligibility model recently proposed by Lavandier et al. [J. Acoust. Soc. Am. 131, 218-231 (2012)], which requires separate inputs for target and interferer. The data indicate that the proposed model provides comparably good predictions from a mixed-signals input under both anechoic and reverberant conditions.

Roles of the target and masker fundamental frequencies in voice segregation.

Intelligibility of a target voice improves when its fundamental frequency (F0) differs from that of a masking voice, but it remains unclear how this masking release (MR) depends on the two relative F0s. Three experiments measured speech reception thresholds (SRTs) for a target voice against different maskers. Experiment 1 evaluated the influence of target F0 itself. SRTs against white noise were elevated by at least 2 dB for a monotonized target voice compared with the unprocessed voice, but SRTs differed little for F0s between 50 and 150 Hz. In experiments 2 and 3, a MR occurred when there was a steady difference in F0 between the target voice and a stationary speech-shaped harmonic complex or a babble. However, this MR was considerably larger when the F0 of the masker was 11 semitones above the target F0 than when it was 11 semitones below. In contrast, for a fixed masker F0, the MR was similar whether the target F0 was above or below. The dependency of these MRs on the masker F0 suggests that a spectral mechanism such as glimpsing in between resolved masker partials may account for an important part of this phenomenon.

Speech recognition against harmonic and inharmonic complexes: spectral dips and periodicity.

Speech recognition in a complex masker usually benefits from masker harmonicity, but there are several factors at work. The present study focused on two of them, glimpsing spectrally in between masker partials and periodicity within individual frequency channels. Using both a theoretical and an experimental approach, it is demonstrated that when inharmonic complexes are generated by jittering partials from their harmonic positions, there are better opportunities for spectral glimpsing in inharmonic than in harmonic maskers, and this difference is enhanced as fundamental frequency (F0) increases. As a result, measurements of masking level difference between the two maskers can be reduced, particularly at higher F0s. Using inharmonic maskers that offer similar glimpsing opportunity to harmonic maskers, it was found that the masking level difference between the two maskers varied little with F0, was influenced by periodicity of the first four partials, and could occur in low-, mid-, or high-frequency regions. Overall, the present results suggested that both spectral glimpsing and periodicity contribute to speech recognition under masking by harmonic complexes, and these effects seem independent from one another.

Energetic and informational masking in a simulated restaurant environment.

Participants were seated at a central table for two in a virtual restaurant, simulated over headphones. They listened to the person across the table. Speech reception thresholds (SRTs) were measured as a function of the number of interfering sources distributed across other tables in the room; those sources were either speech-shaped noises or competing speech. The restaurant either was enclosed by acoustically reflective surfaces or was anechoic. Variations in SRT for speech-shaped noises were accurately predicted (r = 0.96) by a model of spatial release from masking based on the additive combination of better-ear listening and binaural unmasking. However, SRTs for interfering voices followed a different pattern. A single interfering voice gave a lower SRT than a single speech-shaped noise source (by 6.3 dB in anechoic conditions and 1.2 dB in reverberant conditions). This difference can be attributed to the effects of dip listening and to the exploitation of differences between voices in fundamental frequency (F0). SRTs for two interfering voices were markedly higher than for a single voice, particularly when the interfering voice was the same as the target voice. Multiple speech interferers produced more masking than multiple noise interferers. This effect can be attributed to informational masking (IM). These results indicate that current models require some elaboration before they will produce accurate predictions of intelligibility in noisy social environments.

Speech intelligibility among modulated and spatially distributed noise sources.

At a cocktail party, listeners are faced with multiple, spatially distributed interfering voices. The dominant interfering voice may change from moment to moment and, consequently, change in spatial location. The ability of the binaural system to deal with such a dynamic scene has not been systematically analyzed. Spatial release from masking (SRM) was measured in simple spatial scenes, simulated over headphones with a frontal speech source. For a single noise at 105°, SRM was reduced if that noise modulated (10 Hz square wave, 50% duty cycle, 20 dB modulation depth), but, for two noises in symmetrical locations, SRM increased if the noises were modulated in alternation, suggesting that the binaural system can "switch" between exploiting different spatial configurations. Experiment 2 assessed the contributions of interaural time and level differences as a function of modulation rate (1-20 Hz). Scenes were created using the original head-related impulse responses and ones that had been manipulated to isolate each cue. SRM decreased steeply with modulation rate. The combined effects of interaural time and level differences were consistent with additive contributions. The results indicate that binaural sluggishness limits the contribution of binaural switching to speech understanding at a cocktail party.