Assessing and Modeling Spatial Release From Listening Effort in Listeners With Normal Hearing: Reference Ranges and Effects of Noise Direction and Age.

Listening to speech in noisy environments is challenging and effortful. Factors like the signal-to-noise ratio (SNR), the spatial separation between target speech and noise interferer(s), and possibly also the listener's age might influence perceived listening effort (LE). This study measured and modeled the effect of the spatial separation of target speech and interfering stationary speech-shaped noise on the perceived LE and its relation to the age of the listeners. Reference ranges for the relationship between subjectively perceived LE and SNR for different noise azimuths were established. For this purpose, 70 listeners with normal hearing and from three age groups rated the perceived LE using the Adaptive Categorical Listening Effort Scaling method (ACALES, Krueger et al., 2017a) with speech from the front and noise from 0°, 90°, 135°, or 180° azimuth. Based on these data, the spatial release from listening effort (SRLE) was calculated. The noise azimuth had a strong effect on SRLE, with the highest release for 135°. The binaural speech intelligibility model (BSIM2020, Hauth et al., 2020) predicted SRLE very well at negative SNRs, but overestimated for positive SNRs. No significant effect of age was found on the respective subjective ratings. Therefore, the reference ranges were determined independently of age. These reference ranges can be used for the classification of LE measurements. However, when the increase of the perceived LE with SNR was analyzed, a significant age difference was found between the listeners of the youngest and oldest group when considering the upper range of the LE function.

Connected Hearing Devices and Audiologists: The User-Centered Development of Digital Service Innovations.

Today, medical technology manufacturers enter the service market through the development of digital service innovations. In the field of audiology, these developments increasingly shift the service capacities from audiologists to manufacturers and technical systems. However, the technology-driven developments of manufacturers lack acceptance of hearing device users and undermine the important role of audiologists within the service provision. By following a user-centered design approach in order to deal with the technological and social challenges of disruptive services, we aim to develop service innovations on an integrated service platform in the field of tele-audiology. To ensure the acceptance of technology-driven service innovations among hearing device users and audiologists, we systematically integrated these actors in a participatory innovation process. With qualitative and quantitative data we identified several requirements and preferences for different service innovations in the field of tele-audiology. According to the preferences of the different actors, we proposed a service platform approach based on a connected hearing device in three pillars of application: 1) one-to-one (1:1) service innovations based on a remote fitting concept directly improve the availability of services offered by audiologists without being physically present. Based on this, 2) one-to-many (1:N) service innovations allow the use of the connected hearing device as an indirect data source for training a machine learning algorithm that empowers users through the automation of service processes. A centralized server system collects the data and performs the training of this algorithm. The optimized algorithm is provided to the connected hearing devices to perform automatic acoustic scene classification. This in turn allows optimization of the hearing devices within each acoustic scene. After the user-centered development of the different service innovations which are designed to converge on an integrated service platform, we experimentally evaluated the functionality and applicability of the system as well as the associated role models between the technical system, the hearing device users and audiologists. As a future outlook, we show potentials to use the connected hearing device for 3) cross-industry (N:M) service innovations in contexts outside the healthcare domain and give practical implications for the market launch of successful service innovations in the field of tele-audiology.

Speech Audiometry at Home: Automated Listening Tests via Smart Speakers With Normal-Hearing and Hearing-Impaired Listeners.

Speech audiometry in noise based on sentence tests is an important diagnostic tool to assess listeners' speech recognition threshold (SRT), i.e., the signal-to-noise ratio corresponding to 50% intelligibility. The clinical standard measurement procedure requires a professional experimenter to record and evaluate the response (expert-conducted speech audiometry). The use of automatic speech recognition enables self-conducted measurements with an easy-to-use speech-based interface. This article compares self-conducted SRT measurements using smart speakers with expert-conducted laboratory measurements. With smart speakers, there is no control over the absolute presentation level, potential errors from the automated response logging, and room acoustics. We investigate the differences between highly controlled measurements in the laboratory and smart speaker-based tests for young normal-hearing (NH) listeners as well as for elderly NH, mildly and moderately hearing-impaired listeners in low, medium, and highly reverberant room acoustics. For the smart speaker setup, we observe an overall bias in the SRT result that depends on the hearing loss. The bias ranges from +0.7 dB for elderly moderately hearing-impaired listeners to +2.2 dB for young NH listeners. The intrasubject standard deviation is close to the clinical standard deviation (0.57/0.69 dB for the young/elderly NH compared with 0.5 dB observed for clinical tests and 0.93/1.09 dB for the mild/moderate hearing-impaired listeners compared with 0.9 dB). For detecting a clinically elevated SRT, the speech-based test achieves an area under the curve value of 0.95 and therefore seems promising for complementing clinical measurements.

The Virtual Reality Lab: Realization and Application of Virtual Sound Environments.

To assess perception with and performance of modern and future hearing devices with advanced adaptive signal processing capabilities, novel evaluation methods are required that go beyond already established methods. These novel methods will simulate to a certain extent the complexity and variability of acoustic conditions and acoustic communication styles in real life. This article discusses the current state and the perspectives of virtual reality technology use in the lab for designing complex audiovisual communication environments for hearing assessment and hearing device design and evaluation. In an effort to increase the ecological validity of lab experiments, that is, to increase the degree to which lab data reflect real-life hearing-related function, and to support the development of improved hearing-related procedures and interventions, this virtual reality lab marks a transition from conventional (audio-only) lab experiments to the field. The first part of the article introduces and discusses the notion of the communication loop as a theoretical basis for understanding the factors that are relevant for acoustic communication in real life. From this, requirements are derived that allow an assessment of the extent to which a virtual reality lab reflects these factors, and which may be used as a proxy for ecological validity. The most important factor of real-life communication identified is a closed communication loop among the actively behaving participants. The second part of the article gives an overview of the current developments towards a virtual reality lab at Oldenburg University that aims at interactive and reproducible testing of subjects with and without hearing devices in challenging communication conditions. The extent to which the virtual reality lab in its current state meets the requirements defined in the first part is discussed, along with its limitations and potential further developments. Finally, data are presented from a qualitative study that compared subject behavior and performance in two audiovisual environments presented in the virtual reality lab-a street and a cafeteria-with the corresponding field environments. The results show similarities and differences in subject behavior and performance between the lab and the field, indicating that the virtual reality lab in its current state marks a step towards more ecological validity in lab-based hearing and hearing device research, but requires further development towards higher levels of ecological validity.

Relation Between Listening Effort and Speech Intelligibility in Noise.

PURPOSE: Subjective ratings of listening effort might be applicable to estimate hearing difficulties at positive signal-to-noise ratios (SNRs) at which speech intelligibility scores are near 100%. Hence, ratings of listening effort were compared with speech intelligibility scores at different SNRs, and the benefit of hearing aids was evaluated. METHOD: Two groups of listeners, 1 with normal hearing and 1 with hearing impairment, performed adaptive speech intelligibility and adaptive listening effort tests (Adaptive Categorical Listening Effort Scaling; Krueger, Schulte, Brand, & Holube, 2017) with sentences of the Oldenburg Sentence Test (Wagener, Brand, & Kollmeier, 1999a, 1999b; Wagener, Kühnel, & Kollmeier, 1999) in 4 different maskers. Model functions were fitted to the data to estimate the speech reception threshold and listening effort ratings for extreme effort and no effort. RESULTS: Listeners with hearing impairment showed higher rated listening effort compared with listeners with normal hearing. For listeners with hearing impairment, the rating extreme effort, which corresponds to negative SNRs, was more correlated to the speech reception threshold than the rating no effort, which corresponds to positive SNRs. A benefit of hearing aids on speech intelligibility was only verifiable at negative SNRs, whereas the effect on listening effort showed high individual differences mainly at positive SNRs. CONCLUSION: The adaptive procedure for rating subjective listening effort yields information beyond using speech intelligibility to estimate hearing difficulties and to evaluate hearing aids.

Development of an adaptive scaling method for subjective listening effort.

An adaptive procedure for controlling the signal-to-noise ratio (SNR) when rating the subjectively perceived listening effort (Adaptive Categorical Listening Effort Scaling) is described. For this, the listening effort is rated on a categorical scale with 14 steps after the presentation of three sentences in a background masker. In a first phase of the procedure, the individual SNR range for ratings from "no effort" to "extreme effort" is estimated. In the following phases, stimuli with randomly selected SNRs within this range are presented. One or two linear regression lines are fitted to the data describing subjective listening effort as a function of SNR. The results of the adaptive procedure are independent of the initial SNR. Although a static procedure using fixed, predefined SNRs produced similar results, the adaptive procedure avoided lengthy pretests for suitable SNRs and limited possible bias in the rating procedures. The adaptive procedure resolves individual differences, as well as differences between maskers. Inter-individual standard deviations are about three times as large as intra-individual standard deviations and the intra-class correlation coefficient for test-retest reliability is, on average, 0.9.

Age-related effects in interlimb practice on coding complex movement sequences.

Hikosaka et al. (1999) proposed that sequential movements are acquired in independent visual-spatial and motor coordinate systems with coding initially represented in visual-spatial coordinates, and later after extended practice in motor coordinates. One aspect of sequence learning that has not been systematically studied, however, is the question of whether or not older adults show the same pattern of coding in inter-limb practice as younger learners. In the present experiment an inter-limb practice paradigm was designed to determine the role that visual-spatial (Cartesian) and motor (joint angles, activation patterns) coordinates play in the coding and learning of a complex movement sequence. Younger and older adults practiced a 16-element movement sequence with one limb on Day 1 and the contra-lateral limb on Day 2. Practice involved the same sequence with either the same visual-spatial or motor coordinates on the two days. Retention tests were conducted on Day 3. Results indicated that keeping the visual-spatial coordinates the same during acquisition resulted in superior retention only for younger adults. Results also indicated the overall slowing of sequential movement production for older adults which appears to result from these participants inability to impose a structure on the sequence. This provides strong evidence that the visual-spatial code plays a dominant role in complex movement sequences and this code is represented in an effector-independent manner for younger adults, but not for older adults.

Asymmetric effector transfer of complex movement sequences.

An experiment was designed to determine if the addition of a load altered the effector transfer profile observed in earlier experiments using multi-element movement sequences. The acquisition task required participants to move a horizontal lever (with 0.567kg load) to 16 sequentially projected targets. One group practiced the movement sequence with their right (dominant) limb and another group practiced with their left (non-dominant) limb. Approximately 24h after completion of the acquisition session both groups were administered test blocks (0kg, 0.567kg, and 1.134kg) using their practiced and unpracticed limbs. Decreased and increased loads had minimal effect on test performance. The results indicated that the group trained with their left limb were able to perform the right limb tests as well as the group that trained with the right limb. However, the group that trained with their right limb were significantly slower performing the tests with the left limb than the group that practiced with their left limb. Importantly, the left acquisition limb group maintained the pattern of element durations used during practice on the various tests including transfer to the dominant limb. However, the pattern of element durations for the right acquisition limb group on the left limb transfer tests was altered such that the production of only the fastest produced elements were disrupted. These results suggest that one of the reasons for poor sequence performance when transferring from the right to left is because the sequence structure developed during acquisition and used on the tests lacked access to the appropriate commands or the controller lacked the ability to implement codes that effectively manage the movement dynamics.

Inter-manual transfer and practice: coding of simple motor sequences.

Previous research suggests that movements are represented early in practice in visual-spatial coordinates/codes, which are effector independent, and later in practice in motor coordinates/codes (e.g., joint angles, activation patterns), which are effector dependent. In the present experiments, the task was to reproduce 1.3 s patterns of elbow flexions and extensions. An inter-manual transfer paradigm was used in Experiment 1 and an inter-manual practice paradigm was used in Experiment 2. The present results clearly indicated a strong advantage of effector transfer when the motor coordinates available during acquisition were reinstated (Experiment 1) and demonstrate that inter-manual practice with the same motor coordinates results in enhanced retention performance relative to transfer and practice where the same visual-spatial coordinates are used. These results demonstrate that the more effective movement code (motor or visual-spatial) is dependent on the movement sequence characteristics (e.g., difficulty, number of elements, and mode of control [preplanned or on-line]). These results are also interesting because they indicate, contrary to previous findings with more complex movement sequences, that an effective motor code can be developed relatively early in practice for rapid movement sequences.

Effects of interlimb practice on coding and learning of movement sequences.

An interlimb practice paradigm was designed to determine the role that visual-spatial (Cartesian) and motor (joint angles, activation patterns) coordinates play in the coding and learning of complex movement sequences. Participants practised a 16-element movement sequence by moving a lever to sequentially presented targets with one limb on Day 1 and the contralateral limb on Day 2. Practice involved the same sequence with either the same visual-spatial or motor coordinates on the two days. A unilateral practice condition (control) was also tested where both coordinate systems were changed but the same limb was used. Retention tests were conducted on Day 3. Regardless of the order in which the limbs were used during practice, results indicated that keeping the visual-spatial coordinates the same during acquisition resulted in superior retention. This provides strong evidence that the visual-spatial code plays a dominant role in complex movement sequences, and this code is represented in an effector-independent manner.