High variability phonetic training facilitates perception-to-production transfer in Mandarin-speaking children with cochlear implants: An acoustic investigation.

This study primarily aimed to evaluate the effectiveness of high variability phonetic training (HVPT) for children with cochlear implants (CIs) via the cross-modal transfer of perceptual learning to lexical tone production, a scope that has been largely neglected by previous training research. Sixteen CI participants received a five-session HVPT within a period of three weeks, whereas another 16 CI children were recruited without receiving any formal training. Lexical tone production was assessed with a picture naming task before the provision (pretest) and immediately after (posttest) and ten weeks after (follow-up test) the completion of the training protocol. The production samples were coded and analyzed acoustically. Despite considerable distinctions from the typical baselines of normal-hearing peers, the trained CI children exhibited significant improvements in Mandarin tone production from pretest to posttest in pitch height of T1, pitch slope of T2, and pitch curvature of T3. Moreover, the training-induced acoustic changes in the concave characteristic of the T3 contour was retained ten weeks after training termination. This study represents an initial acoustic investigation on HVPT-induced benefits in lexical tone production for the pediatric CI population, which provides valuable insights into applying this perceptual training technique as a viable tool in clinical practices.

Cortical mechanisms of across-ear speech integration investigated using functional near-infrared spectroscopy (fNIRS).

This study aimed to investigate integration of alternating speech, a stimulus which classically produces a V-shaped speech intelligibility function with minimum at 2-6 Hz in typical-hearing (TH) listeners. We further studied how degraded speech impacts intelligibility across alternating rates (2, 4, 8, and 32 Hz) using vocoded speech, either in the right ear or bilaterally, to simulate single-sided deafness with a cochlear implant (SSD-CI) and bilateral CIs (BiCI), respectively. To assess potential cortical signatures of across-ear integration, we recorded activity in the bilateral auditory cortices (AC) and dorsolateral prefrontal cortices (DLPFC) during the task using functional near-infrared spectroscopy (fNIRS). For speech intelligibility, the V-shaped function was reproduced only in the BiCI condition; TH (with ceiling scores) and SSD-CI conditions had significantly higher scores across all alternating rates compared to the BiCI condition. For fNIRS, the AC and DLPFC exhibited significantly different activity across alternating rates in the TH condition, with altered activity patterns in both regions in the SSD-CI and BiCI conditions. Our results suggest that degraded speech inputs in one or both ears impact across-ear integration and that different listening strategies were employed for speech integration manifested as differences in cortical activity across conditions.

Auditory areas are recruited for naturalistic visual meaning in early deaf people.

Congenital deafness enhances responses of auditory cortices to non-auditory tasks, yet the nature of the reorganization is not well understood. Here, naturalistic stimuli are used to induce neural synchrony across early deaf and hearing individuals. Participants watch a silent animated film in an intact version and three versions with gradually distorted meaning. Differences between groups are observed in higher-order auditory cortices in all stimuli, with no statistically significant effects in the primary auditory cortex. Comparison between levels of scrambling revealed a heterogeneity of function in secondary auditory areas. Both hemispheres show greater synchrony in the deaf than in the hearing participants for the intact movie and high-level variants. However, only the right hemisphere shows an increased inter-subject synchrony in the deaf people for the low-level movie variants. An event segmentation validates these results: the dynamics of the right secondary auditory cortex in the deaf people consist of shorter-length events with more transitions than the left. Our results reveal how deaf individuals use their auditory cortex to process visual meaning.

Underlying dimensions of real-time word recognition in cochlear implant users.

Word recognition is a gateway to language, linking sound to meaning. Prior work has characterized its cognitive mechanisms as a form of competition between similar-sounding words. However, it has not identified dimensions along which this competition varies across people. We sought to identify these dimensions in a population of cochlear implant users with heterogenous backgrounds and audiological profiles, and in a lifespan sample of people without hearing loss. Our study characterizes the process of lexical competition using the Visual World Paradigm. A principal component analysis reveals that people's ability to resolve lexical competition varies along three dimensions that mirror prior small-scale studies. These dimensions capture the degree to which lexical access is delayed ("Wait-and-See"), the degree to which competition fully resolves ("Sustained-Activation"), and the overall rate of activation. Each dimension is predicted by a different auditory skills and demographic factors (onset of deafness, age, cochlear implant experience). Moreover, each dimension predicts outcomes (speech perception in quiet and noise, subjective listening success) over and above auditory fidelity. Higher degrees of Wait-and-See and Sustained-Activation predict poorer outcomes. These results suggest the mechanisms of word recognition vary along a few underlying dimensions which help explain variable performance among listeners encountering auditory challenge.

Cochlear Implantation in Single-Sided Deafness and Asymmetric Hearing Loss: 12 Months Follow-up Results of a European Multicenter Evaluation.

People with single-sided deafness (SSD) or asymmetric hearing loss (AHL) have particular difficulty understanding speech in noisy listening situations and in sound localization. The objective of this multicenter study is to evaluate the effect of a cochlear implant (CI) in adults with single-sided deafness (SSD) or asymmetric hearing loss (AHL), particularly regarding sound localization and speech intelligibility with additional interest in electric-acoustic pitch matching. A prospective longitudinal study at 7 European tertiary referral centers was conducted including 19 SSD and 16 AHL subjects undergoing cochlear implantation. Sound localization accuracy was investigated in terms of root mean square error and signed bias before and after implantation. Speech recognition in quiet and speech reception thresholds in noise for several spatial configurations were assessed preoperatively and at several post-activation time points. Pitch perception with CI was tracked using pitch matching. Data up to 12 months post activation were collected. In both SSD and AHL subjects, CI significantly improved sound localization for sound sources on the implant side, and thus overall sound localization. Speech recognition in quiet with the implant ear improved significantly. In noise, a significant head shadow effect was found for SSD subjects only. However, the evaluation of AHL subjects was limited by the small sample size. No uniform development of pitch perception with the implant ear was observed. The benefits shown in this study confirm and expand the existing body of evidence for the effectiveness of CI in SSD and AHL. Particularly, improved localization was shown to result from increased localization accuracy on the implant side.

Bengali-Sign: A Machine Learning-Based Bengali Sign Language Interpretation for Deaf and Non-Verbal People.

Sign language is undoubtedly a common way of communication among deaf and non-verbal people. But it is not common among hearing people to use sign language to express feelings or share information in everyday life. Therefore, a significant communication gap exists between deaf and hearing individuals, despite both groups experiencing similar emotions and sentiments. In this paper, we developed a convolutional neural network-squeeze excitation network to predict the sign language signs and developed a smartphone application to provide access to the ML model to use it. The SE block provides attention to the channel of the image, thus improving the performance of the model. On the other hand, the smartphone application brings the ML model close to people so that everyone can benefit from it. In addition, we used the Shapley additive explanation to interpret the black box nature of the ML model and understand the models working from within. Using our ML model, we achieved an accuracy of 99.86% on the KU-BdSL dataset. The SHAP analysis shows that the model primarily relies on hand-related visual cues to predict sign language signs, aligning with human communication patterns.

Vocalization modulates the mouse auditory cortex even in the absence of hearing.

Vocal communication depends on distinguishing self-generated vocalizations from other sounds. Vocal motor corollary discharge (CD) signals are thought to support this ability by adaptively suppressing auditory cortical responses to auditory feedback. One challenge is that vocalizations, especially those produced during courtship and other social interactions, are accompanied by other movements and are emitted during a state of heightened arousal, factors that could potentially modulate auditory cortical activity. Here, we monitor auditory cortical activity, ultrasonic vocalizations (USVs), and other non-vocal courtship behaviors in a head-fixed male mouse while he interacts with a female mouse. This approach reveals a vocalization-specific signature in the auditory cortex that suppresses the activity of USV playback-excited neurons, emerges before vocal onset, and scales with USV band power. Notably, this vocal modulatory signature is also present in the auditory cortex of congenitally deaf mice, revealing an adaptive vocal CD signal that manifests independently of auditory feedback or auditory experience.

[Early auditory processing of speech in prelingually-deafened children with cochlear implants based on event-related potentials].

Objective: To investigate the early auditory discrimination of vowels, consonants and lexical tones in prelingually-deafened children with cochlear implants (CI) using auditory event-related potentials. Methods: Nineteen prelingually-deafened CI children and 19 normal hearing (NH) children were recruited in this study. A multi-deviant oddball paradigm was constructed using the monosyllable/ta1/as the standard stimulus and monosyllables/tu1/,/te1/, /da1/,/ra1/,/ta4/and/ta2/as the deviant stimuli. The event-related potentials evoked by vowel, consonant and lexical tone contrasts were recorded and analyzed in the two groups. Results: NH children showed robust mismatch negativities (MMNs) to vowel, consonant and lexical tone contrasts (P<0.05), whereas CI children only showed positive mismatch responses (pMMRs) and P3a responses to the vowel (P<0.05) and consonant contrasts (P<0.05) and no significant event-related potential to the lexical tone contrasts (P>0.05). The longer pMMR and P3a peak latencies (P<0.01) but similar amplitudes (P>0.05) were found in CI children than in NH children. CI children showed weaker phase synchronization of θ oscillations than NH children (P<0.05). The duration of CI use was positively correlated with the scores of Categories of Auditory Performance (CAP) (P=0.004), Speech Intelligibility Rate (SIR) (P=0.044) and Meaningful Auditory Integration Scale (MAIS) (P=0.001) in CI children. Conclusions: Prelingually-deafened CI children can process vowels and consonants at an early stage. However, their ability of processing speech, especially lexical tones, is still more immature compared with their NH peers. The event-related potentials could be objective electrophysiological indicators reflecting the maturity of CI children's auditory speech functions. Long-term CI use is beneficial for prelingually-deafened children to improve auditory and speech performance.

[The use of visual feedback in the treatment of a deaf young man with puberphonia]. / Primenenie vizual'noi obratnoi svyazi pri lechenii glukhogo yunoshi s puberfoniei.

A case of successful correction of the pitch frequency using the computer program Circ FFT is described.

Gray matter volume of the feline cerebral cortex and structural plasticity following perinatal deafness.

In response to sensory deprivation, the brain adapts according to contemporary demands to efficiently navigate a modified perceptual environment. This reorganization may result in improved processing of the remaining senses-a phenomenon referred to as compensatory crossmodal plasticity. One approach to explore this neuroplasticity is to consider the macrostructural changes in neural tissue that mirror this functional optimization. The current study is the first of its kind to measure MRI-derived gray matter (GM) volumes of control felines (n=30), while additionally identifying volumetric differences in response to perinatal deafness (30 ototoxically-deafened cats). To accomplish this purpose, regional and morphometric methods were performed in parallel. The regional analysis evaluated volumetric alterations of global GM, as well as the volumes of 146 regions of interest (ROIs) and 12 functional subgroupings of these ROIs. Results revealed whole-brain GM preservation; however, somatosensory and visual cortices exhibited an overall increase in volume. On a smaller scale, this analysis uncovered two auditory ROIs (second auditory cortex, A2, and ventral auditory field, VAF) that decreased in volume alongside two visual regions (anteromedial lateral suprasylvian area, AMLS and splenial visual area, SVA) that increased-all localized within the right hemisphere. Comparatively, the findings of tensor-based morphometry (TBM) generally aligned with those of the ROI-based method, as this voxel-wise approach demonstrated clusters of expansion coincident with visual- and somatosensory-related loci; although, it failed to detect any GM reductions following deafness. As distinct differences were identified in each analysis, the current study highlights the importance of employing multiple methods when exploring MRI volumetry. Overall, this study proposes that volumetric alterations within sensory loci allude to a redistribution of cortical space arising from modified perceptual demands following auditory deprivation.

An ERP investigation of perceptual vs motoric iconicity in sign production.

The type of form-meaning mapping for iconic signs can vary. For perceptually-iconic signs there is a correspondence between visual features of a referent (e.g., the beak of a bird) and the form of the sign (e.g., extended thumb and index finger at the mouth for the American Sign Language (ASL) sign BIRD). For motorically-iconic signs there is a correspondence between how an object is held/manipulated and the form of the sign (e.g., the ASL sign FLUTE depicts how a flute is played). Previous studies have found that iconic signs are retrieved faster in picture-naming tasks, but type of iconicity has not been manipulated. We conducted an ERP study in which deaf signers and a control group of English speakers named pictures that targeted perceptually-iconic, motorically-iconic, or non-iconic ASL signs. For signers (unlike the control group), naming latencies varied by iconicity type: perceptually-iconic < motorically-iconic < non-iconic signs. A reduction in the N400 amplitude was only found for the perceptually-iconic signs, compared to both non-iconic and motorically-iconic signs. No modulations of N400 amplitudes were observed for the control group. We suggest that this pattern of results arises because pictures eliciting perceptually-iconic signs can more effectively prime lexical access due to greater alignment between features of the picture and the semantic and phonological features of the sign. We speculate that naming latencies are facilitated for motorically-iconic signs due to later processes (e.g., faster phonological encoding via cascading activation from semantic features). Overall, the results indicate that type of iconicity plays role in sign production when elicited by picture-naming tasks.

Neural underpinnings of sentence reading in deaf, native sign language users.

The goal of this study was to investigate sentence-level reading circuits in deaf native signers, a unique group of deaf people who are immersed in a fully accessible linguistic environment from birth, and hearing readers. Task-based fMRI, functional connectivity and lateralization analyses were conducted. Both groups exhibited overlapping brain activity in the left-hemispheric perisylvian regions in response to a semantic sentence task. We found increased activity in left occipitotemporal and right frontal and temporal regions in deaf readers. Lateralization analyses did not confirm more rightward asymmetry in deaf individuals. Deaf readers exhibited weaker functional connectivity between inferior frontal and middle temporal gyri and enhanced coupling between temporal and insular cortex. In conclusion, despite the shared functional activity within the semantic reading network across both groups, our results suggest greater reliance on cognitive control processes for deaf readers, possibly resulting in greater effort required to perform the task in this group.

Investigating the crowding effect on letters and symbols in deaf adults.

Reading requires the transformation of a complex array of visual features into sounds and meaning. For deaf signers who experience changes in visual attention and have little or no access to the sounds of the language they read, understanding the visual constraints underlying reading is crucial. This study aims to explore a fundamental aspect of visual perception intertwined with reading: the crowding effect. This effect manifests as the struggle to distinguish a target letter when surrounded by flanker letters. Through a two-alternative forced choice task, we assessed the recognition of letters and symbols presented in isolation or flanked by two or four characters, positioned either to the left or right of fixation. Our findings reveal that while deaf individuals exhibit higher accuracy in processing letters compared to symbols, their performance falls short of that of their hearing counterparts. Interestingly, despite their proficiency with letters, deaf individuals didn't demonstrate quicker letter identification, particularly in the most challenging scenario where letters were flanked by four characters. These outcomes imply the development of a specialized letter processing system among deaf individuals, albeit one that may subtly diverge from that of their hearing counterparts.

Cortical volumetric changes after cochlear implantation in postlingually deaf adults: correlation with speech perception abilities.

This study aims to analyse the volumetric changes in brain MRI after cochlear implantation (CI), focusing on the speech perception in postlingually deaf adults. We conducted a prospective cohort study with 16 patients who had bilateral hearing loss and received unilateral CI. Based on the surgical side, patients were categorized into left and right CI groups. Volumetric T1-weighted brain MRI were obtained before and one year after the surgery. To overcome the artifact caused by the internal device in post-CI scan, image reconstruction method was newly devised and applied using the contralateral hemisphere of the pre-CI MRI data, to run FreeSurfer. We conducted within-subject template estimation for unbiased longitudinal image analysis, based on the linear mixed effect models. When analyzing the contralateral cerebral hemisphere before and after CI, a substantial increase in superior frontal gyrus and superior temporal gyrus (STG) volumes was observed in the left CI group. A positive correlation was observed in the STG and post-CI word recognition score in both groups. As far as we know, this is the first study attempting longitudinal brain volumetry based on post-CI MRI scans. We demonstrate that better auditory performance after CI is associated with structural restoration in central auditory structures.

The time course of Cantonese and Hong Kong Sign Language phonological activation: An ERP study of deaf bimodal bilingual readers of Chinese.

This study investigated Cantonese and Hong Kong Sign Language (HKSL) phonological activation patterns in Hong Kong deaf readers using the ERP technique. Two experiments employing the error disruption paradigm were conducted while recording participants' EEGs. Experiment 1 focused on orthographic and speech-based phonological processing, while Experiment 2 examined sign-phonological processing. ERP analyses focused on the P200 (180-220 ms) and N400 (300-500 ms) components. The results of Experiment 1 showed that hearing readers exhibited both orthographic and phonological effects in the P200 and N400 windows, consistent with previous studies on Chinese reading. In deaf readers, significant speech-based phonological effects were observed in the P200 window, and orthographic effects spanned both the P200 and N400 windows. Comparative analysis between the two groups revealed distinct spatial distributions for orthographic and speech-based phonological ERP effects, which may indicate the engagement of different neural networks during early processing stages. Experiment 2 found evidence of sign-phonological activation in both the P200 and N400 windows among deaf readers, which may reflect the involvement of sign-phonological representations in early lexical access and later semantic integration. Furthermore, exploratory analysis revealed that higher reading fluency in deaf readers correlated with stronger orthographic effects in the P200 window and diminished effects in the N400 window, indicating that efficient orthographic processing during early lexical access is a distinguishing feature of proficient deaf readers.

Duration of cochlear implant use in children with prelingual single-sided deafness is a predictor of word perception in the CI ear.

As part of a longitudinal study regarding the benefit of early cochlear implantation for children with single-sided deafness, the current work explored the children's daily device use, potential barriers to full-time device use, and the children's ability to understand speech with the cochlear implant (CI). Data were collected from 20 children with prelingual SSD who received a CI before the age of 2.5 years, from the initial activation of the sound processor until the children were 4.8 to 11.0 years old. Daily device use was extracted from the CI's data logging, while word perception in quiet was assessed using direct audio input to the children's sound processor. The children's caregivers completed a questionnaire about habits, motivations, and barriers to device use. The children with SSD and a CI used their device on average 8.3 h per day, corresponding to 63 % of their time spent awake. All children except one could understand speech through the CI, with an average score of 59 % on a closed-set test and 73 % on an open-set test. More device use was associated with higher speech perception scores. Parents were happy with their decision to pursue a CI for their child. Certain habits, like taking off the sound processor during illness, were associated with lower device use. Providing timely counselling to the children's parents, focused on SSD-specific challenges, may be helpful to improve daily device use in these children.

Adaptive Strategies of Single-Sided Deaf Cochlear-Implant Users Revealed Through Resting State Activity: an Auditory PET Brain Imaging Study.

Brain plasticity refers to the brain's ability to reorganize its structure or function in response to experiences, learning, and environmental influences. This phenomenon is particularly significant in individuals with deafness, as the brain adapts to compensate for the lack of auditory stimulation. The aim of this study is to investigate whether cochlear implantation can restore a normal pattern of brain activation following auditory stimulation in cases of asymmetric hearing loss. We used a PET-scan technique to assess brain activity after cochlear implantation, specifically during an auditory voice/non-voice discrimination task. The results indicated a nearly normal pattern of brain activity during the auditory discrimination task, except for increased activation in areas related to attentional processes compared to controls. Additionally, brain activity at rest showed significant changes in implanted participants, including cross modal visuo-auditory processing. Therefore, cochlear implants can restore the brain's activation pattern through long-term adaptive adjustments in intrinsic brain activity.

Investigating the impact of early deafness on learned action-effect contingency for action linked to peripheral sensory effects.

Investigating peripheral visual processing in individuals with early auditory deprivation is a critical research area in the field of neuroscience, since it helps understanding the phenomenon of sensory adaptation and brain plasticity after sensory loss. Prior research has already demonstrated that the absence of auditory input, which is crucial to detect events occurring out of the central egocentric visual space, leads to an improved processing of visual and tactile stimuli occurring in peripheral regions of the sensory space. Nevertheless, no prior studies have explored whether such enhanced processing also takes place within the domain of action, particularly when individuals are required to perform actions that produce peripheral sensory outcomes. To test this hypothesis, we recruited 15 hearing (31 ± 3.3 years) and 15 early deaf adults (42 ± 2.6 years) for a neuro-behavioral experiment involving: 1) a behavioral task where participants executed a simple motor action (i.e., a button press) and received a visual feedback either in the center or in a peripheral region of the visual field, and 2) the electrophysiological recording of brain electrical potentials (EEG). We measured and compared neural activity preceding the motor action (the readiness potentials) and visual evoked responses (the N1 and P2 ERP components) and found that deaf individuals did not exhibit more pronounced modulation of neural responses when their motor actions resulted in peripheral visual stimuli compared to their hearing counterparts. Instead they showed a reduced modulation when visual stimuli were presented in the center. Our results suggest a redistribution of attentional resources from center to periphery in deaf individuals during sensorimotor coupling.

Linguistic network in early deaf individuals: A neuroimaging meta-analysis.

This meta-analysis summarizes evidence from 44 neuroimaging experiments and characterizes the general linguistic network in early deaf individuals. Meta-analytic comparisons with hearing individuals found that a specific set of regions (in particular the left inferior frontal gyrus and posterior middle temporal gyrus) participates in supramodal language processing. In addition to previously described modality-specific differences, the present study showed that the left calcarine gyrus and the right caudate were additionally recruited in deaf compared with hearing individuals. In addition, this study showed that the bilateral posterior superior temporal gyrus is shaped by cross-modal plasticity, whereas the left frontotemporal areas are shaped by early language experience. Although an overall left-lateralized pattern for language processing was observed in the early deaf individuals, regional lateralization was altered in the inferior frontal gyrus and anterior temporal lobe. These findings indicate that the core language network functions in a modality-independent manner, and provide a foundation for determining the contributions of sensory and linguistic experiences in shaping the neural bases of language processing.

Postural Sway Velocity of Deaf Children with and without Vestibular Dysfunction.

BACKGROUND: Sensory information obtained from the visual, somatosensory, and vestibular systems is responsible for regulating postural control, and if damage occurs in one or more of these sensory systems, postural control may be altered. OBJECTIVE: To evaluate and compare the postural sway velocity between children with normal hearing and with sensorineural hearing loss (SNHL), matched by sex and age group, and to compare the postural sway velocity between children with normal hearing and with SNHL, with and without vestibular dysfunction. METHODS: Cross-sectional study that evaluated 130 children (65 with normal hearing and 65 with SNHL), of both sexes and aged between 7 and 11 years, from public schools of the city of Caruaru, Pernambuco state, Brazil. The postural sway velocity of the center of pressure (COP) was assessed by a force platform, in two directions, anteroposterior (AP) and mediolateral (ML)), in three positions, namely bipedal support with feet together and parallel (parallel feet (PF)), bipedal support with one foot in front of the other (tandem foot (TF)), and single-leg support (one foot (OF)), evaluated with the eyes open and closed. RESULTS: Children with SNHL demonstrated greater postural sway velocity compared to children with normal hearing in all the positions evaluated, with significant differences in the AP direction, with the eyes open (PF: p = 0.001; TF: p = 0.000; OF: p = 0.003) and closed (PF: p = 0.050; TF: p = 0.005). The same occurred in the ML direction, with the eyes open (PF: p = 0.001; TF: p = 0.000; OF: p = 0.001) and closed (PF: p = 0.002; TF: p = 0.000). The same occurred in relation to vestibular function, where the children with SNHL with an associated vestibular dysfunction demonstrated greater postural sway velocity compared to children with normal hearing in all the positions evaluated, demonstrating significant differences in the AP direction, with the eyes open (TF: p = 0.001; OF: p = 0.029) and eyes closed (PF: p = 0.036; TF: p = 0.033). The same occurred in the ML direction, with the eyes open (TF: p = 0.000) and with the eyes closed (PF: p = 0.008; TF: p = 0.009). CONCLUSIONS: Children with SNHL demonstrated greater instability of postural control than children with normal hearing in all the directions assessed. Children with SNHL and an associated vestibular dysfunction demonstrated the greatest instability of postural control in this study.