Early assessment of communicative competence in children with hearing loss using the Child-Caregiver Communication Assessment through Rebesco's Evaluation (CC-CARE) method.

PURPOSE: This work presents a new frame-by-frame video analysis method called Child-Caregiver Communication Assessment through Rebesco's Evaluation (CC-CARE), developed in the context of pediatric hearing loss as a rehabilitation tool for assessing children's early communication skills. CC-CARE stems from the commonly used Tait video analysis and extends it by including a new set of parameters aimed at disentangling between hearing-dependent and hearing-independent aspects of communication. METHOD: In this paper, we collected video samples of child-caregiver interactions in a group of 65 normal-hearing children and a group of 165 hearing-impaired children. For each group, we present the CC-CARE method and describe the parameters, their score distributions, correlations and we estimate the adherence of the CC-CARE scores with children's developmental trajectory. Moreover, we compare the results of CC-CARE scores between the two groups having had different development of the auditory system. Finally, a fully-data driven approach was employed to assess the consistency of the communicative efficacy index (CEI), a score aiming to capture a global result of the CC-CARE procedure. RESULTS: Correlations among parameter scores were found in each within-group analysis, revealing CC-CARE's internal consistency in measuring associated but nonoverlapping communication dimensions. For both groups, CC-CARE scores were associated with participants' age. Differences between scores emerged for a between-group analysis, indicating CC-CARE sensitivity to extract communication differences as a function of the hearing status. For both groups, the data analysis revealed that the CEI captures large variance portions across all parameter scores of the CC-CARE method. CONCLUSIONS: Results provide the first evidence that the CC-CARE video analysis method could be a reliable tool capable of highlighting the cascading effects of hearing impairment on children's preverbal communicative efficacy. The CC-CARE method aims to support early rehabilitation of hearing loss by describing a child's communicative efficacy.

Dissecting abstract, modality-specific and experience-dependent coding of affect in the human brain.

Emotion and perception are tightly intertwined, as affective experiences often arise from the appraisal of sensory information. Nonetheless, whether the brain encodes emotional instances using a sensory-specific code or in a more abstract manner is unclear. Here, we answer this question by measuring the association between emotion ratings collected during a unisensory or multisensory presentation of a full-length movie and brain activity recorded in typically developed, congenitally blind and congenitally deaf participants. Emotional instances are encoded in a vast network encompassing sensory, prefrontal, and temporal cortices. Within this network, the ventromedial prefrontal cortex stores a categorical representation of emotion independent of modality and previous sensory experience, and the posterior superior temporal cortex maps the valence dimension using an abstract code. Sensory experience more than modality affects how the brain organizes emotional information outside supramodal regions, suggesting the existence of a scaffold for the representation of emotional states where sensory inputs during development shape its functioning.

Sound suppresses earliest visual cortical processing after sight recovery in congenitally blind humans.

Neuroscientific research has consistently shown more extensive non-visual activity in the visual cortex of congenitally blind humans compared to sighted controls; a phenomenon known as crossmodal plasticity. Whether or not crossmodal activation of the visual cortex retracts if sight can be restored is still unknown. The present study, involving a rare group of sight-recovery individuals who were born pattern vision blind, employed visual event-related potentials to investigate persisting crossmodal modulation of the initial visual cortical processing stages. Here we report that the earliest, stimulus-driven retinotopic visual cortical activity (<100 ms) was suppressed in a spatially specific manner in sight-recovery individuals when concomitant sounds accompanied visual stimulation. In contrast, sounds did not modulate the earliest visual cortical response in two groups of typically sighted controls, nor in a third control group of sight-recovery individuals who had suffered a transient phase of later (rather than congenital) visual impairment. These results provide strong evidence for persisting crossmodal activity in the visual cortex after sight recovery following a period of congenital visual deprivation. Based on the time course of this modulation, we speculate on a role of exuberant crossmodal thalamic input which may arise during a sensitive phase of brain development.

Distinguishing Fine Structure and Summary Representation of Sound Textures from Neural Activity.

The auditory system relies on both local and summary representations; acoustic local features exceeding system constraints are compacted into a set of summary statistics. Such compression is pivotal for sound-object recognition. Here, we assessed whether computations subtending local and statistical representations of sounds could be distinguished at the neural level. A computational auditory model was employed to extract auditory statistics from natural sound textures (i.e., fire, rain) and to generate synthetic exemplars where local and statistical properties were controlled. Twenty-four human participants were passively exposed to auditory streams while the electroencephalography (EEG) was recorded. Each stream could consist of short, medium, or long sounds to vary the amount of acoustic information. Short and long sounds were expected to engage local or summary statistics representations, respectively. Data revealed a clear dissociation. Compared with summary-based ones, auditory-evoked responses based on local information were selectively greater in magnitude in short sounds. Opposite patterns emerged for longer sounds. Neural oscillations revealed that local features and summary statistics rely on neural activity occurring at different temporal scales, faster (beta) or slower (theta-alpha). These dissociations emerged automatically without explicit engagement in a discrimination task. Overall, this study demonstrates that the auditory system developed distinct coding mechanisms to discriminate changes in the acoustic environment based on fine structure and summary representations.

Altered neural oscillations underlying visuospatial processing in cerebral visual impairment.

Visuospatial processing deficits are commonly observed in individuals with cerebral visual impairment, even in cases where visual acuity and visual field functions are intact. Cerebral visual impairment is a brain-based visual disorder associated with the maldevelopment of central visual pathways and structures. However, the neurophysiological basis underlying higher-order perceptual impairments in this condition has not been clearly identified, which in turn poses limits on developing rehabilitative interventions. Using combined eye tracking and EEG recordings, we assessed the profile and performance of visual search on a naturalistic virtual reality-based task. Participants with cerebral visual impairment and controls with neurotypical development were instructed to search, locate and fixate on a specific target placed among surrounding distractors at two levels of task difficulty. We analysed evoked (phase-locked) and induced (non-phase-locked) components of broadband (4-55 Hz) neural oscillations to uncover the neurophysiological basis of visuospatial processing. We found that visual search performance in cerebral visual impairment was impaired compared to controls (as indexed by outcomes of success rate, reaction time and gaze error). Analysis of neural oscillations revealed markedly reduced early-onset evoked theta [4-6 Hz] activity (within 0.5 s) regardless of task difficulty. Moreover, while induced alpha activity increased with task difficulty in controls, this modulation was absent in the cerebral visual impairment group identifying a potential neural correlate related to deficits with visual search and distractor suppression. Finally, cerebral visual impairment participants also showed a sustained induced gamma response [30-45 Hz]. We conclude that impaired visual search performance in cerebral visual impairment is associated with substantial alterations across a wide range of neural oscillation frequencies. This includes both evoked and induced components suggesting the involvement of feedforward and feedback processing as well as local and distributed levels of neural processing.

The development of oscillatory and aperiodic resting state activity is linked to a sensitive period in humans.

Congenital blindness leads to profound changes in electroencephalographic (EEG) resting state activity. A well-known consequence of congenital blindness in humans is the reduction of alpha activity which seems to go together with increased gamma activity during rest. These results have been interpreted as indicating a higher excitatory/inhibitory (E/I) ratio in visual cortex compared to normally sighted controls. Yet it is unknown whether the spectral profile of EEG during rest would recover if sight were restored. To test this question, the present study evaluated periodic and aperiodic components of the EEG resting state power spectrum. Previous research has linked the aperiodic components, which exhibit a power-law distribution and are operationalized as a linear fit of the spectrum in log-log space, to cortical E/I ratio. Moreover, by correcting for the aperiodic components from the power spectrum, a more valid estimate of the periodic activity is possible. Here we analyzed resting state EEG activity from two studies involving (1) 27 permanently congenitally blind adults (CB) and 27 age-matched normally sighted controls (MCB); (2) 38 individuals with reversed blindness due to bilateral, dense, congenital cataracts (CC) and 77 age-matched sighted controls (MCC). Based on a data driven approach, aperiodic components of the spectra were extracted for the low frequency (Lf-Slope 1.5 to 19.5 Hz) and high frequency (Hf-Slope 20 to 45 Hz) range. The Lf-Slope of the aperiodic component was significantly steeper (more negative slope), and the Hf-Slope of the aperiodic component was significantly flatter (less negative slope) in CB and CC participants compared to the typically sighted controls. Alpha power was significantly reduced, and gamma power was higher in the CB and the CC groups. These results suggest a sensitive period for the typical development of the spectral profile during rest and thus likely an irreversible change in the E/I ratio in visual cortex due to congenital blindness. We speculate that these changes are a consequence of impaired inhibitory circuits and imbalanced feedforward and feedback processing in early visual areas of individuals with a history of congenital blindness.

Crossmodal plasticity following short-term monocular deprivation.

A brief period of monocular deprivation (MD) induces short-term plasticity of the adult visual system. Whether MD elicits neural changes beyond visual processing is yet unclear. Here, we assessed the specific impact of MD on neural correlates of multisensory processes. Neural oscillations associated with visual and audio-visual processing were measured for both the deprived and the non-deprived eye. Results revealed that MD changed neural activities associated with visual and multisensory processes in an eye-specific manner. Selectively for the deprived eye, alpha synchronization was reduced within the first 150 ms of visual processing. Conversely, gamma activity was enhanced in response to audio-visual events only for the non-deprived eye within 100-300 ms after stimulus onset. The analysis of gamma responses to unisensory auditory events revealed that MD elicited a crossmodal upweight for the non-deprived eye. Distributed source modeling suggested that the right parietal cortex played a major role in neural effects induced by MD. Finally, visual and audio-visual processing alterations emerged for the induced component of the neural oscillations, indicating a prominent role of feedback connectivity. Results reveal the causal impact of MD on both unisensory (visual and auditory) and multisensory (audio-visual) processes and, their frequency-specific profiles. These findings support a model in which MD increases excitability to visual events for the deprived eye and audio-visual and auditory input for the non-deprived eye.

A modality-independent proto-organization of human multisensory areas.

The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.

Neuroplasticity following cochlear implants.

The auditory cortex of people with sensorineural hearing loss can be re-afferented using a cochlear implant (CI): a neural prosthesis that bypasses the damaged cells in the cochlea to directly stimulate the auditory nerve. Although CIs are the most successful neural prosthesis to date, some CI users still do not achieve satisfactory outcomes using these devices. To explain variability in outcomes, clinicians and researchers have increasingly focused their attention on neuroscientific investigations that examined how the auditory cortices respond to the electric signals that originate from the CI. This chapter provides an overview of the literature that examined how the auditory cortex changes its functional properties in response to inputs from the CI, in animal models and in humans. We focus first on the basic responses to sounds delivered through electrical hearing and, next, we examine the integrity of two fundamental aspects of the auditory system: tonotopy and processing of binaural cues. When addressing the effects of CIs in humans, we also consider speech-evoked responses. We conclude by discussing to what extent this neuroscientific literature can contribute to clinical practices and help to overcome variability in outcomes.

Event-related potential correlates of visuo-tactile motion processing in congenitally deaf humans.

The impact of congenital deafness on the development of vision has been investigated to a considerable degree. However, whether multisensory processing is affected by auditory deprivation has often remained largely overlooked. To fill this gap, we investigated the consequences of a profound auditory deprivation from birth on visuo-tactile processing. While the electroencephalogram (EEG) was recorded, dynamic visuo-tactile stimuli with a congruent or an incongruent motion direction were presented to a group of congenitally deaf native signers (N = 21) and matched hearing controls (N = 21). Standard stimuli were moving continuously for 200 ms either upwards or downwards, whereas the motion of deviant stimuli was interrupted in one of the two modalities. Participants were asked to detect deviant stimuli, moving in a predefined direction while ignoring deviants moving in the non-target direction. Behaviorally, deaf individuals committed more false alarms than hearing controls in the incongruent condition, that is, they responded more often when deviants moved in the non-target motion direction. ERPs (140-164 ms) of the deaf group were more anteriorly distributed for the visuo-tactile stimulation in comparison to hearing controls. Moreover, visuo-tactile motion congruency effects emerged with a later latency in the deaf group (350-450 ms) than in the hearing control group (200-280 ms). These findings suggest altered selection strategies and neural correlates for visuo-tactile motion processing as a result of congenital deafness.

Developmental experiences alter the temporal processing characteristics of the visual cortex: Evidence from deaf and hearing native signers.

To date, the extent to which early experience shapes the functional characteristics of neural circuits is still a matter of debate. In the present study, we tested whether congenital deafness and/or the acquisition of a sign language alter the temporal processing characteristics of the visual system. Moreover, we investigated whether, assuming cross-modal plasticity in deaf individuals, the temporal processing characteristics of possibly reorganised auditory areas resemble those of the visual cortex. Steady-state visual evoked potentials (SSVEPs) were recorded in congenitally deaf native signers, hearing native signers, and hearing nonsigners. The luminance of the visual stimuli was periodically modulated at 12, 21, and 40 Hz. For hearing nonsigners, the optimal driving rate was 12 Hz. By contrast, for the group of hearing signers, the optimal driving rate was 12 and 21 Hz, whereas for the group of deaf signers, the optimal driving rate was 21 Hz. We did not observe evidence for cross-modal recruitment of auditory cortex in the group of deaf signers. These results suggest a higher preferred neural processing rate as a consequence of the acquisition of a sign language.

Interactions between auditory statistics processing and visual experience emerge only in late development.

The auditory system relies on local and global representations to discriminate sounds. This study investigated whether vision influences the development and functioning of these fundamental sound computations. We employed a computational approach to control statistical properties embedded in sounds and tested samples of sighted controls (SC) and congenitally (CB) and late-onset (LB) blind individuals in two experiments. In experiment 1, performance relied on local features analysis; in experiment 2, performance benefited from computing global representations. In both experiments, SC and CB performance remarkably overlapped. Conversely, LB performed systematically worse than the other groups when relying on local features, with no alterations on global representations. Results suggest that auditory computations tested here develop independently from vision. The efficiency of local auditory processing can be hampered in case sight becomes unavailable later in life, supporting the existence of an audiovisual interplay for the processing of auditory details, which emerges only in late development.

Visual search performance in cerebral visual impairment is associated with altered alpha band oscillations.

Individuals with cerebral visual impairment (CVI) often present with deficits related to visuospatial processing. However, the neurophysiological basis underlying these higher order perceptual dysfunctions have not been clearly identified. We assessed visual search performance using a novel virtual reality based task paired with eye tracking to simulate the exploration of a naturalistic scene (a virtual toy box). This was combined with electroencephalography (EEG) recordings and an analysis pipeline focusing on time frequency decomposition of alpha oscillatory activity. We found that individuals with CVI showed an overall impairment in visual search performance (as indexed by decreased success rate, as well as increased reaction time, visual search area, and gaze error) compared to controls with neurotypical development. Analysis of captured EEG activity following stimulus onset revealed that in the CVI group, there was a distinct lack of strong and well defined posterior alpha desynchronization; an important signal involved in the coordination of neural activity related to visual processing. Finally, an exploratory analysis revealed that in CVI, the magnitude of alpha desynchronization was associated with impaired visual search performance as well as decreased volume of specific thalamic nuclei implicated in visual processing. These results suggest that impairments in visuospatial processing related to visual search in CVI are associated with alterations in alpha band oscillations as well as early neurological injury at the level of visual thalamic nuclei.

Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness.

The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.

Three factors to characterize plastic potential transitions in the visual system.

A comprehensive understanding of brain-environment interactions is elusive even at the sensory level as neural plasticity waxes and wanes across the lifespan. Temporary and permanent visual deprivations remain pivotal approaches for studying the degree of experience-dependent plasticity of sensory functions. Natural models and experimental manipulations of visual experiences have contributed to uncovering some of the guiding principles that characterize transitions of plastic potentials in the human visual system. The existing literature regarding the neural plasticity associated with visual systems has been extensively discussed by two recent reviews articles (Röder et al., 2020; Castaldi et al., 2020) which provided an overview of different models of study and methods of investigations, gathering insights on both developing and adult brains. Here, we propose a framework of three main factors to characterize how the driving forces shaping visual circuits mutate, both quantitatively and qualitatively, between early development and adulthood.

The size-weight illusion is unimpaired in individuals with a history of congenital visual deprivation.

Visual deprivation in childhood can lead to lifelong impairments in multisensory processing. Here, the Size-Weight Illusion (SWI) was used to test whether visuo-haptic integration recovers after early visual deprivation. Normally sighted individuals perceive larger objects to be lighter than smaller objects of the same weight. In Experiment 1, individuals treated for dense bilateral congenital cataracts (who had no patterned visual experience at birth), individuals treated for developmental cataracts (who had patterned visual experience at birth, but were visually impaired), congenitally blind individuals and normally sighted individuals had to rate the weight of manually explored cubes that differed in size (Small, Medium, Large) across two possible weights (350 g, 700 g). In Experiment 2, individuals treated for dense bilateral congenital cataracts were compared to sighted individuals in a similar task using a string set-up, which removed haptic size cues. In both experiments, indistinguishable SWI effects were observed across all groups. These results provide evidence that early aberrant vision does not interfere with the development of the SWI, and suggest a recovery of the integration of size and weight cues provided by the visual and haptic modality.

An electrophysiological biomarker for the classification of cataract-reversal patients: A case-control study.

BACKGROUND: Untreated congenital blindness through cataracts leads to lasting visual brain system changes, including substantial alterations of extrastriate visual areas. Consequently, late-treated individuals (> 5 months of age) with dense congenital bilateral cataracts (CC) exhibit poorer visual function recovery compared to individuals with bilateral developmental cataracts (DC). Reliable methods to differentiate between patients with congenital and developmental cataracts are often lacking, impeding efficient rehabilitation management and introducing confounds in clinical and basic research on recovery prognosis and optimal timing of surgery. A persistent reduction of the P1 wave of visual event-related potentials (VERPs), associated with extrastriate visual cortical activity, has been reported in CC but not in DC individuals. Using two experiments, this study developed and validated P1-based biomarkers for diagnosing a history of congenital blindness in cataract-reversal individuals. METHODS: Congenital and developmental cataract-reversal individuals as well as typically sighted matched controls took part in a first experiment used for exploring an electrophysiological biomarker (N CC = 13, N DC = 13, N Control = 26). Circular stimuli containing gratings were presented in one of the visual field quadrants while visual event-related potentials (VERPs) were recorded. Two biomarkers were derived from the P1 wave of the VERP: (1) The mean of the normalized P1 amplitude at posterior electrodes, and (2) a classifier obtained from a linear support vector machine (SVM). A second experiment with partially new CC/DC individuals and their matched controls (N CC = 14, N DC = 15, N Control = 29) was consecutively used to validate the classification based on both biomarkers. Performance of the classifiers were evaluated using receiver operating characteristic (ROC) curve analyses. All cataract-reversal individuals were tested after at least one year of vision recovery. FINDINGS: The normalized P1 amplitude over posterior electrodes allowed a successful classification of the CC from the DC individuals and typically sighted controls (area under ROC curve, AUC = 0.803 and 0.929 for the normalized P1 amplitude and the SVM-based biomarker, respectively). The validation for both biomarkers in experiment 2 again resulted in a high classification success (AUC = 0.800 and 0.883, respectively for the normalized P1 amplitude and the SVM-based biomarker). In the most conservative scenario involving classification of CC from DC individuals in a group of only cataract-reversal individuals, excluding typically sighted controls, the SVM-based biomarker was found to be superior to the mean P1 amplitude based biomarker (AUC = 0.852 compared to 0.757 for the mean P1 based biomarker in validation). Minimum specificity obtained was 80% across all biomarkers. INTERPRETATION: A persistent reduction of the P1 wave provides a highly specific method for classifying cataract patients post-surgically as having suffered from bilateral congenital vs. bilateral developmental cataracts. We suggest that using the P1 based non-invasive electrophysiological biomarker will augment existing clinical classification criteria for individuals with a history of bilateral congenital cataracts, aiding clinical and basic research, recovery prognosis, and rehabilitation efforts. FUNDING: German Research Foundation (DFG) and the European Research Council (ERC).

Biological Action Identification Does Not Require Early Visual Input for Development.

Visual input during the first years of life is vital for the development of numerous visual functions. While normal development of global motion perception seems to require visual input during an early sensitive period, the detection of biological motion (BM) does not seem to do so. A more complex form of BM processing is the identification of human actions. Here, we tested whether identification rather than detection of BM is experience dependent. A group of human participants who had been treated for congenital cataracts (CC; of up to 18 years in duration, CC group) had to identify ten actions performed by human line figures. In addition, they performed a coherent motion (CM) detection task, which required identifying the direction of CM amid the movement of random dots. As controls, developmental cataract (DC) reversal individuals (DC group) who had undergone the same surgical treatment as CC group were included. Moreover, normally sighted controls were tested both with vision blurred to match the visual acuity (VA) of CC individuals [vision matched (VM) group] and with full sight [sighted control (SC) group]. The CC group identified biological actions with an extraordinary high accuracy (on average ∼85% correct) and was indistinguishable from the VM control group. By contrast, CM processing impairments of the CC group persisted even after controlling for VA. These results in the same individuals demonstrate an impressive resilience of BM processing to aberrant early visual experience and at the same time a sensitive period for the development of CM processing.

EEG frequency-tagging demonstrates increased left hemispheric involvement and crossmodal plasticity for face processing in congenitally deaf signers.

In humans, face-processing relies on a network of brain regions predominantly in the right occipito-temporal cortex. We tested congenitally deaf (CD) signers and matched hearing controls (HC) to investigate the experience dependence of the cortical organization of face processing. Specifically, we used EEG frequency-tagging to evaluate: (1) Face-Object Categorization, (2) Emotional Facial-Expression Discrimination and (3) Individual Face Discrimination. The EEG was recorded to visual stimuli presented at a rate of 6 Hz, with oddball stimuli at a rate of 1.2 Hz. In all three experiments and in both groups, significant face discriminative responses were found. Face-Object categorization was associated to a relative increased involvement of the left hemisphere in CD individuals compared to HC individuals. A similar trend was observed for Emotional Facial-Expression discrimination but not for Individual Face Discrimination. Source reconstruction suggested a greater activation of the auditory cortices in the CD group for Individual Face Discrimination. These findings suggest that the experience dependence of the relative contribution of the two hemispheres as well as crossmodal plasticity vary with different aspects of face processing.