Active inference as a unifying, generic and adaptive framework for a P300-based BCI.

OBJECTIVE: Going adaptive is a major challenge for the field of brain-computer interface (BCI). This entails a machine that optimally articulates inference about the user's intentions and its own actions. Adaptation can operate over several dimensions which calls for a generic and flexible framework. APPROACH: We appeal to one of the most comprehensive computational approach to brain (adaptive) functions: the active inference (AI) framework. It entails an explicit (probabilistic) model of the user that the machine interacts with, here involved in a P300-spelling task. This takes the form of a discrete input-output state-space model establishing the link between the machine's (i) observations-a P300 or error potential for instance, (ii) representations-of the user intentions to spell or pause, and (iii) actions-to flash, spell or switch-off the application. MAIN RESULTS: Using simulations with real EEG data from 18 subjects, results demonstrate the ability of AI to yield a significant increase in bit rate (17%) over state-of-the-art approaches, such as dynamic stopping. SIGNIFICANCE: Thanks to its flexibility, this one model enables to implement optimal (dynamic) stopping but also optimal flashing (i.e. active sampling), automated error correction, and switching off when the user does not look at the screen anymore. Importantly, this approach enables the machine to flexibly arbitrate between all these possible actions. We demonstrate AI as a unifying and generic framework to implement a flexible interaction behaviour in a given BCI context.

The role of hedonics in the Human Affectome.

Experiencing pleasure and displeasure is a fundamental part of life. Hedonics guide behavior, affect decision-making, induce learning, and much more. As the positive and negative valence of feelings, hedonics are core processes that accompany emotion, motivation, and bodily states. Here, the affective neuroscience of pleasure and displeasure that has largely focused on the investigation of reward and pain processing, is reviewed. We describe the neurobiological systems of hedonics and factors that modulate hedonic experiences (e.g., cognition, learning, sensory input). Further, we review maladaptive and adaptive pleasure and displeasure functions in mental disorders and well-being, as well as the experience of aesthetics. As a centerpiece of the Human Affectome Project, language used to express pleasure and displeasure was also analyzed, and showed that most of these analyzed words overlap with expressions of emotions, actions, and bodily states. Our review shows that hedonics are typically investigated as processes that accompany other functions, but the mechanisms of hedonics (as core processes) have not been fully elucidated.

Contextual modulation of value signals in reward and punishment learning.

Compared with reward seeking, punishment avoidance learning is less clearly understood at both the computational and neurobiological levels. Here we demonstrate, using computational modelling and fMRI in humans, that learning option values in a relative--context-dependent--scale offers a simple computational solution for avoidance learning. The context (or state) value sets the reference point to which an outcome should be compared before updating the option value. Consequently, in contexts with an overall negative expected value, successful punishment avoidance acquires a positive value, thus reinforcing the response. As revealed by post-learning assessment of options values, contextual influences are enhanced when subjects are informed about the result of the forgone alternative (counterfactual information). This is mirrored at the neural level by a shift in negative outcome encoding from the anterior insula to the ventral striatum, suggesting that value contextualization also limits the need to mobilize an opponent punishment learning system.

Amygdala responses to unpleasant pictures are influenced by task demands and positive affect trait.

The role of attention in emotional processing is still the subject of debate. Recent studies have found that high positive affect in approach motivation narrows attention. Furthermore, the positive affect trait has been suggested as an important component for determining human variability in threat reactivity. We employed functional magnetic resonance imaging to investigate whether different states of attention control would modulate amygdala responses to highly unpleasant pictures relative to neutral and whether this modulation would be influenced by the positive affect trait. Participants (n = 22, 12 male) were scanned while viewing neutral (people) or unpleasant pictures (mutilated bodies) flanked by two peripheral bars. They were instructed to (a) judge the picture content as unpleasant or neutral or (b) to judge the difference in orientation between the bars in an easy condition (0 or 90(∘) orientation difference) or (c) in a hard condition (0 or 6(∘) orientation difference). Whole brain analysis revealed a task main effect of brain areas related to the experimental manipulation of attentional control, including the amygdala, dorsolateral prefrontal cortex, and posterior parietal cortex. Region of interest analysis showed an inverse correlation (r = -0.51, p < 0.01) between left amygdala activation and positive affect level when participants viewed unpleasant stimuli and judged bar orientation in the easy condition. This result suggests that subjects with high positive affect exhibit lower amygdala reactivity to distracting unpleasant pictures. In conclusion, the current study suggests that positive affect modulates attention effect on unpleasant pictures, therefore attenuating emotional responses.

Emotional valence and the free-energy principle.

The free-energy principle has recently been proposed as a unified Bayesian account of perception, learning and action. Despite the inextricable link between emotion and cognition, emotion has not yet been formulated under this framework. A core concept that permeates many perspectives on emotion is valence, which broadly refers to the positive and negative character of emotion or some of its aspects. In the present paper, we propose a definition of emotional valence in terms of the negative rate of change of free-energy over time. If the second time-derivative of free-energy is taken into account, the dynamics of basic forms of emotion such as happiness, unhappiness, hope, fear, disappointment and relief can be explained. In this formulation, an important function of emotional valence turns out to regulate the learning rate of the causes of sensory inputs. When sensations increasingly violate the agent's expectations, valence is negative and increases the learning rate. Conversely, when sensations increasingly fulfil the agent's expectations, valence is positive and decreases the learning rate. This dynamic interaction between emotional valence and learning rate highlights the crucial role played by emotions in biological agents' adaptation to unexpected changes in their world.

Decreased premotor cortex volume in victims of urban violence with posttraumatic stress disorder.

BACKGROUND: Studies addressing posttraumatic stress disorder (PTSD) have demonstrated that PTSD patients exhibit structural abnormalities in brain regions that relate to stress regulation and fear responses, such as the hippocampus, amygdala, anterior cingulate cortex, and ventromedial prefrontal cortex. Premotor cortical areas are involved in preparing to respond to a threatening situation and in representing the peripersonal space. Urban violence is an important and pervasive cause of human suffering, especially in large urban centers in the developing world. Violent events, such as armed robbery, are very frequent in certain cities, and these episodes increase the risk of PTSD. Assaultive trauma is characterized by forceful invasion of the peripersonal space; therefore, could this traumatic event be associated with structural alteration of premotor areas in PTSD? METHODOLOGY/PRINCIPAL FINDINGS: Structural magnetic resonance imaging scans were acquired from a sample of individuals that had been exposed to urban violence. This sample consisted of 16 PTSD patients and 16 age- and gender-matched controls. Psychometric questionnaires differentiated PTSD patients from trauma-exposed controls with regard to PTSD symptoms, affective, and resilience predispositions. Voxel-based morphometric analysis revealed that, compared with controls, the PTSD patients presented significant reductions in gray matter volume in the ventral premotor cortex and in the pregenual anterior cingulate cortex. CONCLUSIONS: Volume reduction in the premotor cortex that is observed in victims of urban violence with PTSD may be associated with a disruption in the dynamical modulation of the safe space around the body. The finding that PTSD patients presented a smaller volume of pregenual anterior cingulate cortex is consistent with the results of other PTSD neuroimaging studies that investigated different types of traumatic events.

Medial prefrontal cortex and striatum mediate the influence of social comparison on the decision process.

We compared private and social decision making to investigate the neural underpinnings of the effect of social comparison on risky choices. We measured brain activity using functional MRI while participants chose between two lotteries: in the private condition, they observed the outcome of the unchosen lottery, and in the social condition, the outcome of the lottery chosen by another person. The striatum, a reward-related brain structure, showed higher activity when participants won more than their counterpart (social gains) compared with winning in isolation and lower activity when they won less than their counterpart (social loss) compared with private loss. The medial prefrontal cortex, implicated in social reasoning, was more activated by social gains than all other events. Sensitivity to social gains influenced both brain activity and behavior during subsequent choices. Specifically, striatal activity associated with social gains predicted medial prefrontal cortex activity during social choices, and experienced social gains induced more risky and competitive behavior in later trials. These results show that interplay between reward and social reasoning networks mediates the influence of social comparison on the decision process.

Emotion affects action: Midcingulate cortex as a pivotal node of interaction between negative emotion and motor signals.

Affective pictures drive the activity of brain networks and impact behavior. We showed previously that viewing unpleasant pictures interfered in the performance of a basic nonemotional visual detection task. In the present study, we employed functional magnetic resonance imaging to test the hypothesis that behavioral interference may result from the interaction between negatively valenced and motor-related signals in the brain. As in our previous study (Pereira et al., 2006), participants performed a simple target detection task that followed the presentation of unpleasant or neutral pictures. Our results revealed that an unpleasant emotional context modulated evoked responses in several regions engaged by the simple target detection task. In particular, the midcingulate cortex was recruited when participants performed target detection trials during the unpleasant context, and signal responses in this region closely mirrored the pattern of behavioral interference (as revealed via reaction time). Our findings suggest that the midcingulate cortex may be an important site for the interaction between negatively valenced signals and motor signals in the brain and that it may be involved in the implementation of defensive responses, such as freezing.

Anxiogenic properties of a computer simulation for panic disorder with agoraphobia.

BACKGROUND: There are several useful methods to induce anxiety in patients with panic disorder with agoraphobia (PDA). Our aim was to ascertain if a computer simulation (CS) could induce anxiety and physiologic alterations in PDA patients. METHODS: 10 healthy controls (HC) and 10 patients who fulfilled DSM-IV criteria for PDA were recruited for this study. The anxiety level was measured with the Subjective Units of Distress Scale (SUDS) and the Diagnostic Symptom Questionnaire (DSQ) was used to ascertain panic attack (PA) symptoms. The heart rate, skin conductance and respiration were monitored during exposure to the CS. The CS was a 3D computer animation of a short bus trip, from a first person perspective. RESULTS: In PDA patients CS exposure increased anxiety levels, they also had higher scores in the DSQ and two of them had PA. Compared to the HC, the PDA patients had higher skin conductance level, electrodermal response magnitude, respiratory rate, tidal volume, and respiratory rate irregularities. The heart rate means were higher for PDA patients who had PA, followed by HC and PDA patients who did not have PA. There were no significant differences between the two groups regarding the sense of presence. LIMITATIONS: The main limitations were the small sample size, and some PDA patients under medications. CONCLUSIONS: This study indicated that CS exposure may induce anxiety, electrodermal and respiratory alterations in patients with PDA. CS exposure may be a useful tool in the research and treatment of PD patients.

KARDIA: a Matlab software for the analysis of cardiac interbeat intervals.

This article presents KARDIA, a Matlab (MathWorks Inc., MA) software developed for the analysis of cardiac interbeat interval (IBI) data. Available functions are called through a graphical user interface and permit the study of phasic cardiac responses (PCRs) and the estimation of time and frequency domain heart rate variability (HRV) parameters. Scaling exponents of heartbeat fluctuations are calculated with the detrended fluctuation analysis (DFA) algorithm. Grand average and individual subject results can be exported to spreadsheets for further statistical analysis. KARDIA is distributed free of charge under the terms of GNU public license so that other users can modify the code and adjust the program's performance according to their own scientific requirements.

Autonomic reactions to mutilation pictures: positive affect facilitates safety signal processing.

For survival, humans are continuously vigilant for signs of danger. Equally important, but less studied, is our ability to detect and respond to safety cues. The trait of positive affect may be a key component determining human variability in safety detection. Here we investigate autonomic and self-report reactivity to pictures of mutilated bodies, after reading a text about the art of mimicking injuries in the movies. Participants that scored high in positive affect trait showed attenuated autonomic reactions to the mutilation pictures. Thus, high positive affect facilitated engagement in safety cues and modulated reflexive reactions of the brain's defense system.

Regret and its avoidance: a neuroimaging study of choice behavior.

Human decisions can be shaped by predictions of emotions that ensue after choosing advantageously or disadvantageously. Indeed, anticipating regret is a powerful predictor of future choices. We measured brain activity using functional magnetic resonance imaging (fMRI) while subjects selected between two gambles wherein regret was induced by providing information about the outcome of the unchosen gamble. Increasing regret enhanced activity in the medial orbitofrontal region, the anterior cingulate cortex and the hippocampus. Notably, across the experiment, subjects became increasingly regret-aversive, a cumulative effect reflected in enhanced activity within medial orbitofrontal cortex and amygdala. This pattern of activity reoccurred just before making a choice, suggesting that the same neural circuitry mediates direct experience of regret and its anticipation. These results demonstrate that medial orbitofrontal cortex modulates the gain of adaptive emotions in a manner that may provide a substrate for the influence of high-level emotions on decision making.

Contour integration in the primary visual cortex of the opossum.

To investigate whether contour integration is a generalized mammalian feature we studied single cells in V1 on the South-America opossum ( ), a plesiomorphic animal believed to retain basic characteristics of early mammals. We observed that when a cell's receptive field (RF) was masked (i.e. an artificial scotoma was produced), sweeping a long bar (several times the length of the RF) at the cell's preferred orientation elicited robust responses in many cells (28/103, or 27%). Therefore, some cells in the primary visual cortex of the opossum interpolate under conditions consistent with physical occlusion. The present results indicate that the property of contour integration appears to be a basic property of the mammalian visual system.

Conference report: functional magnetic resonance imaging for beginners--a review of the fMRI experience IV, 13-14 May 2002, Natcher Conference Center, National Institutes of Health, Bethesda, MD.

The fourth fMRI Experience meeting was held at the Bethesda, Maryland campus of the National Institutes of Health on May 13th and 14th, 2002. The purpose of the meeting was to provide a platform for students working with functional magnetic resonance imaging (fMRI) to pres ent their research to an international audience of peers. This year"s meeting featured special lectures from Dr. Leslie Ungerleider ("Imaging Mechanisms of Visual Attention") and Dr. Daniel Weinberger ("Genetic Variation and fMRI Response").