Observational reinforcement learning in children and young adults.

Observational learning is essential for the acquisition of new behavior in educational practices and daily life and serves as an important mechanism for human cognitive and social-emotional development. However, we know little about its underlying neurocomputational mechanisms from a developmental perspective. In this study we used model-based fMRI to investigate differences in observational learning and individual learning between children and younger adults. Prediction errors (PE), the difference between experienced and predicted outcomes, related positively to striatal and ventral medial prefrontal cortex activation during individual learning and showed no age-related differences. PE-related activation during observational learning was more pronounced when outcomes were worse than predicted. Particularly, negative PE-coding in the dorsal medial prefrontal cortex was stronger in adults compared to children and was associated with improved observational learning in children and adults. The current findings pave the way to better understand observational learning challenges across development and educational settings.

Identifying who adolescents prefer as source of information within their social network.

Adolescents are highly influenced by their peers within their social networks. This social influence can stem from both unsolicited peer pressure and the active search for guidance. While extensive research examined the mechanisms of peer pressure, little is known about who adolescents prefer as a source of information. To address this gap, we conducted two independent studies using a novel social search paradigm that allows participants to choose which social sources they wish to observe. In both studies, adolescents demonstrated a preference for their friends over non-friends, as well as for peers who were perceived as trustworthy. Across both studies, we found mixed evidence for the role of perceived popularity as a selection criterion. Notable, study 2 revealed the significance of "cool", "admirable" and "acting mean" as additional characteristics of preferred peers, traits that are often associated with elevated peer status. It also revealed an interest for peers perceived as being smart. These findings highlight the active role adolescents have in choosing social sources and emphasize the importance of multiple peer characteristics. Future research should investigate whether adolescents' interest in these types of peers is contingent upon specific social contexts, age groups, and peer cultures.

Developmental patterns and individual differences in responding to social feedback: A longitudinal fMRI study from childhood to adolescence.

Learning to control behavior when receiving feedback underlies social adaptation in childhood and adolescence, and is potentially strengthened by environmental support factors, such as parents. This study examined the neural development of responding to social feedback from childhood to adolescence, and effects of parental sensitivity on this development. We studied these questions in a 3-wave longitudinal fMRI sample (ages 7-13 years, n = 512). We measured responses to feedback using the fMRI Social Network Aggression Task through noise blasts following peer feedback and associated neural activity, and parental sensitivity using observations of parent-child interactions during Etch-a-Sketch. Results revealed largest reductions in noise blasts following positive feedback between middle and late childhood and following negative feedback between late childhood and early adolescence. Additionally, brain-behavior associations between dorsolateral prefrontal cortex activation and noise blast durations became more differentiated across development. Parental sensitivity was only associated with noise blast duration following positive feedback in childhood, but not in adolescence. There was no relation between parental sensitivity and neural activity. Our findings contribute to our understanding of neural development and individual differences in responding to social feedback, and the role of parenting in supporting children's adaption to social feedback.

Expecting the unexpected: a review of learning under uncertainty across development.

Many of our decisions take place under uncertainty. To successfully navigate the environment, individuals need to estimate the degree of uncertainty and adapt their behaviors accordingly by learning from experiences. However, uncertainty is a broad construct and distinct types of uncertainty may differentially influence our learning. We provide a semi-systematic review to illustrate cognitive and neurobiological processes involved in learning under two types of uncertainty: learning in environments with stochastic outcomes, and with volatile outcomes. We specifically reviewed studies (N = 26 studies) that included an adolescent population, because adolescence is a period in life characterized by heightened exploration and learning, as well as heightened uncertainty due to experiencing many new, often social, environments. Until now, reviews have not comprehensively compared learning under distinct types of uncertainties in this age range. Our main findings show that although the overall developmental patterns were mixed, most studies indicate that learning from stochastic outcomes, as indicated by increased accuracy in performance, improved with age. We also found that adolescents tended to have an advantage compared with adults and children when learning from volatile outcomes. We discuss potential mechanisms explaining these age-related differences and conclude by outlining future research directions.

Age differences in intertemporal choice among children, adolescents, and adults.

When choosing between sooner-smaller and later-larger rewards (i.e., intertemporal choices), adults typically prefer later-larger rewards more often than children. Intertemporal choice preferences have been implicated in various impulsivity-related psychopathologies, making it important to understand the underlying mechanisms not only in terms of how reward magnitude and delay affect choice but also in terms of how these mechanisms develop across age. We administered an intertemporal choice paradigm to 60 children (8-11 years), 79 adolescents (14-16 years), and 60 young adults (18-23 years). The paradigm systematically varied amounts and delays of the available rewards, allowing us to identify mechanisms underlying age-related differences in patience. Compared with young adults, both children and adolescents made fewer later-larger choices. In terms of underlying mechanisms, variation in delays, absolute reward magnitudes, and relative amount differences affected choice in each age group, indicating that children showed sensitivity to the same choice-relevant factors as young adults. Sensitivity to both absolute reward magnitude and relative amount differences showed a further monotonic age-related increase, whereas no change in delay sensitivity occurred. Lastly, adolescents and young adults weakly displayed a present bias (i.e., overvaluing immediate vs. future rewards; nonsignificant and trend, respectively), whereas children showed a nonsignificant but opposite pattern, possibly indicating that specifically dealing with future rewards changed with age. These findings shed light on the underlying mechanisms that contribute to the development of patience. By decomposing overt choices, our results suggest that the age-related increase in patience may be driven specifically by stronger sensitivity to amount differences with age.

Adolescents seek social information under uncertainty.

Adolescence is a period of emerging independence, in which adolescents face difficult decisions, including those that involve risk for health and well-being. Previous research suggests that learning from others might be a prominent strategy of adolescents to inform these difficult decisions. However, there is a gap in the literature that addresses the active role adolescents may have in gaining information about others' behavior (i.e., social information search). Here, we investigated when and how much social information adolescents search before making decisions under risk and ambiguity, using a novel social search paradigm. In this paradigm, adolescents were able to reveal real information about their classmates' choices before deciding on their final choice. Our two experiments suggest that social information search can be broken down in two independent decisions: first the decision to initiate search, followed by the decision to continue search. Several factors motivated initiation of search, including: (a) the difficulty of the choice, (b) uncertainty about the outcome, and (c) the magnitude of the reward at stake. Search took generally longer when adolescents faced information not in line with their initial preference. Finally, we observed that adolescents used the sampled social information to inform their risky-choice behavior. Taken together, these results provide novel insights into the dynamics of peer influence in adolescence and stress the importance of treating adolescents not only as receivers, but as active agents searching for social information. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Development of social feedback processing and responses in childhood: an fMRI test-replication design in two age cohorts.

This study investigated behavioral and neural correlates underlying social feedback processing and subsequent aggressive behaviors in childhood in two age cohorts (test sample: n = 509/n = 385 and replication sample: n = 354/n = 195, 7-9 years old). Using a previously validated Social Network Aggression Task, we showed that negative social feedback resulted in most behavioral aggression, followed by less aggression after neutral and least aggression after positive feedback. Receiving positive and negative social feedback was associated with increased activity in the insula, medial prefrontal cortex and ventrolateral prefrontal cortex. Responding to feedback was associated with additional activation in the dorsolateral prefrontal cortex (DLPFC) following positive feedback. This DLPFC activation correlated negatively with aggression. Furthermore, age analyses showed that older children showed larger reductions in aggression following positive feedback and more neural activation in the DLPFC when responding to positive feedback compared to younger children. To assess the robustness of our results, we examined these processes in two independent behavioral/functional magnetic resonance imaging samples using equivalence testing, thereby contributing to replicable reports. Together, these findings demonstrate an important role of social saliency and regulatory processes where regulation of aggression rapidly develops between the ages of 7 and 9 years.

Risks and rewards in adolescent decision-making.

Adolescent decision-making has been characterized as risky, and a heightened reward sensitivity may be one of the aspects contributing to riskier choice-behavior. Previous studies have targeted reward-sensitivity in adolescence and the neurobiological mechanisms of reward processing in the adolescent brain. In recent examples, researchers aim to disentangle the contributions of risk- and reward-sensitivity to adolescent risk-taking. Here, we discuss recent findings of adolescent's risk preferences and the associated neural mechanisms. We highlight potential frameworks that target individual differences in risk preferences in an effort to understand adolescent risk-taking, and with an ultimate goal of leveraging undesirable levels of risk taking.

A methodological perspective on learning in the developing brain.

The brain undergoes profound development across childhood and adolescence, including continuous changes in brain morphology, connectivity, and functioning that are, in part, dependent on one's experiences. These neurobiological changes are accompanied by significant changes in children's and adolescents' cognitive learning. By drawing from studies in the domains of reading, reinforcement learning, and learning difficulties, we present a brief overview of methodological approaches and research designs that bridge brain- and behavioral research on learning. We argue that ultimately these methods and designs may help to unravel questions such as why learning interventions work, what learning computations change across development, and how learning difficulties are distinct between individuals.

Understanding the Dynamics of the Developing Adolescent Brain Through Team Science.

One of the major goals for research on adolescent development is to identify the optimal conditions for adolescents to grow up in a complex social world and to understand individual differences in these trajectories. Based on influential theoretical and empirical work in this field, achieving this goal requires a detailed understanding of the social context in which neural and behavioral development takes place, along with longitudinal measurements at multiple levels (e.g., genetic, hormonal, neural, behavioral). In this perspectives article, we highlight the promising role of team science in achieving this goal. To illustrate our point, we describe meso (peer relations) and micro (social learning) approaches to understand social development in adolescence as crucial aspects of adolescent mental health. Finally, we provide an overview of how our team has extended our collaborations beyond scientific partners to multiple societal partners for the purpose of informing and including policymakers, education and health professionals, as well as adolescents themselves when conducting and communicating research.

Peer feedback decreases impulsive choice in adolescents with and without attention-deficit/hyperactivity disorder.

Background: Impulsivity is a core feature of attention-deficit/hyperactivity disorder (ADHD). Previous work using the delay discounting task to assess impulsivity reveals that adolescents with ADHD tend to prefer a smaller-immediate reward over a larger-delayed reward, and this relates to problematic choices in daily life. To gain a better understanding of daily decision-making in adolescence, it is important to examine the social context, as peers have a major influence on decisions. Peer influence often has a negative connotation, but also provides an opportunity to promote positive outcomes. To date, it is unclear if peers affect impulsive decision-making in adolescents with ADHD, for better or for worse. Methods: The aim of this preregistered study was to examine the effect of peer feedback on impulsive choice in male adolescents with and without ADHD (ages 13-23; N = 113). We utilized an adapted delay discounting task that was administered alone, in a social condition, and alone again. In the social condition, adolescents received either (between-subjects) manipulated impulsive or non-impulsive peer feedback. Impulsive peer feedback consisted of likes for choosing the smaller immediate reward, whereas non-impulsive peers endorsed choosing the larger delayed reward. Results: Preregistered analyses showed that non-impulsive peer feedback resulted in decreased impulsive choice, whereas impulsive peer feedback did not alter decision-making in adolescents with and without ADHD. Explorative analyses of inattention and hyperactivity-impulsivity symptoms in the total sample, irrespective of diagnosis, showed that lower hyperactivity-impulsivity and more inattention symptoms were associated with increased susceptibility to non-impulsive peer feedback. Conclusions: Together, these findings indicate that peers may provide an opportunity to decrease impulsivity and emphasize individual differences in susceptibility to non-impulsive peer feedback related to inattention and hyperactivity-impulsivity. Therefore, peer feedback may be a promising component in behavioral peer-supported interventions in adolescents with ADHD.

Developmental Changes in Dynamic Functional Connectivity From Childhood Into Adolescence.

The longitudinal study of typical neurodevelopment is key for understanding deviations due to specific factors, such as psychopathology. However, research utilizing repeated measurements remains scarce. Resting-state functional magnetic resonance imaging (MRI) studies have traditionally examined connectivity as 'static' during the measurement period. In contrast, dynamic approaches offer a more comprehensive representation of functional connectivity by allowing for different connectivity configurations (time varying connectivity) throughout the scanning session. Our objective was to characterize the longitudinal developmental changes in dynamic functional connectivity in a population-based pediatric sample. Resting-state MRI data were acquired at the ages of 10 (range 8-to-12, n = 3,327) and 14 (range 13-to-15, n = 2,404) years old using a single, study-dedicated 3 Tesla scanner. A fully-automated spatially constrained group-independent component analysis (ICA) was applied to decompose multi-subject resting-state data into functionally homogeneous regions. Dynamic functional network connectivity (FNC) between all ICA time courses were computed using a tapered sliding window approach. We used a k-means algorithm to cluster the resulting dynamic FNC windows from each scan session into five dynamic states. We examined age and sex associations using linear mixed-effects models. First, independent from the dynamic states, we found a general increase in the temporal variability of the connections between intrinsic connectivity networks with increasing age. Second, when examining the clusters of dynamic FNC windows, we observed that the time spent in less modularized states, with low intra- and inter-network connectivity, decreased with age. Third, the number of transitions between states also decreased with age. Finally, compared to boys, girls showed a more mature pattern of dynamic brain connectivity, indicated by more time spent in a highly modularized state, less time spent in specific states that are frequently observed at a younger age, and a lower number of transitions between states. This longitudinal population-based study demonstrates age-related maturation in dynamic intrinsic neural activity from childhood into adolescence and offers a meaningful baseline for comparison with deviations from typical development. Given that several behavioral and cognitive processes also show marked changes through childhood and adolescence, dynamic functional connectivity should also be explored as a potential neurobiological determinant of such changes.

Increased Ventromedial Prefrontal Cortex Activity in Adolescence Benefits Prosocial Reinforcement Learning.

Learning which of our behaviors benefit others contributes to forming social relationships. An important period for the development of (pro)social behavior is adolescence, which is characterized by transitions in social connections. It is, however, unknown how learning to benefit others develops across adolescence and what the underlying cognitive and neural mechanisms are. In this functional neuroimaging study, we assessed learning for self and others (i.e., prosocial learning) and the concurring neural tracking of prediction errors across adolescence (ages 9-21, N = 74). Participants performed a two-choice probabilistic reinforcement learning task in which outcomes resulted in monetary consequences for themselves, an unknown other, or no one. Participants from all ages were able to learn for themselves and others, but learning for others showed a more protracted developmental trajectory. Prediction errors for self were observed in the ventral striatum and showed no age-related differences. However, prediction error coding for others showed an age-related increase in the ventromedial prefrontal cortex. These results reveal insights into the computational mechanisms of learning for others across adolescence, and highlight that learning for self and others show different age-related patterns.

Parental Support and Positive Mood Buffer Adolescents' Academic Motivation During the COVID-19 Pandemic.

School closures during the first COVID-19 lockdown in 2020 severely disrupted adolescents' lives. We used a daily diary method for 20 days, including online and physical school days, assessing daily mood, social support and conflict, and academic motivation in 102 adolescents aged 12-16 years. We found that adolescents' academic motivation was lower on online compared with physical school days. In general, positive mood was positively associated with academic motivation, and friend conflict related negatively to academic motivation. Moreover, lower levels of parental support were related to lower academic motivation on online versus physical school days. Overall, these findings identified some critical changes in adolescents' daily experiences during the COVID-19 school closure and social-emotional factors that may buffer decreases in adolescents' academic motivation.

Developmental asymmetries in learning to adjust to cooperative and uncooperative environments.

Learning to successfully navigate social environments is a critical developmental goal, predictive of long-term wellbeing. However, little is known about how people learn to adjust to different social environments, and how this behaviour emerges across development. Here, we use a series of economic games to assess how children, adolescents, and young adults learn to adjust to social environments that differ in their level of cooperation (i.e., trust and coordination). Our results show an asymmetric developmental pattern: adjustment requiring uncooperative behaviour remains constant across adolescence, but adjustment requiring cooperative behaviour improves markedly across adolescence. Behavioural and computational analyses reveal that age-related differences in this social learning are shaped by age-related differences in the degree of inequality aversion and in the updating of beliefs about others. Our findings point to early adolescence as a phase of rapid change in cooperative behaviours, and highlight this as a key developmental window for interventions promoting well-adjusted social behaviour.

Longitudinal changes in DLPFC activation during childhood are related to decreased aggression following social rejection.

Regulating aggression after social feedback is an important prerequisite for developing and maintaining social relations, especially in the current times with larger emphasis on online social evaluation. Studies in adults highlighted the role of the dorsolateral prefrontal cortex (DLPFC) in regulating aggression. Little is known about the development of aggression regulation following social feedback during childhood, while this is an important period for both brain maturation and social relations. The current study used a longitudinal design, with 456 twins undergoing two functional MRI sessions across the transition from middle (7 to 9 y) to late (9 to 11 y) childhood. Aggression regulation was studied using the Social Network Aggression Task. Behavioral aggression after social evaluation decreased over time, whereas activation in the insula, dorsomedial PFC and DLPFC increased over time. Brain-behavior analyses showed that increased DLPFC activation after negative feedback was associated with decreased aggression. Change analyses further revealed that children with larger increases in DLPFC activity from middle to late childhood showed stronger decreases in aggression over time. These findings provide insights into the development of social evaluation sensitivity and aggression control in childhood.

A Bi-Dimensional Taxonomy of Social Responsivity in Middle Childhood: Prosociality and Reactive Aggression Predict Externalizing Behavior Over Time.

Developing social skills is essential to succeed in social relations. Two important social constructs in middle childhood, prosocial behavior and reactive aggression, are often regarded as separate behaviors with opposing developmental outcomes. However, there is increasing evidence for the co-occurrence of prosociality and aggression, as both might indicate responsivity to the social environment. Here, we tested whether a bi-dimensional taxonomy of prosociality and reactive aggression could predict internalizing and externalizing problems over time. We re-analyzed data of two well-validated experimental tasks for prosociality (the Prosocial Cyberball Game) and reactive aggression (the Social Network Aggression Task) in a developmental population sample (n = 496, 7-9 years old). Results revealed no associations between prosociality and reactive aggression, confirming the independence of those constructs. Interestingly, although prosociality and reactive aggression independently did not predict problem behavior, the interaction of both was negatively predictive of changes in externalizing problems over time. Specifically, only children who scored low on both prosociality and reactive aggression showed an increase in externalizing problems 1 year later, whereas levels of externalizing problems did not change for children who scored high on both types of behavior. Thus, our results suggest that at an individual level, reactive aggression in middle childhood might not always be maladaptive when combined with prosocial behavior, thereby confirming the importance of studying social competence across multiple dimensions.

Behavioral and Neural Pathways Supporting the Development of Prosocial and Risk-Taking Behavior Across Adolescence.

This study tested the pathways supporting adolescent development of prosocial and rebellious behavior. Self-report and structural brain development data were obtained in a three-wave, longitudinal neuroimaging study (8-29 years, N = 210 at Wave 3). First, prosocial and rebellious behavior assessed at Wave 3 were positively correlated. Perspective taking and intention to comfort uniquely predicted prosocial behavior, whereas fun seeking (current levels and longitudinal changes) predicted both prosocial and rebellious behaviors. These changes were accompanied by developmental declines in nucleus accumbens and medial prefrontal cortex (MPFC) volumes, but only faster decline of MPFC (faster maturity) related to less rebellious behavior. These findings point toward a possible differential susceptibility marker, fun seeking, as a predictor of both prosocial and rebellious developmental outcomes.

Neural tracking of subjective value under riskand ambiguity in adolescence.

Although many neuroimaging studies on adolescent risk taking have focused on brain activation during outcome valuation, less attention has been paid to the neural correlates of choice valuation. Subjective choice valuation may be particularly influenced by whether a choice presents risk (known probabilities) or ambiguity (unknown probabilities), which has rarely been studied in developmental samples. Therefore, we examined the neural tracking of subjective value during choice under risk and ambiguity in a large sample of adolescents (N = 188, 12-22 years). Specifically, we investigated which brain regions tracked subjective value coding under risk and ambiguity. A model-based approach to estimate individuals' risk and ambiguity attitudes showed prominent variation in individuals' aversions to risk and ambiguity. Furthermore, participants subjectively experienced the ambiguous options as being riskier than the risky options. Subjective value tracking under risk was coded by activation in ventral striatum and superior parietal cortex. Subjective value tracking under ambiguity was coded by dorsolateral prefrontal cortex (PFC) and superior temporal gyrus activation. Finally, overlapping activation in the dorsomedial PFC was observed for subjective value under both conditions. Overall, this is the first study to chart brain activation patterns for subjective choice valuation under risk and ambiguity in an adolescent sample, which shows that the building blocks for risk and ambiguity processing are already present in early adolescence. Finally, we highlight the potential of combining behavioral modeling with fMRI for investigating choice valuation in adolescence, which may ultimately aid in understanding who takes risks and why.

Are individual differences quantitative or qualitative? An integrated behavioral and fMRI MIMIC approach.

In cognitive neuroscience there is a growing interest in individual differences. We propose the Multiple Indicators Multiple Causes (MIMIC) model of combined behavioral and fMRI data to determine whether such differences are quantitative or qualitative in nature. A simulation study revealed the MIMIC model to have adequate power for this goal, and parameter recovery to be satisfactory. The MIMIC model was illustrated with a re-analysis of Van Duijvenvoorde et al. (2016) and Blankenstein et al. (2018) decision making data. This showed individual differences in Van Duijvenvoorde et al. (2016) to originate in qualitative differences in decision strategies. Parameters indicated some individuals to use an expected value decision strategy, while others used a loss minimizing strategy, distinguished by individual differences in vmPFC activity. Individual differences in Blankenstein et al. (2018) were explained by quantitative differences in risk aversion. Parameters showed that more risk averse individuals preferred safe over risky choices, as predicted by heightened vmPFC activity. We advocate using the MIMIC model to empirically determine, rather than assume, the nature of individual differences in combined behavioral and fMRI datasets.