Cortical cognitive processing during reading captured using functional-near infrared spectroscopy.

Neuroimaging studies using functional magnetic resonance imaging (fMRI) have provided unparalleled insights into the fundamental neural mechanisms underlying human cognitive processing, such as high-level linguistic processes during reading. Here, we build upon this prior work to capture sentence reading comprehension outside the MRI scanner using functional near infra-red spectroscopy (fNIRS) in a large sample of participants (n = 82). We observed increased task-related hemodynamic responses in prefrontal and temporal cortical regions during sentence-level reading relative to the control condition (a list of non-words), replicating prior fMRI work on cortical recruitment associated with high-level linguistic processing during reading comprehension. These results lay the groundwork towards developing adaptive systems to support novice readers and language learners by targeting the underlying cognitive processes. This work also contributes to bridging the gap between laboratory findings and more real-world applications in the realm of cognitive neuroscience.

Multi-Level Linguistic Alignment in a Dynamic Collaborative Problem-Solving Task.

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low-level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high-level convergence. Linguistic alignment captures the ways people reuse, that is, "align to," the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi-level linguistic alignment, as well as how alignment is related to communicative outcomes within a unique collaborative problem-solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade-off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem-solving tasks.

Sadness facilitates "deeper" reading comprehension: a behavioural and eye tracking study.

Reading is one of the most common everyday activities, yet research elucidating how affective influence reading processes and outcomes is sparse with inconsistent results. To investigate this question, we randomly assigned participants (N = 136) to happiness (positive affect), sadness (negative affect), and neutral video-induction conditions prior to engaging in self-paced reading of a long, complex science text. Participants completed assessments targeting multiple levels of comprehension (e.g. recognising factual information, integrating different textual components, and open-ended responses of concepts from memory) after reading and after a week-long delay. Results indicated that the Sadness (vs. Happiness) condition had higher comprehension scores, with the largest effects emerging for assessments targeting deeper levels comprehension immediately after reading. Eye-tracking analyses revealed that such benefits may be partly driven by sustained attentional focus over the 20-minute reading session. We discuss results with respect to theories on affect, cognition, and text comprehension.

Using artificial intelligence to assess personal qualities in college admissions.

Personal qualities like prosocial purpose and leadership predict important life outcomes, including college success. Unfortunately, the holistic assessment of personal qualities in college admissions is opaque and resource intensive. Can artificial intelligence (AI) advance the goals of holistic admissions? While cost-effective, AI has been criticized as a "black box" that may inadvertently penalize already disadvantaged subgroups when used in high-stakes settings. Here, we consider an AI approach to assessing personal qualities that aims to overcome these limitations. Research assistants and admissions officers first identified the presence/absence of seven personal qualities in n = 3131 applicant essays describing extracurricular and work experiences. Next, we fine-tuned pretrained language models with these ratings, which successfully reproduced human codes across demographic subgroups. Last, in a national sample (N = 309,594), computer-generated scores collectively demonstrated incremental validity for predicting 6-year college graduation. We discuss challenges and opportunities of AI for assessing personal qualities.

The iPRISM webtool: an interactive tool to pragmatically guide the iterative use of the Practical, Robust Implementation and Sustainability Model in public health and clinical settings.

BACKGROUND: To increase uptake of implementation science (IS) methods by researchers and implementers, many have called for ways to make it more accessible and intuitive. The purpose of this paper is to describe the iPRISM webtool (Iterative, Practical, Robust Implementation and Sustainability Model) and how this interactive tool operationalizes PRISM to assess and guide a program's (a) alignment with context, (b) progress on pragmatic outcomes, (c) potential adaptations, and (d) future sustainability across the stages of the implementation lifecycle. METHODS: We used an iterative human-centered design process to develop the iPRISM webtool. RESULTS: We conducted user-testing with 28 potential individual and team-based users who were English and Spanish speaking from diverse settings in various stages of implementing different types of programs. Users provided input on all aspects of the webtool including its purpose, content, assessment items, visual feedback displays, navigation, and potential application. Participants generally expressed interest in using the webtool and high likelihood of recommending it to others. The iPRISM webtool guides English and Spanish-speaking users through the process of iteratively applying PRISM across the lifecycle of a program to facilitate systematic assessment and alignment with context. The webtool summarizes assessment responses in graphical and tabular displays and then guides users to develop feasible and impactful adaptations and corresponding action plans. Equity considerations are integrated throughout. CONCLUSIONS: The iPRISM webtool can intuitively guide individuals and teams from diverse settings through the process of using IS methods to iteratively assess and adapt different types of programs to align with the context across the implementation lifecycle. Future research and application will continue to develop and evaluate this IS resource.

Large studies reveal how reference bias limits policy applications of self-report measures.

There is growing policy interest in identifying contexts that cultivate self-regulation. Doing so often entails comparing groups of individuals (e.g., from different schools). We show that self-report questionnaires-the most prevalent modality for assessing self-regulation-are prone to reference bias, defined as systematic error arising from differences in the implicit standards by which individuals evaluate behavior. In three studies, adolescents (N = 229,685) whose peers performed better academically rated themselves lower in self-regulation and held higher standards for self-regulation. This effect was not observed for task measures of self-regulation and led to paradoxical predictions of college persistence 6 years later. These findings suggest that standards for self-regulation vary by social group, limiting the policy applications of self-report questionnaires.

Alignment Between Heart Rate Variability From Fitness Trackers and Perceived Stress: Perspectives From a Large-Scale In Situ Longitudinal Study of Information Workers.

BACKGROUND: Stress can have adverse effects on health and well-being. Informed by laboratory findings that heart rate variability (HRV) decreases in response to an induced stress response, recent efforts to monitor perceived stress in the wild have focused on HRV measured using wearable devices. However, it is not clear that the well-established association between perceived stress and HRV replicates in naturalistic settings without explicit stress inductions and research-grade sensors. OBJECTIVE: This study aims to quantify the strength of the associations between HRV and perceived daily stress using wearable devices in real-world settings. METHODS: In the main study, 657 participants wore a fitness tracker and completed 14,695 ecological momentary assessments (EMAs) assessing perceived stress, anxiety, positive affect, and negative affect across 8 weeks. In the follow-up study, approximately a year later, 49.8% (327/657) of the same participants wore the same fitness tracker and completed 1373 EMAs assessing perceived stress at the most stressful time of the day over a 1-week period. We used mixed-effects generalized linear models to predict EMA responses from HRV features calculated over varying time windows from 5 minutes to 24 hours. RESULTS: Across all time windows, the models explained an average of 1% (SD 0.5%; marginal R2) of the variance. Models using HRV features computed from an 8 AM to 6 PM time window (namely work hours) outperformed other time windows using HRV features calculated closer to the survey response time but still explained a small amount (2.2%) of the variance. HRV features that were associated with perceived stress were the low frequency to high frequency ratio, very low frequency power, triangular index, and SD of the averages of normal-to-normal intervals. In addition, we found that although HRV was also predictive of other related measures, namely, anxiety, negative affect, and positive affect, it was a significant predictor of stress after controlling for these other constructs. In the follow-up study, calculating HRV when participants reported their most stressful time of the day was less predictive and provided a worse fit (R2=0.022) than the work hours time window (R2=0.032). CONCLUSIONS: A significant but small relationship between perceived stress and HRV was found. Thus, although HRV is associated with perceived stress in laboratory settings, the strength of that association diminishes in real-life settings. HRV might be more reflective of perceived stress in the presence of specific and isolated stressors and research-grade sensing. Relying on wearable-derived HRV alone might not be sufficient to detect stress in naturalistic settings and should not be considered a proxy for perceived stress but rather a component of a complex phenomenon.

Predicting Participant Compliance With Fitness Tracker Wearing and Ecological Momentary Assessment Protocols in Information Workers: Observational Study.

BACKGROUND: Studies that use ecological momentary assessments (EMAs) or wearable sensors to track numerous attributes, such as physical activity, sleep, and heart rate, can benefit from reductions in missing data. Maximizing compliance is one method of reducing missing data to increase the return on the heavy investment of time and money into large-scale studies. OBJECTIVE: This paper aims to identify the extent to which compliance can be prospectively predicted from individual attributes and initial compliance. METHODS: We instrumented 757 information workers with fitness trackers for 1 year and conducted EMAs in the first 56 days of study participation as part of an observational study. Their compliance with the EMA and fitness tracker wearing protocols was analyzed. Overall, 31 individual characteristics (eg, demographics and personalities) and behavioral variables (eg, early compliance and study portal use) were considered, and 14 variables were selected to create beta regression models for predicting compliance with EMAs 56 days out and wearable compliance 1 year out. We surveyed study participation and correlated the results with compliance. RESULTS: Our modeling indicates that 16% and 25% of the variance in EMA compliance and wearable compliance, respectively, could be explained through a survey of demographics and personality in a held-out sample. The likelihood of higher EMA and wearable compliance was associated with being older (EMA: odds ratio [OR] 1.02, 95% CI 1.00-1.03; wearable: OR 1.02, 95% CI 1.01-1.04), speaking English as a first language (EMA: OR 1.38, 95% CI 1.05-1.80; wearable: OR 1.39, 95% CI 1.05-1.85), having had a wearable before joining the study (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.50, 95% CI 1.23-1.83), and exhibiting conscientiousness (EMA: OR 1.25, 95% CI 1.04-1.51; wearable: OR 1.34, 95% CI 1.14-1.58). Compliance was negatively associated with exhibiting extraversion (EMA: OR 0.74, 95% CI 0.64-0.85; wearable: OR 0.67, 95% CI 0.57-0.78) and having a supervisory role (EMA: OR 0.65, 95% CI 0.54-0.79; wearable: OR 0.66, 95% CI 0.54-0.81). Furthermore, higher wearable compliance was negatively associated with agreeableness (OR 0.68, 95% CI 0.56-0.83) and neuroticism (OR 0.85, 95% CI 0.73-0.98). Compliance in the second week of the study could help explain more variance; 62% and 66% of the variance in EMA compliance and wearable compliance, respectively, was explained. Finally, compliance correlated with participants' self-reflection on the ease of participation, usefulness of our compliance portal, timely resolution of issues, and compensation adequacy, suggesting that these are avenues for improving compliance. CONCLUSIONS: We recommend conducting an initial 2-week pilot to measure trait-like compliance and identify participants at risk of long-term noncompliance, performing oversampling based on participants' individual characteristics to avoid introducing bias in the sample when excluding data based on noncompliance, using an issue tracking portal, and providing special care in troubleshooting to help participants maintain compliance.

Examining Response to Negative Life Events Through Fitness Tracker Data.

Negative life events, such as the death of a loved one, are an unavoidable part of life. These events can be overwhelmingly stressful and may lead to the development of mental health disorders. To mitigate these adverse developments, prior literature has utilized measures of psychological responses to negative life events to better understand their effects on mental health. However, psychological changes represent only one aspect of an individual's potential response. We posit measuring additional dimensions of health, such as physical health, may also be beneficial, as physical health itself may be affected by negative life events and measuring its response could provide context to changes in mental health. Therefore, the primary aim of this work was to quantify how an individual's physical health changes in response to negative life events by testing for deviations in their physiological and behavioral state (PB-state). After capturing post-event, PB-state responses, our second aim sought to contextualize changes within known factors of psychological response to negative life events, namely coping strategies. To do so, we utilized a cohort of professionals across the United States monitored for 1 year and who experienced a negative life event while under observation. Garmin Vivosmart-3 devices provided a multidimensional representation of one's PB-state by collecting measures of resting heart rate, physical activity, and sleep. To test for deviations in PB-state following negative life events, One-Class Support Vector Machines were trained on a window of time prior to the event, which established a PB-state baseline. The model then evaluated participant's PB-state on the day of the life event and each day that followed, assigning each day a level of deviance relative to the participant's baseline. Resulting response curves were then examined in association with the use of various coping strategies using Bayesian gamma-hurdle regression models. The results from our objectives suggest that physical determinants of health also deviate in response to negative life events and that these deviations can be mitigated through different coping strategies. Taken together, these observations stress the need to examine physical determinants of health alongside psychological determinants when investigating the effects of negative life events.

Emotional regularity: associations with personality, psychological health, and occupational outcomes.

Emotional regularity is the degree to which a person maintains and returns to a set of emotional states over time. The present investigation examined associations between emotional regularity and extant emotion measures as well as psychologically relevant dimensions of personality, health, and real-world occupational outcomes. Participants included 598 U.S. adults who provided daily experience sampling reports on their emotional states for approximately two months. Results suggest that emotional regularity was related to, but distinct from, well-established measures of emotion including emotional intensity, variability, covariation, inertia, granularity, and emodiversity. Furthermore, emotional regularity significantly predicted measures of personality, psychological health, and occupational outcomes even when accounting for extant emotion measures and sociodemographic covariates. Finally, it explained modest (7.5%) improvement (in terms of cross-validated RSq.) over baseline models containing emotional intensity, variability, and sociodemographic covariates. These findings suggest that emotional regularity may provide an important indicator of healthy emotional functioning and may be a promising area for further scientific discovery.

What Eye Movements Reveal About Later Comprehension of Long Connected Texts.

We know that reading involves coordination between textual characteristics and visual attention, but research linking eye movements during reading and comprehension assessed after reading is surprisingly limited, especially for reading long connected texts. We tested two competing possibilities: (a) the weak association hypothesis: Links between eye movements and comprehension are weak and short-lived, versus (b) the strong association hypothesis: The two are robustly linked, even after a delay. Using a predictive modeling approach, we trained regression models to predict comprehension scores from global eye movement features, using participant-level cross-validation to ensure that the models generalize across participants. We used data from three studies in which readers (Ns = 104, 130, 147) answered multiple-choice comprehension questions ~30 min after reading a 6,500-word text, or after reading up to eight 1,000-word texts. The models generated accurate predictions of participants' text comprehension scores (correlations between observed and predicted comprehension: 0.384, 0.362, 0.372, ps < .001), in line with the strong association hypothesis. We found that making more, but shorter fixations, consistently predicted comprehension across all studies. Furthermore, models trained on one study's data could successfully predict comprehension on the others, suggesting generalizability across studies. Collectively, these findings suggest that there is a robust link between eye movements and subsequent comprehension of a long connected text, thereby connecting theories of low-level eye movements with those of higher order text processing during reading.

Validation of survey effort measures of grit and self-control in a sample of high school students.

Personality traits such as grit and self-control are important determinants of success in life outcomes. However, most measures of these traits, which rely on self-reports, might be biased when used for the purpose of evaluating education policies or interventions. Recent research has shown the potential of survey effort-in particular, item non-response and careless answering-as a proxy measure of these traits. The current investigation uses a dataset of high school seniors (N = 513) to investigate survey effort measures in relationship with teacher reports, performance task measures, high school academic outcomes, and college attendance. Our results show promise for use of survey effort as proxy measures of grit and self-control.

The eye-mind wandering link: Identifying gaze indices of mind wandering across tasks.

During mind wandering, visual processing of external information is attenuated. Accordingly, mind wandering is associated with changes in gaze behaviors, albeit findings are inconsistent in the literature. This heterogeneity obfuscates a complete view of the moment-to-moment processing priorities of the visual system during mind wandering. We hypothesize that this observed heterogeneity is an effect of idiosyncrasy across tasks with varying spatial allocation demands, visual processing demands, and discourse processing demands and reflects a strategic, compensatory shift in how the visual system operates during mind wandering. We recorded eye movements and mind wandering (via thought-probes) as 132 college-aged adults completed a battery of 7 short (6 min) tasks with different visual demands. We found that for tasks requiring extensive sampling of the visual field, there were fewer fixations, and, depending on the specific task, fixations were longer and/or more dispersed. This suggests that visual sampling is sparser and potentially slower and more dispersed to compensate for the decreased sampling rate during mind wandering. For tasks that demand centrally focused gaze, mind wandering was accompanied by more exploratory eye movements, such as shorter and more dispersed fixations as well as larger saccades. Gaze behaviors were not reliably associated with mind wandering during a film comprehension task. These findings provide insight into how the visual system prioritizes external information when attention is focused inward and indicates the importance of task demands when assessing the relationship between eye movements, visual processing, and mind wandering. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

How Does High School Extracurricular Participation Predict Bachelor's Degree Attainment? It is Complicated.

This study answered novel questions about the connection between high school extracurricular dosage (number of activities and participation duration) and the attainment of a bachelor's degree. Using data from the Common Application and the National Student Clearinghouse (N = 311,308), we found that greater extracurricular participation positively predicted bachelor's degree attainment. However, among students who ultimately earned a bachelor's degree, participating in more than a moderate number of high school activities (3 or 4) predicted decreasing odds of earning a bachelor's degree on time (within 4 years). This effect intensified as participation duration increased, such that students who participated in the greatest number of high school activities for the most years were the most likely to delay college graduation.

Beyond Dyadic Coordination: Multimodal Behavioral Irregularity in Triads Predicts Facets of Collaborative Problem Solving.

We hypothesize that effective collaboration is facilitated when individuals and environmental components form a synergy where they work together and regulate one another to produce stable patterns of behavior, or regularity, as well as adaptively reorganize to form new behaviors, or irregularity. We tested this hypothesis in a study with 32 triads who collaboratively solved a challenging visual computer programming task for 20 min following an introductory warm-up phase. Multidimensional recurrence quantification analysis was used to examine fine-grained (i.e., every 10 s) collective patterns of regularity across team members' speech rate, body movement, and team interaction with the shared user interface. We found that teams exhibited significant patterns of regularity as compared to shuffled baselines, but there were no systematic trends in regularity across time. We also found that periods of regularity were associated with a reduction in overall behavior. Notably, the production of irregular behavior predicted expert-coded metrics of collaborative activity, such as teams' ability to construct shared knowledge and effectively negotiate and coordinate execution of solutions, net of overall behavioral production and behavioral self-similarity. Our findings support the theory that groups can interact to form interpersonal synergies and indicate that information about system-level dynamics is a viable way to understand and predict effective collaborative processes.

A brief behavioral measure of frustration tolerance predicts academic achievement immediately and two years later.

Achieving important goals is widely assumed to require confronting obstacles, failing repeatedly, and persisting in the face of frustration. Yet empirical evidence linking achievement and frustration tolerance is lacking. To facilitate work on this important topic, we developed and validated a novel behavioral measure of frustration tolerance: the Mirror Tracing Frustration Task (MTFT). In this 5-min task, participants allocate time between a difficult tracing task and entertaining games and videos. In two studies of young adults (Study 1: N = 148, Study 2: N = 283), we demonstrated that the MTFT increased frustration more than 18 other emotions, and that MTFT scores were related to self-reported frustration tolerance. Next, we assessed whether frustration tolerance correlated with similar constructs, including self-control and grit, as well as objective measures of real-world achievement. In a prospective longitudinal study of high-school seniors (N = 391), MTFT scores predicted grade-point average and standardized achievement test scores, and-more than 2 years after completing the MTFT-progress toward a college degree. Though small in size (i.e., rs ranging from .10 to .24), frustration tolerance predicted outcomes over and above a rich set of covariates, including IQ, sociodemographics, self-control, and grit. These findings demonstrate the validity of the MTFT and highlight the importance of frustration tolerance for achieving valued goals. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

How the stimulus influences mind wandering in semantically rich task contexts.

What do we think about when we mind wander and where do these thoughts come from? We tested the idea that semantically rich stimuli yield patterns of mind wandering that are closely coupled with the stimuli compared to being more internally triggered. We analyzed the content of 949 self-reported zone outs (1218 thoughts) and 519 of their triggers from 88 participants who read an instructional text and watched a film for 20 min each. We found that mind wandering associated with memory retrieval was more frequent than prospection and introspection across both stimuli. Over 70% of autobiographical and semantic memory retrievals were triggered by the content of the stimuli, compared to around 30% for prospective and introspective thoughts. Further, latent semantic analysis revealed that semantic and unspecific memories were more "semantically" similar to their triggers than prospective and introspective thoughts, suggesting that they arise from spontaneous associations with the stimulus. These findings suggest a re-evaluation of how internal concerns and the external world give rise to mind wandering and emphasize the importance of studying mind wandering in semantically rich contexts akin to much of the real world.

Re-Watching Lectures as a Study Strategy and Its Effect on Mind Wandering.

Material re-exposure (e.g., re-reading) is a popular mnemonic strategy, however, its utility has been questioned. We extend research on re-reading to re-watching - an emerging mnemonic technique given the increased use of recorded lectures today (e.g., in online courses). Consistent with findings from recent investigations of re-reading, there were no benefits of massed re-watching on memory for lecture material and re-watching increased rates of mind wandering. We discuss implications for understanding the cognitive consequences of re-exposure-based mnemonics.

Gaze-based signatures of mind wandering during real-world scene processing.

Physiological limitations on the visual system require gaze to move from location to location to extract the most relevant information within a scene. Therefore, gaze provides a real-time index of the information-processing priorities of the visual system. We investigated gaze allocation during mind wandering (MW), a state where cognitive priorities shift from processing task-relevant external stimuli (i.e., the visual world) to task-irrelevant internal thoughts. In both a main study and a replication, we recorded the eye movements of college-aged adults who studied images of urban scenes and responded to pseudorandom thought probes on whether they were mind wandering or attentively viewing at the time of the probe. Probe-caught MW was associated with fewer and longer fixations, greater fixation dispersion, and more frequent eyeblinks (only observed in the main study) relative to periods of attentive scene viewing. These findings demonstrate that gaze indices typically considered to represent greater engagement with scene processing (e.g., longer fixations) can also indicate MW. In this way, the current work exhibits a need for empirical investigations and computational models of gaze control to account for MW for a more accurate representation of the moment-to-moment information-processing priorities of the visual system. (PsycINFO Database Record

Driven to distraction: A lack of change gives rise to mind wandering.

How does the dynamic structure of the external world direct attention? We examined the relationship between event structure and attention to test the hypothesis that narrative shifts (both theoretical and perceived) negatively predict attentional lapses. Self-caught instances of mind wandering were collected while 108 participants watched a 32.5 min film called The Red Balloon. We used theoretical codings of situational change and human perceptions of event boundaries to predict mind wandering in 5-s intervals. Our findings suggest a temporal alignment between the structural dynamics of the film and mind wandering reports. Specifically, the number of situational changes and likelihood of perceiving event boundaries in the prior 0-15 s interval negatively predicted mind wandering net of low-level audiovisual features. Thus, mind wandering is less likely to occur when there is more event change, suggesting that narrative shifts keep attention from drifting inwards.