Clustering Individuals Based on Similarity in Idiographic Factor Loading Patterns.

Idiographic measurement models such as p-technique and dynamic factor analysis (DFA) assess latent constructs at the individual level. These person-specific methods may provide more accurate models than models obtained from aggregated data when individuals are heterogeneous in their processes. Developing clustering methods for the grouping of individuals with similar measurement models would enable researchers to identify if measurement model subtypes exist across individuals as well as assess if the different models correspond to the same latent concept or not. In this paper, methods for clustering individuals based on similarity in measurement model loadings obtained from time series data are proposed. We review literature on idiographic factor modeling and measurement invariance, as well as clustering for time series analysis. Through two studies, we explore the utility and effectiveness of these measures. In Study 1, a simulation study is conducted, demonstrating the recovery of groups generated to have differing factor loadings using the proposed clustering method. In Study 2, an extension of Study 1 to DFA is presented with a simulation study. Overall, we found good recovery of simulated clusters and provide an example demonstrating the method with empirical data.

Homogeneity Assumptions in the Analysis of Dynamic Processes.

With the increased use of time series data in human research, ranging from ecological momentary assessments to data passively obtained, researchers can explore dynamic processes more than ever before. An important question researchers must ask themselves is, do I think all individuals have similar processes? If not, how different, and in what ways? Dr. Peter Molenaar's work set the foundation to answer these questions by providing insight into individual-level analysis for processes that are assumed to differ across individuals in at least some aspects. Currently, such assumptions do not have a clear taxonomy regarding the degree of homogeneity in the patterns of relations among variables and the corresponding parameter values. This paper provides the language with which researchers can discuss assumptions inherent in their analyses. We define strict homogeneity as the assumption that all individuals have an identical pattern of relations as well as parameter values; pattern homogeneity assumes the same pattern of relations but parameter values can differ; weak homogeneity assumes there are some (but not all) generalizable aspects of the process; and no homogeneity explicitly assumes no population-level similarities in dynamic processes across individuals. We demonstrate these assumptions with an empirical data set of daily emotions in couples.

From the Individual to the Group: Using Idiographic Analyses and Two-Stage Random Effects Meta-Analysis to Obtain Population Level Inferences for within-Person Processes.

In psychology, the use of portable technology and wearable devices to ease participant burden in data collection is on the rise. This creates increased interest in collecting real-time or near real-time data from individuals within their natural environments. As a result, vast amounts of observational time series data are generated. Often, motivation for collecting this data hinges on understanding within-person processes that underlie psychological phenomena. Motivated by the body of Dr. Peter Molenaar's life work calling for analytical approaches that consider potential heterogeneity and non-ergodicity, the focus of this paper is on using idiographic analyses to generate population inferences for within-person processes. Meta-analysis techniques using one-stage and two-stage random effects meta-analysis as implemented in single-case experimental designs are presented. The case for preferring a two-stage approach for meta-analysis of single-subject observational time series data is made and demonstrated using an empirical example. This provides a novel implementation of the methodology as prior implementations focus on applications to short time series with experimental designs. Inspired by Dr. Molenaar's work, we describe how an approach, two-stage random effects meta-analysis (2SRE-MA), aligns with recent calls to consider idiographic approaches when making population-level inferences regarding within-person processes.

Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work.

Using traces of behaviors to predict outcomes is useful in varied contexts ranging from buyer behaviors to behaviors collected from smart-home devices. Increasingly, higher education systems have been using Learning Management System (LMS) digital data to capture and understand students' learning and well-being. Researchers in the social sciences are increasingly interested in the potential of using digital log data to predict outcomes and design interventions. Using LMS data for predicting the likelihood of students' success in for-credit college courses provides a useful example of how social scientists can use these techniques on a variety of data types. Here, we provide a primer on how LMS data can be feature-mapped and analyzed to accomplish these goals. We begin with a literature review summarizing current approaches to analyzing LMS data, then discuss ethical issues of privacy when using demographic data and equitable model building. In the second part of the paper, we provide an overview of popular machine learning algorithms and review analytic considerations such as feature generation, assessment of model performance, and sampling techniques. Finally, we conclude with an empirical example demonstrating the ability of LMS data to predict student success, summarizing important features and assessing model performance across different model specifications.

A Square-Root Second-Order Extended Kalman Filtering Approach for Estimating Smoothly Time-Varying Parameters.

Researchers collecting intensive longitudinal data (ILD) are increasingly looking to model psychological processes, such as emotional dynamics, that organize and adapt across time in complex and meaningful ways. This is also the case for researchers looking to characterize the impact of an intervention on individual behavior. To be useful, statistical models must be capable of characterizing these processes as complex, time-dependent phenomenon, otherwise only a fraction of the system dynamics will be recovered. In this paper we introduce a Square-Root Second-Order Extended Kalman Filtering approach for estimating smoothly time-varying parameters. This approach is capable of handling dynamic factor models where the relations between variables underlying the processes of interest change in a manner that may be difficult to specify in advance. We examine the performance of our approach in a Monte Carlo simulation and show the proposed algorithm accurately recovers the unobserved states in the case of a bivariate dynamic factor model with time-varying dynamics and treatment effects. Furthermore, we illustrate the utility of our approach in characterizing the time-varying effect of a meditation intervention on day-to-day emotional experiences.

BRAIN Initiative: Cutting-Edge Tools and Resources for the Community.

The overarching goal of the NIH BRAIN (Brain Research through Advancing Innovative Neurotechnologies) Initiative is to advance the understanding of healthy and diseased brain circuit function through technological innovation. Core principles for this goal include the validation and dissemination of the myriad innovative technologies, tools, methods, and resources emerging from BRAIN-funded research. Innovators, BRAIN funding agencies, and non-Federal partners are working together to develop strategies for making these products usable, available, and accessible to the scientific community. Here, we describe several early strategies for supporting the dissemination of BRAIN technologies. We aim to invigorate a dialogue with the neuroscience research and funding community, interdisciplinary collaborators, and trainees about the existing and future opportunities for cultivating groundbreaking research products into mature, integrated, and adaptable research systems. Along with the accompanying Society for Neuroscience 2019 Mini-Symposium, "BRAIN Initiative: Cutting-Edge Tools and Resources for the Community," we spotlight the work of several BRAIN investigator teams who are making progress toward providing tools, technologies, and services for the neuroscience community. These tools access neural circuits at multiple levels of analysis, from subcellular composition to brain-wide network connectivity, including the following: integrated systems for EM- and florescence-based connectomics, advances in immunolabeling capabilities, and resources for recording and analyzing functional connectivity. Investigators describe how the resources they provide to the community will contribute to achieving the goals of the NIH BRAIN Initiative. Finally, in addition to celebrating the contributions of these BRAIN-funded investigators, the Mini-Symposium will illustrate the broader diversity of BRAIN Initiative investments in cutting-edge technologies and resources.

Measuring Cognitive Flexibility with the Flexible Item Selection Task: From fMRI Adaptation to Individual Connectome Mapping.

Cognitive flexibility, the ability to appropriately adjust behavior in a changing environment, has been challenging to operationalize and validate in cognitive neuroscience studies. Here, we investigate neural activation and directed functional connectivity underlying cognitive flexibility using an fMRI-adapted version of the Flexible Item Selection Task (FIST) in adults (n = 32, ages 19-46 years). The fMRI-adapted FIST was reliable, showed comparable performance to the computer-based version of the task, and produced robust activation in frontoparietal, anterior cingulate, insular, and subcortical regions. During flexibility trials, participants directly engaged the left inferior frontal junction, which influenced activity in other cortical and subcortical regions. The strength of intrinsic functional connectivity between select brain regions was related to individual differences in performance on the FIST, but there was also significant individual variability in functional network topography supporting cognitive flexibility. Taken together, these results suggest that the FIST is a valid measure of cognitive flexibility, which relies on computations within a broad corticosubcortical network driven by inferior frontal junction engagement.

Model-based network discovery of developmental and performance-related differences during risky decision-making.

Theories of adolescent neurodevelopment have largely focused on group-level descriptions of neural changes that help explain increases in risk behavior that are stereotypical of the teen years. However, because these models are concerned with describing the "average" individual, they can fail to account for important individual or within-group variability. New methodological developments now offer the possibility of accounting for both group trends and individual differences within the same modeling framework. Here we apply GIMME, a model-based approach which uses both group and individual-level information to construct functional connectivity maps, to investigate risky behavior and neural changes across development. Adolescents (N = 30, Mage = 13.22), young adults (N = 23, Mage = 19.19), and adults (N = 31, Mage = 43.93) completed a risky decision-making task during an fMRI scan, and functional networks were constructed for each individual. We took two subgrouping approaches: 1) a confirmatory approach where we searched for functional connections that distinguished between our a priori age categories, and 2) an exploratory approach where we allowed an unsupervised algorithm to sort individuals freely. Contrary to expectations, we show that age is not the most influence contributing to network configurations. The implications for developmental theories and methodologies are discussed.

Comparing directed functional connectivity between groups with confirmatory subgrouping GIMME.

Connectivity modeling in functional neuroimaging has become widely used method of analysis for understanding functional architecture. One method for deriving directed connectivity models is Group Iterative Multiple Model Estimation (GIMME; Gates and Molenaar, 2012). GIMME looks for commonalities across the sample to detect signal from noise and arrive at edges that exist across the majority in the group ("group-level edges") and individual-level edges. In this way, GIMME obtains generalizable results via the group-level edges while also allowing for between subject heterogeneity in connectivity, moving the field closer to obtaining reliable personalized connectivity maps. In this article, we present a novel extension of GIMME, confirmatory subgrouping GIMME, which estimates subgroup-level edges for a priori known groups (e.g. typically developing controls vs. clinical group). Detecting edges that consistently exist for individuals within predefined subgroups aids in interpretation of the heterogeneity in connectivity maps and allows for subgroup-specific inferences. We describe this algorithm, as well as several methods to examine the results. We present an empirical example that finds similarities and differences in resting state functional connectivity among four groups of children: typically developing controls (TDC), children with autism spectrum disorder (ASD), children with Inattentive (ADHD-I) and Combined (ADHD-C) Type ADHD. Findings from this study suggest common involvement of the left Broca's area in all the clinical groups, as well as several unique patterns of functional connectivity specific to a given disorder. Overall, the current approach and proof of principle findings highlight a novel and reliable tool for capturing heterogeneity in complex mental health disorders.

A Limited Information Estimator for Dynamic Factor Models.

Structural equation modeling (SEM) is an increasingly popular method for examining multivariate time series data. As in cross-sectional data analysis, structural misspecification of time series models is inevitable, and further complicated by the fact that errors occur in both the time series and measurement components of the model. In this article, we introduce a new limited information estimator and local fit diagnostic for dynamic factor models within the SEM framework. We demonstrate the implementation of this estimator and examine its performance under both correct and incorrect model specifications via a small simulation study. The estimates from this estimator are compared to those from the most common system-wide estimators and are found to be more robust to the structural misspecifications considered.

Detecting Clusters/Communities in Social Networks.

Cohen's κ, a similarity measure for categorical data, has since been applied to problems in the data mining field such as cluster analysis and network link prediction. In this paper, a new application is examined: community detection in networks. A new algorithm is proposed that uses Cohen's κ as a similarity measure for each pair of nodes; subsequently, the κ values are then clustered to detect the communities. This paper defines and tests this method on a variety of simulated and real networks. The results are compared with those from eight other community detection algorithms. Results show this new algorithm is consistently among the top performers in classifying data points both on simulated and real networks. Additionally, this is one of the broadest comparative simulations for comparing community detection algorithms to date.

The first day is always the hardest: Functional connectivity during cue exposure and the ability to resist smoking in the initial hours of a quit attempt.

Quitting smoking is the single best change in behavior that smokers can make to improve their health and extend their lives. Although most smokers express a strong desire to stop using cigarettes, the vast majority of quit attempts end in relapse. Relapse is particularly likely when smokers encounter cigarette cues. A striking number of relapses occur very quickly, with many occurring within as little as 24h. Characterizing what distinguishes successful quit attempts from unsuccessful ones, particularly just after cessation is initiated, is a research priority. We addressed this significant issue by examining the association between functional connectivity during cigarette cue exposure and smoking behavior during the first 24h of a quit attempt. Functional MRI was used to measure brain activity during cue exposure in nicotine-deprived daily smokers during the first day of a quit attempt. Participants were then given the opportunity to smoke. Using data collected in two parent studies, we identified a subset of participants who chose to smoke and a matched subset who declined (n=38). Smokers who were able to resist smoking displayed significant functional connectivity between the left anterior insula and the dorsolateral prefrontal cortex, whereas there was no such connectivity for those who chose to smoke. Notably, there were no differences in mean levels of activation in brain regions of interest, underscoring the importance of assessing interregional connectivity when investigating the links between cue-related neural responses and overt behavior. To our knowledge, this is the first study to link patterns of functional connectivity and actual cigarette use during the pivotal first hours of attempt to change smoking behavior.

Network Mapping with GIMME.

Network science is booming! While the insights and images afforded by network mapping techniques are compelling, implementing the techniques is often daunting to researchers. Thus, the aim of this tutorial is to facilitate implementation in the context of GIMME, or group iterative multiple model estimation. GIMME is an automated network analysis approach for intensive longitudinal data. It creates person-specific networks that explain how variables are related in a system. The relations can signify current or future prediction that is common across people or applicable only to an individual. The tutorial begins with conceptual and mathematical descriptions of GIMME. It proceeds with a practical discussion of analysis steps, including data acquisition, preprocessing, program operation, a posteriori testing of model assumptions, and interpretation of results; throughout, a small empirical data set is analyzed to showcase the GIMME analysis pipeline. The tutorial closes with a brief overview of extensions to GIMME that may interest researchers whose questions and data sets have certain features. By the end of the tutorial, researchers will be equipped to begin analyzing the temporal dynamics of their heterogeneous time series data with GIMME.

Unsupervised Classification During Time-Series Model Building.

Researchers who collect multivariate time-series data across individuals must decide whether to model the dynamic processes at the individual level or at the group level. A recent innovation, group iterative multiple model estimation (GIMME), offers one solution to this dichotomy by identifying group-level time-series models in a data-driven manner while also reliably recovering individual-level patterns of dynamic effects. GIMME is unique in that it does not assume homogeneity in processes across individuals in terms of the patterns or weights of temporal effects. However, it can be difficult to make inferences from the nuances in varied individual-level patterns. The present article introduces an algorithm that arrives at subgroups of individuals that have similar dynamic models. Importantly, the researcher does not need to decide the number of subgroups. The final models contain reliable group-, subgroup-, and individual-level patterns that enable generalizable inferences, subgroups of individuals with shared model features, and individual-level patterns and estimates. We show that integrating community detection into the GIMME algorithm improves upon current standards in two important ways: (1) providing reliable classification and (2) increasing the reliability in the recovery of individual-level effects. We demonstrate this method on functional MRI from a sample of former American football players.

State space modeling of time-varying contemporaneous and lagged relations in connectivity maps.

Most connectivity mapping techniques for neuroimaging data assume stationarity (i.e., network parameters are constant across time), but this assumption does not always hold true. The authors provide a description of a new approach for simultaneously detecting time-varying (or dynamic) contemporaneous and lagged relations in brain connectivity maps. Specifically, they use a novel raw data likelihood estimation technique (involving a second-order extended Kalman filter/smoother embedded in a nonlinear optimizer) to determine the variances of the random walks associated with state space model parameters and their autoregressive components. The authors illustrate their approach with simulated and blood oxygen level-dependent functional magnetic resonance imaging data from 30 daily cigarette smokers performing a verbal working memory task, focusing on seven regions of interest (ROIs). Twelve participants had dynamic directed functional connectivity maps: Eleven had one or more time-varying contemporaneous ROI state loadings, and one had a time-varying autoregressive parameter. Compared to smokers without dynamic maps, smokers with dynamic maps performed the task with greater accuracy. Thus, accurate detection of dynamic brain processes is meaningfully related to behavior in a clinical sample.

Networks involved in olfaction and their dynamics using independent component analysis and unified structural equation modeling.

The study of human olfaction is complicated by the myriad of processing demands in conscious perceptual and emotional experiences of odors. Combining functional magnetic resonance imaging with convergent multivariate network analyses, we examined the spatiotemporal behavior of olfactory-generated blood-oxygenated-level-dependent signal in healthy adults. The experimental functional magnetic resonance imaging (fMRI) paradigm was found to offset the limitations of olfactory habituation effects and permitted the identification of five functional networks. Analysis delineated separable neuronal circuits that were spatially centered in the primary olfactory cortex, striatum, dorsolateral prefrontal cortex, rostral prefrontal cortex/anterior cingulate, and parietal-occipital junction. We hypothesize that these functional networks subserve primary perceptual, affective/motivational, and higher order olfactory-related cognitive processes. Results provided direct evidence for the existence of parallel networks with top-down modulation for olfactory processing and clearly distinguished brain activations that were sniffing-related versus odor-related. A comprehensive neurocognitive model for olfaction is presented that may be applied to broader translational studies of olfactory function, aging, and neurological disease.

Greater BOLD activity but more efficient connectivity is associated with better cognitive performance within a sample of nicotine-deprived smokers.

The first few days of an attempt to quit smoking are marked by impairments in cognitive domains, such as working memory and attention. These cognitive impairments have been linked to increased risk for relapse. Little is known about individual differences in the cognitive impairments that accompany deprivation or the neural processing reflected in those differences. In order to address this knowledge gap, we collected functional magnetic resonance imaging (fMRI) data from 118 nicotine-deprived smokers while they performed a verbal n-back task. We predicted better performance would be associated with more efficient patterns of brain activation and effective connectivity. Results indicated that performance was positively related to load-related activation in the left dorsolateral prefrontal cortex and the left lateral premotor cortex. Additionally, effective connectivity patterns differed as a function of performance, with more accurate participants having simpler, more parsimonious network models than did worse participants. Cognitive efficiency is typically thought of as less neural activation for equal or superior behavioral performance. Taken together, findings suggest cognitive efficiency should not be viewed solely in terms of amount of activation but that both the magnitude of activation within and degree of covariation between task-critical structures must be considered. This research highlights the benefit of combining traditional fMRI analysis with newer methods for modeling brain connectivity. These results suggest a possible role for indices of network functioning in assessing relapse risk in quitting smokers as well as offer potentially useful targets for novel intervention strategies.

A Model Implied Instrumental Variable Approach to Exploratory Factor Analysis (MIIV-EFA).

Spearman (Am J Psychol 15(1):201-293, 1904. https://doi.org/10.2307/1412107 ) marks the birth of factor analysis. Many articles and books have extended his landmark paper in permitting multiple factors and determining the number of factors, developing ideas about simple structure and factor rotation, and distinguishing between confirmatory and exploratory factor analysis (CFA and EFA). We propose a new model implied instrumental variable (MIIV) approach to EFA that allows intercepts for the measurement equations, correlated common factors, correlated errors, standard errors of factor loadings and measurement intercepts, overidentification tests of equations, and a procedure for determining the number of factors. We also permit simpler structures by removing nonsignificant loadings. Simulations of factor analysis models with and without cross-loadings demonstrate the impressive performance of the MIIV-EFA procedure in recovering the correct number of factors and in recovering the primary and secondary loadings. For example, in nearly all replications MIIV-EFA finds the correct number of factors when N is 100 or more. Even the primary and secondary loadings of the most complex models were recovered when the sample sizes were at least 500. We discuss limitations and future research areas. Two appendices describe alternative MIIV-EFA algorithms and the sensitivity of the algorithm to cross-loadings.

Dynamic processes in behavioral activation therapy for anhedonic adolescents: Modeling common and patient-specific relations.

OBJECTIVE: Behavioral activation (BA) is a brief intervention for depression encouraging gradual and systematic re-engagement with rewarding activities and behaviors. Given this treatment focus, BA may be particularly beneficial for adolescents with prominent anhedonia, a predictor of poor treatment response and common residual symptom. We applied group iterative multiple model estimation (GIMME) to ecological momentary assessment (EMA) treatment data to investigate common and person-specific processes during BA for anhedonic adolescents. METHOD: Thirty-nine adolescents (Mage = 15.7 years old, 67% female, 81% White) with elevated anhedonia (Snaith-Hamilton Pleasure Scale) were enrolled in a 12-week BA trial, with weekly anhedonia assessments. EMA surveys were triggered every other week (2-3 surveys per day) throughout treatment assessing current positive affect (PA) and negative affect (NA), engagement in pleasurable activities and social interactions, anticipatory pleasure, rumination, and recent pleasurable and stressful experiences. RESULTS: A multilevel model revealed significant decreases in anhedonia, t(25.5) = -4.76, p < .001, over the 12-week trial. GIMME results indicated substantial heterogeneity in variable networks across patients. PA was the variable with the greatest number (22% of all paths vs. 11% for NA) of predictive paths to other symptoms (i.e., highest out-degree). Higher PA (but not NA) out-degree was associated with greater anhedonia improvement, t(25.8) = -2.22, p = .035. CONCLUSIONS: Results revealed substantial heterogeneity in variable relations across patients, which may obscure the search for common processes of change in BA. PA may be a particularly important treatment target for anhedonic adolescents in BA. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Blind Subgrouping of Task-based fMRI.

Significant heterogeneity in network structures reflecting individuals' dynamic processes can exist within subgroups of people (e.g., diagnostic category, gender). This makes it difficult to make inferences regarding these predefined subgroups. For this reason, researchers sometimes wish to identify subsets of individuals who have similarities in their dynamic processes regardless of any predefined category. This requires unsupervised classification of individuals based on similarities in their dynamic processes, or equivalently, in this case, similarities in their network structures of edges. The present paper tests a recently developed algorithm, S-GIMME, that takes into account heterogeneity across individuals with the aim of providing subgroup membership and precise information about the specific network structures that differentiate subgroups. The algorithm has previously provided robust and accurate classification when evaluated with large-scale simulation studies but has not yet been validated on empirical data. Here, we investigate S-GIMME's ability to differentiate, in a purely data-driven manner, between brain states explicitly induced through different tasks in a new fMRI dataset. The results provide new evidence that the algorithm was able to resolve, in an unsupervised data-driven manner, the differences between different active brain states in empirical fMRI data to segregate individuals and arrive at subgroup-specific network structures of edges. The ability to arrive at subgroups that correspond to empirically designed fMRI task conditions, with no biasing or priors, suggests this data-driven approach can be a powerful addition to existing methods for unsupervised classification of individuals based on their dynamic processes.