Assessing the effectiveness of spatial PCA on SVM-based decoding of EEG data.

Principal component analysis (PCA) has been widely employed for dimensionality reduction prior to multivariate pattern classification (decoding) in EEG research. The goal of the present study was to provide an evaluation of the effectiveness of PCA on decoding accuracy (using support vector machines) across a broad range of experimental paradigms. We evaluated several different PCA variations, including group-based and subject-based component decomposition and the application of Varimax rotation or no rotation. We also varied the numbers of PCs that were retained for the decoding analysis. We evaluated the resulting decoding accuracy for seven common event-related potential components (N170, mismatch negativity, N2pc, P3b, N400, lateralized readiness potential, and error-related negativity). We also examined more challenging decoding tasks, including decoding of face identity, facial expression, stimulus location, and stimulus orientation. The datasets also varied in the number and density of electrode sites. Our findings indicated that none of the PCA approaches consistently improved decoding performance related to no PCA, and the application of PCA frequently reduced decoding performance. Researchers should therefore be cautious about using PCA prior to decoding EEG data from similar experimental paradigms, populations, and recording setups.

Assessing Trial-by-Trial Electrophysiological and Behavioral Markers of Attentional Control and Sensory Precision in Psychotic and Mood Disorders.

BACKGROUND AND HYPOTHESIS: The current study investigated the extent to which changes in attentional control contribute to performance on a visual perceptual discrimination task, on a trial-by-trial basis in a transdiagnostic clinical sample. STUDY DESIGN: Participants with schizophrenia (SZ; N = 58), bipolar disorder (N = 42), major depression disorder (N = 51), and psychiatrically healthy controls (N = 92) completed a visual perception task in which stimuli appeared briefly. The design allowed us to estimate the lapse rate and the precision of perceptual representations of the stimuli. Electroencephalograms (EEG) were recorded to examine pre-stimulus activity in the alpha band (8-13 Hz), overall and in relation to behavior performance on the task. STUDY RESULTS: We found that the attention lapse rate was elevated in the SZ group compared with all other groups. We also observed group differences in pre-stimulus alpha activity, with control participants showing the highest levels of pre-stimulus alpha when averaging across trials. However, trial-by-trial analyses showed within-participant fluctuations in pre-stimulus alpha activity significantly predicted the likelihood of making an error, in all groups. Interestingly, our analysis demonstrated that aperiodic contributions to the EEG signal (which affect power estimates across frequency bands) serve as a significant predictor of behavior as well. CONCLUSIONS: These results confirm the elevated attention lapse rate that has been observed in SZ, validate pre-stimulus EEG markers of attentional control and their use as a predictor of behavior on a trial-by-trial basis, and suggest that aperiodic contributions to the EEG signal are an important target for further research in this area, in addition to alpha-band activity.

Enhanced Working Memory Representations for Rare Events.

Rare events (oddballs) produce a variety of enhanced physiological responses relative to frequent events (standards), including the P3b component of the event-related potential (ERP) waveform. Previous research has suggested that the P3b component is related to working memory, which implies that working memory representations will be enhanced for rare stimuli. To test this hypothesis, we devised a modified oddball paradigm in which the target was a disk presented at one of 16 different locations, which were divided into a rare set and a frequent set. Participants made a binary response on each trial to report whether the target appeared in the rare set or the frequent set. As expected, the P3b was much larger for stimuli appearing at a location within the rare set. We also included occasional probe trials in which the subject reported the exact location of the target. We found that these reports were more accurate for locations within the rare set than for locations within the frequent set. Moreover, the mean accuracy of these reports was correlated with the mean amplitude of the P3b. We also applied multivariate pattern analysis to the ERP data to "decode" the remembered location of the target. Decoding accuracy was greater for locations within the rare set than for locations within the frequent set. These behavioral and electrophysiological results demonstrate that although both frequent and rare events are stored in working memory, the representations are enhanced for rare events.

Using multivariate pattern analysis to increase effect sizes for event-related potential analyses.

Multivariate pattern analysis (MVPA) approaches can be applied to the topographic distribution of event-related potential (ERP) signals to "decode" subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE data set and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two MVPA approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

Optimal filters for ERP research I: A general approach for selecting filter settings.

Filtering plays an essential role in event-related potential (ERP) research, but filter settings are usually chosen on the basis of historical precedent, lab lore, or informal analyses. This reflects, in part, the lack of a well-reasoned, easily implemented method for identifying the optimal filter settings for a given type of ERP data. To fill this gap, we developed an approach that involves finding the filter settings that maximize the signal-to-noise ratio for a specific amplitude score (or minimizes the noise for a latency score) while minimizing waveform distortion. The signal is estimated by obtaining the amplitude score from the grand average ERP waveform (usually a difference waveform). The noise is estimated using the standardized measurement error of the single-subject scores. Waveform distortion is estimated by passing noise-free simulated data through the filters. This approach allows researchers to determine the most appropriate filter settings for their specific scoring methods, experimental designs, subject populations, recording setups, and scientific questions. We have provided a set of tools in ERPLAB Toolbox to make it easy for researchers to implement this approach with their own data.

Optimal filters for ERP research II: Recommended settings for seven common ERP components.

In research with event-related potentials (ERPs), aggressive filters can substantially improve the signal-to-noise ratio and maximize statistical power, but they can also produce significant waveform distortion. Although this tradeoff has been well documented, the field lacks recommendations for filter cutoffs that quantitatively address both of these competing considerations. To fill this gap, we quantified the effects of a broad range of low-pass filter and high-pass filter cutoffs for seven common ERP components (P3b, N400, N170, N2pc, mismatch negativity, error-related negativity, and lateralized readiness potential) recorded from a set of neurotypical young adults. We also examined four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency). For each combination of component and scoring methods, we quantified the effects of filtering on data quality (noise level and signal-to-noise ratio) and waveform distortion. This led to recommendations for optimal low-pass and high-pass filter cutoffs. We repeated the analyses after adding artificial noise to provide recommendations for data sets with moderately greater noise levels. For researchers who are analyzing data with similar ERP components, noise levels, and participant populations, using the recommended filter settings should lead to improved data quality and statistical power without creating problematic waveform distortion.

Evaluating the effectiveness of artifact correction and rejection in event-related potential research.

Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods in minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.

A Transdiagnostic Study of Effort-Cost Decision-Making in Psychotic and Mood Disorders.

BACKGROUND: Research suggests that effort-cost decision-making (ECDM), the estimation of work required to obtain reward, may be a relevant framework for understanding motivational impairment in psychotic and mood pathology. Specifically, research has suggested that people with psychotic and mood pathology experience effort as more costly than controls, and thus pursue effortful goals less frequently. This study examined ECDM across psychotic and mood pathology. HYPOTHESIS: We hypothesized that patient groups would show reduced willingness to expend effort compared to controls. STUDY DESIGN: People with schizophrenia (N = 33), schizoaffective disorder (N = 28), bipolar disorder (N = 39), major depressive disorder (N = 40), and controls (N = 70) completed a physical ECDM task. Participants decided between completing a low-effort or high-effort option for small or larger rewards, respectively. Reward magnitude, reward probability, and effort magnitude varied trial-by-trial. Data were analyzed using standard and hierarchical logistic regression analyses to assess the subject-specific contribution of various factors to choice. Negative symptoms were measured with a clinician-rated interview. STUDY RESULTS: There was a significant effect of group, driven by reduced choice of high-effort options in schizophrenia. Hierarchical logistic regression revealed that reduced choice of high-effort options in schizophrenia was driven by weaker contributions of probability information. Use of reward information was inversely associated with motivational impairment in schizophrenia. Surprisingly, individuals with major depressive disorder and bipolar disorder did not differ from controls. CONCLUSIONS: Our results provide support for ECDM deficits in schizophrenia. Additionally, differences between groups in ECDM suggest a seemingly similar behavioral phenotype, reduced motivation, could arise from disparate mechanisms.

Using Multivariate Pattern Analysis to Increase Effect Sizes for Event-Related Potential Analyses.

Multivariate pattern analysis approaches can be applied to the topographic distribution of event-related potential (ERP) signals to 'decode' subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE dataset and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two multivariate pattern analysis approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

Evaluating the effectiveness of artifact correction and rejection in event-related potential research.

Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.

Is covert attention necessary for programming accurate saccades? Evidence from saccade-locked event-related potentials.

For decades, researchers have assumed that shifts of covert attention mandatorily occur prior to eye movements to improve perceptual processing of objects before they are fixated. However, recent research suggests that the N2pc component-a neural measure of covert attentional allocation-does not always precede eye movements. The current study investigated whether the N2pc component mandatorily precedes eye movements and assessed its role in the accuracy of gaze control. In three experiments, participants searched for a letter of a specific color (e.g., red) and directed gaze to it as a response. Electroencephalograms and eye movements were coregistered to determine whether neural markers of covert attention preceded the initial shift of gaze. The results showed that the presaccadic N2pc only occurred under limited conditions: when there were many potential target locations and distractors. Crucially, there was no evidence that the presence or magnitude of the presaccadic N2pc was associated with improved eye movement accuracy in any of the experiments. Interestingly, ERP decoding analyses were able to classify the target location well before the eyes started to move, which likely reflects a presaccadic cognitive process that is distinct from the attentional process measured by the N2pc. Ultimately, we conclude that the covert attentional mechanism indexed by the N2pc is not necessary for precise gaze control.

Optimal Filters for ERP Research II: Recommended Settings for Seven Common ERP Components.

In research with event-related potentials (ERPs), aggressive filters can substantially improve the signal-to-noise ratio and maximize statistical power, but they can also produce significant waveform distortion. Although this tradeoff has been well documented, the field lacks recommendations for filter cutoffs that quantitatively address both of these competing considerations. To fill this gap, we quantified the effects of a broad range of low-pass filter and high-pass filter cutoffs for seven common ERP components (P3b, N400, N170, N2pc, mismatch negativity, error-related negativity, and lateralized readiness potential) recorded from a set of neurotypical young adults. We also examined four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency). For each combination of component and scoring method, we quantified the effects of filtering on data quality (noise level and signal-to-noise ratio) and waveform distortion. This led to recommendations for optimal low-pass and high-pass filter cutoffs. We repeated the analyses after adding artificial noise to provide recommendations for datasets with moderately greater noise levels. For researchers who are analyzing data with similar ERP components, noise levels, and participant populations, using the recommended filter settings should lead to improved data quality and statistical power without creating problematic waveform distortion.

Qualitatively Different Delay-Dependent Working Memory Distortions in People With Schizophrenia and Healthy Control Participants.

BACKGROUND: Impairments in working memory (WM) have been well documented in people with schizophrenia (PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed response task to explore a qualitative difference in WM dynamics between PSZ and healthy control participants (HCs). More specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous trial targets (serial dependence). We tested the hypothesis that WM representations would drift toward the previous trial target in HCs but away from the previous trial target in PSZ. METHODS: We assessed serial dependence in PSZ (n = 31) and HCs (n = 25) using orientation as the to-be-remembered feature and memory delays lasting from 0 to 8 seconds. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a delay period of varying length. RESULTS: Consistent with prior studies, we found that current trial memory representations were less precise in PSZ than in HCs. We also found that WM for the current trial orientation drifted toward the previous trial orientation in HCs (representational attraction) but drifted away from the previous trial orientation in PSZ (representational repulsion). CONCLUSIONS: These results demonstrate a qualitative difference in WM dynamics between PSZ and HCs that cannot be easily explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCs in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

A Critique of the Attentional Window Account of Capture Failures.

There has been a lengthy debate about whether salient stimuli have the power to automatically capture attention, even when entirely task irrelevant. Theeuwes (2022) has suggested that an attentional window account could explain why capture is observed in some studies, but not others. According to this account, when search is difficult, participants narrow their attentional window, and this prevents the salient distractor from generating a saliency signal. In turn, this causes the salient distractor to fail to capture attention. In the present commentary, we describe two major problems with this account. First, the attentional window account proposes that attention must be focused so narrowly that featural information from the salient distractor will be filtered prior to saliency computations. However, many previous studies observing no capture provided evidence that featural processing was sufficiently detailed to guide attention toward the target shape. This indicates that the attentional window was sufficiently broad to allow featural processing. Second, the attentional window account proposes that capture should occur more readily in easy search tasks than difficult search tasks. We review previous studies that violate this basic prediction of the attentional window account. A more parsimonious account of the data is that control over feature processing can be exerted proactively to prevent capture, at least under certain conditions.

Decoding semantic relatedness and prediction from EEG: A classification method comparison.

Machine-learning (ML) decoding methods have become a valuable tool for analyzing information represented in electroencephalogram (EEG) data. However, a systematic quantitative comparison of the performance of major ML classifiers for the decoding of EEG data in neuroscience studies of cognition is lacking. Using EEG data from two visual word-priming experiments examining well-established N400 effects of prediction and semantic relatedness, we compared the performance of three major ML classifiers that each use different algorithms: support vector machine (SVM), linear discriminant analysis (LDA), and random forest (RF). We separately assessed the performance of each classifier in each experiment using EEG data averaged over cross-validation blocks and using single-trial EEG data by comparing them with analyses of raw decoding accuracy, effect size, and feature importance weights. The results of these analyses demonstrated that SVM outperformed the other ML methods on all measures and in both experiments.

Optimal Filters for ERP Research I: A General Approach for Selecting Filter Settings.

Filtering plays an essential role in event-related potential (ERP) research, but filter settings are usually chosen on the basis of historical precedent, lab lore, or informal analyses. This reflects, in part, the lack of a well-reasoned, easily implemented method for identifying the optimal filter settings for a given type of ERP data. To fill this gap, we developed an approach that involves finding the filter settings that maximize the signal-to-noise ratio for a specific amplitude score (or minimizes the noise for a latency score) while minimizing waveform distortion. The signal is estimated by obtaining the amplitude score from the grand average ERP waveform (usually a difference waveform). The noise is estimated using the standardized measurement error of the single-subject scores. Waveform distortion is estimated by passing noise-free simulated data through the filters. This approach allows researchers to determine the most appropriate filter settings for their specific scoring methods, experimental designs, subject populations, recording setups, and scientific questions. We have provided a set of tools in ERPLAB Toolbox to make it easy for researchers to implement this approach with their own data.

Managing EEG studies: How to prepare and what to do once data collection has begun.

In this paper, we provide guidance for the organization and implementation of EEG studies. This work was inspired by our experience conducting a large-scale, multi-site study, but many elements could be applied to any EEG project. Section 1 focuses on study activities that take place before data collection begins. Topics covered include: establishing and training study teams, considerations for task design and piloting, setting up equipment and software, development of formal protocol documents, and planning communication strategy with all study team members. Section 2 focuses on what to do once data collection has already begun. Topics covered include: (1) how to effectively monitor and maintain EEG data quality, (2) how to ensure consistent implementation of experimental protocols, and (3) how to develop rigorous preprocessing procedures that are feasible for use in a large-scale study. Links to resources are also provided, including sample protocols, sample equipment and software tracking forms, sample code, and tutorial videos (to access resources, please visit: https://osf.io/wdrj3/).

Transdiagnostic Predictors of Everyday Functioning: Examining the Relationships of Depression and Reinforcement Learning.

BACKGROUND AND HYPOTHESIS: Impairments in function (ie, the ability to independently accomplish daily tasks) have been established in psychotic disorders. Identifying factors that contribute to these deficits is essential to developing effective interventions. The current study had several goals: examine potential differential relationships across domains of neurocognition, assess whether reinforcement learning is related to function, identify if predictors of function are transdiagnostic, determine whether depression and positive symptoms contribute to function, and to explore whether the modality of assessment impacts observed relationships. STUDY DESIGN: Data from 274 participants were examined with schizophrenia/schizoaffective disorder (SZ; n = 195) and bipolar disorder (BD; n = 79). To reduce dimensionality, a PCA was completed on neurocognitive tasks which resulted in 3 components. These components and clinical interview data were used to investigate predictors of functional domains across measures of function (self- and informant-report SLOF and UPSA). RESULTS: Two components, working memory/processing speed/episodic memory (ßs = 0.18-0.42), and negative/positive reinforcement learning (ß = -0.04), predicted different functional domains. Predictors of function were largely transdiagnostic with two exceptions: reinforcement learning had a positive association with self-reported interpersonal relationships for SZ and a negative association for BD (ß = 0.34), and the negative association between positive symptoms and self-reported social acceptability was stronger for BD than for SZ (ß = 0.93). Depression robustly predicted self-reported but not informant-reported function, and anhedonia predicted all domains of informant-reported function. CONCLUSIONS: These findings imply that reinforcement learning may differentially relate to function across disorders, traditional domains of neurocognition can be effective transdiagnostic targets for interventions, and positive symptoms and depression play a critical role in self-perceived functional impairments.

Qualitatively different delay-dependent working memory distortions in people with schizophrenia and healthy control subjects.

Background: Impairments in working memory(WM) have been well-documented in people with schizophrenia(PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed-response task to explore a qualitative difference in WM dynamics between PSZ and healthy control subjects(HCS). Specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous-trial targets(serial dependence). We tested the hypothesis that WM representations drift toward the previous-trial target in HCS but away from the previous-trial target in PSZ. Methods: We assessed serial dependence in PSZ(N=31) and HCS(N=25), using orientation as the to-be-remembered feature and memory delays from 0 to 8s. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a varying delay period. Results: Consistent with prior studies, we found that current-trial memory representations were less precise in PSZ than in HCS. We also found that WM for the current-trial orientation drifted toward the previous-trial orientation in HCS(representational attraction) but drifted away from the previous-trial orientation in PSZ(representational repulsion). Conclusions: These results demonstrate a qualitative difference in WM dynamics between PSZ and HCS that cannot easily be explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results, because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCS in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

Variations in ERP data quality across paradigms, participants, and scoring procedures.

Although it is widely accepted that data quality for event-related potential (ERP) components varies considerably across studies and across participants within a study, ERP data quality has not received much systematic analysis. The present study used a recently developed metric of ERP data quality- the standardized measurement error (SME)-to examine how data quality varies across different ERP paradigms, across individual participants, and across different procedures for quantifying amplitude and latency values. The EEG recordings were taken from the ERP CORE, which includes data from 40 neurotypical college students for seven widely studied ERP components: P3b, N170, mismatch negativity, N400, error-related negativity, N2pc, and lateralized readiness potential. Large differences in data quality were observed across the different ERP components, and very large differences in data quality were observed across participants. Data quality also varied depending on the algorithm used to quantify the amplitude and especially the latency of a given ERP component. These results provide an initial set of benchmark values that can be used for comparison with previous and future ERP studies. They also provide useful information for predicting effect sizes and statistical power in future studies, even with different numbers of trials. More broadly, this study provides a general approach that could be used to determine which specific experimental designs, data collection procedures, and data processing algorithms lead to the best data quality.