Garden of forking paths in ERP research - Effects of varying pre-processing and analysis steps in an N400 experiment.

This study tackles the Garden of Forking Paths, as a challenge for replicability and reproducibility of ERP studies. Here, we applied a multiverse analysis to a sample ERP N400 dataset, donated by an independent research team. We analyzed this dataset using 14 pipelines selected to showcase the full range of methodological variability found in the N400 literature using systematic review approach. The selected pipelines were compared in depth by looking into statistical test outcomes, descriptive statistics, effect size, data quality, and statistical power. In this way we provide a worked example of how analytic flexibility can impact results in research fields with high dimensionality such as ERP, when analyzed using standard null-hypothesis significance testing. Out of the methodological decisions that were varied, high-pass filter cut-off, artifact removal method, baseline duration, reference, measurement latency and locations, and amplitude measure (peak vs. mean) were all shown to affect at least some of the study outcome measures. Low-pass filtering was the only step which did not notably influence any of these measures. This study shows that even some of the seemingly minor procedural deviations can influence the conclusions of an ERP study. We demonstrate the power of multiverse analysis in both identifying the most reliable effects in a given study, and for providing insights into consequences of methodological decisions.

Good scientific practice in EEG and MEG research: Progress and perspectives.

Good scientific practice (GSP) refers to both explicit and implicit rules, recommendations, and guidelines that help scientists to produce work that is of the highest quality at any given time, and to efficiently share that work with the community for further scrutiny or utilization. For experimental research using magneto- and electroencephalography (MEEG), GSP includes specific standards and guidelines for technical competence, which are periodically updated and adapted to new findings. However, GSP also needs to be regularly revisited in a broader light. At the LiveMEEG 2020 conference, a reflection on GSP was fostered that included explicitly documented guidelines and technical advances, but also emphasized intangible GSP: a general awareness of personal, organizational, and societal realities and how they can influence MEEG research. This article provides an extensive report on most of the LiveMEEG contributions and new literature, with the additional aim to synthesize ongoing cultural changes in GSP. It first covers GSP with respect to cognitive biases and logical fallacies, pre-registration as a tool to avoid those and other early pitfalls, and a number of resources to enable collaborative and reproducible research as a general approach to minimize misconceptions. Second, it covers GSP with respect to data acquisition, analysis, reporting, and sharing, including new tools and frameworks to support collaborative work. Finally, GSP is considered in light of ethical implications of MEEG research and the resulting responsibility that scientists have to engage with societal challenges. Considering among other things the benefits of peer review and open access at all stages, the need to coordinate larger international projects, the complexity of MEEG subject matter, and today's prioritization of fairness, privacy, and the environment, we find that current GSP tends to favor collective and cooperative work, for both scientific and for societal reasons.

How to do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature.

Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 - June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.

P3 latency as a biomarker for the complexity of migraine with aura: Event-related potential study.

BACKGROUND: This study aimed to compare the P3 component between patients who have migraines with aura and healthy subjects, and to compare different subtypes of migraine with aura relative to the complexity of migraine aura. METHODS: Average Migraine Aura Complexity Score was calculated for each MwA patient. Visual oddball paradigm was used to elicit the P3 component. P3 amplitudes and latencies elicited from frequent and rare stimuli, as well as from difference wave, were compared with healthy subjects. Subsequently, subtypes of migraine with aura were compared and Average Migraine Aura Complexity Score was used to explore the connection between features of the P3 and complexity of migraine with aura. RESULTS: 37 patients who have migraine with aura (16 with simple aura and 21 with complex aura) patients and 28 healthy subjects were studied. Patients who have migraine with aura had significantly prolonged latencies compared to healthy subjects (411 ± 39 ms vs 372 ± 34 ms, p < 0.001) relative to a rare condition. Patients who have complex aura significantly differs from patients who have simple aura (427 ± 34 ms vs 389 ± 35 ms, p = 0.004) and healthy subjects (372 ± 34 ms, p < 0.001) relative to P3 latency in a rare condition and the patients who have complex aura significantly differs from healthy subjects (442 ± 37 ms vs 394 ± 33 ms, p < 0.001) relative to P3 latency in difference wave. P3 latency from rare condition positively correlated with the Average Migraine Aura Complexity Score (p < 0.001). CONCLUSIONS: Visual oddball paradigm, particularly rare stimuli, could serve as a potential new tool for deep profiling of different clinical complexities among patients who have migraine with aura. Also, the present pattern of P3 components provided new evidence for the cognitive dysfunctions in patients who have migraine with aura.

Spatiotemporal Eye-Tracking Feature Set for Improved Recognition of Dyslexic Reading Patterns in Children.

Considering the detrimental effects of dyslexia on academic performance and its common occurrence, developing tools for dyslexia detection, monitoring, and treatment poses a task of significant priority. The research performed in this paper was focused on detecting and analyzing dyslexic tendencies in Serbian children based on eye-tracking measures. The group of 30 children (ages 7-13, 15 dyslexic and 15 non-dyslexic) read 13 different text segments on 13 different color configurations. For each text segment, the corresponding eye-tracking trail was recorded and then processed offline and represented by nine conventional features and five newly proposed features. The features were used for dyslexia recognition using several machine learning algorithms: logistic regression, support vector machine, k-nearest neighbor, and random forest. The highest accuracy of 94% was achieved using all the implemented features and leave-one-out subject cross-validation. Afterwards, the most important features for dyslexia detection (representing the complexity of fixation gaze) were used in a statistical analysis of the individual color effects on dyslexic tendencies within the dyslexic group. The statistical analysis has shown that the influence of color has high inter-subject variability. This paper is the first to introduce features that provide clear separability between a dyslexic and control group in the Serbian language (a language with a shallow orthographic system). Furthermore, the proposed features could be used for diagnosing and tracking dyslexia as biomarkers for objective quantification.

Towards ARTEM-IS: Design guidelines for evidence-based EEG methodology reporting tools.

As the number of EEG papers increases, so too do the number of guidelines for how to report what has been done. However, current guidelines and checklists appear to have limited adoption, as systematic reviews have shown the journal article format is highly prone to errors, ambiguities and omissions of methodological details. This is a problem for transparency in the scientific record, along with reproducibility and metascience. Following lessons learned in the high complexity fields of aviation and surgery, we conclude that new tools are needed to overcome the limitations of written methodology descriptions, and that these tools should be developed through community consultation to ensure that they have the most utility for EEG stakeholders. As a first step in tool development, we present the ARTEM-IS Statement describing what action will be needed to create an Agreed Reporting Template for Electroencephalography Methodology - International Standard (ARTEM-IS), along with ARTEM-IS Design Guidelines for developing tools that use an evidence-based approach to error reduction. We first launched the statement at the LiveMEEG conference in 2020 along with a draft of an ARTEM-IS template for public consultation. Members of the EEG community are invited to join this collective effort to create evidence-based tools that will help make the process of reporting methodology intuitive to complete and foolproof by design.

The Sensor Hub for Detecting the Developmental Characteristics in Reading in Children on a White vs. Colored Background/Colored Overlays.

This study investigated the influence of white vs. 12 background and overlay colors on the reading process in twenty-four school-age children. Previous research reported that colors could affect reading skills as an important factor in the emotional and physiological state of the body. The aim of the study was to assess developmental differences between second and third grade students of an elementary school, and to evaluate differences in electroencephalography (EEG), ocular, electrodermal activities (EDA) and heart rate variability (HRV). Our findings showed a decreasing trend with age regarding EEG power bands (Alpha, Beta, Delta, Theta) and lower scores of reading duration and eye-tracking measures in younger children compared to older children. As shown in the results, HRV parameters showed higher scores in 12 background and overlay colors among second than third grade students, which is linearly correlated to the level of stress and is readable from EDA measures as well. Our study showed the calming effect on second graders of turquoise and blue background colors. Considering other colors separately for each parameter, we assumed that there are no systematic differences in reading duration, EEG power band, eye-tracking and EDA measures.

Characteristics of N400 component elicited in patients who have migraine with aura.

BACKGROUND: This study aimed to examine the N400 effect and event-related potentials (ERPs) elicited from congruent and incongruent stimuli in patients who have migraines with aura (MwA). METHODS: A total of 33 MwA patients and 20 healthy controls (HCs) were studied. They were balanced in age (35.12 ± 8.94 vs 34.70 ± 9.59 years, p = 0.872) and sex (69.7 vs 75.0% females, p = 0.761). ERPs were measured in response to both stimuli, where pictures were preceded with an object name that either matched or mismatched with the object. Averaged amplitudes, peaks, peak latencies, difference waves and topography were compared between MwA and HCs. RESULTS: MwA patients had significantly lower averaged amplitudes at the Fz and F4 sites during incongruent stimuli, as well as reduced peaks at the C3 and Pz sites. Topography showed a more widespread N400 effect over scalp relative to HCs. The difference ERP waveforms did not differ in the N400 effect between groups, but the P600 effect was significantly stronger in the HCs group relative to the MwA group at the Pz (6.52 ± 2.57 vs. 3.50 ± 3.15, p = 0.001) and P4 (5.86 ± 2.79 vs. 3.95 ± 3.64, p = 0.040) sites. CONCLUSIONS: Picture-word matching tasks could serve as a potential new method for the investigation of semantic processing in MwA patients.

Towards continuous and real-time attention monitoring at work: reaction time versus brain response.

Continuous and objective measurement of the user attention state still represents a major challenge in the ergonomics research. Recently available wearable electroencephalography (EEG) opens new opportunities for objective and continuous evaluation of operators' attention, which may provide a new paradigm in ergonomics. In this study, wearable EEG was recorded during simulated assembly operation, with the aim to analyse P300 event-related potential component, which provides reliable information on attention processing. In parallel, reaction times (RTs) were recorded and the correlation between these two attention-related modalities was investigated. Negative correlation between P300 amplitudes and RTs has been observed on the group level (p < .001). However, on the individual level, the obtained correlations were not consistent. As a result, we propose the P300 amplitude for accurate attention monitoring in ergonomics research. On the other hand, no significant correlation between RTs and P300 latency was found on group, neither on individual level. Practitioner Summary: Ergonomic studies of assembly operations mainly investigated physical aspects, while mental states of the assemblers were not sufficiently addressed. Presented study aims at attention tracking, using realistic workplace replica. It is shown that drops in attention could be successfully traced only by direct brainwave observation, using wireless electroencephalographic measurements.

ERP Indicators of Phonological Awareness Development in Children: A Systematic Review.

Phonological awareness is the ability to correctly recognize and manipulate phonological structures. The role of phonological awareness in reading development has become evident in behavioral research showing that it is inherently tied to measures of phonological processing and reading ability. This has also been shown with ERP research that examined how phonological processing training can benefit reading skills. However, there have not been many attempts to systematically review how phonological awareness itself is developed neurocognitively. In the present review, we screened 224 papers and systematically reviewed 40 papers that have explored phonological awareness and phonological processing using ERP methodology with both typically developing and children with reading problems. This review highlights ERP components that can be used as neurocognitive predictors of early developmental dyslexia and reading disorders in young children. Additionally, we have presented how phonological processing is developed neurocognitively throughout childhood, as well as which phonological tasks can be used to predict the development of phonological awareness prior to developing reading skills. Neurocognitive measures of early phonological processing can serve as supplemental diagnostic sources to behavioral measures of reading abilities because they show different aspects of phonological sensitivity when compared to behavioral measures.

Accessible Dyslexia Detection with Real-Time Reading Feedback through Robust Interpretable Eye-Tracking Features.

Developing reliable, quantifiable, and accessible metrics for dyslexia diagnosis and tracking represents an important goal, considering the widespread nature of dyslexia and its negative impact on education and quality of life. In this study, we observe eye-tracking data from 15 dyslexic and 15 neurotypical Serbian school-age children who read text segments presented on different color configurations. Two new eye-tracking features were introduced that quantify the amount of spatial complexity of the subject's gaze through time and inherently provide information regarding the locations in the text in which the subject struggled the most. The features were extracted from the raw eye-tracking data (x, y coordinates), from the original data gathered at 60 Hz, and from the downsampled data at 30 Hz, examining the compatibility of features with low-cost or custom-made eye-trackers. The features were used as inputs to machine learning algorithms, and the best-obtained accuracy was 88.9% for 60 Hz and 87.8% for 30 Hz. The features were also used to analyze the influence of background/overlay color on the quality of reading, and it was shown that the introduced features separate the dyslexic and control groups regardless of the background/overlay color. The colors can, however, influence each subject differently, which implies that an individualistic approach would be necessary to obtain the best therapeutic results. The performed study shows promise in dyslexia detection and evaluation, as the proposed features can be implemented in real time as feedback during reading and show effectiveness at detecting dyslexia with data obtained using a lower sampling rate.

The Influence of Unlimited Sucrose Intake on Body Weight and Behavior-Findings from a Mouse Model.

A potential relationship between unrestricted sucrose intake (USI), overweight, and emotional/behavioral control has not been well documented. We examined the influence of USI and having less sweetness than expected on body weight (BW), motor/exploratory, anxiety-like, and social dominant behavior in adult C57BL/6J male mice. Animals had free access to water (group 1) or 32% sucrose and water (sucrose groups 2-5) for 10 days. Then, group 2 remained with 32% sucrose while groups 3-5 were subjected to the downshift (24 h access to 4%, 8%, or 16% sucrose). All experimental groups were weighed and tested in the novel-open arena (NA), elevated plus maze (EPM), and tube tests to assess BW, motor/exploratory, anxiety-like, and social dominance behavior, respectively. USI did not influence animals' BW but produced hyperactivity and anxiolytic-like behavior, which was evident in EPM but not in NA; the outcomes of the downshift were comparable. USI did not influence successes/wins in the tube test but altered emotions that drive the winning, favoring a less anxious behavioral phenotype; this was not evident in the downshifted groups. Observed findings suggest that USI promotes sensation-seeking and motivates dominance, without changing BW, while blunted emotional base of social dominance might be an early mark of the downshift.

The effect of colour on reading performance in children, measured by a sensor hub: From the perspective of gender.

In recent decades reported findings regarding gender differences in reading achievement, cognitive abilities and maturation process in boys and girls are conflicting. As reading is one of the most important processes in the maturation of an individual, the aim of the study was to better understand gender differences between primary school students. The study evaluates differences in Heart Rate Variability (HRV), Electroencephalography (EEG), Electrodermal Activities (EDA) and eye movement of participants during the reading task. Taking into account that colour may affect reading skills, in that it affects the emotional and physiological state of the body, the research attempts to provide a better understanding of gender differences in reading through examining the effect of colour, as applied to reading content. The physiological responses of 50 children (25 boys and 25 girls) to 12 different background and overlay colours of reading content were measured and summarised during the reading process. Our findings show that boys have shorter reading duration scores and a longer Saccade Count, Saccade Duration Total, and Saccade Duration Average when reading on a coloured background, especially purple, which could be caused by their motivation and by the type of reading task. Also, the boys had higher values for the Delta band and the Whole Range of EEG measurements in comparison to the girls when reading on coloured backgrounds, which could reflect the faster maturation of the girls. Regarding EDA measurements we did not find systematic differences between groups either on white or on coloured/overlay background. We found the most significant differences arose in the HRV parameters, namely (SDNN (ms), STD HR (beats/min), RMSSD (ms), NN50 (beats), pNN50 (%), CVRR) when children read the text on coloured/overlay backgrounds, where the girls showed systematically higher values on HRV measurements in comparison to the boys, mostly with yellow, red, and orange overlay colours.

The Relation between Physiological Parameters and Colour Modifications in Text Background and Overlay during Reading in Children with and without Dyslexia.

Reading is one of the essential processes during the maturation of an individual. It is estimated that 5-10% of school-age children are affected by dyslexia, the reading disorder characterised by difficulties in the accuracy or fluency of word recognition. There are many studies which have reported that coloured overlays and background could improve the reading process, especially in children with reading disorders. As dyslexia has neurobiological origins, the aim of the present research was to understand the relationship between physiological parameters and colour modifications in the text and background during reading in children with and without dyslexia. We have measured differences in electroencephalography (EEG), heart rate variability (HRV), electrodermal activities (EDA) and eye movements of the 36 school-age (from 8 to 12 years old) children (18 with dyslexia and 18 of control group) during the reading task in 13 combinations of background and overlay colours. Our findings showed that the dyslexic children have longer reading duration, fixation count, fixation duration average, fixation duration total, and longer saccade count, saccade duration total, and saccade duration average while reading on white and coloured background/overlay. It was found that the turquoise background, turquoise overlay, and yellow background colours are beneficial for dyslexic readers, as they achieved the shortest time duration of the reading tasks when these colours were used. Additionally, dyslexic children have higher values of beta (15-40 Hz) and the broadband EEG (0.5-40 Hz) power while reading in one particular colour (purple), as well as increasing theta range power while reading with the purple overlay. We have observed no significant differences between HRV parameters on white colour, except for single colours (purple, turquoise overlay, and yellow overlay) where the control group showed higher values for mean HR, while dyslexic children scored higher with mean RR. Regarding EDA measure, we found systematically lower values in children with dyslexia in comparison to the control group. Based on the present results, we can conclude that both pastel and intense background/overlays are beneficial for reading of both groups and all sensor modalities could be used to better understand the neurophysiological origins in dyslexic children.

Conceptual relation preference: A matter of strategy or one of salience?

In order to determine whether preference in object matching tasks measures participants' strategy or tells us something about the salience of relations between corresponding concepts, we conducted three experiments. In Experiment 1 and Experiment 2, we approached this question by measuring the ease with which adult participants process different relations when they are under strategic instruction. When asked to group objects based on thematic or taxonomic relatedness, participants were slower (Experiment 2) and tended to make more errors (Experiment 1-2) when they had to find a taxonomically related pair than when they searched for a thematically related one. In Experiment 3, participants performed a standard matching task and their eye-movements were monitored throughout. In addition to the strong thematic preference in participants' choices, we measured longer fixations to thematically related objects than taxonomic competitors. Even though thematic and taxonomic information appear to compete for selection in early phases of observation, thematic conceptual relations appear to be more salient and preferred, independently of instruction.

Correction: Comparing the temporal dynamics of thematic and taxonomic processing using event-related potentials.

[This corrects the article DOI: 10.1371/journal.pone.0189362.].

Comparing the temporal dynamics of thematic and taxonomic processing using event-related potentials.

We report the results of a study comparing the temporal dynamics of thematic and taxonomic knowledge activation in a picture-word priming paradigm using event-related potentials. Although we found no behavioral differences between thematic and taxonomic processing, ERP data revealed distinct patterns of N400 and P600 amplitude modulation for thematic and taxonomic priming. Thematically related target stimuli elicited less negativity than taxonomic targets between 280-460 ms after stimulus onset, suggesting easier semantic processing of thematic than taxonomic relationships. Moreover, P600 mean amplitude was significantly increased for taxonomic targets between 520-600 ms, consistent with a greater need for stimulus reevaluation in that condition. These results offer novel evidence in favor of a dissociation between thematic and taxonomic thinking in the early phases of conceptual evaluation.

To call a cloud 'cirrus': sound symbolism in names for categories or items.

The aim of the present paper is to experimentally test whether sound symbolism has selective effects on labels with different ranges-of-reference within a simple noun-hierarchy. In two experiments, adult participants learned the make up of two categories of unfamiliar objects ('alien life forms'), and were passively exposed to either category-labels or item-labels, in a learning-by-guessing categorization task. Following category training, participants were tested on their visual discrimination of object pairs. For different groups of participants, the labels were either congruent or incongruent with the objects. In Experiment 1, when trained on items with individual labels, participants were worse (made more errors) at detecting visual object mismatches when trained labels were incongruent. In Experiment 2, when participants were trained on items in labelled categories, participants were faster at detecting a match if the trained labels were congruent, and faster at detecting a mismatch if the trained labels were incongruent. This pattern of results suggests that sound symbolism in category labels facilitates later similarity judgments when congruent, and discrimination when incongruent, whereas for item labels incongruence generates error in judgements of visual object differences. These findings reveal that sound symbolic congruence has a different outcome at different levels of labelling within a noun hierarchy. These effects emerged in the absence of the label itself, indicating subtle but pervasive effects on visual object processing.

Benefits of Instructed Responding in Manual Assembly Tasks: An ERP Approach.

The majority of neuroergonomics studies are focused mainly on investigating the interaction between operators and automated systems. Far less attention has been dedicated to the investigation of brain processes in more traditional workplaces, such as manual assembly, which are still ubiquitous in industry. The present study investigates whether assembly workers' attention can be enhanced if they are instructed with which hand to initiate the assembly operation, as opposed to the case when they can commence the operation with whichever hand they prefer. For this aim, we replicated a specific workplace, where 17 participants in the study simulated a manual assembly operation of the rubber hoses that are used in vehicle hydraulic brake systems, while wearing wireless electroencephalography (EEG). The specific EEG feature of interest for this study was the P300 components' amplitude of the event-related potential (ERP), as it has previously been shown that it is positively related to human attention. The behavioral attention-related modality of reaction times (RTs) was also recorded. Participants were presented with two distinct tasks during the simulated operation, which were counterbalanced across participants. In the first task, digits were used as indicators for the operation initiation (Numbers task), where participants could freely choose with which hand they would commence the action upon seeing the digit. In the second task, participants were presented with arrows, which served as instructed operation initiators (Arrows task), and they were instructed to start each operation with the hand that corresponded to the arrow direction. The results of this study showed that the P300 amplitude was significantly higher in the instructed condition. Interestingly, the RTs did not differ across any task conditions. This, together with the other findings of this study, suggests that attention levels can be increased using instructed responses without compromising work performance or operators' well-being, paving the way for future applications in manual assembly task design.

Balloons and bavoons versus spikes and shikes: ERPs reveal shared neural processes for shape-sound-meaning congruence in words, and shape-sound congruence in pseudowords.

There is something about the sound of a pseudoword like takete that goes better with a spiky, than a curvy shape (Köhler, 1929:1947). Yet despite decades of research into sound symbolism, the role of this effect on real words in the lexicons of natural languages remains controversial. We report one behavioural and one ERP study investigating whether sound symbolism is active during normal language processing for real words in a speaker's native language, in the same way as for novel word forms. The results indicate that sound-symbolic congruence has a number of influences on natural language processing: Written forms presented in a congruent visual context generate more errors during lexical access, as well as a chain of differences in the ERP. These effects have a very early onset (40-80 ms, 100-160 ms, 280-320 ms) and are later overshadowed by familiar types of semantic processing, indicating that sound symbolism represents an early sensory-co-activation effect.