Open Science 2.0: Towards a truly collaborative research ecosystem.

Conversations about open science have reached the mainstream, yet many open science practices such as data sharing remain uncommon. Our efforts towards openness therefore need to increase in scale and aim for a more ambitious target. We need an ecosystem not only where research outputs are openly shared but also in which transparency permeates the research process from the start and lends itself to more rigorous and collaborative research. To support this vision, this Essay provides an overview of a selection of open science initiatives from the past 2 decades, focusing on methods transparency, scholarly communication, team science, and research culture, and speculates about what the future of open science could look like. It then draws on these examples to provide recommendations for how funders, institutions, journals, regulators, and other stakeholders can create an environment that is ripe for improvement.

Reducing bias in secondary data analysis via an Explore and Confirm Analysis Workflow (ECAW): a proposal and survey of observational researchers.

Background. Although preregistration can reduce researcher bias and increase transparency in primary research settings, it is less applicable to secondary data analysis. An alternative method that affords additional protection from researcher bias, which cannot be gained from conventional forms of preregistration alone, is an Explore and Confirm Analysis Workflow (ECAW). In this workflow, a data management organization initially provides access to only a subset of their dataset to researchers who request it. The researchers then prepare an analysis script based on the subset of data, upload the analysis script to a registry, and then receive access to the full dataset. ECAWs aim to achieve similar goals to preregistration, but make access to the full dataset contingent on compliance. The present survey aimed to garner information from the research community where ECAWs could be applied-employing the Avon Longitudinal Study of Parents and Children (ALSPAC) as a case example. Methods. We emailed a Web-based survey to researchers who had previously applied for access to ALSPAC's transgenerational observational dataset. Results. We received 103 responses, for a 9% response rate. The results suggest that-at least among our sample of respondents-ECAWs hold the potential to serve their intended purpose and appear relatively acceptable. For example, only 10% of respondents disagreed that ALSPAC should run a study on ECAWs (versus 55% who agreed). However, as many as 26% of respondents agreed that they would be less willing to use ALSPAC data if they were required to use an ECAW (versus 45% who disagreed). Conclusion. Our data and findings provide information for organizations and individuals interested in implementing ECAWs and related interventions. Preregistration. https://osf.io/g2fw5 Deviations from the preregistration are outlined in electronic supplementary material A.

Corrigendum: The Potential of Functional Near-Infrared Spectroscopy-Based Neurofeedback-A Systematic Review and Recommendations for Best Practice.

[This corrects the article DOI: 10.3389/fnins.2020.00594.].

Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice.

Journals exert considerable control over letters, commentaries and online comments that criticize prior research (post-publication critique). We assessed policies (Study One) and practice (Study Two) related to post-publication critique at 15 top-ranked journals in each of 22 scientific disciplines (N = 330 journals). Two-hundred and seven (63%) journals accepted post-publication critique and often imposed limits on length (median 1000, interquartile range (IQR) 500-1200 words) and time-to-submit (median 12, IQR 4-26 weeks). The most restrictive limits were 175 words and two weeks; some policies imposed no limits. Of 2066 randomly sampled research articles published in 2018 by journals accepting post-publication critique, 39 (1.9%, 95% confidence interval [1.4, 2.6]) were linked to at least one post-publication critique (there were 58 post-publication critiques in total). Of the 58 post-publication critiques, 44 received an author reply, of which 41 asserted that original conclusions were unchanged. Clinical Medicine had the most active culture of post-publication critique: all journals accepted post-publication critique and published the most post-publication critique overall, but also imposed the strictest limits on length (median 400, IQR 400-550 words) and time-to-submit (median 4, IQR 4-6 weeks). Our findings suggest that top-ranked academic journals often pose serious barriers to the cultivation, documentation and dissemination of post-publication critique.

Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014-2017).

Psychologists are navigating an unprecedented period of introspection about the credibility and utility of their discipline. Reform initiatives emphasize the benefits of transparency and reproducibility-related research practices; however, adoption across the psychology literature is unknown. Estimating the prevalence of such practices will help to gauge the collective impact of reform initiatives, track progress over time, and calibrate future efforts. To this end, we manually examined a random sample of 250 psychology articles published between 2014 and 2017. Over half of the articles were publicly available (154/237, 65%, 95% confidence interval [CI] = [59%, 71%]); however, sharing of research materials (26/183; 14%, 95% CI = [10%, 19%]), study protocols (0/188; 0%, 95% CI = [0%, 1%]), raw data (4/188; 2%, 95% CI = [1%, 4%]), and analysis scripts (1/188; 1%, 95% CI = [0%, 1%]) was rare. Preregistration was also uncommon (5/188; 3%, 95% CI = [1%, 5%]). Many articles included a funding disclosure statement (142/228; 62%, 95% CI = [56%, 69%]), but conflict-of-interest statements were less common (88/228; 39%, 95% CI = [32%, 45%]). Replication studies were rare (10/188; 5%, 95% CI = [3%, 8%]), and few studies were included in systematic reviews (21/183; 11%, 95% CI = [8%, 16%]) or meta-analyses (12/183; 7%, 95% CI = [4%, 10%]). Overall, the results suggest that transparency and reproducibility-related research practices were far from routine. These findings establish baseline prevalence estimates against which future progress toward increasing the credibility and utility of psychology research can be compared.

The Potential of Functional Near-Infrared Spectroscopy-Based Neurofeedback-A Systematic Review and Recommendations for Best Practice.

Background: The effects of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI)-neurofeedback on brain activation and behaviors have been studied extensively in the past. More recently, researchers have begun to investigate the effects of functional near-infrared spectroscopy-based neurofeedback (fNIRS-neurofeedback). FNIRS is a functional neuroimaging technique based on brain hemodynamics, which is easy to use, portable, inexpensive, and has reduced sensitivity to movement artifacts. Method: We provide the first systematic review and database of fNIRS-neurofeedback studies, synthesizing findings from 22 peer-reviewed studies (including a total of N = 441 participants; 337 healthy, 104 patients). We (1) give a comprehensive overview of how fNIRS-neurofeedback training protocols were implemented, (2) review the online signal-processing methods used, (3) evaluate the quality of studies using pre-set methodological and reporting quality criteria and also present statistical sensitivity/power analyses, (4) investigate the effectiveness of fNIRS-neurofeedback in modulating brain activation, and (5) review its effectiveness in changing behavior in healthy and pathological populations. Results and discussion: (1-2) Published studies are heterogeneous (e.g., neurofeedback targets, investigated populations, applied training protocols, and methods). (3) Large randomized controlled trials are still lacking. In view of the novelty of the field, the quality of the published studies is moderate. We identified room for improvement in reporting important information and statistical power to detect realistic effects. (4) Several studies show that people can regulate hemodynamic signals from cortical brain regions with fNIRS-neurofeedback and (5) these studies indicate the feasibility of modulating motor control and prefrontal brain functioning in healthy participants and ameliorating symptoms in clinical populations (stroke, ADHD, autism, and social anxiety). However, valid conclusions about specificity or potential clinical utility are premature. Conclusion: Due to the advantages of practicability and relatively low cost, fNIRS-neurofeedback might provide a suitable and powerful alternative to EEG and fMRI neurofeedback and has great potential for clinical translation of neurofeedback. Together with more rigorous research and reporting practices, further methodological improvements may lead to a more solid understanding of fNIRS-neurofeedback. Future research will benefit from exploiting the advantages of fNIRS, which offers unique opportunities for neurofeedback research.

A consensus framework for neurofeedback research (and the perils of unfounded neuroreductionism): Reply to Micoulaud-Franchi and Fovet (2018).

We were pleased to read the constructive commentary (Micoulaud-Franchi & Fovet, 2018) on our original piece (Thibault & Raz, 2017). In this response, we build on the theoretical framework for studying neurofeedback that the commentators sketch out while pointing out potential caveats to adopting a neuroreductionist approach. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Treating ADHD With Suggestion: Neurofeedback and Placebo Therapeutics.

OBJECTIVE: We propose that clinicians can use suggestion to help treat conditions such as ADHD. METHODS: We use EEG neurofeedback as a case study, alongside evidence from a recent pilot experiment utilizing a sham MRI scanner to highlight the therapeutic potential of suggestion-based treatments. RESULTS: The medical literature demonstrates that many practitioners already prescribe treatments that hardly outperform placebo comparators. Moreover, the sham MRI experiment showed that, even with full disclosure of the procedure, suggestion alone can reduce the symptomatology of ADHD. CONCLUSION: Non-deceptive suggestion-based treatments, especially those drawing on accessories from neuroscience, may offer a safe complement and potential alternative to current standard of care for individuals with ADHD.

Neurofeedback with fMRI: A critical systematic review.

Neurofeedback relying on functional magnetic resonance imaging (fMRI-nf) heralds new prospects for self-regulating brain and behavior. Here we provide the first comprehensive review of the fMRI-nf literature and the first systematic database of fMRI-nf findings. We synthesize information from 99 fMRI-nf experiments-the bulk of currently available data. The vast majority of fMRI-nf findings suggest that self-regulation of specific brain signatures seems viable; however, replication of concomitant behavioral outcomes remains sparse. To disentangle placebo influences and establish the specific effects of neurofeedback, we highlight the need for double-blind placebo-controlled studies alongside rigorous and standardized statistical analyses. Before fMRI-nf can join the clinical armamentarium, research must first confirm the sustainability, transferability, and feasibility of fMRI-nf in patients as well as in healthy individuals. Whereas modulating specific brain activity promises to mold cognition, emotion, thought, and action, reducing complex mental health issues to circumscribed brain regions may represent a tenuous goal. We can certainly change brain activity with fMRI-nf. However, it remains unclear whether such changes translate into meaningful behavioral improvements in the clinical domain.

The psychology of neurofeedback: Clinical intervention even if applied placebo.

Advocates of neurofeedback make bold claims concerning brain regulation, treatment of disorders, and mental health. Decades of research and thousands of peer-reviewed publications support neurofeedback using electroencephalography (EEG-nf); yet, few experiments isolate the act of receiving feedback from a specific brain signal as a necessary precursor to obtain the purported benefits. Moreover, while psychosocial parameters including participant motivation and expectation, rather than neurobiological substrates, seem to fuel clinical improvement across a wide range of disorders, for-profit clinics continue to sprout across North America and Europe. Here, we highlight the tenuous evidence supporting EEG-nf and sketch out the weaknesses of this approach. We challenge classic arguments often articulated by proponents of EEG-nf and underscore how psychologists and mental health professionals stand to benefit from studying the ubiquitous placebo influences that likely drive these treatment outcomes. (PsycINFO Database Record

Source Localization of Brain States Associated with Canonical Neuroimaging Postures.

Cognitive neuroscientists rarely consider the influence that body position exerts on brain activity; yet, postural variation holds important implications for the acquisition and interpretation of neuroimaging data. Whereas participants in most behavioral and EEG experiments sit upright, many prominent brain imaging techniques (e.g., fMRI) require participants to lie supine. Here we demonstrate that physical comportment profoundly alters baseline brain activity as measured by magnetoencephalography (MEG)-an imaging modality that permits multipostural acquisition. We collected resting-state MEG data from 12 healthy participants in three postures (lying supine, reclining at 45°, and sitting upright). Source-modeling analysis revealed a broadly distributed influence of posture on resting brain function. Sitting upright versus lying supine was associated with greater high-frequency (i.e., beta and gamma) activity in widespread parieto-occipital cortex. Moreover, sitting upright and reclining postures correlated with dampened activity in prefrontal regions across a range of bandwidths (i.e., from alpha to low gamma). The observed effects were large, with a mean Cohen's d of 0.95 ( SD = 0.23). In addition to neural activity, physiological parameters such as muscle tension and eye blinks may have contributed to these posture-dependent changes in brain signal. Regardless of the underlying mechanisms, however, the present results have important implications for the acquisition and interpretation of multimodal imaging data (e.g., studies combining fMRI or PET with EEG or MEG). More broadly, our findings indicate that generalizing results-from supine neuroimaging measurements to erect positions typical of ecological human behavior-would call for considering the influence that posture wields on brain dynamics.

Corrigendum: Imaging Posture Veils Neural Signals.

[This corrects the article on p. 520 in vol. 10, PMID: 27818629.].

Imaging Posture Veils Neural Signals.

Whereas modern brain imaging often demands holding body positions incongruent with everyday life, posture governs both neural activity and cognitive performance. Humans commonly perform while upright; yet, many neuroimaging methodologies require participants to remain motionless and adhere to non-ecological comportments within a confined space. This inconsistency between ecological postures and imaging constraints undermines the transferability and generalizability of many a neuroimaging assay. Here we highlight the influence of posture on brain function and behavior. Specifically, we challenge the tacit assumption that brain processes and cognitive performance are comparable across a spectrum of positions. We provide an integrative synthesis regarding the increasingly prominent influence of imaging postures on autonomic function, mental capacity, sensory thresholds, and neural activity. Arguing that neuroimagers and cognitive scientists could benefit from considering the influence posture wields on both general functioning and brain activity, we examine existing imaging technologies and the potential of portable and versatile imaging devices (e.g., functional near infrared spectroscopy). Finally, we discuss ways that accounting for posture may help unveil the complex brain processes of everyday cognition.