Promoting research quality.

Plenty of awards recognize scientific contributions, but a unique and important one honors those whose efforts significantly enhance the quality and robustness of research. We discuss why this is important to promote trust in science.

Community consensus on core open science practices to monitor in biomedicine.

The state of open science needs to be monitored to track changes over time and identify areas to create interventions to drive improvements. In order to monitor open science practices, they first need to be well defined and operationalized. To reach consensus on what open science practices to monitor at biomedical research institutions, we conducted a modified 3-round Delphi study. Participants were research administrators, researchers, specialists in dedicated open science roles, and librarians. In rounds 1 and 2, participants completed an online survey evaluating a set of potential open science practices, and for round 3, we hosted two half-day virtual meetings to discuss and vote on items that had not reached consensus. Ultimately, participants reached consensus on 19 open science practices. This core set of open science practices will form the foundation for institutional dashboards and may also be of value for the development of policy, education, and interventions.

Incorporating equity, diversity, and inclusiveness into the Hong Kong Principles.

In this response to Labib and Evans, authors of the Hong Kong Principles look forward to collaborating with those from the broad research integrity community to ensure that issues of equity, diversity and inclusion will become part of the ecosystem of research integrity.

#IchbinHannah and the fight for permanent jobs for postdocs: How a fictitious postdoc (almost) triggered a fundamental reform of German academia: How a fictitious postdoc (almost) triggered a fundamental reform of German academia.

Regarding postdocs as disposable labour with limited contracts is damaging for science. Universities need to offer them better career perspectives.

Introducing quality measures in an academic research consortium: Lessons and recommendation from implementing an ad hoc quality management system for organ model research: Lessons and recommendation from implementing an ad hoc quality management system for organ model research.

Lessons from implementing quality control systems in an academic research consortium to improve Good Scientific Practice and reproducibility.

The spinal cord injury-induced immune deficiency syndrome: results of the SCIentinel study.

Infections are prevalent after spinal cord injury (SCI), constitute the main cause of death and are a rehabilitation confounder associated with impaired recovery. We hypothesize that SCI causes an acquired lesion-dependent (neurogenic) immune suppression as an underlying mechanism to facilitate infections. The international prospective multicentre cohort study (SCIentinel; protocol registration DRKS00000122; n = 111 patients) was designed to distinguish neurogenic from general trauma-related effects on the immune system. Therefore, SCI patient groups differing by neurological level, i.e. high SCI [thoracic (Th)4 or higher]; low SCI (Th5 or lower) and severity (complete SCI; incomplete SCI), were compared with a reference group of vertebral fracture (VF) patients without SCI. The primary outcome was quantitative monocytic Human Leukocyte Antigen-DR expression (mHLA-DR, synonym MHC II), a validated marker for immune suppression in critically ill patients associated with infection susceptibility. mHLA-DR was assessed from Day 1 to 10 weeks after injury by applying standardized flow cytometry procedures. Secondary outcomes were leucocyte subpopulation counts, serum immunoglobulin levels and clinically defined infections. Linear mixed models with multiple imputation were applied to evaluate group differences of logarithmic-transformed parameters. Mean quantitative mHLA-DR [ln (antibodies/cell)] levels at the primary end point 84 h after injury indicated an immune suppressive state below the normative values of 9.62 in all groups, which further differed in its dimension by neurological level: high SCI [8.95 (98.3% confidence interval, CI: 8.63; 9.26), n = 41], low SCI [9.05 (98.3% CI: 8.73; 9.36), n = 29], and VF without SCI [9.25 (98.3% CI: 8.97; 9.53), n = 41, P = 0.003]. Post hoc analysis accounting for SCI severity revealed the strongest mHLA-DR decrease [8.79 (95% CI: 8.50; 9.08)] in the complete, high SCI group, further demonstrating delayed mHLA-DR recovery [9.08 (95% CI: 8.82; 9.38)] and showing a difference from the VF controls of -0.43 (95% CI: -0.66; -0.20) at 14 days. Complete, high SCI patients also revealed constantly lower serum immunoglobulin G [-0.27 (95% CI: -0.45; -0.10)] and immunoglobulin A [-0.25 (95% CI: -0.49; -0.01)] levels [ln (g/l × 1000)] up to 10 weeks after injury. Low mHLA-DR levels in the range of borderline immunoparalysis (below 9.21) were positively associated with the occurrence and earlier onset of infections, which is consistent with results from studies on stroke or major surgery. Spinal cord injured patients can acquire a secondary, neurogenic immune deficiency syndrome characterized by reduced mHLA-DR expression and relative hypogammaglobulinaemia (combined cellular and humoral immune deficiency). mHLA-DR expression provides a basis to stratify infection-risk in patients with SCI.

Prediction of Stroke Outcome in Mice Based on Noninvasive MRI and Behavioral Testing.

BACKGROUND: Prediction of poststroke outcome using the degree of subacute deficit or magnetic resonance imaging is well studied in humans. While mice are the most commonly used animals in preclinical stroke research, systematic analysis of outcome predictors is lacking. METHODS: We intended to incorporate heterogeneity into our retrospective study to broaden the applicability of our findings and prediction tools. We therefore analyzed the effect of 30, 45, and 60 minutes of arterial occlusion on the variance of stroke volumes. Next, we built a heterogeneous cohort of 215 mice using data from 15 studies that included 45 minutes of middle cerebral artery occlusion and various genotypes. Motor function was measured using a modified protocol for the staircase test of skilled reaching. Phases of subacute and residual deficit were defined. Magnetic resonance images of stroke lesions were coregistered on the Allen Mouse Brain Atlas to characterize stroke topology. Different random forest prediction models that either used motor-functional deficit or imaging parameters were generated for the subacute and residual deficits. RESULTS: Variance of stroke volumes was increased by 45 minutes of arterial occlusion compared with 60 minutes. The inclusion of various genotypes enhanced heterogeneity further. We detected both a subacute and residual motor-functional deficit after stroke in mice and different recovery trajectories could be observed. In mice with small cortical lesions, lesion volume was the best predictor of the subacute deficit. The residual deficit could be predicted most accurately by the degree of the subacute deficit. When using imaging parameters for the prediction of the residual deficit, including information about the lesion topology increased prediction accuracy. A subset of anatomic regions within the ischemic lesion had particular impact on the prediction of long-term outcomes. Prediction accuracy depended on the degree of functional impairment. CONCLUSIONS: For the first time, we developed and validated a robust tool for the prediction of functional outcomes after experimental stroke in mice using a large and genetically heterogeneous cohort. These results are discussed in light of study design and imaging limitations. In the future, using outcome prediction can improve the design of preclinical studies and guide intervention decisions.

Preregistration of exploratory research: Learning from the golden age of discovery.

Preregistration of study protocols and, in particular, Registered Reports are novel publishing formats that are currently gaining substantial traction. Besides rating the research question and soundness of methodology over outstanding significance of the results, they can help with antagonizing inadequate statistical power, selective reporting of results, undisclosed analytic flexibility, as well as publication bias. Preregistration works well when a clear hypothesis, primary outcome, and mode of analysis can be formulated. But is it also applicable and useful in discovery research, which develops theories and hypotheses, measurement techniques, and generates evidence that justifies further research? I will argue that only slight modifications are needed to harness the potential of preregistration and make exploratory research more trustworthy and useful.

Improving the trustworthiness, usefulness, and ethics of biomedical research through an innovative and comprehensive institutional initiative.

The reproducibility crisis triggered worldwide initiatives to improve rigor, reproducibility, and transparency in biomedical research. There are many examples of scientists, journals, and funding agencies adopting responsible research practices. The QUEST (Quality-Ethics-Open Science-Translation) Center offers a unique opportunity to examine the role of institutions. The Berlin Institute of Health founded QUEST to increase the likelihood that research conducted at this large academic medical center would be trustworthy, useful for scientists and society, and ethical. QUEST researchers perform "science of science" studies to understand problems with standard practices and develop targeted solutions. The staff work with institutional leadership and local scientists to incentivize and support responsible practices in research, funding, and hiring. Some activities described in this paper focus on the institution, whereas others may benefit the national and international scientific community. Our experience, approaches, and recommendations will be informative for faculty leadership, administrators, and researchers interested in improving scientific practice.

The Hong Kong Principles for assessing researchers: Fostering research integrity.

For knowledge to benefit research and society, it must be trustworthy. Trustworthy research is robust, rigorous, and transparent at all stages of design, execution, and reporting. Assessment of researchers still rarely includes considerations related to trustworthiness, rigor, and transparency. We have developed the Hong Kong Principles (HKPs) as part of the 6th World Conference on Research Integrity with a specific focus on the need to drive research improvement through ensuring that researchers are explicitly recognized and rewarded for behaviors that strengthen research integrity. We present five principles: responsible research practices; transparent reporting; open science (open research); valuing a diversity of types of research; and recognizing all contributions to research and scholarly activity. For each principle, we provide a rationale for its inclusion and provide examples where these principles are already being adopted.

The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the "ARRIVE Essential 10," which constitutes the minimum requirement, and the "Recommended Set," which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration (E&E) document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0.

Improving the reproducibility of biomedical research is a major challenge. Transparent and accurate reporting is vital to this process; it allows readers to assess the reliability of the findings and repeat or build upon the work of other researchers. The ARRIVE guidelines (Animal Research: Reporting In Vivo Experiments) were developed in 2010 to help authors and journals identify the minimum information necessary to report in publications describing in vivo experiments. Despite widespread endorsement by the scientific community, the impact of ARRIVE on the transparency of reporting in animal research publications has been limited. We have revised the ARRIVE guidelines to update them and facilitate their use in practice. The revised guidelines are published alongside this paper. This explanation and elaboration document was developed as part of the revision. It provides further information about each of the 21 items in ARRIVE 2.0, including the rationale and supporting evidence for their inclusion in the guidelines, elaboration of details to report, and examples of good reporting from the published literature. This document also covers advice and best practice in the design and conduct of animal studies to support researchers in improving standards from the start of the experimental design process through to publication.

Long-Term Connectome Analysis Reveals Reshaping of Visual, Spatial Networks in a Model With Vascular Dementia Features.

BACKGROUND: Connectome analysis of neuroimaging data is a rapidly expanding field that offers the potential to diagnose, characterize, and predict neurological disease. Animal models provide insight into biological mechanisms that underpin disease, but connectivity approaches are currently lagging in the rodent. METHODS: We present a pipeline adapted for structural and functional connectivity analysis of the mouse brain, and we tested it in a mouse model of vascular dementia. RESULTS: We observed lacunar infarctions, microbleeds, and progressive white matter change across 6 months. For the first time, we report that default mode network activity is disrupted in the mouse model. We also identified specific functional circuitry that was vulnerable to vascular stress, including perturbations in a sensorimotor, visual resting state network that were accompanied by deficits in visual and spatial memory tasks. CONCLUSIONS: These findings advance our understanding of the mouse connectome and provide insight into how it can be altered by vascular insufficiency.

Exact replication: Foundation of science or game of chance?

The need for replication of initial results has been rediscovered only recently in many fields of research. In preclinical biomedical research, it is common practice to conduct exact replications with the same sample sizes as those used in the initial experiments. Such replication attempts, however, have lower probability of replication than is generally appreciated. Indeed, in the common scenario of an effect just reaching statistical significance, the statistical power of the replication experiment assuming the same effect size is approximately 50%-in essence, a coin toss. Accordingly, we use the provocative analogy of "replicating" a neuroprotective drug animal study with a coin flip to highlight the need for larger sample sizes in replication experiments. Additionally, we provide detailed background for the probability of obtaining a significant p value in a replication experiment and discuss the variability of p values as well as pitfalls of simple binary significance testing in both initial preclinical experiments and replication studies with small sample sizes. We conclude that power analysis for determining the sample size for a replication study is obligatory within the currently dominant hypothesis testing framework. Moreover, publications should include effect size point estimates and corresponding measures of precision, e.g., confidence intervals, to allow readers to assess the magnitude and direction of reported effects and to potentially combine the results of initial and replication study later through Bayesian or meta-analytic approaches.

The bench is closer to the bedside than we think: Uncovering the ethical ties between preclinical researchers in translational neuroscience and patients in clinical trials.

Millions of people worldwide currently suffer from serious neurological diseases and injuries for which there are few, and often no, effective treatments. The paucity of effective interventions is, no doubt, due in large part to the complexity of the disorders, as well as our currently limited understanding of their pathophysiology. The bleak picture for patients, however, is also attributable to avoidable impediments stemming from quality concerns in preclinical research that often escape detection by research regulation efforts. In our essay, we connect the dots between these concerns about the quality of preclinical research and their potential ethical impact on the patients who volunteer for early trials of interventions informed by it. We do so in hopes that a greater appreciation among preclinical researchers of these serious ethical consequences can lead to a greater commitment within the research community to adopt widely available tools and measures that can help to improve the quality of research.

The ARRIVE guidelines 2.0: updated guidelines for reporting animal research.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the 'ARRIVE Essential 10,' which constitutes the minimum requirement, and the 'Recommended Set,' which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

SorCS2 facilitates release of endostatin from astrocytes and controls post-stroke angiogenesis.

SorCS2 is an intracellular sorting receptor of the VPS10P domain receptor gene family recently implicated in oxidative stress response. Here, we interrogated the relevance of stress-related activities of SorCS2 in the brain by exploring its role in ischemic stroke in mouse models and in patients. Although primarily seen in neurons in the healthy brain, expression of SorCS2 was massively induced in astrocytes surrounding the ischemic core in mice following stroke. Post-stroke induction was likely a result of increased levels of transforming growth factor ß1 in damaged brain tissue, inducing Sorcs2 gene transcription in astrocytes but not neurons. Induced astrocytic expression of SorCS2 was also seen in stroke patients, substantiating the clinical relevance of this observation. In astrocytes in vitro and in the mouse brain in vivo, SorCS2 specifically controlled release of endostatin, a factor linked to post-stroke angiogenesis. The ability of astrocytes to release endostatin acutely after stroke was lost in mice deficient for SorCS2, resulting in a blunted endostatin response which coincided with impaired vascularization of the ischemic brain. Our findings identified activated astrocytes as a source for endostatin in modulation of post-stroke angiogenesis, and the importance of the sorting receptor SorCS2 in this brain stress response.

Human gestational N-methyl-d-aspartate receptor autoantibodies impair neonatal murine brain function.

OBJECTIVE: Maternal autoantibodies are a risk factor for impaired brain development in offspring. Antibodies (ABs) against the NR1 (GluN1) subunit of the N-methyl-d-aspartate receptor (NMDAR) are among the most frequently diagnosed anti-neuronal surface ABs, yet little is known about effects on fetal development during pregnancy. METHODS: We established a murine model of in utero exposure to human recombinant NR1 and isotype-matched nonreactive control ABs. Pregnant C57BL/6J mice were intraperitoneally injected on embryonic days 13 and 17 each with 240µg of human monoclonal ABs. Offspring were investigated for acute and chronic effects on NMDAR function, brain development, and behavior. RESULTS: Transferred NR1 ABs enriched in the fetus and bound to synaptic structures in the fetal brain. Density of NMDAR was considerably reduced (up to -49.2%) and electrophysiological properties were altered, reflected by decreased amplitudes of spontaneous excitatory postsynaptic currents in young neonates (-34.4%). NR1 AB-treated animals displayed increased early postnatal mortality (+27.2%), impaired neurodevelopmental reflexes, altered blood pH, and reduced bodyweight. During adolescence and adulthood, animals showed hyperactivity (+27.8% median activity over 14 days), lower anxiety, and impaired sensorimotor gating. NR1 ABs caused long-lasting neuropathological effects also in aged mice (10 months), such as reduced volumes of cerebellum, midbrain, and brainstem. INTERPRETATION: The data collectively support a model in which asymptomatic mothers can harbor low-level pathogenic human NR1 ABs that are diaplacentally transferred, causing neurotoxic effects on neonatal development. Thus, AB-mediated network changes may represent a potentially treatable neurodevelopmental congenital brain disorder contributing to lifelong neuropsychiatric morbidity in affected children. ANN NEUROL 2019;86:656-670.