High-throughput phenotyping reveals expansive genetic and structural underpinnings of immune variation.

By developing a high-density murine immunophenotyping platform compatible with high-throughput genetic screening, we have established profound contributions of genetics and structure to immune variation (http://www.immunophenotype.org). Specifically, high-throughput phenotyping of 530 unique mouse gene knockouts identified 140 monogenic 'hits', of which most had no previous immunologic association. Furthermore, hits were collectively enriched in genes for which humans show poor tolerance to loss of function. The immunophenotyping platform also exposed dense correlation networks linking immune parameters with each other and with specific physiologic traits. Such linkages limit freedom of movement for individual immune parameters, thereby imposing genetically regulated 'immunologic structures', the integrity of which was associated with immunocompetence. Hence, we provide an expanded genetic resource and structural perspective for understanding and monitoring immune variation in health and disease.

Genome-wide generation and systematic phenotyping of knockout mice reveals new roles for many genes.

Mutations in whole organisms are powerful ways of interrogating gene function in a realistic context. We describe a program, the Sanger Institute Mouse Genetics Project, that provides a step toward the aim of knocking out all genes and screening each line for a broad range of traits. We found that hitherto unpublished genes were as likely to reveal phenotypes as known genes, suggesting that novel genes represent a rich resource for investigating the molecular basis of disease. We found many unexpected phenotypes detected only because we screened for them, emphasizing the value of screening all mutants for a wide range of traits. Haploinsufficiency and pleiotropy were both surprisingly common. Forty-two percent of genes were essential for viability, and these were less likely to have a paralog and more likely to contribute to a protein complex than other genes. Phenotypic data and more than 900 mutants are openly available for further analysis. PAPERCLIP:

Statistical simulations show that scientists need not increase overall sample size by default when including both sexes in in vivo studies.

In recent years, there has been a strong drive to improve the inclusion of animals of both sexes in the design of in vivo research studies, driven by a need to increase sex representation in fundamental biology and drug development. This has resulted in inclusion mandates by funding bodies and journals, alongside numerous published manuscripts highlighting the issue and providing guidance to scientists. However, progress is slow and barriers to the routine use of both sexes remain. A frequent, major concern is the perceived need for a higher overall sample size to achieve an equivalent level of statistical power, which would result in an increased ethical and resource burden. This perception arises from either the belief that sex inclusion will increase variability in the data (either through a baseline difference or a treatment effect that depends on sex), thus reducing the sensitivity of statistical tests, or from misapprehensions about the correct way to analyse the data, including disaggregation or pooling by sex. Here, we conduct an in-depth examination of the consequences of including both sexes on statistical power. We performed simulations by constructing artificial datasets that encompass a range of outcomes that may occur in studies studying a treatment effect in the context of both sexes. This includes both baseline sex differences and situations in which the size of the treatment effect depends on sex in both the same and opposite directions. The data were then analysed using either a factorial analysis approach, which is appropriate for the design, or a t test approach following pooling or disaggregation of the data, which are common but erroneous strategies. The results demonstrate that there is no loss of power to detect treatment effects when splitting the sample size across sexes in most scenarios, providing that the data are analysed using an appropriate factorial analysis method (e.g., two-way ANOVA). In the rare situations where power is lost, the benefit of understanding the role of sex outweighs the power considerations. Additionally, use of the inappropriate analysis pipelines results in a loss of statistical power. Therefore, we recommend analysing data collected from both sexes using factorial analysis and splitting the sample size across male and female mice as a standard strategy.

Reproducibility of animal research in light of biological variation.

Context-dependent biological variation presents a unique challenge to the reproducibility of results in experimental animal research, because organisms' responses to experimental treatments can vary with both genotype and environmental conditions. In March 2019, experts in animal biology, experimental design and statistics convened in Blonay, Switzerland, to discuss strategies addressing this challenge. In contrast to the current gold standard of rigorous standardization in experimental animal research, we recommend the use of systematic heterogenization of study samples and conditions by actively incorporating biological variation into study design through diversifying study samples and conditions. Here we provide the scientific rationale for this approach in the hope that researchers, regulators, funders and editors can embrace this paradigm shift. We also present a road map towards better practices in view of improving the reproducibility of animal research.

Author Correction: Reproducibility of animal research in light of biological variation.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement.

In animal experiments, blinding (also known as masking) is a methodological strategy to reduce the risk that scientists, animal care staff, or other staff involved in the research may consciously or subconsciously influence the outcome. Lack of masking has been shown to correlate with an overestimation of treatment efficacy and false positive findings. We conducted exploratory interviews across academic and a commercial setting to discuss the implementation of masking at four stages of the experiment: during allocation and intervention, during the conduct of the experiment, during the outcome assessment, and during the data analysis. The objective was to explore the awareness, engagement, perceptions, and the barriers to implementing masking in animal experiments. We conducted multiple interviews, to explore 30 different experiments, and found examples of excellent practice but also areas where masking was rarely implemented. Significant barriers arose from the operational and informatic systems implemented. These systems have prioritised the management of welfare without considering how to allow researchers to use masking in their experiments. For some experiments, there was a conflict between the management of welfare for an individual animal versus delivering a robust experiment where all animals are treated in the same manner. We identified other challenges related to the level of knowledge on the purpose of masking or the implementation and the work culture. The exploration of these issues provides insight into how we, as a community, can identify the most significant barriers in a given research environment. Here, we offer practical solutions to enable researchers to implement masking as standard. To move forward, we need both the individual scientists to embrace the use of masking and the facility managers and institutes to engage and provide a framework that supports the scientists.

Correction: Do multiple experimenters improve the reproducibility of animal studies?

[This corrects the article DOI: 10.1371/journal.pbio.3001564.].

Do multiple experimenters improve the reproducibility of animal studies?

The credibility of scientific research has been seriously questioned by the widely claimed "reproducibility crisis". In light of this crisis, there is a growing awareness that the rigorous standardisation of experimental conditions may contribute to poor reproducibility of animal studies. Instead, systematic heterogenisation has been proposed as a tool to enhance reproducibility, but a real-life test across multiple independent laboratories is still pending. The aim of this study was therefore to test whether heterogenisation of experimental conditions by using multiple experimenters improves the reproducibility of research findings compared to standardised conditions with only one experimenter. To this end, we replicated the same animal experiment in 3 independent laboratories, each employing both a heterogenised and a standardised design. Whereas in the standardised design, all animals were tested by a single experimenter; in the heterogenised design, 3 different experimenters were involved in testing the animals. In contrast to our expectation, the inclusion of multiple experimenters in the heterogenised design did not improve the reproducibility of the results across the 3 laboratories. Interestingly, however, a variance component analysis indicated that the variation introduced by the different experimenters was not as high as the variation introduced by the laboratories, probably explaining why this heterogenisation strategy did not bring the anticipated success. Even more interestingly, for the majority of outcome measures, the remaining residual variation was identified as an important source of variance accounting for 41% (CI95 [34%, 49%]) to 72% (CI95 [58%, 88%]) of the observed total variance. Despite some uncertainty surrounding the estimated numbers, these findings argue for systematically including biological variation rather than eliminating it in animal studies and call for future research on effective improvement strategies.

The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the "ARRIVE Essential 10," which constitutes the minimum requirement, and the "Recommended Set," which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration (E&E) document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0.

Improving the reproducibility of biomedical research is a major challenge. Transparent and accurate reporting is vital to this process; it allows readers to assess the reliability of the findings and repeat or build upon the work of other researchers. The ARRIVE guidelines (Animal Research: Reporting In Vivo Experiments) were developed in 2010 to help authors and journals identify the minimum information necessary to report in publications describing in vivo experiments. Despite widespread endorsement by the scientific community, the impact of ARRIVE on the transparency of reporting in animal research publications has been limited. We have revised the ARRIVE guidelines to update them and facilitate their use in practice. The revised guidelines are published alongside this paper. This explanation and elaboration document was developed as part of the revision. It provides further information about each of the 21 items in ARRIVE 2.0, including the rationale and supporting evidence for their inclusion in the guidelines, elaboration of details to report, and examples of good reporting from the published literature. This document also covers advice and best practice in the design and conduct of animal studies to support researchers in improving standards from the start of the experimental design process through to publication.

Genome-wide in vivo screen identifies novel host regulators of metastatic colonization.

Metastasis is the leading cause of death for cancer patients. This multi-stage process requires tumour cells to survive in the circulation, extravasate at distant sites, then proliferate; it involves contributions from both the tumour cell and tumour microenvironment ('host', which includes stromal cells and the immune system). Studies suggest the early steps of the metastatic process are relatively efficient, with the post-extravasation regulation of tumour growth ('colonization') being critical in determining metastatic outcome. Here we show the results of screening 810 mutant mouse lines using an in vivo assay to identify microenvironmental regulators of metastatic colonization. We identify 23 genes that, when disrupted in mouse, modify the ability of tumour cells to establish metastatic foci, with 19 of these genes not previously demonstrated to play a role in host control of metastasis. The largest reduction in pulmonary metastasis was observed in sphingosine-1-phosphate (S1P) transporter spinster homologue 2 (Spns2)-deficient mice. We demonstrate a novel outcome of S1P-mediated regulation of lymphocyte trafficking, whereby deletion of Spns2, either globally or in a lymphatic endothelial-specific manner, creates a circulating lymphopenia and a higher percentage of effector T cells and natural killer (NK) cells present in the lung. This allows for potent tumour cell killing, and an overall decreased metastatic burden.

Impact of repeated micro and macro blood sampling on clinical chemistry and haematology in rats for toxicokinetic studies.

Non-clinical rodent safety studies are essential in the development of new medicines to assess for potential adverse effects. Typically, toxicokinetic samples are collected from a satellite group. AstraZeneca implemented repeated microsampling of main study animals as standard in the one-month small molecule regulatory toxicology studies. A retrospective analysis of the clinical chemistry and haematology data collected in 52 independent studies from the adult rat controls explored the impact of micro and macro sampling of main study animals. For the majority of variables, the blood sampling technique had no significant impact on the mean or range. For microsampling, a few variables had statistically significant effects on the mean signal but these were considered to have limited biological relevance and would therefore not introduce a meaningful bias to any toxicological evaluation. The macrosampling had the expected effects on the red cell parameters of haemoglobin, haematocrit and red blood count due to the larger blood volume draw. In contrast, microsampling showed no such changes. In conclusion, this large-scale retrospective analysis supports the use of microsampling, for toxicokinetics, of main study animals and enables us to conduct rodent toxicology studies without satellite animals and further reduce the number of animals used in toxicological assessments.

Exclusive dependence of IL-10Rα signalling on intestinal microbiota homeostasis and control of whipworm infection.

The whipworm Trichuris trichiura is a soil-transmitted helminth that dwells in the epithelium of the caecum and proximal colon of their hosts causing the human disease, trichuriasis. Trichuriasis is characterized by colitis attributed to the inflammatory response elicited by the parasite while tunnelling through intestinal epithelial cells (IECs). The IL-10 family of receptors, comprising combinations of subunits IL-10Rα, IL-10Rß, IL-22Rα and IL-28Rα, modulates intestinal inflammatory responses. Here we carefully dissected the role of these subunits in the resistance of mice to infection with T. muris, a mouse model of the human whipworm T. trichiura. Our findings demonstrate that whilst IL-22Rα and IL-28Rα are dispensable in the host response to whipworms, IL-10 signalling through IL-10Rα and IL-10Rß is essential to control caecal pathology, worm expulsion and survival during T. muris infections. We show that deficiency of IL-10, IL-10Rα and IL-10Rß results in dysbiosis of the caecal microbiota characterised by expanded populations of opportunistic bacteria of the families Enterococcaceae and Enterobacteriaceae. Moreover, breakdown of the epithelial barrier after whipworm infection in IL-10, IL-10Rα and IL-10Rß-deficient mice, allows the translocation of these opportunistic pathogens or their excretory products to the liver causing organ failure and lethal disease. Importantly, bone marrow chimera experiments indicate that signalling through IL-10Rα and IL-10Rß in haematopoietic cells, but not IECs, is crucial to control worm expulsion and immunopathology. These findings are supported by worm expulsion upon infection of conditional mutant mice for the IL-10Rα on IECs. Our findings emphasize the pivotal and complex role of systemic IL-10Rα signalling on immune cells in promoting microbiota homeostasis and maintaining the intestinal epithelial barrier, thus preventing immunopathology during whipworm infections.

Reproducible preclinical research-Is embracing variability the answer?

Translational failures and replication issues of published research are undermining preclinical research and, if the outcomes are questionable, raise ethical implications over the continued use of animals. Standardization of procedures, environmental conditions, and genetic background has traditionally been proposed as the gold standard approach, as it reduces variability, thereby enhancing sensitivity and supporting reproducibility when the environment is defined precisely. An alternative view is that standardization can identify idiosyncratic effects and hence decrease reproducibility. In support of this alternative view, Voelkl and colleagues present evidence from resampling a large quantity of research data exploring a variety of treatments. They demonstrate that by implementing multi-laboratory experiments with as few as two sites, we can increase reproducibility by embracing variation without increasing the sample size.

The ARRIVE guidelines 2.0: updated guidelines for reporting animal research.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the 'ARRIVE Essential 10,' which constitutes the minimum requirement, and the 'Recommended Set,' which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

onlineFDR: an R package to control the false discovery rate for growing data repositories.

SUMMARY: In many areas of biological research, hypotheses are tested in a sequential manner, without having access to future P-values or even the number of hypotheses to be tested. A key setting where this online hypothesis testing occurs is in the context of publicly available data repositories, where the family of hypotheses to be tested is continually growing as new data is accumulated over time. Recently, Javanmard and Montanari proposed the first procedures that control the FDR for online hypothesis testing. We present an R package, onlineFDR, which implements these procedures and provides wrapper functions to apply them to a historic dataset or a growing data repository. AVAILABILITY AND IMPLEMENTATION: The R package is freely available through Bioconductor (http://www.bioconductor.org/packages/onlineFDR). SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research.

Reproducible science requires transparent reporting. The ARRIVE guidelines (Animal Research: Reporting of In Vivo Experiments) were originally developed in 2010 to improve the reporting of animal research. They consist of a checklist of information to include in publications describing in vivo experiments to enable others to scrutinise the work adequately, evaluate its methodological rigour, and reproduce the methods and results. Despite considerable levels of endorsement by funders and journals over the years, adherence to the guidelines has been inconsistent, and the anticipated improvements in the quality of reporting in animal research publications have not been achieved. Here, we introduce ARRIVE 2.0. The guidelines have been updated and information reorganised to facilitate their use in practice. We used a Delphi exercise to prioritise and divide the items of the guidelines into 2 sets, the "ARRIVE Essential 10," which constitutes the minimum requirement, and the "Recommended Set," which describes the research context. This division facilitates improved reporting of animal research by supporting a stepwise approach to implementation. This helps journal editors and reviewers verify that the most important items are being reported in manuscripts. We have also developed the accompanying Explanation and Elaboration document, which serves (1) to explain the rationale behind each item in the guidelines, (2) to clarify key concepts, and (3) to provide illustrative examples. We aim, through these changes, to help ensure that researchers, reviewers, and journal editors are better equipped to improve the rigour and transparency of the scientific process and thus reproducibility.

The Experimental Design Assistant.

Addressing the common problems that researchers encounter when designing and analysing animal experiments will improve the reliability of in vivo research. In this article, the Experimental Design Assistant (EDA) is introduced. The EDA is a web-based tool that guides the in vivo researcher through the experimental design and analysis process, providing automated feedback on the proposed design and generating a graphical summary that aids communication with colleagues, funders, regulatory authorities, and the wider scientific community. It will have an important role in addressing causes of irreproducibility.