A roadmap towards a human-centric safety assessment of advanced therapy medicinal products.

Advanced therapy medicinal products (ATMPs) are among the most complex pharmaceuticals with high human specificity. Species differences severely limit the clinical relevance of in vivo data. We conducted interviews with stakeholders involved in ATMP development about their perspective on the use of in vivo studies, the perceived hurdles and associated potential solutions regarding non-clinical development of ATMPs. In total, 17 stakeholders from 9 different countries were interviewed. A workshop was held with key stakeholders to further discuss major topics identified from the interviews. Conducting in vivo studies remains the status quo for ATMPs development. The hurdles identified included determining the amount of information required before clinical entry and effective use of limited human samples to understand a treatment or for clinical monitoring. A number of key points defined the need for future in vivo studies as well as improved application and implementation of New Approach Methodology (NAM)-based approach for products within a well-known modality or technology platform. These included data transparency, understanding of the added value of in vivo studies, and continuous advancement, evaluation, and qualification of NAMs. Based on the outcome of the discussions, a roadmap with practical steps towards a human-centric safety assessment of ATMPs was established.

Exploring Greater Flexibility for Chronic Toxicity Study Designs to Support Human Safety Assessment While Balancing 3Rs Considerations.

Chronic repeated-dose toxicity studies are required to support long-term dosing in late-stage clinical trials, providing data to adequately characterize adverse effects of potential concern for human safety. Different regulatory guidances for the design and duration of chronic toxicity studies are available, with flexibility in approaches often adopted for specific drug modalities. These guidances may provide opportunities to reduce time, cost, compound requirement and animal use within drug development programs if applied more broadly and considered outside their current scopes of use. This article summarizes presentations from a workshop at the 43rd Annual Meeting of the American College of Toxicology (ACT) in November 2022, discussing different approaches for chronic toxicity studies. A recent industry collaboration between the Netherlands Medicines Evaluation Board (MEB) and UK National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC3Rs) illustrated current practices and the value of chronic toxicity studies for monoclonal antibodies (mAbs) and evaluated a weight of evidence (WOE) model where a 3-month study rather than a 6-month study might be adequate. Other topics included potential opportunities for single-species chronic toxicity studies for small molecules, peptides and oligonucleotides and whether a 6-month duration non-rodent study can be used more routinely than a 9-month study (similar to ICH S6(R1) for biological products). Also addressed were opportunities to optimize recovery animal use if warranted and whether restriction to one study only (if at all) can be applied more widely within and outside ICH S6(R1).

Re-evaluating the need for chronic toxicity studies with therapeutic monoclonal antibodies, using a weight of evidence approach.

To support registration of monoclonal antibodies (mAbs) for chronic indications, 6-month toxicity studies have historically been conducted. Experience with mAb development has shown a relatively benign and well-understood safety profile for this class, with most toxicity findings anticipated based on pharmacology. We evaluated whether a 6-month toxicity study is necessary to assess the long-term safety of mAbs. Data on First-in-Human (FIH)-enabling and chronic toxicity studies were shared for 142 mAbs submitted by 11 companies. Opportunities to further optimize study designs to reduce animal usage were identified. For 71% of mAbs, no toxicities or no new toxicities were noted in chronic studies compared to FIH-enabling study findings. New toxicities of potential concern for human safety or that changed trial design were identified in 13.5% of cases, with 7% being considered critical and 2% leading to program termination. An iterative, weight-of-evidence model which considers factors that influence the overall risk for a mAb to cause toxicity was developed. This model enables an evidence-based justification, suggesting when 3-month toxicity studies are likely sufficient to support late-stage clinical development and registration for some mAbs.

The use of recovery animals in nonclinical safety assessment studies with monoclonal antibodies: further 3Rs opportunities remain.

Assessment of reversibility from nonclinical toxicity findings in animals with potential adverse clinical impact is required during pharmaceutical development, but there is flexibility around how and when this is performed and if recovery animals are necessary. For monoclonal antibodies (mAbs) and in accordance with ICH S6(R1) if inclusion of recovery animals is warranted, this need only occur in one study. Data on study designs for first-in-human (FIH)-enabling and later-development toxicity studies were shared from a recent collaboration between the NC3Rs, EPAA, Netherlands Medicines Evaluation Board (MEB) and 14 pharmaceutical companies. This enabled a review of practices on recovery animal use during mAb development and identification of opportunities to reduce research animal use. Recovery animals were included in 68% of FIH-enabling and 69% of later-development studies, often in multiple studies in the same program. Recovery groups were commonly in control plus one test article-dosed group or in all dose groups (45% of studies, each design). Based on the shared data review and conclusions, limiting inclusion of recovery to a single nonclinical toxicology study and species, study design optimisation and use of existing knowledge instead of additional recovery groups provide opportunities to further reduce animal use within mAb development programs.

Applicability of organ-on-chip systems in toxicology and pharmacology.

Organ-on-chip (OoC) systems are microfabricated cell culture devices designed to model functional units of human organs by harboring an in vitro generated organ surrogate. In the present study, we reviewed issues and opportunities related to the application of OoC in the safety and efficacy assessment of chemicals and pharmaceuticals, as well as the steps needed to achieve this goal. The relative complexity of OoC over simple in vitro assays provides advantages and disadvantages in the context of compound testing. The broader biological domain of OoC potentially enhances their predictive value, whereas their complexity present issues with throughput, standardization and transferability. Using OoCs for regulatory purposes requires detailed and standardized protocols, providing reproducible results in an interlaboratory setting. The extent to which interlaboratory standardization of OoC is feasible and necessary for regulatory application is a matter of debate. The focus of applying OoCs in safety assessment is currently directed to characterization (the biology represented in the test) and qualification (the performance of the test). To this aim, OoCs are evaluated on a limited scale, especially in the pharmaceutical industry, with restricted sets of reference substances. Given the low throughput of OoC, it is questionable whether formal validation, in which many reference substances are extensively tested in different laboratories, is feasible for OoCs. Rather, initiatives such as open technology platforms, and collaboration between OoC developers and risk assessors may prove an expedient strategy to build confidence in OoCs for application in safety and efficacy assessment.

Translatability of preclinical to early clinical tolerable and pharmacologically active dose ranges for central nervous system active drugs.

The primary purpose of this study was to assess the translatability of preclinical to early clinical tolerable and pharmacologically active dose ranges for central nervous system (CNS) active drugs. As a part of this, IBs were reviewed on reporting quality. Investigator's Brochures (IBs) of studies performed at the Centre for Human Drug Research (CHDR) reporting statistically significant results of CNS activity related to the drug's mechanism of action were included. The quality of IBs was assessed based on the presence of a rationale for the chosen animal model, completeness of pharmacokinetic (PK) results in reporting and internal validity information of the preclinical evidence. The IB-derisk tool was used to generate preclinical and early clinical data overviews data. For each compound, the overlap between pharmacologically active dose ranges and well-tolerated levels was calculated for three pharmacokinetic (PK) parameters: human equivalent dose (HED), maximum plasma concentration (Cmax) and area under the curve (AUC). Twenty-five IBs were included. In general, the quality of reporting in IBs was assessed as poor. About a third of studies did not explore the entire concentration-effect curve (pre)clinically. Single dose tolerability ranges were most accurately predicted by Cmax. Human equivalent dose and AUC were the best predictors of pharmacologically active ranges. Tolerable and pharmacologically active dose ranges in healthy volunteers can be reasonably well predicted from preclinical data with the IB-derisk tool. The translatability of preclinical studies can be improved by applying a higher reporting standard in IBs including comparable PK measurements across all preclinical and clinical studies.

The ability of animal studies to detect serious post marketing adverse events is limited.

The value of animal studies to assess drug safety is unclear because many such studies are biased and have methodological shortcomings. We studied whether post-marketing serious adverse reactions to small molecule drugs could have been detected on the basis of animal study data included in drug registration files. Of 93 serious adverse reactions related to 43 small molecule drugs, only 19% were identified in animal studies as a true positive outcome, which suggests that data from animal studies are of limited value to pharmacovigilance activities. Our study shows that drug registration files can be used to study the predictive value of animal studies and that the value of animal studies in all stages of the drug development should be investigated in a collaborative endeavour between regulatory authorities, industry, and academia.

Tradition, not science, is the basis of animal model selection in translational and applied research.

National and international laws and regulations exist to protect animals used for scientific purposes in translational and applied research, which includes drug development. However, multiple animal models are available for each disease. We evaluated the argumentation behind the selection of a specific animal model using thematic content analysis in project applications issued in 2017-2019 in the Netherlands. In total, 125 animal models for translational and applied research from 110 project applications were assessed. Explanations to select a specific model included: the model's availability (79%); the availability of expertise (62%); and the model showing similar disease pathology/symptoms (59%) to humans. Therefore, current selection of a specific animal model seems to be based on tradition rather than its potential predictive value for clinical outcome. The applicants' explanations for the implementation of the 3R prin­ciples (replacement, reduction and refinement) as to the animal model were unspecific. Replacement was achieved by using data from prior in vitro studies, reduction by optimal experimental design and statistics, and refinement by reducing discomfort. Additionally, due to the stated need for a test model with high complexity (47%) and intactness (30%), the full replacement of animal models with alternative (non-live animal) approaches was thought unachievable. Without a clear, systematic and transparent justification for the selection of a specific animal model, the likelihood of poorly trans­latable research remains. It is not only up to the researcher to demonstrate this, as ethical committees and funding bodies can provide positive stimuli to drive this change.

Sex Proportionality in Pre-clinical and Clinical Trials: An Evaluation of 22 Marketing Authorization Application Dossiers Submitted to the European Medicines Agency.

This study assessed to what extent women were included in all phases of drug development; whether the clinical studies in the marketing authorization application dossiers include information per sex; and explored whether there are differences between women and men in the drugs' efficacy and safety. Data were extracted from dossiers submitted to the European Medicines Agency. Twenty-two dossiers of drugs approved between 2011 and 2015 for the treatment of various diseases were included. Female animals were included in only 9% of the pharmacodynamics studies, but female and male animals were included in all toxicology studies. Although fewer women than men were included in the clinical studies used to evaluate pharmacokinetics (PK) (29 to 40% women), all dossiers contained sex-specific PK parameter estimations. In the phase III trials, inclusion of women was proportional to disease prevalence for depression, epilepsy, thrombosis, and diabetes [participation to prevalence ratio (PPR) range: 0.91-1.04], but women were considered underrepresented for schizophrenia, hepatitis C, hypercholesterolemia, HIV, and heart failure (PPR range: 0.49-0.74). All dossiers contained sex-specific subgroup analyses of efficacy and safety. There seemed to be higher efficacy for women in one dossier and a trend toward lower efficacy in another dossier. More women had adverse events in both treatment (73.0 vs. 70.6%, p < 0.001) and placebo groups (69.5 vs. 65.5%, p < 0.001). In conclusion, women were included throughout all phases of clinical drug research, and sex-specific information was available in the evaluated dossiers. The included number of women was, however, not always proportional to disease prevalence rates.

Levelling the Translational Gap for Animal to Human Efficacy Data.

Reports of a reproducibility crisis combined with a high attrition rate in the pharmaceutical industry have put animal research increasingly under scrutiny in the past decade. Many researchers and the general public now question whether there is still a justification for conducting animal studies. While criticism of the current modus operandi in preclinical research is certainly warranted, the data on which these discussions are based are often unreliable. Several initiatives to address the internal validity and reporting quality of animal studies (e.g., Animals in Research: Reporting In Vivo Experiments (ARRIVE) and Planning Research and Experimental Procedures on Animals: Recommendations for Excellence (PREPARE) guidelines) have been introduced but seldom implemented. As for external validity, progress has been virtually absent. Nonetheless, the selection of optimal animal models of disease may prevent the conducting of clinical trials, based on unreliable preclinical data. Here, we discuss three contributions to tackle the evaluation of the predictive value of animal models of disease themselves. First, we developed the Framework to Identify Models of Disease (FIMD), the first step to standardise the assessment, validation and comparison of disease models. FIMD allows the identification of which aspects of the human disease are replicated in the animals, facilitating the selection of disease models more likely to predict human response. Second, we show an example of how systematic reviews and meta-analyses can provide another strategy to discriminate between disease models quantitatively. Third, we explore whether external validity is a factor in animal model selection in the Investigator's Brochure (IB), and we use the IB-derisk tool to integrate preclinical pharmacokinetic and pharmacodynamic data in early clinical development. Through these contributions, we show how we can address external validity to evaluate the translatability and scientific value of animal models in drug development. However, while these methods have potential, it is the extent of their adoption by the scientific community that will define their impact. By promoting and adopting high quality study design and reporting, as well as a thorough assessment of the translatability of drug efficacy of animal models of disease, we will have robust data to challenge and improve the current animal research paradigm.

Comparison of drug efficacy in two animal models of type 2 diabetes: A systematic review and meta-analysis.

Previous qualitative research has suggested there are only minor differences between the db/db mouse and the Zucker Diabetic Fatty (ZDF) rat, both animal models of type 2 diabetes. However, it is not known whether these models are also comparable regarding drug response in quantitative terms (effect size). To investigate the extent of these differences, we conducted a systematic review and meta-analysis of approved drugs in these models. We searched on PubMed and Embase on July 3, 2019 for studies including either model, a monotherapy arm with an EMA/FDA approved drug for the treatment of type 2 diabetes, HbA1c assessment and a control group. Studies aimed at diabetes prevention or with surgical interventions were excluded. We calculated the Standardised Mean Difference (SMD) to compare effect sizes (HbA1c reduction) per drug and drug class across models. We included a risk of bias assessment for all included publications. A total of 121 publications met our inclusion criteria. For drugs with more than two comparisons, both models predicted the direction of the effect regarding HbA1c levels. There were no differences between the db/db mouse and ZDF rat, except for exenatide (P = 0.02) and GLP-1 agonists (P = 0.03) in which a larger effect size was calculated in the ZDF rat. Our results indicate the differences between the db/db mouse and ZDF rat are not relevant for preliminary efficacy testing. This methodology can be used to further differentiate between animal models used for the same indication, facilitating the selection of models more likely to predict human response.

Baseline imbalances and clinical outcomes of atypical antipsychotics in dementia: A meta-epidemiological study of randomized trials.

OBJECTIVES: To assess baseline imbalances in placebo-controlled trials of atypical antipsychotics in dementia, and their association with neuropsychiatric symptoms (NPS), extrapyramidal symptoms (EPS), and mortality. METHOD: We searched for trials in multiple sources. Two reviewers extracted baseline characteristics and outcomes per treatment group. We calculated direction, range, pooled mean, and heterogeneity in the baseline differences, and used meta-regression for the relationship with the outcomes. RESULTS: We identified 23 trials. Baseline type of dementia, cognitive impairment and NPS were poorly reported. The drug group had a higher mean age than the placebo group in nine trials and lower mean age in three trials (p = 0.073). The difference in percentage men between the drug and placebo group ranged from -9.7% to 4.4%. There were no statistically significant pooled baseline differences, but heterogeneity was present for age. Higher mean age at baseline in the drug versus placebo group was significantly associated with greater reduction in NPS, and higher percentage of non-White persons with lower risk of EPS. Imbalances were not significantly associated with risk of mortality. CONCLUSION: Randomized trials of atypical antipsychotics in dementia showed baseline imbalances that were associated with higher efficacy and lower risk of EPS for atypical antipsychotics versus placebo.

Correction: A standardised framework to identify optimal animal models for efficacy assessment in drug development.

[This corrects the article DOI: 10.1371/journal.pone.0218014.].

Are some animal models more equal than others? A case study on the translational value of animal models of efficacy for Alzheimer's disease.

Clinical trial failures (>99%) in Alzheimer's disease are in stark contrast to positive efficacy data in animals. We evaluated the correlation between animal and clinical efficacy outcomes (cognition) in Alzheimer's disease using data from registered drugs as well as interventions tested in phase II or III clinical trials for Alzheimer's disease. We identified 20 interventions, which were tested in 208 animal studies in 63 different animal models. Clinical outcome was correlated with animal results in 58% of cases. But, individual animal models showed divergent results across interventions, individual interventions showed divergent results across animal models, and animal model outcomes were determined with 16 different methods. This result is unsurprising due to poor external validity (what do we model) of the animal models. Although the animal models all share Alzheimer's disease symptoms, none represents the whole syndrome. Investigators did not motivate why one model was chosen over another, and did not consider the ways the disease phenomena were generated (spontaneous, (experimentally) induced or by genetic modification), or the species characteristics, which determine the outcomes. The explanation for the lack of correlation between animal and human outcomes can be manifold: the pathogenesis of Alzheimer's disease is not reflected in the animal model or the outcomes are not comparable. Our conclusion is that currently no animal models exist which are predictive for the efficacy of interventions for Alzheimer's disease.

A standardised framework to identify optimal animal models for efficacy assessment in drug development.

INTRODUCTION: Poor translation of efficacy data derived from animal models can lead to clinical trials unlikely to benefit patients-or even put them at risk-and is a potential contributor to costly and unnecessary attrition in drug development. OBJECTIVES: To develop a tool to assess, validate and compare the clinical translatability of animal models used for the preliminary assessment of efficacy. DESIGN AND RESULTS: We performed a scoping review to identify the key aspects used to validate animal models. Eight domains (Epidemiology, Symptomatology and Natural History-SNH, Genetic, Biochemistry, Aetiology, Histology, Pharmacology and Endpoints) were identified. We drafted questions to evaluate the different facets of human disease simulation. We designed the Framework to Identify Models of Disease (FIMD) to include standardised instructions, a weighting and scoring system to compare models as well as factors to help interpret model similarity and evidence uncertainty. We also added a reporting quality and risk of bias assessment of drug intervention studies in the Pharmacological Validation domain. A web-based survey was conducted with experts from different stakeholders to gather input on the framework. We conducted a pilot study of the validation in two models for Type 2 Diabetes (T2D)-the ZDF rat and db/db mouse. Finally, we present a full validation and comparison of two animal models for Duchenne Muscular Dystrophy (DMD): the mdx mouse and GRMD dog. We show that there are significant differences between the mdx mouse and the GRMD dog, the latter mimicking the human epidemiological, SNH, and histological aspects to a greater extent than the mouse despite the overall lack of published data. CONCLUSIONS: FIMD facilitates drug development by serving as the basis to select the most relevant model that can provide meaningful data and is more likely to generate translatable results to progress drug candidates to the clinic.

Role of histamine in short- and long-term effects of methamphetamine on the developing mouse brain.

With the rise in methamphetamine (MA) use among women of childbearing age, the potential consequences of MA exposure to the developing brain for cognition in adulthood is a major concern. Histamine might mediate these MA effects. Following MA administration in neonatal mice, histamine levels in brain were elevated and the hypothalamic-pituitary-adrenal axis was activated. Co-administration of MA with the H3 receptor agonist immepip antagonized these effects. The effects of MA on histamine levels and on hypothalamic-pituitary-adrenal axis activation at P20 were more pronounced in female than male mice. These sex differences could have contributed to the increased susceptibility of female mice to the detrimental long-term cognitive effects of MA and the H3/H4 antagonist thioperamide. Following behavioral testing, mice neonatally treated with MA or thioperamide showed reduced levels of the dendritic marker microtubule-associated protein 2 in the CA3 region of the hippocampus and the enthorhinal cortex. This was not seen in mice neonatally treated with immepip and MA who did not show cognitive impairments, suggesting that these brain areas might be particularly important for the long-term effects of MA on cognitive function. These data support a role for histamine in the effects of MA on the developing brain.

An 80-amino acid deletion in the third intracellular loop of a naturally occurring human histamine H3 isoform confers pharmacological differences and constitutive activity.

In this article, we pharmacologically characterized two naturally occurring human histamine H3 receptor (hH3R) isoforms, hH3R(445) and hH3R(365). These abundantly expressed splice variants differ by a deletion of 80 amino acids in the intracellular loop 3. In this report, we show that the hH3R(365) is differentially expressed compared with the hH3R(445) and has a higher affinity and potency for H3R agonists and conversely a lower potency and affinity for H3R inverse agonists. Furthermore, we show a higher constitutive signaling of the hH3R(365) compared with the hH3R(445) in both guanosine-5'-O-(3-[35S]thio) triphosphate binding and cAMP assays, likely explaining the observed differences in hH3R pharmacology of the two isoforms. Because H3R ligands are beneficial in animal models of obesity, epilepsy, and cognitive diseases such as Alzheimer's disease and attention deficit hyperactivity disorder and currently entered clinical trails, these differences in H3R pharmacology of these two isoforms are of great importance for a detailed understanding of the action of H3R ligands.

Impairments in spatial memory retention of GFAP-apoE4 female mice.

The human apolipoprotein E isoforms, apoE2, apoE3, and apoE4, have differential effects on brain function. Compared to apoE3, apoE4 increases the risk of age-related cognitive decline in humans and female mice expressing apoE in neurons. Here, we show impaired spatial memory retention in female mice expressing apoE4 in astrocytes compared to those expressing apoE3 in astrocytes or lacking apoE. Thus, apoE4 impairs cognition whether expressed in neurons or astrocytes.

Mouse behavioural analysis in systems biology.

Molecular techniques allowing in vivo modulation of gene expression have provided unique opportunities and challenges for behavioural studies aimed at understanding the function of particular genes or biological systems under physiological or pathological conditions. Although various animal models are available, the laboratory mouse (Mus musculus) has unique features and is therefore a preferred animal model. The mouse shares a remarkable genetic resemblance and aspects of behaviour with humans. In this review, first we describe common mouse models for behavioural analyses. As both genetic and environmental factors influence behavioural performance and need to be carefully evaluated in behavioural experiments, considerations for designing and interpretations of these experiments are subsequently discussed. Finally, common behavioural tests used to assess brain function are reviewed, and it is illustrated how behavioural tests are used to increase our understanding of the role of histaminergic neurotransmission in brain function.