Gender differences in the response to antipsychotic medication in patients with schizophrenia: An individual patient data meta-analysis of placebo-controlled studies.

OBJECTIVE: To determine whether gender and menopausal status moderate the response to antipsychotic medication in patients with schizophrenia. METHODS: We analyzed data of 22 short-term placebo-controlled registration trials of antipsychotic medications, which included 5,231 patients with schizophrenia. We applied two-step individual patient data meta-regression analyses to establish the influence of gender and menopausal status on treatment response in mean difference in symptom severity and difference in response (>30% symptom reduction). Analyses were performed both with and without correction for baseline (negative) symptom severity. RESULTS: Antipsychotic treatment is associated with larger mean symptom reduction in women than in men with schizophrenia. The number needed to treat (NNT) for a response in women was 6.9, in men 9.4. Although, we found an age by gender effect, the gender by treatment effect was independent of premenopausal status and baseline (negative) symptom severity. CONCLUSION: In the treatment of schizophrenia we found evidence of a higher response to antipsychotic medication in women relative to men. We found no evidence that this effect was driven by menopausal status, or baseline (negative) symptom severity. Despite the impact of gender and age on effect size in acute antipsychotic treatment, efficacy was clinically relevant in all subgroups.

Sex Proportionality in Pre-clinical and Clinical Trials: An Evaluation of 22 Marketing Authorization Application Dossiers Submitted to the European Medicines Agency.

This study assessed to what extent women were included in all phases of drug development; whether the clinical studies in the marketing authorization application dossiers include information per sex; and explored whether there are differences between women and men in the drugs' efficacy and safety. Data were extracted from dossiers submitted to the European Medicines Agency. Twenty-two dossiers of drugs approved between 2011 and 2015 for the treatment of various diseases were included. Female animals were included in only 9% of the pharmacodynamics studies, but female and male animals were included in all toxicology studies. Although fewer women than men were included in the clinical studies used to evaluate pharmacokinetics (PK) (29 to 40% women), all dossiers contained sex-specific PK parameter estimations. In the phase III trials, inclusion of women was proportional to disease prevalence for depression, epilepsy, thrombosis, and diabetes [participation to prevalence ratio (PPR) range: 0.91-1.04], but women were considered underrepresented for schizophrenia, hepatitis C, hypercholesterolemia, HIV, and heart failure (PPR range: 0.49-0.74). All dossiers contained sex-specific subgroup analyses of efficacy and safety. There seemed to be higher efficacy for women in one dossier and a trend toward lower efficacy in another dossier. More women had adverse events in both treatment (73.0 vs. 70.6%, p < 0.001) and placebo groups (69.5 vs. 65.5%, p < 0.001). In conclusion, women were included throughout all phases of clinical drug research, and sex-specific information was available in the evaluated dossiers. The included number of women was, however, not always proportional to disease prevalence rates.

Tradition, not science, is the basis of animal model selection in translational and applied research.

National and international laws and regulations exist to protect animals used for scientific purposes in translational and applied research, which includes drug development. However, multiple animal models are available for each disease. We evaluated the argumentation behind the selection of a specific animal model using thematic content analysis in project applications issued in 2017-2019 in the Netherlands. In total, 125 animal models for translational and applied research from 110 project applications were assessed. Explanations to select a specific model included: the model's availability (79%); the availability of expertise (62%); and the model showing similar disease pathology/symptoms (59%) to humans. Therefore, current selection of a specific animal model seems to be based on tradition rather than its potential predictive value for clinical outcome. The applicants' explanations for the implementation of the 3R prin­ciples (replacement, reduction and refinement) as to the animal model were unspecific. Replacement was achieved by using data from prior in vitro studies, reduction by optimal experimental design and statistics, and refinement by reducing discomfort. Additionally, due to the stated need for a test model with high complexity (47%) and intactness (30%), the full replacement of animal models with alternative (non-live animal) approaches was thought unachievable. Without a clear, systematic and transparent justification for the selection of a specific animal model, the likelihood of poorly trans­latable research remains. It is not only up to the researcher to demonstrate this, as ethical committees and funding bodies can provide positive stimuli to drive this change.

Assessment of the Regulatory Dialogue Between Pharmaceutical Companies and the European Medicines Agency on the Choice of Noninferiority Margins.

Choosing a noninferiority margin is one of the main challenges when designing a noninferiority trial. The European Medicines Agency (EMA) published a guidance report on the choice of margins in 2005. Nonetheless, in 2008 and 2009 they did not accept 41% (35 of 86) of the noninferiority margins that were proposed by pharmaceutical companies in the context of scientific-advice letters. In this study, we focus on whether the EMA's recommendations were followed by pharmaceutical companies, and on a possible relationship with eventual drug approval. Five of the 35 unaccepted margins were equivalence margins; we considered only the 30 unaccepted noninferiority margins in our analysis. Twelve of these margins were defined based on clinical and statistical considerations (the approach recommended by the EMA) and were rejected due to unacceptable clinical considerations. The other 18 margins were rejected because they were considered too wide. The EMA's recommendations were followed in the cases of 10 of the 15 margins (67%) for which information on follow-through of recommendations was available. The main reason for ignoring the EMA's recommendation in the other 5 cases was that the margins had been accepted by the US Food and Drug Administration. The proportions of approved drugs for which recommendations were and were not followed were similar, yet numbers were too low for formal statistical testing. This study shows that the main concern of regulators with regard to noninferiority trials was the strictness of margins from a clinical perspective. Future studies using more recent data, including data on the US Food and Drug Administration, may help in assessing the impact of guideline recommendations on noninferiority margins used for drug approval and may assist in reaching consensus among regulators about the choice of margins.

Run-in periods and clinical outcomes of antipsychotics in dementia: A meta-epidemiological study of placebo-controlled trials.

PURPOSE: Run-in periods are used to identify placebo-responders and washout. Our aim was to assess the association of run-in periods with clinical outcomes of antipsychotics in dementia. METHODS: We searched randomized placebo-controlled trials of conventional and atypical antipsychotics for neuropsychiatric symptoms (NPS) in dementia in electronic sources and references of selected articles. We extracted (a) the presence of a run-in period, use of placebo/investigated drug during run-in (versus washout only), and run-in duration (1 week or more) and (b) the reduction in NPS, number of participants with somnolence, extrapyramidal symptoms (EPS), and deaths per treatment group. We pooled clinical outcomes comparing antipsychotic and placebo groups in trials with and without run-in. RESULTS: We identified 35 trials. Twenty-nine trials used run-in. The pooled standardized mean difference in the reduction of NPS was -0.170 (95% CI, -0.227 to -0.112) in trials with run-in and -0.142 (95% CI, -0.331 to 0.047) in trials without run-in. The pooled odds ratio for somnolence was 2.8 (95% CI, 2.3-3.5) in trials with run-in and 3.5 (95% CI, 1.2-10.7) in trials without run-in; for EPS, these ORs were 1.8 (95% CI, 1.4-2.2) and 2.0 (95% CI, 1.3-3.1) respectively, and for mortality 1.4 (95% CI, 1.0-2.0) and 1.6 (95% CI, 0.7-3.4). The use of placebo/investigated drug during run-in and run-in duration did not affect the estimates in a consistent way. CONCLUSIONS: The use of run-in in trials might have led to overestimated efficacy and especially underestimated risks of side effects of antipsychotics compared with placebo for NPS in dementia.

Future of the drug label: Perspectives from a multistakeholder dialogue.

Regulating drugs does not end when market access has been granted. Monitoring drugs over the life cycle has become state of the art, inherent to evolving legislation and societal need. Here, we explore how the drug label could move along in a changing playing-field and become a sustainable label for the future. A dialogue between academia, government, the pharmaceutical industry and patient/societal organizations was organized by the Regulatory Science Network Netherlands. This is their view.

Correction: A standardised framework to identify optimal animal models for efficacy assessment in drug development.

[This corrects the article DOI: 10.1371/journal.pone.0218014.].

Are some animal models more equal than others? A case study on the translational value of animal models of efficacy for Alzheimer's disease.

Clinical trial failures (>99%) in Alzheimer's disease are in stark contrast to positive efficacy data in animals. We evaluated the correlation between animal and clinical efficacy outcomes (cognition) in Alzheimer's disease using data from registered drugs as well as interventions tested in phase II or III clinical trials for Alzheimer's disease. We identified 20 interventions, which were tested in 208 animal studies in 63 different animal models. Clinical outcome was correlated with animal results in 58% of cases. But, individual animal models showed divergent results across interventions, individual interventions showed divergent results across animal models, and animal model outcomes were determined with 16 different methods. This result is unsurprising due to poor external validity (what do we model) of the animal models. Although the animal models all share Alzheimer's disease symptoms, none represents the whole syndrome. Investigators did not motivate why one model was chosen over another, and did not consider the ways the disease phenomena were generated (spontaneous, (experimentally) induced or by genetic modification), or the species characteristics, which determine the outcomes. The explanation for the lack of correlation between animal and human outcomes can be manifold: the pathogenesis of Alzheimer's disease is not reflected in the animal model or the outcomes are not comparable. Our conclusion is that currently no animal models exist which are predictive for the efficacy of interventions for Alzheimer's disease.

A standardised framework to identify optimal animal models for efficacy assessment in drug development.

INTRODUCTION: Poor translation of efficacy data derived from animal models can lead to clinical trials unlikely to benefit patients-or even put them at risk-and is a potential contributor to costly and unnecessary attrition in drug development. OBJECTIVES: To develop a tool to assess, validate and compare the clinical translatability of animal models used for the preliminary assessment of efficacy. DESIGN AND RESULTS: We performed a scoping review to identify the key aspects used to validate animal models. Eight domains (Epidemiology, Symptomatology and Natural History-SNH, Genetic, Biochemistry, Aetiology, Histology, Pharmacology and Endpoints) were identified. We drafted questions to evaluate the different facets of human disease simulation. We designed the Framework to Identify Models of Disease (FIMD) to include standardised instructions, a weighting and scoring system to compare models as well as factors to help interpret model similarity and evidence uncertainty. We also added a reporting quality and risk of bias assessment of drug intervention studies in the Pharmacological Validation domain. A web-based survey was conducted with experts from different stakeholders to gather input on the framework. We conducted a pilot study of the validation in two models for Type 2 Diabetes (T2D)-the ZDF rat and db/db mouse. Finally, we present a full validation and comparison of two animal models for Duchenne Muscular Dystrophy (DMD): the mdx mouse and GRMD dog. We show that there are significant differences between the mdx mouse and the GRMD dog, the latter mimicking the human epidemiological, SNH, and histological aspects to a greater extent than the mouse despite the overall lack of published data. CONCLUSIONS: FIMD facilitates drug development by serving as the basis to select the most relevant model that can provide meaningful data and is more likely to generate translatable results to progress drug candidates to the clinic.

Alignment of European Regulatory and Health Technology Assessments: A Review of Licensed Products for Alzheimer's Disease.

Aims: To facilitate regulatory learning, we evaluated similarities and differences in evidence requirements between regulatory and health technology assessment (HTA) bodies of Alzheimer's disease (AD) approved products. Methods: The European marketing authorisation application dossiers and European public assessment reports (EPARs) of the licensed AD drugs were screened to identify the phase III randomised controlled trials (RCTs) and outcomes used. We also screened the assessment reports of the National Institute of Health and Care Excellence (NICE, England) and the National Health Care Institute (ZiN, the Netherlands) to identify the studies and outcomes used in HTA assessments. Results: The application dossiers of donepezil, galantamine, rivastigmine, and memantine contained 16 phase III RCTs in total. These trials were also included in HTA assessments except that NICE excluded studies that were not published (n = 2) or trials that included patients with other types of dementia (n = 3). In the regulatory assessments the focus was on cognitive and global outcomes, and to some extent on function. In the HTA assessments of clinical effectiveness other domains were also covered including: function, behaviour and mood, and, occasionally, quality of life. In the economic analyses of NICE the domains cognition, function, and quality of life were included. Conclusion: There was a large overlap in inclusion of trials in regulatory and HTA assessments, although the focus on specific outcomes slightly differed. Understanding the methods and perceptions of both authorities can stimulate regulatory and HTA cross-talk and further alignment, and therefore more rapid patient access to new treatments.

Dose-Finding Studies Among Orphan Drugs Approved in the EU: A Retrospective Analysis.

In the development process for new drugs, dose-finding studies are of major importance. Absence of these studies may lead to failed phase 3 trials and delayed marketing authorization. In our study we investigated to what extent dose-finding studies are performed in the case of orphan drugs for metabolic and oncologic indications. We identified all orphan drugs that were authorized until August 1, 2017. European Public Assessment Reports were used to extract the final dose used in the summary of product characteristics, involvement of healthy volunteers, study type, end points used, number of patients, number of doses, studies in special populations, and dose used for phase 3 studies. Each drug was checked for major objections and dose changes postmarketing. We included 49 orphan drugs, of which 28 were indicated for metabolic disorders and 21 for oncologic indications. Dose-finding studies were performed in 32 orphan drugs, and studies in healthy volunteers in 26. The absence of dose-finding studies was mostly due to the rarity of the disease. In this case the dose was determined based on factors such as animal studies or clinical experience. Dose-related major objections were raised for 9 orphan drugs. Postmarketing dose-finding studies were conducted in 18 orphan drugs, but dose changes were applied in only 2 drugs. In conclusion, dose-finding studies in the case of metabolic and oncologic orphan drugs were conducted in the development programs of two thirds of orphan drugs. Dose-finding studies performed postmarketing suggest that registered doses are not always optimal. It is thus important to perform more robust dose-finding studies both pre- and postmarketing.

Baseline imbalances and clinical outcomes of atypical antipsychotics in dementia: A meta-epidemiological study of randomized trials.

OBJECTIVES: To assess baseline imbalances in placebo-controlled trials of atypical antipsychotics in dementia, and their association with neuropsychiatric symptoms (NPS), extrapyramidal symptoms (EPS), and mortality. METHOD: We searched for trials in multiple sources. Two reviewers extracted baseline characteristics and outcomes per treatment group. We calculated direction, range, pooled mean, and heterogeneity in the baseline differences, and used meta-regression for the relationship with the outcomes. RESULTS: We identified 23 trials. Baseline type of dementia, cognitive impairment and NPS were poorly reported. The drug group had a higher mean age than the placebo group in nine trials and lower mean age in three trials (p = 0.073). The difference in percentage men between the drug and placebo group ranged from -9.7% to 4.4%. There were no statistically significant pooled baseline differences, but heterogeneity was present for age. Higher mean age at baseline in the drug versus placebo group was significantly associated with greater reduction in NPS, and higher percentage of non-White persons with lower risk of EPS. Imbalances were not significantly associated with risk of mortality. CONCLUSION: Randomized trials of atypical antipsychotics in dementia showed baseline imbalances that were associated with higher efficacy and lower risk of EPS for atypical antipsychotics versus placebo.

Oncologic orphan drugs approved in the EU - do clinical trial data correspond with real-world effectiveness?

BACKGROUND: Evaluation of evidence for efficacy of orphan medicinal products (OMPs) for rare malignancies may be hampered by the use of tumor measurements instead of clinical endpoints. This may cause efficacy data to not always match effectiveness in the real-world. We investigated whether an efficacy-effectiveness gap exists for oncologic OMPs and aimed to identify which factors contribute to it. Also, the magnitude of the clinical efficacy of oncologic OMPs was evaluated. METHODS: We included all oncologic OMPs authorized in the European Union from 2000 to 2017. Pivotal studies were evaluated by means of the European Society for Medical Oncology - Magnitude of Clinical Benefit Scale (ESMO-MCBS). To estimate real-world effectiveness, a literature search was performed to identify post-marketing studies, of which data on overall survival (OS) were extracted. OS of the new OMP was compared with OS data of standard of care. An OS gain of ≥3 months compared to pre-marketing data was considered clinically relevant. RESULTS: Twenty OMPs were included, of which 5 were authorized based on OS as a primary endpoint. 10 OMPs had post-marketing data available, of which 40% did not show a clinically relevant OS gain in the real world. All OMPs that were studied with OS as primary endpoint in the pivotal study had a clinically relevant OS gain in the real world. Furthermore, all OMPs that had a high ESMO-MCBS score and post-marketing data available, resulted in a clinically relevant OS gain in the real world. CONCLUSIONS: Although the sample size is small, our results indicate an efficacy-effectiveness gap for oncologic OMPs exists. Significant changes in PFS do not always lead to an increased OS. The use of PFS may be justified, but validation of surrogate endpoints is needed.

Drug Shortages From the Perspectives of Authorities and Pharmacy Practice in the Netherlands: An Observational Study.

Background: Drug shortages are a potential threat to public health. Reliable data on drug shortages is limited. The objective was to examine the extent and nature of potential drug shortages signaled by authorities and pharmacy practice in the Netherlands Materials and Methods: The primary working systems of Dutch authorities (Medicines Evaluation Board and Health and Youth Care Inspectorate) and the archives of pharmacy practice (Royal Dutch Pharmacists Association) from 2012 to 2015 were searched for number, characteristics, overlap, and date of signals on potential drug shortages. Also, the product characteristics of the potential drug shortages were analyzed from the two different sources Results: Authorities detected 2.6 times more signals on potential shortages than pharmacy practice. Only 438 (8%) out of 5,731 potential drug shortages were detected by both authorities and pharmacy practice. Signals were detected later by authorities than by pharmacy practice, especially on potential permanent shortages (median difference -180 days (IQR: -4 to -405 days)). Authorities detected by majority (72%) signals related to permanent shortages with relative overrepresentation of rectal products and anti-infectives for systemic use. In contrast, pharmacy practice detected by majority (71%) signals related to temporary shortages with relative overrepresentation of ocular and cutaneous products, anti-infectives for systemic use, products for sensory organs and dermatologicals. Conclusions: Authorities and pharmacy practice detected different signals on potential drug shortages with little overlap. Combining data from both authorities and pharmacy practice seems to be necessary in order to gain a more complete overview and maximum insight in potential drug shortages at a national level. Moreover, the finding that authorities were informed later than pharmacy practice causes concerns in terms of opportunities for authorities to assist pharmacy practice to find solutions for shortages.

European regulatory use and impact of subgroup evaluation in marketing authorisation applications.

Marketing authorisation application dossiers relating to medicinal products containing new active substances and evaluated by the European Medicines Agency (EMA) over the period 2012-2015 were examined. Major objections and other concerns relating to efficacy and safety of the day 80 assessment reports were reviewed. Overall, approved products have more subgroup concerns than nonapproved products, which seems to be a consistent pattern. Subgroup analyses are mainly assessed to have the insurance that subgroups of patients that might lack a positive benefit: risk ratio will not be wrongly included in the approved treatment indication.

Aggregated N-of-1 trials for unlicensed medicines for small populations: an assessment of a trial with ephedrine for myasthenia gravis.

BACKGROUND: Inexpensive medicines with a long history of use may currently be prescribed off-label for rare indications. Reimbursement is at the discretion of health insurance companies, and may be unpredictable. The example addressed was ephedrine as add-on treatment for myasthenia gravis. Stakeholders from academia, a patient organization, the Dutch National Health Care Institute (NHCI) and Dutch Medicines Evaluation Board (MEB) advised on the trial design. The NHCI and MEB agreed to provide scientific advice on the suitability of the evidence generated by the trial, for regulatory decisions. This paper describes the feasibility of the trial and the utility of its aggregated results. RESULTS: The trialists experienced the trial as feasible. Retrospective interviews showed that the trial as performed was acceptable to patients. The treatment effect in the primary outcome measure, muscle strength, was statistically significant when inferred to the population level, though the effect size was modest. Secondary outcomes were statistically significant in a preplanned, fixed effects analysis within the four patients. The NHCI advised that it could potentially make reimbursement decisions based on the Fitting Evidence framework, should the trialists decide to apply for reimbursement. The MEB advised that for a licensing decision, the N-of-1 design is a last-resort option for demonstrating treatment benefit in a rare disease. N-of-1 trials alone do not provide enough evidence on potential risk. The MEB found the current trial inconclusive. It suggested doing a 2-armed trial of longer duration, possibly with a different outcome measure (postponement of corticosteroid use). It suggested engaging a consultancy or commercial sponsor, should the trialists decide to seek market authorization of the drug. CONCLUSIONS: In theory, evidence from aggregated N-of-1 trials is suitable for use in licensing and reimbursement decisions. The current example illustrates differences in interpretation of N-of-1 results by health authorities. In the era of personalized medicine, consensus is required on the interpretation of data from study designs geared to small groups. Demonstrating effectiveness of inexpensive medicines in small populations may require involvement of non-commercial parties, to preserve affordability.

Early Nonresponse in the Antipsychotic Treatment of Acute Mania: A Criterion for Reconsidering Treatment? Results From an Individual Patient Data Meta-Analysis.

OBJECTIVE: To investigate whether early nonresponse to antipsychotic treatment of acute mania predicts treatment failure and, if so, to establish the best definition or criterion of an early nonresponse. DATA SOURCES: Short-term efficacy studies assessing antipsychotics that were submitted to the Dutch Medicines Evaluation Board during an 11-year period as part of the marketing authorization application for the indication of acute manic episode of bipolar disorder. Pharmaceutical companies provided their raw patient data, which enabled us to perform an individual patient data meta-analysis. STUDY SELECTION: All double-blind, randomized, placebo-controlled trials assessing the efficacy of antipsychotics for acute manic episode of bipolar disorder were included (10 trials). DATA EXTRACTION: All patients with data available for completer analysis (N = 1,243), symptom severity scores on the Young Mania Rating Scale (YMRS) at weeks 0, 1, and 2 and at study end point (week 3 or 4). RESULTS: The a priori chances of nonresponse and nonremission at study end point were 40.9% (95% CI, 38.2%-43.6%) and 65.3% (95% CI, 62.0%-68.6%), respectively. Early nonresponse in weeks 1 and 2, defined by cutoff scores ranging from a ≤ 10% to a ≤ 50% reduction in symptoms compared to baseline on the YMRS, significantly predicted nonresponse (≤ 0% symptom reduction) and nonremission (YMRS score higher than 8) in week 3. The predictive value of early nonresponse (PVnr_se) at week 1 for both nonresponse and nonremission at study end point declined linearly with increasing cutoff scores of early nonresponse; nonresponse: 76.0% (95% CI, 69.7%-82.3%) for a ≤ 10% response to 48.7% (95% CI, 45.5%-51.9%) for a ≤ 50% response; nonremission: 92.2% (95% CI, 88.3%-96.1%) for a ≤ 10% response to 76.8% (95% CI, 74.4%-79.5%) for a ≤ 50% response. A similar linear decline was observed for increasing cutoff scores of early nonresponse at week 2 for nonresponse, but not for nonremission at end point: nonresponse 90.3% (95% CI, 84.6%-96.0%) for a ≤ 10% response to 65.0% (95% CI, 61.4%-68.6%) for a ≤ 50% response; nonremission: 94.2% (95% CI, 89.7%-98.7%) for a ≤ 10% response and 93.2% (95% CI, 93.1%-95.1%) for a ≤ 50% response. Specific antipsychotic characteristics did not modify these findings at either time point (week 1: P = .127; week 2: P = .213). CONCLUSIONS: When patients fail to respond early (1-2 weeks) after the initiation of antipsychotic treatment for acute mania, clinicians should reconsider their treatment choice using a 2-stage strategy.

Does Insight Affect the Efficacy of Antipsychotics in Acute Mania?: An Individual Patient Data Regression Meta-Analysis.

Patients having an acute manic episode of bipolar disorder often lack insight into their condition. Because little is known about the possible effect of insight on treatment efficacy, we examined whether insight at the start of treatment affects the efficacy of antipsychotic treatment in patients with acute mania. We used individual patient data from 7 randomized, double-blind, placebo-controlled registration studies of 4 antipsychotics in patients with acute mania (N = 1904). Insight was measured with item 11 of the Young Mania Rating Scale (YMRS) at baseline and study endpoint 3 weeks later. Treatment outcome was defined by (a) mean change score, (b) response defined as 50% or more improvement on YMRS, and (c) remission defined as YMRS score less than 8 at study endpoint. We used multilevel mixed effect linear (or logistic) regression analyses of individual patient data to assess the interaction between baseline insight and treatment outcomes. At treatment initiation, 1207 (63.5%) patients had impaired or no insight into their condition. Level of insight significantly modified the efficacy of treatment by mean change score (P = 0.039), response rate (P = 0.033), and remission rate (P = 0.043), with greater improvement in patients with more impaired insight. We therefore recommend that patients experiencing acute mania should be treated immediately and not be delayed until patients regain insight.