Item performance of the scale for the assessment and rating of ataxia in rare and ultra-rare genetic ataxias.

The Scale for the Assessment and Rating of Ataxia (SARA) is widely used for assessing the severity and progression of genetic cerebellar ataxias. SARA is now considered a primary end point in several ataxia treatment trials, but its underlying composite item measurement model has not yet been tested. This work aimed to evaluate the composite properties of SARA and its items using item response theory (IRT) and to demonstrate its applicability across even ultra-rare genetic ataxias. Leveraging SARA subscores data from 1932 visits from 990 patients of the Autosomal Recessive Cerebellar Ataxias (ARCA) registry, we assessed the performance of SARA using IRT methodology. The item characteristics were evaluated over the ataxia severity range of the entire ataxia population as well as the assessment validity across 115 genetic ARCA subpopulations. A unidimensional IRT model was able to describe SARA item data, indicating that SARA captures one single latent variable. All items had high discrimination values (1.5-2.9) indicating the effectiveness of the SARA in differentiating between subjects with different disease statuses. Each item contributed between 7% and 28% of the total assessment informativeness. There was no evidence for differences between the 115 genetic ARCA subpopulations in SARA applicability. These results show the good discrimination ability of SARA with all of its items adding informational value. The IRT framework provides a thorough description of SARA on the item level, and facilitates its utilization as a clinical outcome assessment in upcoming longitudinal natural history or treatment trials, across a large number of ataxias, including ultra-rare ones.

Physiologically-based pharmacokinetic models versus allometric scaling for prediction of tyrosine-kinase inhibitor exposure from adults to children.

PURPOSE: Model-based methods can predict pediatric exposure and support initial dose selection. The aim of this study was to evaluate the performance of allometric scaling of population pharmacokinetic (popPK) versus physiologically based pharmacokinetic (PBPK) models in predicting the exposure of tyrosine kinase inhibitors (TKIs) for pediatric patients (≥ 2 years), based on adult data. The drugs imatinib, sunitinib and pazopanib were selected as case studies due to their complex PK profiles including high inter-patient variability, active metabolites, time-varying clearances and non-linear absorption. METHODS: Pediatric concentration measurements and adult popPK models were derived from the literature. Adult PBPK models were generated in PK-Sim® using available physicochemical properties, calibrated to adult data when needed. PBPK and popPK models for the pediatric populations were translated from the models for adults and were used to simulate concentration-time profiles that were compared to the observed values. RESULTS: Ten pediatric datasets were collected from the literature. While both types of models captured the concentration-time profiles of imatinib, its active metabolite, sunitinib and pazopanib, the PBPK models underestimated sunitinib metabolite concentrations. In contrast, allometrically scaled popPK simulations accurately predicted all concentration-time profiles. Trough concentration (Ctrough) predictions from the popPK model fell within a 2-fold range for all compounds, while 3 out of 5 PBPK predictions exceeded this range for the imatinib and sunitinib metabolite concentrations. CONCLUSION: Based on the identified case studies it appears that allometric scaling of popPK models is better suited to predict exposure of TKIs in pediatric patients ≥ 2 years. This advantage may be attributed to the stable enzyme expression patterns from 2 years old onwards, which can be easily related to adult levels through allometric scaling. In some instances, both methods performed comparably. Understanding where discrepancies between the model methods arise, can further inform model development and ultimately support pediatric dose selection.

Covariate modeling in pharmacometrics: General points for consideration.

Modeling the relationships between covariates and pharmacometric model parameters is a central feature of pharmacometric analyses. The information obtained from covariate modeling may be used for dose selection, dose individualization, or the planning of clinical studies in different population subgroups. The pharmacometric literature has amassed a diverse, complex, and evolving collection of methodologies and interpretive guidance related to covariate modeling. With the number and complexity of technologies increasing, a need for an overview of the state of the art has emerged. In this article the International Society of Pharmacometrics (ISoP) Standards and Best Practices Committee presents perspectives on best practices for planning, executing, reporting, and interpreting covariate analyses to guide pharmacometrics decision making in academic, industry, and regulatory settings.

Evaluation of covariate effects in item response theory models.

Item response theory (IRT) models are usually the best way to analyze composite or rating scale data. Standard methods to evaluate covariate or treatment effects in IRT models do not allow to identify item-specific effects. Finding subgroups of patients who respond differently to certain items could be very important when designing inclusion or exclusion criteria for clinical trials, and aid in understanding different treatment responses in varying disease manifestations. We present a new method to investigate item-specific effects in IRT models, which is based on inspection of residuals. The method was investigated in a simulation exercise with a model for the Epworth Sleepiness Scale. We also provide a detailed discussion as a guidance on how to build a robust covariate IRT model.

Item response theory analysis of daytime sleepiness as a symptom of obstructive sleep apnea.

Obstructive sleep apnea (OSA) is a sleep disorder which is linked to many health risks. The gold standard to evaluate OSA in clinical trials is the Apnea-Hypopnea Index (AHI). However, it is time-consuming, costly, and disregards aspects such as quality of life. Therefore, it is of interest to use patient-reported outcomes like the Epworth Sleepiness Scale (ESS), which measures daytime sleepiness, as surrogate end points. We investigate the link between AHI and ESS, via item response theory (IRT) modeling. Through the developed IRT model it was identified that AHI and ESS are not correlated to any high degree and probably not measuring the same sleepiness construct. No covariate relationships of clinical relevance were found. This suggests that ESS is a poor choice as an end point for clinical development if treatment is targeted at improving AHI, and especially so in a mild OSA patient group.

Predicting the Long-Term Effects of Therapeutic Neutralization of Oncostatin M on Human Hematopoiesis.

Therapeutic neutralization of Oncostatin M (OSM) causes mechanism-driven anemia and thrombocytopenia, which narrows the therapeutic window complicating the selection of doses (and dosing intervals) that optimize efficacy and safety. We utilized clinical data from studies of an anti-OSM monoclonal antibody (GSK2330811) in healthy volunteers (n = 49) and systemic sclerosis patients (n = 35), to quantitatively determine the link between OSM and alterations in red blood cell (RBC) and platelet production. Longitudinal changes in hematopoietic variables (including RBCs, reticulocytes, platelets, erythropoietin, and thrombopoietin) were linked in a physiology-based model, to capture the long-term effects and variability of therapeutic OSM neutralization on human hematopoiesis. Free serum OSM stimulated precursor cell production through sigmoidal relations, with higher maximum suppression (Imax ) and OSM concentration for 50% suppression (IC50 ) for platelets (89.1% [95% confidence interval: 83.4-93.0], 6.03 pg/mL [4.41-8.26]) than RBCs (57.0% [49.7-64.0], 2.93 pg/mL [2.55-3.36]). Reduction in hemoglobin and platelets increased erythro- and thrombopoietin, respectively, prompting reticulocytosis and (partially) alleviating OSM-restricted hematopoiesis. The physiology-based model was substantiated by preclinical data and utilized in exploration of once-weekly or every other week dosing regimens. Predictions revealed an (for the indication) unacceptable occurrence of grade 2 (67% [58-76], 29% [20-38]) and grade 3 (17% [10-25], 3% [0-7]) anemias, with limited thrombocytopenia. Individual extent of RBC precursor modulation was moderately correlated to skin mRNA gene expression changes. The physiological basis and consideration of interplay among hematopoietic variables makes the model generalizable to other drug and nondrug scenarios, with adaptations for patient populations, diseases, and therapeutics that modulate hematopoiesis or exhibit risk of anemia and/or thrombocytopenia.

Increase in peg-asparaginase clearance as a predictor for inactivation in patients with acute lymphoblastic leukemia.

Asparaginase is an essential component of acute lymphoblastic leukemia (ALL) therapy, yet its associated toxicities often lead to treatment discontinuation, increasing the risk of relapse. Hypersensitivity reactions include clinical allergies, silent inactivation, or allergy-like responses. We hypothesized that even moderate increases in asparaginase clearance are related to later inactivation. We therefore explored mandatory monitoring of asparaginase enzyme activity (AEA) in patients with ALL aged 1-45 years treated according to the ALLTogether pilot protocol in the Nordic and Baltic countries to relate mean AEA to inactivation, to build a pharmacokinetic model to better characterize the pharmacokinetics of peg-asparaginase and assess whether an increased clearance relates to subsequent inactivation. The study analyzed 1631 real-time AEA samples from 253 patients, identifying inactivation in 18.2% of the patients. This inactivation presented as mild allergy (28.3%), severe allergy (50.0%), or silent inactivation (21.7%). A pharmacokinetic transit compartment model was used to describe AEA-time profiles, revealing that 93% of patients with inactivation exhibited prior increased clearance, whereas 86% of patients without hypersensitivity maintained stable clearance throughout asparaginase treatment. These findings enable prediction of inactivation and options for either dose increments or a shift to alternative asparaginase formulations to optimize ALL treatment strategies.

Comparison of Two Methods for Determining Item Characteristic Functions and Latent Variable Time-Course for Pharmacometric Item Response Models.

There are examples in the literature demonstrating different approaches to defining the item characteristic functions (ICF) and characterizing the latent variable time-course within a pharmacometrics item response theory (IRT) framework. One such method estimates both the ICF and latent variable time-course simultaneously, and another method establishes the ICF first then models the latent variable directly. To date, a direct comparison of the "simultaneous" and "sequential" methodologies described in this work has not yet been systematically investigated. Item parameters from a graded response IRT model developed from Parkinson's Progression Marker Initiative (PPMI) study data were used as simulation parameters. Each method was evaluated under the following conditions: (i) with and without drug effect and (ii) slow progression rate with smaller sample size and rapid progression rate with larger sample size. Overall, the methods performed similarly, with low bias and good precision for key parameters and hypothesis testing for drug effect. The ICF parameters were well determined when the model was correctly specified, with an increase in precision in the scenario with rapid progression. In terms of drug effect, both methods had large estimation bias for the slow progression rate; however, this bias can be considered small relative to overall progression rate. Both methods demonstrated type 1 error control and similar discrimination between model with and without drug effect. The simultaneous method was slightly more precise than the sequential method while the sequential method was more robust towards longitudinal model misspecification and offers practical advantages in model building.

Characterization of anti-drug antibody dynamics using a bivariate mixed hidden-markov model by nonlinear-mixed effects approach.

Biological therapies may act as immunogenic triggers leading to the formation of anti-drug antibodies (ADAs). Population pharmacokinetic (PK) models can be used to characterize the relationship between ADA and drug disposition but often rely on the ADA bioassay results, which may not be sufficiently sensitive to inform on this characterization.In this work, a methodology that could help to further elucidate the underlying ADA production and impact on the drug disposition was explored. A mixed hidden-Markov model (MHMM) was developed to characterize the underlying (hidden) formation of ADA against the biologic, using certolizumab pegol (CZP), as a test drug. CZP is a PEGylated Fc free TNF-inhibitor used in the treatment of rheumatoid arthritis and other chronic inflammatory diseases.The bivariate MHMM used information from plasma drug concentrations and ADA measurements, from six clinical studies (n = 845), that were correlated through a bivariate Gaussian function to infer about two hidden states; production and no-production of ADA influencing PK. Estimation of inter-individual variability was not supported in this case. Parameters associated with the observed part of the model were reasonably well estimated while parameters associated with the hidden part were less precise. Individual state sequences obtained using a Viterbi algorithm suggested that the model was able to determine the start of ADA production for each individual, being a more assay-independent methodology than traditional population PK. The model serves as a basis for identification of covariates influencing the ADA formation, and thus has the potential to identify aspects that minimize its impact on PK and/or efficacy.

Training the next generation of pharmacometric modelers: a multisector perspective.

The current demand for pharmacometricians outmatches the supply provided by academic institutions and considerable investments are made to develop the competencies of these scientists on-the-job. Even with the observed increase in academic programs related to pharmacometrics, this need is unlikely to change in the foreseeable future, as the demand and scope of pharmacometrics applications keep expanding. Further, the field of pharmacometrics is changing. The field largely started when Lewis Sheiner and Stuart Beal published their seminal papers on population pharmacokinetics in the late 1970's and early 1980's and has continued to grow in impact and use since its inception. Physiological-based pharmacokinetics and systems pharmacology have grown rapidly in scope and impact in the last decade and machine learning is just on the horizon. While all these methodologies are categorized as pharmacometrics, no one person can be an expert in everything. So how do you train future pharmacometricians? Leading experts in academia, industry, contract research organizations, clinical medicine, and regulatory gave their opinions on how to best train future pharmacometricians. Their opinions were collected and synthesized to create some general recommendations.

Model-Informed Precision Dosing to Reduce Vincristine-Induced Peripheral Neuropathy in Pediatric Patients: A Pharmacokinetic and Pharmacodynamic Modeling and Simulation Analysis.

BACKGROUND: Vincristine-induced peripheral neuropathy (VIPN) is a common adverse effect of vincristine, a drug often used in pediatric oncology. Previous studies demonstrated large inter- and intrapatient variability in vincristine pharmacokinetics (PK). Model-informed precision dosing (MIPD) can be applied to calculate patient exposure and individualize dosing using therapeutic drug monitoring (TDM) measurements. This study set out to investigate the PK/pharmacodynamic (PKPD) relationship of VIPN and determine the utility of MIPD to support clinical decisions regarding dose selection and individualization. METHODS: Data from 35 pediatric patients were utilized to quantify the relationship between vincristine dose, exposure and the development of VIPN. Measurements of vincristine exposure and VIPN (Common Terminology Criteria for Adverse Events [CTCAE]) were available at baseline and for each subsequent dosing occasions (1-5). A PK and PKPD analysis was performed to assess the inter- and intraindividual variability in vincristine exposure and VIPN over time. In silico trials were performed to portray the utility of vincristine MIPD in pediatric subpopulations with a certain age, weight and cytochrome P450 (CYP) 3A5 genotype distribution. RESULTS: A two-compartmental model with linear PK provided a good description of the vincristine exposure data. Clearance and distribution parameters were related to bodyweight through allometric scaling. A proportional odds model with Markovian elements described the incidence of Grades 0, 1 and ≥ 2 VIPN overdosing occasions. Vincristine area under the curve (AUC) was the most significant exposure metric related to the development of VIPN, where an AUC of 50 ng⋅h/mL was estimated to be related to an average VIPN probability of 40% over five dosing occasions. The incidence of Grade ≥ 2 VIPN reduced from 62.1 to 53.9% for MIPD-based dosing compared with body surface area (BSA)-based dosing in patients. Dose decreases occurred in 81.4% of patients with MIPD (vs. 86.4% for standard dosing) and dose increments were performed in 33.4% of patients (no dose increments allowed for standard dosing). CONCLUSIONS: The PK and PKPD analysis supports the use of MIPD to guide clinical dose decisions and reduce the incidence of VIPN. The current work can be used to support decisions with respect to dose selection and dose individualization in children receiving vincristine.

Properties of the full random-effect modeling approach with missing covariate data.

During drug development, a key step is the identification of relevant covariates predicting between-subject variations in drug response. The full random effects model (FREM) is one of the full-covariate approaches used to identify relevant covariates in nonlinear mixed effects models. Here we explore the ability of FREM to handle missing (both missing completely at random (MCAR) and missing at random (MAR)) covariate data and compare it to the full fixed-effects model (FFEM) approach, applied either with complete case analysis or mean imputation. A global health dataset (20 421 children) was used to develop a FREM describing the changes of height for age Z-score (HAZ) over time. Simulated datasets (n = 1000) were generated with variable rates of missing (MCAR) covariate data (0%-90%) and different proportions of missing (MAR) data condition on either observed covariates or predicted HAZ. The three methods were used to re-estimate model and compared in terms of bias and precision which showed that FREM had only minor increases in bias and minor loss of precision at increasing percentages of missing (MCAR) covariate data and performed similarly in the MAR scenarios. Conversely, the FFEM approaches either collapsed at ≥ $$ \ge $$ 70% of missing (MCAR) covariate data (FFEM complete case analysis) or had large bias increases and loss of precision (FFEM with mean imputation). Our results suggest that FREM is an appropriate approach to covariate modeling for datasets with missing (MCAR and MAR) covariate data, such as in global health studies.

Evaluation of the effect of erenumab on migraine-specific questionnaire in patients with chronic and episodic migraine.

Erenumab is a fully human anti-canonical calcitonin gene-related peptide receptor monoclonal antibody approved for migraine prevention. The Migraine-Specific Quality-of-Life Questionnaire (MSQ) is a 14-item patient-reported outcome instrument that measures the impact of migraine on health-related quality of life. Erenumab data from four phase II/III clinical trials were used to develop an item response theory (IRT) model within a nonlinear mixed effects framework, (i) evaluate the MSQ item information with respect to patient disability, (ii) characterize the longitudinal progression of the MSQ, and (iii) quantify the effect of erenumab on the MSQ in patients with migraine. The majority (80%) of information was found to be contained in 9 out of 14 items, extending the current knowledge on the reliability of the MSQ as a psychometric tool. Simulations across three MSQ domains show significant improvement from baseline, exceeding minimally important differences. Overall, the IRT model platform developed herein allows for systematic quantification of the effect of erenumab on the MSQ in patients with migraine.

Generation and application of avatars in pharmacometric modelling.

Simulations from population models have critical applications in drug discovery and development. Avatars or digital twins, defined as individual simulations matching clinical criteria of interest compared to observations from a real subject within a predefined margin of accuracy, may be a better option for simulations performed to inform future drug development stages in cases where an adequate model is not achievable. The aim of this work was to (1) investigate methods for generating avatars with pharmacometric models, and (2) explore the properties of the generated avatars to assess the impact of the different selection settings on the number of avatars per subject, their closeness to the individual observations, and the properties of the selected samples subset from the theoretical model parameters probability density function. Avatars were generated using different combinations of nature and number of clinical criteria, accuracy of agreement, and/or number of simulations for two examples models previously published (hemato-toxicity and integrated glucose-insulin model). The avatar distribution could be used to assess the appropriateness of the models assumed parameter distribution. Similarly it could be used to assess the models ability to properly describe the trajectories of the observations. Avatars can give nuanced information regarding the ability of a model to simulate data similar to the observations both at the population and at the individual level. Further potential applications for avatars may be as a diagnostic tool, an alternative to simulations with insurance to replicate key clinical features, and as an individual measure of model fit.

Assessment of ibrutinib scheduling on leukocyte, lymph node size and blood pressure dynamics in chronic lymphocytic leukemia through pharmacokinetic-pharmacodynamic models.

Ibrutinib is a Bruton tyrosine kinase (Btk) inhibitor for treating chronic lymphocytic leukemia (CLL). It has also been associated with hypertension. The optimal dosing schedule for mitigating this adverse effect is currently under discussion. A quantification of relationships between systemic ibrutinib exposure and efficacy (i.e., leukocyte count and sum of the product of perpendicular diameters [SPD] of lymph nodes) and hypertension toxicity (i.e., blood pressure), and their association with overall survival is needed. Here, we present a semi-mechanistic pharmacokinetic-pharmacodynamic modeling framework to characterize such relationships and facilitate dose optimization. Data from a phase Ib/II study were used, including ibrutinib plasma concentrations to derive daily 0-24-h area under the concentration-time curve, leukocyte count, SPD, survival, and blood pressure measurements. A nonlinear mixed effects modeling approach was applied, considering ibrutinib's pharmacological action and CLL cell dynamics. The final framework included (i) an integrated model for SPD and leukocytes consisting of four CLL cell subpopulations with ibrutinib inhibiting phosphorylated Btk production, (ii) a turnover model in which ibrutinib stimulates an increase in blood pressure, and (iii) a competing risk model for dropout and death. Simulations predicted that the approved dosing schedule had a slightly higher efficacy (24-month, progression-free survival [PFS] 98%) than de-escalation schedules (24-month, average PFS ≈ 97%); the latter had, on average, ≈20% lower proportions of patients with hypertension. The developed modeling framework offers an improved understanding of the relationships among ibrutinib exposure, efficacy and toxicity biomarkers. This framework can serve as a platform to assess dosing schedules in a biologically plausible manner.

A multistate modeling and simulation framework to learn dose-response of oncology drugs: Application to bintrafusp alfa in non-small cell lung cancer.

The dose/exposure-efficacy analyses are often conducted separately for oncology end points like best overall response, progression-free survival (PFS) and overall survival (OS). Multistate models offer to bridge these dose-end point relationships by describing transitions and transition times from enrollment to response, progression, and death, and evaluating transition-specific dose effects. This study aims to apply the multistate pharmacometric modeling and simulation framework in a dose optimization setting of bintrafusp alfa, a fusion protein targeting TGF-ß and PD-L1. A multistate model with six states (stable disease [SD], response, progression, unknown, dropout, and death) was developed to describe the totality of endpoints data (time to response, PFS, and OS) of 80 patients with non-small cell lung cancer receiving 500 or 1200 mg of bintrafusp alfa. Besides dose, evaluated predictor of transitions include time, demographics, premedication, disease factors, individual clearance derived from a pharmacokinetic model, and tumor dynamic metrics observed or derived from tumor size model. We found that probabilities of progression and death upon progression decreased over time since enrollment. Patients with metastasis at baseline had a higher probability to progress than patients without metastasis had. Despite dose failed to be statistically significant for any individual transition, the combined effect quantified through a model with dose-specific transition estimates was still informative. Simulations predicted a 69.2% probability of at least 1 month longer, and, 55.6% probability of at least 2-months longer median OS from the 1200 mg compared to the 500 mg dose, supporting the selection of 1200 mg for future studies.

Relationship between factor VIII levels and bleeding for rFVIII-SingleChain in severe hemophilia A: A repeated time-to-event analysis.

Publications on the exposure-effect relationships of factor concentrates for hemophilia treatment are limited, whereas such analyses give insight on treatment efficacy. Our objective was to examine the relationship between the dose, factor VIII (FVIII) levels and bleeding for rFVIII-SingleChain (lonoctocog alfa, Afstyla). Data from persons with severe hemophilia A on rFVIII-SingleChain prophylaxis from three clinical trials were combined. The published rFVIII-SingleChain population pharmacokinetic (PK) model was evaluated and expanded. The probability of bleeding was described with a parametric repeated time-to-event (RTTE) model. Data included 2080 bleeds, 2545 chromogenic stage assay, and 3052 one-stage assay FVIII levels from 241 persons (median age 19 years) followed for median 1090 days. The majority of the bleeds occurred in joints (65%) and the main bleeding reason was trauma (44%). The probability of bleeding decreased during follow-up and a FVIII level of 8.9 IU/dL (95% confidence interval: 6.9-10.9) decreased the bleeding hazard by 50% compared to a situation without FVIII in plasma. Variability in bleeding hazard between persons with similar FVIII levels was large, and the pre-study annual bleeding rate explained part of this variability. When a FVIII trough level of 1 or 3 IU/dL is targeted during prophylaxis, simulations predicted two (90% prediction interval [PI]: 0-17) or one (90% PI: 0-11) bleeds per year, respectively. In conclusion, the developed PK-RTTE model adequately described the relationship between dose, FVIII levels and bleeds for rFVIII-SingleChain. The obtained estimates were in agreement with those published for the FVIII concentrates BAY 81-8973 (octocog alfa) and BAY 94-9027 (damoctocog alfa pegol), indicating similar efficacy to reduce bleeding.

Joint longitudinal model-based meta-analysis of FEV1 and exacerbation rate in randomized COPD trials.

Model-based meta-analysis (MBMA) is an approach that integrates relevant summary level data from heterogeneously designed randomized controlled trials (RCTs). This study not only evaluated the predictability of a published MBMA for forced expiratory volume in one second (FEV1) and its link to annual exacerbation rate in patients with chronic obstructive pulmonary disease (COPD) but also included data from new RCTs. A comparative effectiveness analysis across all drugs was also performed. Aggregated level data were collected from RCTs published between July 2013 and November 2020 (n = 132 references comprising 156 studies) and combined with data used in the legacy MBMA (published RCTs up to July 2013 - n = 142). The augmented data (n = 298) were used to evaluate the predictive performance of the published MBMA using goodness-of-fit plots for assessment. Furthermore, the model was extended including drugs that were not available before July 2013, estimating a new set of parameters. The legacy MBMA model predicted the post-2013 FEV1 data well, and new estimated parameters were similar to those of drugs in the same class. However, the exacerbation model overpredicted the post-2013 mean annual exacerbation rate data. Inclusion of year when the study started on the pre-treatment placebo rate improved the model predictive performance perhaps explaining potential improvements in the disease management over time. The addition of new data to the legacy COPD MBMA enabled a more robust model with increased predictability performance for both endpoints FEV1 and mean annual exacerbation rate.

Comparison of Seven Non-Linear Mixed Effect Model-Based Approaches to Test for Treatment Effect.

Analyses of longitudinal data with non-linear mixed-effects models (NLMEM) are typically associated with high power, but sometimes at the cost of inflated type I error. Approaches to overcome this problem were published recently, such as model-averaging across drug models (MAD), individual model-averaging (IMA), and combined Likelihood Ratio Test (cLRT). This work aimed to assess seven NLMEM approaches in the same framework: treatment effect assessment in balanced two-armed designs using real natural history data with or without the addition of simulated treatment effect. The approaches are MAD, IMA, cLRT, standard model selection (STDs), structural similarity selection (SSs), randomized cLRT (rcLRT), and model-averaging across placebo and drug models (MAPD). The assessment included type I error, using Alzheimer's Disease Assessment Scale-cognitive (ADAS-cog) scores from 817 untreated patients and power and accuracy in the treatment effect estimates after the addition of simulated treatment effects. The model selection and averaging among a set of pre-selected candidate models were driven by the Akaike information criteria (AIC). The type I error rate was controlled only for IMA and rcLRT; the inflation observed otherwise was explained by the placebo model misspecification and selection bias. Both IMA and rcLRT had reasonable power and accuracy except under a low typical treatment effect.