Estimates of Probabilities of Successful Development of Pain Medications: An Analysis of Pharmaceutical Clinical Development Programs from 2000 to 2020.

BACKGROUND: The authors estimate the probability of successful development and duration of clinical trials for medications to treat neuropathic and nociceptive pain. The authors also consider the effect of the perceived abuse potential of the medication on these variables. METHODS: This study uses the Citeline database to compute the probabilities of success, duration, and survivorship of pain medication development programs between January 1, 2000, and June 30, 2020, conditioned on the phase, type of pain (nociceptive vs. neuropathic), and the abuse potential of the medication. RESULTS: The overall probability of successful development of all pain medications from phase 1 to approval is 10.4% (standard error, 1.5%). Medications to treat nociceptive and neuropathic pain have a probability of successful development of 13.3% (standard error, 2.3%) and 7.1% (standard error, 1.9%), respectively. The probability of successful development of medications with high abuse potential and low abuse potential are 27.8% (standard error, 4.6%) and 4.7% (standard error, 1.2%), respectively. The most common period for attrition is between phase 3 and approval. CONCLUSIONS: The authors' data suggest that the unique attributes of pain medications, such as their abuse potential and intended pathology, can influence the probability of successful development and duration of development.

Estimation of clinical trial success rates and related parameters.

Previous estimates of drug development success rates rely on relatively small samples from databases curated by the pharmaceutical industry and are subject to potential selection biases. Using a sample of 406 038 entries of clinical trial data for over 21 143 compounds from January 1, 2000 to October 31, 2015, we estimate aggregate clinical trial success rates and durations. We also compute disaggregated estimates across several trial features including disease type, clinical phase, industry or academic sponsor, biomarker presence, lead indication status, and time. In several cases, our results differ significantly in detail from widely cited statistics. For example, oncology has a 3.4% success rate in our sample vs. 5.1% in prior studies. However, after declining to 1.7% in 2012, this rate has improved to 2.5% and 8.3% in 2014 and 2015, respectively. In addition, trials that use biomarkers in patient-selection have higher overall success probabilities than trials without biomarkers.

Multimorbidity and mortality: A data science perspective.

Background: With multimorbidity becoming the norm rather than the exception, the management of multiple chronic diseases is a major challenge facing healthcare systems worldwide. Methods: Using a large, nationally representative database of electronic medical records from the United Kingdom spanning the years 2005-2016 and consisting over 4.5 million patients, we apply statistical methods and network analysis to identify comorbid pairs and triads of diseases and identify clusters of chronic conditions across different demographic groups. Unlike many previous studies, which generally adopt cross-sectional designs based on single snapshots of closed cohorts, we adopt a longitudinal approach to examine temporal changes in the patterns of multimorbidity. In addition, we perform survival analysis to examine the impact of multimorbidity on mortality. Results: The proportion of the population with multimorbidity has increased by approximately 2.5 percentage points over the last decade, with more than 17% having at least two chronic morbidities. We find that the prevalence and the severity of multimorbidity, as quantified by the number of co-occurring chronic conditions, increase progressively with age. Stratifying by socioeconomic status, we find that people living in more deprived areas are more likely to be multimorbid compared to those living in more affluent areas at all ages. The same trend holds consistently for all years in our data. In general, hypertension, diabetes, and respiratory-related diseases demonstrate high in-degree centrality and eigencentrality, while cardiac disorders show high out-degree centrality. Conclusions: We use data-driven methods to characterize multimorbidity patterns in different demographic groups and their evolution over the past decade. In addition to a number of strongly associated comorbid pairs (e.g., cardiac-vascular and cardiac-metabolic disorders), we identify three principal clusters: a respiratory cluster, a cardiovascular cluster, and a mixed cardiovascular-renal-metabolic cluster. These are supported by established pathophysiological mechanisms and shared risk factors, and largely confirm and expand on the results of existing studies in the medical literature. Our findings contribute to a more quantitative understanding of the epidemiology of multimorbidity, an important pre-requisite for developing more effective medical care and policy for multimorbid patients.

The reaction of sponsor stock prices to clinical trial outcomes: An event study analysis.

We perform an event study analysis that quantifies the market reaction to clinical trial result announcements for 13,807 trials from 2000 to 2020, one of the largest event studies of clinical trials to date. We first determine the specific dates in the clinical trial process on which the greatest impact on the stock prices of their sponsor companies occur. We then analyze the relationship between the abnormal returns observed on these dates due to the clinical trial outcome and the properties of the trial, such as its phase, target accrual, design category, and disease and sponsor company type (biotechnology or pharmaceutical). We find that the classification of a company as "early biotechnology" or "big pharmaceutical" had the most impact on abnormal returns, followed by properties such as disease, outcome, the phase of the clinical trial, and target accrual. We also find that these properties and classifications by themselves were insufficient to explain the variation in excess returns observed due to clinical trial outcomes.

Accelerating glioblastoma therapeutics via venture philanthropy.

Development of curative treatments for glioblastoma (GBM) has been stagnant in recent decades largely because of significant financial risks. A portfolio-based strategy for the parallel discovery of breakthrough therapies can effectively reduce the financial risks of potentially transformative clinical trials for GBM. Using estimates from domain experts at the National Brain Tumor Society (NBTS), we analyze the performance of a portfolio of 20 assets being developed for GBM, diversified across different development phases and therapeutic mechanisms. We find that the portfolio generates a 14.9% expected annualized rate of return. By incorporating the adaptive trial platform GBM AGILE in our simulations, we show that at least one drug candidate in the portfolio will receive US Food and Drug Administration (FDA) approval with a probability of 79.0% in the next decade.

Life sciences intellectual property licensing at the Massachusetts Institute of Technology.

Academic institutions play a central role in the biotech industry through technology licensing and the creation of startups, but few data are available on their performance and the magnitude of their impact. Here we present a systematic study of technology licensing by one such institution, the Massachusetts Institute of Technology (MIT). Using data on the 76 therapeutics-focused life sciences companies formed through MIT's Technology Licensing Office from 1983 to 2017, we construct several measures of impact, including MIT patents cited in the Orange Book, capital raised, outcomes from mergers and acquisitions, patents granted to MIT intellectual property licensees, drug candidates discovered and US drug approvals-a key benchmark of innovation in the biopharmaceutical industry. As of December 2017, Orange Book listings for four approved small-molecule drugs cite MIT patents, but another 31 FDA-approved drugs (excluding candidates acquired after phase 3) had some involvement of MIT licensees. Fifty-five percent of the latter were either a new molecular entity or a new biological entity, and 55% were granted priority review, an indication that they address an unmet medical need. The methodology described here may be a useful framework for other academic institutions to track outcomes of intellectual property in the therapeutics domain.

Predicting drug approvals: The Novartis data science and artificial intelligence challenge.

We describe a novel collaboration between academia and industry, an in-house data science and artificial intelligence challenge held by Novartis to develop machine-learning models for predicting drug-development outcomes, building upon research at MIT using data from Informa as the starting point. With over 50 cross-functional teams from 25 Novartis offices around the world participating in the challenge, the domain expertise of these Novartis researchers was leveraged to create predictive models with greater sophistication. Ultimately, two winning teams developed models that outperformed the baseline MIT model-areas under the curve of 0.88 and 0.84 versus 0.78, respectively-through state-of-the-art machine-learning algorithms and the use of newly incorporated features and data. In addition to validating the variables shown to be associated with drug approval in the earlier MIT study, the challenge also provided new insights into the drivers of drug-development success and failure.

A cost/benefit analysis of clinical trial designs for COVID-19 vaccine candidates.

We compare and contrast the expected duration and number of infections and deaths averted among several designs for clinical trials of COVID-19 vaccine candidates, including traditional and adaptive randomized clinical trials and human challenge trials. Using epidemiological models calibrated to the current pandemic, we simulate the time course of each clinical trial design for 756 unique combinations of parameters, allowing us to determine which trial design is most effective for a given scenario. A human challenge trial provides maximal net benefits-averting an additional 1.1M infections and 8,000 deaths in the U.S. compared to the next best clinical trial design-if its set-up time is short or the pandemic spreads slowly. In most of the other cases, an adaptive trial provides greater net benefits.

Machine-Learning and Stochastic Tumor Growth Models for Predicting Outcomes in Patients With Advanced Non-Small-Cell Lung Cancer.

PURPOSE: The prediction of clinical outcomes for patients with cancer is central to precision medicine and the design of clinical trials. We developed and validated machine-learning models for three important clinical end points in patients with advanced non-small-cell lung cancer (NSCLC)-objective response (OR), progression-free survival (PFS), and overall survival (OS)-using routinely collected patient and disease variables. METHODS: We aggregated patient-level data from 17 randomized clinical trials recently submitted to the US Food and Drug Administration evaluating molecularly targeted therapy and immunotherapy in patients with advanced NSCLC. To our knowledge, this is one of the largest studies of NSCLC to consider biomarker and inhibitor therapy as candidate predictive variables. We developed a stochastic tumor growth model to predict tumor response and explored the performance of a range of machine-learning algorithms and survival models. Models were evaluated on out-of-sample data using the standard area under the receiver operating characteristic curve and concordance index (C-index) performance metrics. RESULTS: Our models achieved promising out-of-sample predictive performances of 0.79 area under the receiver operating characteristic curve (95% CI, 0.77 to 0.81), 0.67 C-index (95% CI, 0.66 to 0.69), and 0.73 C-index (95% CI, 0.72 to 0.74) for OR, PFS, and OS, respectively. The calibration plots for PFS and OS suggested good agreement between actual and predicted survival probabilities. In addition, the Kaplan-Meier survival curves showed that the difference in survival between the low- and high-risk groups was significant (log-rank test P < .001) for both PFS and OS. CONCLUSION: Biomarker status was the strongest predictor of OR, PFS, and OS in patients with advanced NSCLC treated with immune checkpoint inhibitors and targeted therapies. However, single biomarkers have limited predictive value, especially for programmed death-ligand 1 immunotherapy. To advance beyond the results achieved in this study, more comprehensive data on composite multiomic signatures is required.

Just how good an investment is the biopharmaceutical sector?

Uncertainty surrounding the risk and reward of investments in biopharmaceutical companies poses a challenge to those interested in funding such enterprises. Using data on publicly traded stocks, we track the performance of 1,066 biopharmaceutical companies from 1930 to 2015-the most comprehensive financial analysis of this sector to date. Our systematic exploration of methods for distinguishing biotech and pharmaceutical companies yields a dynamic, more accurate classification method. We find that the performance of the biotech sector is highly sensitive to the presence of a few outlier companies, and confirm that nearly all biotech companies are loss-making enterprises, exhibiting high stock volatility. In contrast, since 2000, pharmaceutical companies have become increasingly profitable, with risk-adjusted returns consistently outperforming the market. The performance of all biopharmaceutical companies is subject not only to factors arising from their drug pipelines (idiosyncratic risk), but also from general economic conditions (systematic risk). The risk associated with returns has profound implications both for patterns of investment and for funding innovation in biomedical R&D.