Genome-wide gene expression tuning reveals diverse vulnerabilities of M. tuberculosis.

Antibacterial agents target the products of essential genes but rarely achieve complete target inhibition. Thus, the all-or-none definition of essentiality afforded by traditional genetic approaches fails to discern the most attractive bacterial targets: those whose incomplete inhibition results in major fitness costs. In contrast, gene "vulnerability" is a continuous, quantifiable trait that relates the magnitude of gene inhibition to the effect on bacterial fitness. We developed a CRISPR interference-based functional genomics method to systematically titrate gene expression in Mycobacterium tuberculosis (Mtb) and monitor fitness outcomes. We identified highly vulnerable genes in various processes, including novel targets unexplored for drug discovery. Equally important, we identified invulnerable essential genes, potentially explaining failed drug discovery efforts. Comparison of vulnerability between the reference and a hypervirulent Mtb isolate revealed incomplete conservation of vulnerability and that differential vulnerability can predict differential antibacterial susceptibility. Our results quantitatively redefine essential bacterial processes and identify high-value targets for drug development.

Large-scale chemical-genetics yields new M. tuberculosis inhibitor classes.

New antibiotics are needed to combat rising levels of resistance, with new Mycobacterium tuberculosis (Mtb) drugs having the highest priority. However, conventional whole-cell and biochemical antibiotic screens have failed. Here we develop a strategy termed PROSPECT (primary screening of strains to prioritize expanded chemistry and targets), in which we screen compounds against pools of strains depleted of essential bacterial targets. We engineered strains that target 474 essential Mtb genes and screened pools of 100-150 strains against activity-enriched and unbiased compound libraries, probing more than 8.5 million chemical-genetic interactions. Primary screens identified over tenfold more hits than screening wild-type Mtb alone, with chemical-genetic interactions providing immediate, direct target insights. We identified over 40 compounds that target DNA gyrase, the cell wall, tryptophan, folate biosynthesis and RNA polymerase, as well as inhibitors that target EfpA. Chemical optimization yielded EfpA inhibitors with potent wild-type activity, thus demonstrating the ability of PROSPECT to yield inhibitors against targets that would have eluded conventional drug discovery.

Assessment of transparency indicators across the biomedical literature: How open is open?

Recent concerns about the reproducibility of science have led to several calls for more open and transparent research practices and for the monitoring of potential improvements over time. However, with tens of thousands of new biomedical articles published per week, manually mapping and monitoring changes in transparency is unrealistic. We present an open-source, automated approach to identify 5 indicators of transparency (data sharing, code sharing, conflicts of interest disclosures, funding disclosures, and protocol registration) and apply it across the entire open access biomedical literature of 2.75 million articles on PubMed Central (PMC). Our results indicate remarkable improvements in some (e.g., conflict of interest [COI] disclosures and funding disclosures), but not other (e.g., protocol registration and code sharing) areas of transparency over time, and map transparency across fields of science, countries, journals, and publishers. This work has enabled the creation of a large, integrated, and openly available database to expedite further efforts to monitor, understand, and promote transparency and reproducibility in science.

Feasibility of using real-world data to emulate substance use disorder clinical trials: a cross-sectional study.

INTRODUCTION: Real-world evidence is receiving considerable attention as a way to evaluate the efficacy and safety of medical products for substance use disorders (SUDs). However, the feasibility of using real-world data (RWD) to emulate clinical trials evaluating treatments for SUDs is uncertain. The aim of this study is to identify the number of clinical trials evaluating treatments for SUDs with reported results that could be feasibly emulated using observational data from contemporary insurance claims and/or electronic health record (EHR) data. METHODS: In this cross-sectional study, all phase 2-4 trials evaluating treatments for SUDs registered on ClinicalTrials.gov with reported results were identified. Each trial was evaluated to determine if the indications, interventions, at least 80% of eligibility criteria, comparators, and primary end points could be ascertained using contemporarily available administrative claims and/or structured EHR data. RESULTS: There were 272 SUD trials on ClinicalTrials.gov with reported results. Of these, when examining feasibility using contemporarily available administrative claims and/or structured EHR data, 262 (96.3%) had indications that were ascertainable; 194 (71.3%) had interventions that were ascertainable; 21 (7.7%) had at least 80% of eligibility criteria that were ascertainable; 17 (6.3%) had active comparators that were ascertainable; and 61 (22.4%) had primary end points that were ascertainable. In total, there were no trials for which all 5 characteristics were ascertainable using contemporarily available administrative claims and/or structured EHR data. When considering placebo comparators as ascertainable, there were 6 (2.2%) trials that had all 5 key characteristics classified as ascertainable from contemporarily available administrative claims and/or structured EHR data. CONCLUSIONS: No trials evaluating treatments for SUDs could be feasibly emulated using contemporarily available RWD, demonstrating a need for an increase in the resolution of data capture within a public health system to facilitate trial emulation.

Associations Between Surrogate Markers and Clinical Outcomes for Nononcologic Chronic Disease Treatments.

Importance: Surrogate markers are increasingly used as primary end points in clinical trials supporting drug approvals. Objective: To systematically summarize the evidence from meta-analyses, systematic reviews and meta-analyses, and pooled analyses (hereafter, meta-analyses) of clinical trials examining the strength of association between treatment effects measured using surrogate markers and clinical outcomes in nononcologic chronic diseases. Data sources: The Food and Drug Administration (FDA) Adult Surrogate Endpoint Table and MEDLINE from inception to March 19, 2023. Study Selection: Three reviewers selected meta-analyses of clinical trials; meta-analyses of observational studies were excluded. Data Extraction and Synthesis: Two reviewers extracted correlation coefficients, coefficients of determination, slopes, effect estimates, or results from meta-regression analyses between surrogate markers and clinical outcomes. Main Outcomes and Measures: Correlation coefficient or coefficient of determination, when reported, was classified as high strength (r ≥ 0.85 or R2 ≥ 0.72); primary findings were otherwise summarized. Results: Thirty-seven surrogate markers listed in FDA's table and used as primary end points in clinical trials across 32 unique nononcologic chronic diseases were included. For 22 (59%) surrogate markers (21 chronic diseases), no eligible meta-analysis was identified. For 15 (41%) surrogate markers (14 chronic diseases), at least 1 meta-analysis was identified, 54 in total (median per surrogate marker, 2.5; IQR, 1.3-6.0); among these, median number of trials and patients meta-analyzed was 18.5 (IQR, 12.0-43.0) and 90 056 (IQR, 20 109-170 014), respectively. The 54 meta-analyses reported 109 unique surrogate marker-clinical outcome pairs: 59 (54%) reported at least 1 r or R2, 10 (17%) of which reported at least 1 classified as high strength, whereas 50 (46%) reported slopes, effect estimates, or results of meta-regression analyses only, 26 (52%) of which reported at least 1 statistically significant result. Conclusions and Relevance: Most surrogate markers used as primary end points in clinical trials to support FDA approval of drugs treating nononcologic chronic diseases lacked high-strength evidence of associations with clinical outcomes from published meta-analyses.

Assessing the use of observational methods and real-world data to emulate ongoing randomized controlled trials.

BACKGROUND/AIMS: There has been growing interest in better understanding the potential of observational research methods in medical product evaluation and regulatory decision-making. Previously, we used linked claims and electronic health record data to emulate two ongoing randomized controlled trials, characterizing the populations and results of each randomized controlled trial prior to publication of its results. Here, our objective was to compare the populations and results from the emulated trials with those of the now-published randomized controlled trials. METHODS: This study compared participants' demographic and clinical characteristics and study results between the emulated trials, which used structured data from OptumLabs Data Warehouse, and the published PRONOUNCE and GRADE trials. First, we examined the feasibility of implementing the baseline participant characteristics included in the published PRONOUNCE and GRADE trials' using real-world data and classified each variable as ascertainable, partially ascertainable, or not ascertainable. Second, we compared the emulated trials and published randomized controlled trials for baseline patient characteristics (concordance determined using standardized mean differences <0.20) and results of the primary and secondary endpoints (concordance determined by direction of effect estimates and statistical significance). RESULTS: The PRONOUNCE trial enrolled 544 participants, and the emulated trial included 2226 propensity score-matched participants. In the PRONOUNCE trial publication, one of the 32 baseline participant characteristics was listed as an exclusion criterion on ClinicalTrials.gov but was ultimately not used. Among the remaining 31 characteristics, 9 (29.0%) were ascertainable, 11 (35.5%) were partially ascertainable, and 10 (32.2%) were not ascertainable using structured data from OptumLabs. For one additional variable, the PRONOUNCE trial did not provide sufficient detail to allow its ascertainment. Of the nine variables that were ascertainable, values in the emulated trial and published randomized controlled trial were discordant for 6 (66.7%). The primary endpoint of time from randomization to the first major adverse cardiovascular event and secondary endpoints of nonfatal myocardial infarction and stroke were concordant between the emulated trial and published randomized controlled trial. The GRADE trial enrolled 5047 participants, and the emulated trial included 7540 participants. In the GRADE trial publication, 8 of 34 (23.5%) baseline participant characteristics were ascertainable, 14 (41.2%) were partially ascertainable, and 11 (32.4%) were not ascertainable using structured data from OptumLabs. For one variable, the GRADE trial did not provide sufficient detail to allow for ascertainment. Of the eight variables that were ascertainable, values in the emulated trial and published randomized controlled trial were discordant for 4 (50.0%). The primary endpoint of time to hemoglobin A1c ≥7.0% was mostly concordant between the emulated trial and the published randomized controlled trial. CONCLUSION: Despite challenges, observational methods and real-world data can be leveraged in certain important situations for a more timely evaluation of drug effectiveness and safety in more diverse and representative patient populations.

Predictors of abstinence, no heavy drinking days, and a 2-level reduction in World Health Organization drinking levels during treatment for alcohol use disorder in the COMBINE study.

BACKGROUND: Data from trials of medications for alcohol use disorder (AUD) can be used to identify predictors of drinking outcomes regardless of treatment, which can inform the design of future trials with heterogeneous populations. Here, we identified predictors of abstinence, no heavy drinking days, and a 2-level reduction in World Health Organization (WHO) drinking levels during treatment for AUD in the Combined Pharmacotherapies and Behavioral Interventions (COMBINE) Study. METHODS: We utilized data from the COMBINE Study, a randomized placebo-controlled trial evaluating the efficacy of naltrexone and acamprosate, both alone and in combination, for AUD (n = 1168). A tree-based machine learning algorithm was used to construct classification trees predicting abstinence, no heavy drinking days, and a 2-level reduction in WHO drinking levels in the last 4 weeks of treatment, based on 89 baseline variables. RESULTS: The final tree for predicting abstinence had one split based on consecutive days abstinent prior to randomization, with a higher proportion of subjects achieving abstinence among those classified as abstinent for >2 versus ≤2 consecutive weeks prior to randomization (66% vs. 29%). The final tree for predicting no heavy drinking days in the last 4 weeks of treatment had three splits based on consecutive days abstinent, age, and total Alcohol Dependence Scale score at baseline. Seventy-three percent of the subjects classified as abstinent for >2 consecutive weeks prior to randomization had no heavy drinking days in the last 4 weeks of treatment. Among those classified as abstinent ≤2 consecutive weeks prior, three additional splits showed that younger subjects (age ≤44 years; 37%), and older subjects (age >44) with a total Alcohol Dependence Scale score >13 and complete abstinence (56%) or other drinking goals (35%), were less likely to have no heavy drinking days than older subjects with a total Alcohol Dependence Scale score ≤13 (67%). The final tree for predicting a 2-level reduction in WHO levels had no splits. CONCLUSIONS: Consecutive days abstinent prior to randomization may predict abstinence and no heavy drinking days and total Alcohol Dependence Scale score and age may predict no heavy drinking days. The 2-level reduction in WHO levels outcome may be less likely to discriminate based on multiple patient characteristics.

Medical journal requirements for clinical trial data sharing: Ripe for improvement.

Florian Naudet and co-authors discuss strengthening requirements for sharing clinical trial data.

Depletion of the DarG antitoxin in Mycobacterium tuberculosis triggers the DNA-damage response and leads to cell death.

Of the ~80 putative toxin-antitoxin (TA) modules encoded by the bacterial pathogen Mycobacterium tuberculosis (Mtb), three contain antitoxins essential for bacterial viability. One of these, Rv0060 (DNA ADP-ribosyl glycohydrolase, DarGMtb ), functions along with its cognate toxin Rv0059 (DNA ADP-ribosyl transferase, DarTMtb ), to mediate reversible DNA ADP-ribosylation (Jankevicius et al., 2016). We demonstrate that DarTMtb -DarGMtb form a functional TA pair and essentiality of darGMtb is dependent on the presence of darTMtb , but simultaneous deletion of both darTMtb -darGMtb does not alter viability of Mtb in vitro or in mice. The antitoxin, DarGMtb , forms a cytosolic complex with DNA-repair proteins that assembles independently of either DarTMtb or interaction with DNA. Depletion of DarGMtb alone is bactericidal, a phenotype that is rescued by expression of an orthologous antitoxin, DarGTaq , from Thermus aquaticus. Partial depletion of DarGMtb triggers a DNA-damage response and sensitizes Mtb to drugs targeting DNA metabolism and respiration. Induction of the DNA-damage response is essential for Mtb to survive partial DarGMtb -depletion and leads to a hypermutable phenotype.

Reproducible research practices, transparency, and open access data in the biomedical literature, 2015-2017.

Currently, there is a growing interest in ensuring the transparency and reproducibility of the published scientific literature. According to a previous evaluation of 441 biomedical journals articles published in 2000-2014, the biomedical literature largely lacked transparency in important dimensions. Here, we surveyed a random sample of 149 biomedical articles published between 2015 and 2017 and determined the proportion reporting sources of public and/or private funding and conflicts of interests, sharing protocols and raw data, and undergoing rigorous independent replication and reproducibility checks. We also investigated what can be learned about reproducibility and transparency indicators from open access data provided on PubMed. The majority of the 149 studies disclosed some information regarding funding (103, 69.1% [95% confidence interval, 61.0% to 76.3%]) or conflicts of interest (97, 65.1% [56.8% to 72.6%]). Among the 104 articles with empirical data in which protocols or data sharing would be pertinent, 19 (18.3% [11.6% to 27.3%]) discussed publicly available data; only one (1.0% [0.1% to 6.0%]) included a link to a full study protocol. Among the 97 articles in which replication in studies with different data would be pertinent, there were five replication efforts (5.2% [1.9% to 12.2%]). Although clinical trial identification numbers and funding details were often provided on PubMed, only two of the articles without a full text article in PubMed Central that discussed publicly available data at the full text level also contained information related to data sharing on PubMed; none had a conflicts of interest statement on PubMed. Our evaluation suggests that although there have been improvements over the last few years in certain key indicators of reproducibility and transparency, opportunities exist to improve reproducible research practices across the biomedical literature and to make features related to reproducibility more readily visible in PubMed.

US Food and Drug Administration utilization of postmarketing requirements and postmarketing commitments, 2009-2018.

BACKGROUND/AIMS: The US Food and Drug Administration outlines clinical studies as postmarketing requirements and commitments to be fulfilled following approval of new drugs and biologics ("therapeutics"). Regulators have increasingly emphasized lifecycle evaluation of approved therapeutics, and postmarketing studies are intended to advance our understanding of therapeutic safety and efficacy. However, little is known about the indications that clinical studies outlined in postmarketing requirements and commitments investigate, including whether they are intended to generate evidence for approved or other clinical indications. Therefore, we characterized US Food and Drug Administration postmarketing requirements and commitments for new therapeutics approved from 2009 to 2018. METHODS: We conducted a cross-sectional study of all novel therapeutics, including small-molecule drugs and biologics, receiving original US Food and Drug Administration approval from 2009 to 2018, using approval letters accessed through the Drug@FDA database. Outcomes included the number and characteristics of US Food and Drug Administration postmarketing requirements and commitments for new therapeutics at original approval, including the types of studies outlined, the indications to be investigated, and the clinical evidence to be generated. RESULTS: From 2009 to 2018, the US Food and Drug Administration approved 343 new therapeutics with 1978 postmarketing requirements and commitments. Overall, 750 (37.9%) postmarketing requirements and commitments outlined clinical studies. For 71 of 343 (20.7%) therapeutics, no postmarketing requirements or commitments for clinical studies were outlined, while at least 1 was outlined for 272 (79.3%; median 2 (interquartile range: 1-4)). Among these 272 therapeutics, the number of postmarketing requirements and commitments for clinical studies per therapeutic did not change from 2009 (median: 2 (interquartile range: 1-4)) to 2018 (median: 2 (interquartile range: 1-3)). Among the 750 postmarketing requirements and commitments for clinical studies, 448 (59.7%) outlined new prospective cohort studies, registries, or clinical trials, while the remainder outlined retrospective studies, secondary analyses, or completion of ongoing studies. Although 455 (60.7%) clinical studies investigated only original approved therapeutic indications, 123 (16.4%) enrolled from an expansion of the approved disease population and 61 (8.1%) investigated diseases unrelated to approved indications. CONCLUSIONS: The US Food and Drug Administration approves most new therapeutics with at least 1 postmarketing requirement or commitment for a clinical study, and outlines investigations of safety or efficacy for both approved and unapproved indications. The median number of 2 clinical studies outlined has remained relatively constant over the last decade. Given increasing emphasis by the US Food and Drug Administration on faster approval and lifecycle evaluation of therapeutics, these findings suggest that more postmarketing requirements and commitments may be necessary to address gaps in the clinical evidence available for therapeutics at approval.

Characteristics of available studies and dissemination of research using major clinical data sharing platforms.

BACKGROUND/AIMS: Over the past decade, numerous data sharing platforms have been launched, providing access to de-identified individual patient-level data and supporting documentation. We evaluated the characteristics of prominent clinical data sharing platforms, including types of studies listed as available for request, data requests received, and rates of dissemination of research findings from data requests. METHODS: We reviewed publicly available information listed on the websites of six prominent clinical data sharing platforms: Biological Specimen and Data Repository Information Coordinating Center, ClinicalStudyDataRequest.com, Project Data Sphere, Supporting Open Access to Researchers-Bristol Myers Squibb, Vivli, and the Yale Open Data Access Project. We recorded key platform characteristics, including listed studies and available supporting documentation, information on the number and status of data requests, and rates of dissemination of research findings from data requests (i.e. publications in a peer-reviewed journals, preprints, conference abstracts, or results reported on the platform's website). RESULTS: The number of clinical studies listed as available for request varied among five data sharing platforms: Biological Specimen and Data Repository Information Coordinating Center (n = 219), ClinicalStudyDataRequest.com (n = 2,897), Project Data Sphere (n = 154), Vivli (n = 5426), and the Yale Open Data Access Project (n = 395); Supporting Open Access to Researchers did not provide a list of Bristol Myers Squibb studies available for request. Individual patient-level data were nearly always reported as being available for request, as opposed to only Clinical Study Reports (Biological Specimen and Data Repository Information Coordinating Center = 211/219 (96.3%); ClinicalStudyDataRequest.com = 2884/2897 (99.6%); Project Data Sphere = 154/154 (100.0%); and the Yale Open Data Access Project = 355/395 (89.9%)); Vivli did not provide downloadable study metadata. Of 1201 data requests listed on ClinicalStudyDataRequest.com, Supporting Open Access to Researchers-Bristol Myers Squibb, Vivli, and the Yale Open Data Access Project platforms, 586 requests (48.8%) were approved (i.e. data access granted). The majority were for secondary analyses and/or developing/validating methods (ClinicalStudyDataRequest.com = 262/313 (83.7%); Supporting Open Access to Researchers-Bristol Myers Squibb = 22/30 (73.3%); Vivli = 63/84 (75.0%); the Yale Open Data Access Project = 111/159 (69.8%)); four were for re-analyses or corroborations of previous research findings (ClinicalStudyDataRequest.com = 3/313 (1.0%) and the Yale Open Data Access Project = 1/159 (0.6%)). Ninety-five (16.1%) approved data requests had results disseminated via peer-reviewed publications (ClinicalStudyDataRequest.com = 61/313 (19.5%); Supporting Open Access to Researchers-Bristol Myers Squibb = 3/30 (10.0%); Vivli = 4/84 (4.8%); the Yale Open Data Access Project = 27/159 (17.0%)). Forty-two (6.8%) additional requests reported results through preprints, conference abstracts, or on the platform's website (ClinicalStudyDataRequest.com = 12/313 (3.8%); Supporting Open Access to Researchers-Bristol Myers Squibb = 3/30 (10.0%); Vivli = 2/84 (2.4%); Yale Open Data Access Project = 25/159 (15.7%)). CONCLUSION: Across six prominent clinical data sharing platforms, information on studies and request metrics varied in availability and format. Most data requests focused on secondary analyses and approximately one-quarter of all approved requests publicly disseminated their results. To further promote the use of shared clinical data, platforms should increase transparency, consistently clarify the availability of the listed studies and supporting documentation, and ensure that research findings from data requests are disseminated.

Evaluation of confounding in epidemiologic studies assessing alcohol consumption on the risk of ischemic heart disease.

BACKGROUND: Among different investigators studying the same exposures and outcomes, there may be a lack of consensus about potential confounders that should be considered as matching, adjustment, or stratification variables in observational studies. Concerns have been raised that confounding factors may affect the results obtained for the alcohol-ischemic heart disease relationship, as well as their consistency and reproducibility across different studies. Therefore, we assessed how confounders are defined, operationalized, and discussed across individual studies evaluating the impact of alcohol on ischemic heart disease risk. METHODS: For observational studies included in a recent alcohol-ischemic heart disease meta-analysis, we identified all variables adjusted, matched, or stratified for in the largest reported multivariate model (i.e. potential confounders). We recorded how the variables were measured and grouped them into higher-level confounder domains. Abstracts and Discussion sections were then assessed to determine whether authors considered confounding when interpreting their study findings. RESULTS: 85 of 87 (97.7%) studies reported multivariate analyses for an alcohol-ischemic heart disease relationship. The most common higher-level confounder domains included were smoking (79, 92.9%), age (74, 87.1%), and BMI, height, and/or weight (57, 67.1%). However, no two models adjusted, matched, or stratified for the same higher-level confounder domains. Most (74/87, 85.1%) articles mentioned or alluded to "confounding" in their Abstract or Discussion sections, but only one stated that their main findings were likely to be affected by residual confounding. There were five (5/87, 5.7%) authors that explicitly asked for caution when interpreting results. CONCLUSION: There is large variation in the confounders considered across observational studies evaluating the impact of alcohol on ischemic heart disease risk and almost all studies spuriously ignore or eventually dismiss confounding in their conclusions. Given that study results and interpretations may be affected by the mix of potential confounders included within multivariate models, efforts are necessary to standardize approaches for selecting and accounting for confounders in observational studies.

Postmarketing commitments for novel drugs and biologics approved by the US Food and Drug Administration: a cross-sectional analysis.

BACKGROUND: Postmarketing commitments are clinical studies that pharmaceutical companies agree to conduct at the time of FDA approval, but which are not required by statute or regulation. As FDA increasingly adopts a lifecycle evaluation process, greater emphasis will be placed on postmarket evidence as a component of therapeutic evaluation. Therefore, the objectives of this study were to determine how often postmarketing commitments agreed upon by pharmaceutical companies at first FDA approval lead to new clinical trials and to establish the characteristics and rates of completion and dissemination of postmarketing commitments. METHODS: For new drugs and biologics approved in 2009-2012, we used public FDA documents, ClinicalTrials.gov, and Scopus, to determine postmarketing commitments and their characteristics known at the time of FDA approval; number subject to reporting requirements, for which FDA is required to make study status information available to the public ("506B studies"), and their statuses; and rates of registration and results reporting on ClinicalTrials.gov and publication in peer-reviewed journals for all clinical trials. RESULTS: Among 110 novel drugs and biologics approved by the FDA between 2009 and 2012, 61 (55.5%) had at least one postmarketing commitment at the time of first approval. Of 331 total postmarketing commitments, 33 (10.0%) were for new clinical trials; 27 of these were 506B studies subject to public reporting requirements, of which 12 (44.4%) did not have a recent (i.e., up-to-date) or closed (i.e., fulfilled or released) status provided publicly by the FDA. Although two postmarketing commitments were insufficiently described in FDA records to perform searches on ClinicalTrials.gov, nearly all (28, 90.3%) of the 31 remaining postmarketing commitments for new clinical trials were registered on ClinicalTrials.gov. Among the registered trials, 23 (23 of 28, 82.1%) were classified as completed or terminated, of which 22 (95.7%) had reported results. When considering all 29 completed or terminated clinical trials, registered or unregistered on ClinicalTrials.gov, only half (14, 48.3%) were published in peer-reviewed journals. CONCLUSIONS: While only 15% of postmarketing commitments agreed to by pharmaceutical companies at the time of FDA approval were for new clinical trials, these trials were nearly always registered with reported results on ClinicalTrials.gov. However, only half were published, and despite FDA public reporting requirements, recent status information was often unavailable for 506B studies.

Age-treatment subgroup analyses in Cochrane intervention reviews: a meta-epidemiological study.

BACKGROUND: There is growing interest in evaluating differences in healthcare interventions across routinely collected demographic characteristics. However, individual subgroup analyses in randomized controlled trials are often not prespecified, adjusted for multiple testing, or conducted using the appropriate statistical test for interaction, and therefore frequently lack credibility. Meta-analyses can be used to examine the validity of potential subgroup differences by collating evidence across trials. Here, we characterize the conduct and clinical translation of age-treatment subgroup analyses in Cochrane reviews. METHODS: For a random sample of 928 Cochrane intervention reviews of randomized trials, we determined how often subgroup analyses of age are reported, how often these analyses have a P < 0.05 from formal interaction testing, how frequently subgroup differences first observed in an individual trial are later corroborated by other trials in the same meta-analysis, and how often statistically significant results are included in commonly used clinical management resources (BMJ Best Practice, UpToDate, Cochrane Clinical Answers, Google Scholar, and Google search). RESULTS: Among 928 Cochrane intervention reviews, 189 (20.4%) included plans to conduct age-treatment subgroup analyses. The vast majority (162 of 189, 85.7%) of the planned analyses were not conducted, commonly because of insufficient trial data. There were 22 reviews that conducted their planned age-treatment subgroup analyses, and another 3 reviews appeared to perform unplanned age-treatment subgroup analyses. These 25 (25 of 928, 2.7%) reviews conducted a total of 97 age-treatment subgroup analyses, of which 65 analyses (in 20 reviews) had non-overlapping subgroup levels. Among the 65 age-treatment subgroup analyses, 14 (21.5%) did not report any formal interaction testing. Seven (10.8%) reported P < 0.05 from formal age-treatment interaction testing; however, none of these seven analyses were in reviews that discussed the potential biological rationale or clinical significance of the subgroup findings or had results that were included in common clinical practice resources. CONCLUSION: Age-treatment subgroup analyses in Cochrane intervention reviews were frequently planned but rarely conducted, and implications of detected interactions were not discussed in the reviews or mentioned in common clinical resources. When subgroup analyses are performed, authors should report the findings, compare the results to previous studies, and outline any potential impact on clinical care.

Beyond genomics: understanding exposotypes through metabolomics.

BACKGROUND: Over the past 20 years, advances in genomic technology have enabled unparalleled access to the information contained within the human genome. However, the multiple genetic variants associated with various diseases typically account for only a small fraction of the disease risk. This may be due to the multifactorial nature of disease mechanisms, the strong impact of the environment, and the complexity of gene-environment interactions. Metabolomics is the quantification of small molecules produced by metabolic processes within a biological sample. Metabolomics datasets contain a wealth of information that reflect the disease state and are consequent to both genetic variation and environment. Thus, metabolomics is being widely adopted for epidemiologic research to identify disease risk traits. In this review, we discuss the evolution and challenges of metabolomics in epidemiologic research, particularly for assessing environmental exposures and providing insights into gene-environment interactions, and mechanism of biological impact. MAIN TEXT: Metabolomics can be used to measure the complex global modulating effect that an exposure event has on an individual phenotype. Combining information derived from all levels of protein synthesis and subsequent enzymatic action on metabolite production can reveal the individual exposotype. We discuss some of the methodological and statistical challenges in dealing with this type of high-dimensional data, such as the impact of study design, analytical biases, and biological variance. We show examples of disease risk inference from metabolic traits using metabolome-wide association studies. We also evaluate how these studies may drive precision medicine approaches, and pharmacogenomics, which have up to now been inefficient. Finally, we discuss how to promote transparency and open science to improve reproducibility and credibility in metabolomics. CONCLUSIONS: Comparison of exposotypes at the human population level may help understanding how environmental exposures affect biology at the systems level to determine cause, effect, and susceptibilities. Juxtaposition and integration of genomics and metabolomics information may offer additional insights. Clinical utility of this information for single individuals and populations has yet to be routinely demonstrated, but hopefully, recent advances to improve the robustness of large-scale metabolomics will facilitate clinical translation.

Reproducible Research Practices and Transparency across the Biomedical Literature.

There is a growing movement to encourage reproducibility and transparency practices in the scientific community, including public access to raw data and protocols, the conduct of replication studies, systematic integration of evidence in systematic reviews, and the documentation of funding and potential conflicts of interest. In this survey, we assessed the current status of reproducibility and transparency addressing these indicators in a random sample of 441 biomedical journal articles published in 2000-2014. Only one study provided a full protocol and none made all raw data directly available. Replication studies were rare (n = 4), and only 16 studies had their data included in a subsequent systematic review or meta-analysis. The majority of studies did not mention anything about funding or conflicts of interest. The percentage of articles with no statement of conflict decreased substantially between 2000 and 2014 (94.4% in 2000 to 34.6% in 2014); the percentage of articles reporting statements of conflicts (0% in 2000, 15.4% in 2014) or no conflicts (5.6% in 2000, 50.0% in 2014) increased. Articles published in journals in the clinical medicine category versus other fields were almost twice as likely to not include any information on funding and to have private funding. This study provides baseline data to compare future progress in improving these indicators in the scientific literature.

Comparison of treatment effect sizes from pivotal and postapproval trials of novel therapeutics approved by the FDA based on surrogate markers of disease: a meta-epidemiological study.

BACKGROUND: The U.S. Food and Drug Administration (FDA) often approves new drugs based on trials that use surrogate markers for endpoints, which involve certain trade-offs and may risk making erroneous inferences about the medical product's actual clinical effect. This study aims to compare the treatment effects among pivotal trials supporting FDA approval of novel therapeutics based on surrogate markers of disease with those observed among postapproval trials for the same indication. METHODS: We searched Drugs@FDA and PubMed to identify published randomized superiority design pivotal trials for all novel drugs initially approved by the FDA between 2005 and 2012 based on surrogate markers as primary endpoints and published postapproval trials using the same surrogate markers or patient-relevant outcomes as endpoints. Summary ratio of odds ratios (RORs) and difference between standardized mean differences (dSMDs) were used to quantify the average difference in treatment effects between pivotal and matched postapproval trials. RESULTS: Between 2005 and 2012, the FDA approved 88 novel drugs for 90 indications based on one or multiple pivotal trials using surrogate markers of disease. Of these, 27 novel drugs for 27 indications were approved based on pivotal trials using surrogate markers as primary endpoints that could be matched to at least one postapproval trial, for a total of 43 matches. For nine (75.0%) of the 12 matches using the same non-continuous surrogate markers as trial endpoints, pivotal trials had larger treatment effects than postapproval trials. On average, treatment effects were 50% higher (more beneficial) in the pivotal than the postapproval trials (ROR 1.5; 95% confidence interval CI 1.01-2.23). For 17 (54.8%) of the 31 matches using the same continuous surrogate markers as trial endpoints, pivotal trials had larger treatment effects than the postapproval trials. On average, there was no difference in treatment effects between pivotal and postapproval trials (dSMDs 0.01; 95% CI -0.15-0.16). CONCLUSIONS: Many postapproval drug trials are not directly comparable to previously published pivotal trials, particularly with respect to endpoint selection. Although treatment effects from pivotal trials supporting FDA approval of novel therapeutics based on non-continuous surrogate markers of disease are often larger than those observed among postapproval trials using surrogate markers as trial endpoints, there is no evidence of difference between pivotal and postapproval trials using continuous surrogate markers.