ABSTRACT
Background: Major adverse cardiovascular events (MACE) are a leading cause of morbidity and mortality among adults with type 2 diabetes. Currently, available MACE prediction models have important limitations, including reliance on data that may not be routinely available, narrow focus on primary prevention, limited patient populations, and longtime horizons for risk prediction. Objectives: The purpose of this study was to derive and internally validate a claims-based prediction model for 1-year risk of MACE in type 2 diabetes. Methods: Using medical and pharmacy claims for adults with type 2 diabetes enrolled in commercial, Medicare Advantage, and Medicare fee-for-service plans between 2014 and 2021, we derived and internally validated the annualized claims-based MACE estimator (ACME) model to predict the risk of MACE (nonfatal acute myocardial infarction, nonfatal stroke, and all-cause mortality). The Cox proportional hazards model was composed of 30 covariates, including patient age, sex, comorbidities, and medications. Results: The study cohort comprised 6,623,526 adults with type 2 diabetes, mean age 68.1 ± 10.6 years, 49.8% women, and 73.0% Non-Hispanic White. ACME had a concordance index of 0.74 (validation index range: 0.739-0.741). The predicted 1-year risk of the study cohort ranged from 0.4% to 99.9%, with a median risk of 3.4% (IQR: 2.3%-6.5%). Conclusions: ACME was derived in a large usual care population, relies on routinely available data, and estimates short-term MACE risk. It can support population risk stratification at the health system and payer levels, participant identification for decentralized clinical trials of cardiovascular disease, and risk-stratified observational studies using real-world data.
ABSTRACT
Cardiovascular disease (CVD) is the leading cause of death among people with type 2 diabetes1-5, most of whom are at moderate CVD risk6, yet there is limited evidence on the preferred choice of glucose-lowering medication for CVD risk reduction in this population. Here, we report the results of a retrospective cohort study where data for US adults with type 2 diabetes and moderate risk for CVD are used to compare the risks of experiencing a major adverse cardiovascular event with initiation of glucagon-like peptide-1 receptor agonists (GLP-1RA; n = 44,188), sodium-glucose cotransporter 2 inhibitors (SGLT2i; n = 47,094), dipeptidyl peptidase-4 inhibitors (DPP4i; n = 84,315) and sulfonylureas (n = 210,679). Compared to DPP4i, GLP-1RA (hazard ratio (HR) 0.87; 95% confidence interval (CI) 0.82-0.93) and SGLT2i (HR 0.85; 95% CI 0.81-0.90) were associated with a lower risk of a major adverse cardiovascular event, whereas sulfonylureas were associated with a higher risk (HR 1.19; 95% CI 1.16-1.22). Thus, GLP-1RA and SGLT2i may be the preferred glucose-lowering agents for cardiovascular risk reduction in patients at moderate baseline risk for CVD. ClinicalTrials.gov registration: NCT05214573.
ABSTRACT
BACKGROUND: The use of fidaxomicin is recommended as first line therapy for all patients with Clostridioides difficile infection (CDI). However, real-world studies have shown conflicting evidence of superiority. METHODS: We conducted a retrospective single center study of patients diagnosed with CDI between 2011-2021. A primary composite outcome of clinical failure, 30-day relapse or CDI-related death was used. A multivariable cause specific Cox proportional hazards model was used to evaluate fidaxomicin compared to vancomycin in preventing the composite outcome. A separate model was fit on a subset of patients with C. difficile ribotypes adjusting for ribotype. RESULTS: There were 598 patients included, of whom 84 received fidaxomicin. The primary outcome occurred in 8 (9.5%) in the fidaxomicin group compared to 111 (21.6%) in the vancomycin group. The adjusted multivariable model showed fidaxomicin was associated with 63% reduction in the risk of the composite outcome compared to vancomycin (HR = 0.37, 95% CI 0.17-0.80). In the 337 patients with ribotype data after adjusting for ribotype 027, the results showing superiority of fidaxomicin were maintained (HR = 0.19, 95% CI 0.05-0.77). CONCLUSION: In the treatment of CDI, we showed that real-world use of fidaxomicin is associated with lower risk of a composite endpoint of treatment failure.
ABSTRACT
BACKGROUND AND OBJECTIVES: Whether patent foramen ovale (PFO) closure benefits older patients with PFO and cryptogenic stroke is unknown because randomized controlled trials (RCTs) have predominantly enrolled patients younger than 60 years of age. Our objective was to estimate anticipated effects of PFO closure in older patients to predict the numbers needed to plan an RCT. METHODS: Effectiveness estimates are derived from major observational studies (Risk of Paradoxical Embolism [RoPE] Study and Oxford Vascular Study, together referred to as the "RoPE-Ox" database) and all 6 major RCTs (Systematic, Collaborative, PFO Closure Evaluation [SCOPE] Consortium). To estimate stroke recurrence risk, observed outcomes were calculated for patients older than 60 years in the age-inclusive observational databases (n = 549). To estimate the reduction in the rate of recurrent stroke associated with PFO closure vs medical therapy based on the RoPE score and the presence of high-risk PFO features, a Cox proportional hazards regression model was developed on the RCT data in the SCOPE database (n = 3,740). These estimates were used to calculate sample sizes required for a future RCT. RESULTS: Five-year risk of stroke recurrence using Kaplan-Meier estimates was 13.7 (95% CI 10.5-17.9) overall, 14.9% (95% CI 10.2-21.6) in those with high-risk PFO features. Predicted relative reduction in the event rate with PFO closure was 12.9% overall, 48.8% in those with a high-risk PFO feature. Using these estimates, enrolling all older patients with cryptogenic stroke and PFO would require much larger samples than those used for prior PFO closure trials, but selectively enrolling patients with high-risk PFO features would require totals of 630 patients for 90% power and 471 patients for 80% power, with an average of 5 years of follow-up. DISCUSSION: Based on our projections, anticipated effect sizes in older patients with high-risk features make a trial in these subjects feasible. With lengthening life expectancy in almost all regions of the world, the utility of PFO closure in older adults is increasingly important to explore.
Subject(s)
Feasibility Studies , Foramen Ovale, Patent , Patient Selection , Stroke , Humans , Foramen Ovale, Patent/complications , Foramen Ovale, Patent/surgery , Aged , Stroke/etiology , Male , Female , Middle Aged , Randomized Controlled Trials as Topic , Recurrence , Treatment Outcome , Age Factors , Aged, 80 and overABSTRACT
Background: Older patients with Hodgkin lymphoma (HL) often have comorbid cardiovascular disease; however, the impact of pre-existing heart failure (HF) on the management and outcomes of HL is unknown. Objectives: The aim of this study was to assess the prevalence of pre-existing HF in older patients with HL and its impact on treatment and outcomes. Methods: Linked Surveillance, Epidemiology, and End Results (SEER) and Medicare data from 1999 to 2016 were used to identify patients 65 years and older with newly diagnosed HL. Pre-existing HF, comorbidities, and cancer treatment were ascertained from billing codes and cause-specific mortality from SEER. The associations between pre-existing HF and cancer treatment were estimated using multivariable logistic regression. Cause-specific Cox proportional hazards models adjusted for comorbidities and cancer treatment were used to estimate the association between pre-existing HF and cause-specific mortality. Results: Among 3,348 patients (mean age 76 ± 7 years, 48.6% women) with newly diagnosed HL, pre-existing HF was present in 437 (13.1%). Pre-existing HF was associated with a lower likelihood of using anthracycline-based chemotherapy regimens (OR: 0.42; 95% CI: 0.29-0.60) and a higher likelihood of lymphoma mortality (HR: 1.25; 95% CI: 1.06-1.46) and cardiovascular mortality (HR: 2.57; 95% CI: 1.96-3.36) in models adjusted for comorbidities. One-year lymphoma mortality cumulative incidence was 37.4% (95% CI: 35.5%-39.5%) with pre-existing HF and 26.3% (95% CI: 25.0%-27.6%) without pre-existing HF. The cardioprotective medications dexrazoxane and liposomal doxorubicin were used in only 4.2% of patients. Conclusions: Pre-existing HF in older patients with newly diagnosed HL is common and associated with higher 1-year mortality. Strategies are needed to improve lymphoma and cardiovascular outcomes in this high-risk population.
ABSTRACT
Background: The Predictive Approaches to Treatment Effect Heterogeneity (PATH) Statement provides guidance for using predictive modeling to identify differences (i.e., heterogeneity) in treatment effects (benefits and harms) among participants in randomized clinical trials (RCTs). It distinguished risk modeling, which uses a multivariable model to predict risk of trial outcome(s) and then examines treatment effects within strata of predicted risk, from effect modeling, which predicts trial outcomes using models that include treatment, individual participant characteristics and interactions of treatment with selected characteristics. Purpose: To describe studies of heterogeneous treatment effects (HTE) that use predictive modeling in RCT data and cite the PATH Statement. Data Sources: The Cited By functions in PubMed, Google Scholar, Web of Science and SCOPUS databases (Jan 7, 2020 - June 5, 2023). Study Selection: 42 reports presenting 45 predictive models. Data Extraction: Double review with adjudication to identify risk and effect modeling and examine consistency with Statement consensus statements. Credibility of HTE findings was assessed using criteria adapted from the Instrument to assess Credibility of Effect Modification Analyses (ICEMAN). Clinical importance of credible HTE findings was also assessed. Data Synthesis: The numbers of reports, especially risk modeling reports, increased year-on-year. Consistency with consensus statements was high, except for two: only 15 of 32 studies with positive overall findings included a risk model; and most effect models explored many candidate covariates with little prior evidence for effect modification. Risk modeling was more likely than effect modeling to identify both credible HTE (14/19 vs 5/26) and clinically important HTE (10/19 vs 4/26). Limitations: Risk of reviewer bias: reviewers assessing credibility and clinical importance were not blinded to adherence to PATH recommendations. Conclusions: The PATH Statement appears to be influencing research practice. Risk modeling often uncovered clinically important HTE; effect modeling was more often exploratory.
ABSTRACT
This Viewpoint discusses the clinical implications of incidentally discovered covert cerebrovascular disease.
Subject(s)
Cerebrovascular Disorders , Incidental Findings , Humans , Cerebrovascular Disorders/diagnostic imaging , Cerebrovascular Disorders/diagnosisABSTRACT
Covert cerebrovascular disease (CCD) is frequently reported on neuroimaging and associates with increased dementia and stroke risk. We aimed to determine how incidentally-discovered CCD during clinical neuroimaging in a large population associates with mortality. We screened CT and MRI reports of adults aged ≥50 in the Kaiser Permanente Southern California health system who underwent neuroimaging for a non-stroke clinical indication from 2009-2019. Natural language processing identified incidental covert brain infarcts (CBI) and/or white matter hyperintensities (WMH), grading WMH as mild/moderate/severe. Models adjusted for age, sex, ethnicity, multimorbidity, vascular risks, depression, exercise, and imaging modality. Of n=241,028, the mean age was 64.9 (SD=10.4); mean follow-up 4.46 years; 178,554 (74.1%) had CT; 62,474 (25.9%) had MRI; 11,328 (4.7%) had CBI; and 69,927 (29.0%) had WMH. The mortality rate per 1,000 person-years with CBI was 59.0 (95%CI 57.0-61.1); with WMH=46.5 (45.7-47.2); with neither=17.4 (17.1-17.7). In adjusted models, mortality risk associated with CBI was modified by age, e.g. HR 1.34 [1.21-1.48] at age 56.1 years vs HR 1.22 [1.17-1.28] at age 72 years. Mortality associated with WMH was modified by both age and imaging modality e.g., WMH on MRI at age 56.1 HR = 1.26 [1.18-1.35]; WMH on MRI at age 72 HR 1.15 [1.09-1.21]; WMH on CT at age 56.1 HR 1.41 [1.33-1.50]; WMH on CT at age 72 HR 1.28 [1.24-1.32], vs. patients without CBI or without WMH, respectively. Increasing WMH severity associated with higher mortality, e.g. mild WMH on MRI had adjusted HR=1.13 [1.06-1.20] while severe WMH on CT had HR=1.45 [1.33-1.59]. Incidentally-detected CBI and WMH on population-based clinical neuroimaging can predict higher mortality rates. We need treatments and healthcare planning for individuals with CCD.
ABSTRACT
Background: Invasive infection remains a dangerous complication of heart transplantation (HT). No objectively defined set of clinical risk factors has been established to reliably predict infection in HT. The aim of this study was to develop a clinical prediction model for use at 1 mo post-HT to predict serious infection by 1 y. Methods: A retrospective cohort study of HT recipients (2000-2018) was performed. The composite endpoint included cytomegalovirus (CMV), herpes simplex or varicella zoster virus infection, blood stream infection, invasive fungal, or nocardial infection occurring 1 mo to 1 y post-HT. A least absolute shrinkage and selection operator regression model was constructed using 10 candidate variables. A concordance statistic, calibration curve, and mean calibration error were calculated. A scoring system was derived for ease of clinical application. Results: Three hundred seventy-five patients were analyzed; 93 patients experienced an outcome event. All variables remained in the final model: aged 55 y or above, history of diabetes, need for renal replacement therapy in first month, CMV risk derived from donor and recipient serology, use of induction and/or early lymphodepleting therapy in the first month, use of trimethoprim-sulfamethoxazole prophylaxis at 1 mo, lymphocyte count under 0.75 × 103cells/µL at 1 mo, and inpatient status at 1 mo. Good discrimination (C-index 0.80) and calibration (mean absolute calibration error 3.6%) were demonstrated. Conclusion: This model synthesizes multiple highly relevant clinical parameters, available at 1 mo post-HT, into a unified, objective, and clinically useful prediction tool for occurrence of serious infection by 1 y post-HT.
ABSTRACT
BACKGROUND: Covert cerebrovascular disease (CCD) includes white matter disease (WMD) and covert brain infarction (CBI). Incidentally-discovered CCD is associated with increased risk of subsequent symptomatic stroke. However, it is unknown whether the severity of WMD or the location of CBI predicts risk. OBJECTIVES: To examine the association of incidentally-discovered WMD severity and CBI location with risk of subsequent symptomatic stroke. METHOD: This retrospective cohort study includes patients ï³50 years old in the Kaiser Permanente Southern California health system who received neuroimaging for a non-stroke indication between 2009-2019. Incidental CBI and WMD were identified via natural language processing of the neuroimage report, and WMD severity was classified into grades. RESULTS: 261,960 patients received neuroimaging; 78,555 (30.0%) were identified to have incidental WMD, and 12,857 (4.9%) to have incidental CBI. Increasing WMD severity is associated with increased incidence rate of future stroke. However, the stroke incidence rate in CT-identified WMD is higher at each level of severity compared to rates in MRI-identified WMD. Patients with mild WMD via CT have a stroke incidence rate of 24.9 per 1,000 person-years, similar to that of patients with severe WMD via MRI. Among incidentally-discovered CBI patients with a determined CBI location, 97.9% are subcortical rather than cortical infarcts. CBI confers a similar risk of future stroke, whether cortical or subcortical, or whether MRI- or CT-detected. CONCLUSIONS: Increasing severity of incidental WMD is associated with an increased risk of future symptomatic stroke, dependent on the imaging modality. Subcortical and cortical CBI conferred similar risks.
ABSTRACT
INTRODUCTION: Integrated care is effective in reducing all-cause mortality in patients with atrial fibrillation (AF) in primary care, though time and resource intensive. The aim of the current study was to assess whether integrated care should be directed at all AF patients equally. METHODS: The ALL-IN trial (n = 1,240 patients, median age 77 years) was a cluster-randomized trial in which primary care practices were randomized to provide integrated care or usual care to AF patients aged 65 years and older. Integrated care comprised of (i) anticoagulation monitoring, (ii) quarterly checkups and (iii) easy-access consultation with cardiologists. For the current analysis, cox proportional hazard analysis with all clinical variables from the CHA2DS2-VASc score was used to predict all-cause mortality in the ALL-IN trial. Subsequently, the hazard ratio and absolute risk reduction were plotted as a function of this predicted mortality risk to explore treatment heterogeneity. RESULTS: Under usual care, after a median of 2 years follow-up the absolute risk of all-cause mortality in the highest-risk quarter was 31.0%, compared to 4.6% in the lowest-risk quarter. On the relative scale, there was no evidence of treatment heterogeneity (p for interaction = 0.90). However, there was substantial treatment heterogeneity on the absolute scale: risk reduction in the lowest risk- quarter of risk 3.3% (95% CI -0.4% - 7.0) compared to 12.0% (95% CI 2.7% - 22.0) in the highest risk quarter. CONCLUSION: While the relative degree of benefit from integrated AF care is similar in all patients, patients with a high all-cause mortality risk have a greater benefit on an absolute scale and should therefore be prioritized when implementing integrated care.
Subject(s)
Atrial Fibrillation , Delivery of Health Care, Integrated , Stroke , Aged , Humans , Atrial Fibrillation/drug therapy , Proportional Hazards Models , Risk Assessment , Risk Factors , Stroke/etiologyABSTRACT
Multiple sclerosis (MS) is heterogeneous with respect to outcomes, and evaluating possible heterogeneity of treatment effect (HTE) is of high interest. HTE is non-random variation in the magnitude of a treatment effect on a clinical outcome across levels of a covariate (i.e. a patient attribute or set of attributes). Multiple statistical techniques can evaluate HTE. The simplest but most bias-prone is conventional one variable-at-a-time subgroup analysis. Recently, multivariable predictive approaches have been promoted to provide more patient-centered results, by accounting for multiple relevant attributes simultaneously. We review approaches used to estimate HTE in clinical trials of MS.
Subject(s)
Multiple Sclerosis , Humans , Multiple Sclerosis/drug therapy , Clinical Trials as TopicABSTRACT
BACKGROUND: Covert brain infarction (CBI) is highly prevalent and linked with stroke risk factors, increased mortality, and morbidity. Evidence to guide management is sparse. We sought to gain information on current practice and attitudes toward CBI and to compare differences in management according to CBI phenotype. METHODS: We conducted a web-based, structured, international survey from November 2021 to February 2022 among neurologists and neuroradiologists. The survey captured respondents' baseline characteristics, general approach toward CBI and included two case scenarios designed to evaluate management decisions taken upon incidental detection of an embolic-phenotype and a small-vessel-disease phenotype. RESULTS: Of 627 respondents (38% vascular neurologists, 24% general neurologists, and 26% neuroradiologists), 362 (58%) had a partial, and 305 (49%) a complete response. Most respondents were university hospital senior faculty members experienced in stroke, mostly from Europe and Asia. Only 66 (18%) of respondents had established institutional written protocols to manage CBI. The majority indicated that they were uncertain regarding useful investigations and further management of CBI patients (median 67 on a slider 0-100, 95% CI 35-81). Almost all respondents (97%) indicated that they would assess vascular risk factors. Although most would investigate and treat similarly to ischemic stroke for both phenotypes, including initiating antithrombotic treatment, there was considerable diagnostic and therapeutic heterogeneity. Less than half of respondents (42%) would assess cognitive function or depression. CONCLUSIONS: There is a high degree of uncertainty and heterogeneity regarding management of two common types of CBI, even among experienced stroke physicians. Respondents were more proactive regarding the diagnostic and therapeutic management than the minimum recommended by current expert opinions. More data are required to guide management of CBI; meantime, more consistent approaches to identification and consistent application of current knowledge, that also consider cognition and mood, would be promising first steps to improve consistency of care.
Subject(s)
Brain Infarction , Stroke , Humans , Brain Infarction/therapy , Stroke/diagnosis , Neurologists , Europe , AsiaABSTRACT
BACKGROUND: People with comorbidities are underrepresented in clinical trials. Empirical estimates of treatment effect modification by comorbidity are lacking, leading to uncertainty in treatment recommendations. We aimed to produce estimates of treatment effect modification by comorbidity using individual participant data (IPD). METHODS AND FINDINGS: We obtained IPD for 120 industry-sponsored phase 3/4 trials across 22 index conditions (n = 128,331). Trials had to be registered between 1990 and 2017 and have recruited ≥300 people. Included trials were multicentre and international. For each index condition, we analysed the outcome most frequently reported in the included trials. We performed a two-stage IPD meta-analysis to estimate modification of treatment effect by comorbidity. First, for each trial, we modelled the interaction between comorbidity and treatment arm adjusted for age and sex. Second, for each treatment within each index condition, we meta-analysed the comorbidity-treatment interaction terms from each trial. We estimated the effect of comorbidity measured in 3 ways: (i) the number of comorbidities (in addition to the index condition); (ii) presence or absence of the 6 commonest comorbid diseases for each index condition; and (iii) using continuous markers of underlying conditions (e.g., estimated glomerular filtration rate (eGFR)). Treatment effects were modelled on the usual scale for the type of outcome (absolute scale for numerical outcomes, relative scale for binary outcomes). Mean age in the trials ranged from 37.1 (allergic rhinitis trials) to 73.0 (dementia trials) and percentage of male participants range from 4.4% (osteoporosis trials) to 100% (benign prostatic hypertrophy trials). The percentage of participants with 3 or more comorbidities ranged from 2.3% (allergic rhinitis trials) to 57% (systemic lupus erythematosus trials). We found no evidence of modification of treatment efficacy by comorbidity, for any of the 3 measures of comorbidity. This was the case for 20 conditions for which the outcome variable was continuous (e.g., change in glycosylated haemoglobin in diabetes) and for 3 conditions in which the outcomes were discrete events (e.g., number of headaches in migraine). Although all were null, estimates of treatment effect modification were more precise in some cases (e.g., sodium-glucose co-transporter-2 (SGLT2) inhibitors for type 2 diabetes-interaction term for comorbidity count 0.004, 95% CI -0.01 to 0.02) while for others credible intervals were wide (e.g., corticosteroids for asthma-interaction term -0.22, 95% CI -1.07 to 0.54). The main limitation is that these trials were not designed or powered to assess variation in treatment effect by comorbidity, and relatively few trial participants had >3 comorbidities. CONCLUSIONS: Assessments of treatment effect modification rarely consider comorbidity. Our findings demonstrate that for trials included in this analysis, there was no empirical evidence of treatment effect modification by comorbidity. The standard assumption used in evidence syntheses is that efficacy is constant across subgroups, although this is often criticised. Our findings suggest that for modest levels of comorbidities, this assumption is reasonable. Thus, trial efficacy findings can be combined with data on natural history and competing risks to assess the likely overall benefit of treatments in the context of comorbidity.
Subject(s)
Asthma , Diabetes Mellitus, Type 2 , Rhinitis, Allergic , Humans , Male , Comorbidity , Randomized Controlled Trials as TopicABSTRACT
Despite the predominance of the evidence-based medicine paradigm, a fundamental incongruity remains: Evidence is derived from groups of people, yet medical decisions are made by and for individuals. Randomization ensures the comparability of treatment groups within a clinical trial, which allows for unbiased estimation of average treatment effects. If we treated groups of patients instead of individuals, or if patients with the same disease were identical to one another in all factors that determined the harms and the benefits of therapy, then these group-level averages would make a perfectly sound foundation for medical decision-making. But patients differ from one another in many ways that determine the likelihood of an outcome, both with and without a treatment. Nevertheless, popular approaches to evidence-based medicine have encouraged a reliance on the average treatment effects estimated from clinical trials and meta-analysis as guides to decision-making for individuals. Here, we discuss the limitations of this approach as well as limitations of conventional, one-variable-at-a-time subgroup analysis; finally, we discuss the rationale for "predictive" approaches to heterogeneous treatment effects. Predictive approaches to heterogeneous treatment effects combine methods for causal inference (e.g. randomization) with methods for prediction that permit inferences about which patients are likely to benefit and which are not, taking into account multiple relevant variables simultaneously to yield "personalized" estimates of benefit-harm trade-offs. We focus on risk modeling approaches, which rely on the mathematical dependence of the absolute treatment effect with the baseline risk, which varies substantially "across patients" in most trials. While there are a number of examples of risk modeling approaches that have been practice-changing, risk modeling does not provide ideal estimates of individual treatment effects, since risk modeling does not account for how individual variables might modify the effects of therapy. In "effect modeling," prediction models are developed directly on clinical trial data, including terms for treatment and treatment effect interactions. These more flexible approaches may better uncover individualized treatment effects, but are also prone to overfitting when dimensionality is high, power is low, and there is limited prior knowledge about effect modifiers.
Subject(s)
Evidence-Based Medicine , Patient-Centered Care , Humans , Causality , Clinical Trials as TopicABSTRACT
OBJECTIVES: To (1) explore trends of risk of bias (ROB) in prediction research over time following key methodological publications, using the Prediction model Risk Of Bias ASsessment Tool (PROBAST) and (2) assess the inter-rater agreement of the PROBAST. STUDY DESIGN AND SETTING: PubMed and Web of Science were searched for reviews with extractable PROBAST scores on domain and signaling question (SQ) level. ROB trends were visually correlated with yearly citations of key publications. Inter-rater agreement was assessed using Cohen's Kappa. RESULTS: One hundred and thirty nine systematic reviews were included, of which 85 reviews (containing 2,477 single studies) on domain level and 54 reviews (containing 2,458 single studies) on SQ level. High ROB was prevalent, especially in the Analysis domain, and overall trends of ROB remained relatively stable over time. The inter-rater agreement was low, both on domain (Kappa 0.04-0.26) and SQ level (Kappa -0.14 to 0.49). CONCLUSION: Prediction model studies are at high ROB and time trends in ROB as assessed with the PROBAST remain relatively stable. These results might be explained by key publications having no influence on ROB or recency of key publications. Moreover, the trend may suffer from the low inter-rater agreement and ceiling effect of the PROBAST. The inter-rater agreement could potentially be improved by altering the PROBAST or providing training on how to apply the PROBAST.
Subject(s)
Bias , Humans , Risk AssessmentABSTRACT
Treatment effects are often anticipated to vary across groups of patients with different baseline risk. The Predictive Approaches to Treatment Effect Heterogeneity (PATH) statement focused on baseline risk as a robust predictor of treatment effect and provided guidance on risk-based assessment of treatment effect heterogeneity in a randomized controlled trial. The aim of this study is to extend this approach to the observational setting using a standardized scalable framework. The proposed framework consists of five steps: (1) definition of the research aim, i.e., the population, the treatment, the comparator and the outcome(s) of interest; (2) identification of relevant databases; (3) development of a prediction model for the outcome(s) of interest; (4) estimation of relative and absolute treatment effect within strata of predicted risk, after adjusting for observed confounding; (5) presentation of the results. We demonstrate our framework by evaluating heterogeneity of the effect of thiazide or thiazide-like diuretics versus angiotensin-converting enzyme inhibitors on three efficacy and nine safety outcomes across three observational databases. We provide a publicly available R software package for applying this framework to any database mapped to the Observational Medical Outcomes Partnership Common Data Model. In our demonstration, patients at low risk of acute myocardial infarction receive negligible absolute benefits for all three efficacy outcomes, though they are more pronounced in the highest risk group, especially for acute myocardial infarction. Our framework allows for the evaluation of differential treatment effects across risk strata, which offers the opportunity to consider the benefit-harm trade-off between alternative treatments.
ABSTRACT
BACKGROUND: Baseline outcome risk can be an important determinant of absolute treatment benefit and has been used in guidelines for "personalizing" medical decisions. We compared easily applicable risk-based methods for optimal prediction of individualized treatment effects. METHODS: We simulated RCT data using diverse assumptions for the average treatment effect, a baseline prognostic index of risk, the shape of its interaction with treatment (none, linear, quadratic or non-monotonic), and the magnitude of treatment-related harms (none or constant independent of the prognostic index). We predicted absolute benefit using: models with a constant relative treatment effect; stratification in quarters of the prognostic index; models including a linear interaction of treatment with the prognostic index; models including an interaction of treatment with a restricted cubic spline transformation of the prognostic index; an adaptive approach using Akaike's Information Criterion. We evaluated predictive performance using root mean squared error and measures of discrimination and calibration for benefit. RESULTS: The linear-interaction model displayed optimal or close-to-optimal performance across many simulation scenarios with moderate sample size (N = 4,250; ~ 785 events). The restricted cubic splines model was optimal for strong non-linear deviations from a constant treatment effect, particularly when sample size was larger (N = 17,000). The adaptive approach also required larger sample sizes. These findings were illustrated in the GUSTO-I trial. CONCLUSIONS: An interaction between baseline risk and treatment assignment should be considered to improve treatment effect predictions.
Subject(s)
Randomized Controlled Trials as Topic , Humans , Prognosis , Computer Simulation , Sample SizeABSTRACT
Importance: Anthracycline-containing regimens are highly effective for diffuse large B-cell lymphoma (DLBCL); however, patients with preexisting heart failure (HF) may be less likely to receive anthracyclines and may be at higher risk of lymphoma mortality. Objective: To assess the prevalence of preexisting HF in older patients with DLBCL and its association with treatment patterns and outcomes. Design, Setting, and Participants: This longitudinal cohort study used data from the Surveillance, Epidemiology, and End Results (SEER)-Medicare registry from 1999 to 2016. The SEER registry is a system of population-based cancer registries, capturing more than 25% of the US population. Linkage to Medicare offers additional information from billing claims. This study included individuals 65 years and older with newly diagnosed DLBCL from 2000 to 2015 with Medicare Part A or B continuously in the year prior to lymphoma diagnosis. Data were analyzed from September 2020 to December 2022. Exposures: Preexisting HF in the year prior to DLBCL diagnosis ascertained from billing codes required one of the following: (1) 1 primary inpatient discharge diagnosis, (2) 2 outpatient diagnoses, (3) 3 secondary inpatient discharge diagnoses, (4) 3 emergency department diagnoses, or (5) 2 secondary inpatient discharge diagnoses plus 1 outpatient diagnosis. Main Outcomes and Measures: The primary outcome was anthracycline-based treatment. The secondary outcomes were (1) cardioprotective medications and (2) cause-specific mortality. The associations between preexisting HF and cancer treatment were estimated using multivariable logistic regression. The associations between preexisting HF and cause-specific mortality were evaluated using cause-specific Cox proportional hazards models with adjustment for comorbidities and cancer treatment. Results: Of 30â¯728 included patients with DLBCL, 15 474 (50.4%) were female, and the mean (SD) age was 77.8 (7.2) years. Preexisting HF at lymphoma diagnosis was present in 4266 patients (13.9%). Patients with preexisting HF were less likely to be treated with an anthracycline (odds ratio, 0.55; 95% CI, 0.49-0.61). Among patients with preexisting HF who received an anthracycline, dexrazoxane or liposomal doxorubicin were used in 78 of 1119 patients (7.0%). One-year lymphoma mortality was 41.8% (95% CI, 40.5-43.2) with preexisting HF and 29.6% (95% CI, 29.0%-30.1%) without preexisting HF. Preexisting HF was associated with higher lymphoma mortality in models adjusting for baseline and time-varying treatment factors (hazard ratio, 1.24; 95% CI, 1.18-1.31). Conclusions and Relevance: In this study, preexisting HF in patients with newly diagnosed DLBCL was common and was associated with lower use of anthracyclines and lower use of any chemotherapy. Trials are needed for this high-risk population.