Bayesian pairwise meta-analysis of time-to-event outcomes in the presence of non-proportional hazards: A simulation study of flexible parametric, piecewise exponential and fractional polynomial models.

BACKGROUND: Traditionally, meta-analysis of time-to-event outcomes reports a single pooled hazard ratio assuming proportional hazards (PH). For health technology assessment evaluations, hazard ratios are frequently extrapolated across a lifetime horizon. However, when treatment effects vary over time, an assumption of PH is not always valid. The Royston-Parmar (RP), piecewise exponential (PE), and fractional polynomial (FP) models can accommodate non-PH and provide plausible extrapolations of survival curves beyond observed data. METHODS: Simulation study to assess and compare the performance of RP, PE, and FP models in a Bayesian framework estimating restricted mean survival time difference (RMSTD) at 50 years from a pairwise meta-analysis with evidence of non-PH. Individual patient data were generated from a mixture Weibull distribution. Twelve scenarios were considered varying the amount of follow-up data, number of trials in a meta-analysis, non-PH interaction coefficient, and prior distributions. Performance was assessed through bias and mean squared error. Models were applied to a metastatic breast cancer example. RESULTS: FP models performed best when the non-PH interaction coefficient was 0.2. RP models performed best in scenarios with complete follow-up data. PE models performed well on average across all scenarios. In the metastatic breast cancer example, RMSTD at 50-years ranged from -14.6 to 8.48 months. CONCLUSIONS: Synthesis of time-to-event outcomes and estimation of RMSTD in the presence of non-PH can be challenging and computationally intensive. Different approaches make different assumptions regarding extrapolation and sensitivity analyses varying key assumptions are essential to check the robustness of conclusions to different assumptions for the underlying survival function.

New horizons in evidence synthesis for older adults.

Evidence synthesis, embedded within a systematic review of the literature, is a well-established approach for collating and combining all the relevant information on a particular research question. A robust synthesis can establish the evidence base, which underpins best practice guidance. Such endeavours are frequently used by policymakers and practitioners to inform their decision making. Traditionally, an evidence synthesis of interventions consisted of a meta-analysis of quantitative data comparing two treatment alternatives addressing a specific and focussed clinical question. However, as the methods in the field have evolved, especially in response to the increasingly complex healthcare questions, more advanced evidence synthesis techniques have been developed. These can deal with extended data structures considering more than two treatment alternatives (network meta-analysis) and complex multicomponent interventions. The array of questions capable of being answered has also increased with specific approaches being developed for different evidence types including diagnostic, prognostic and qualitative data. Furthermore, driven by a desire for increasingly up-to-date evidence summaries, living systematic reviews have emerged. All of these methods can potentially have a role in informing older adult healthcare decisions. The aim of this review is to increase awareness and uptake of the increasingly comprehensive array of newer synthesis methods available and highlight their utility for answering clinically relevant questions in the context of older adult research, giving examples of where such techniques have already been effectively applied within the field. Their strengths and limitations are discussed, and we suggest user-friendly software options to implement the methods described.

Data visualisation approaches for component network meta-analysis: visualising the data structure.

BACKGROUND: Health and social care interventions are often complex and can be decomposed into multiple components. Multicomponent interventions are often evaluated in randomised controlled trials. Across trials, interventions often have components in common which are given alongside other components which differ across trials. Multicomponent interventions can be synthesised using component NMA (CNMA). CNMA is limited by the structure of the available evidence, but it is not always straightforward to visualise such complex evidence networks. The aim of this paper is to develop tools to visualise the structure of complex evidence networks to support CNMA. METHODS: We performed a citation review of two key CNMA methods papers to identify existing published CNMA analyses and reviewed how they graphically represent intervention complexity and comparisons across trials. Building on identified shortcomings of existing visualisation approaches, we propose three approaches to standardise visualising the data structure and/or availability of data: CNMA-UpSet plot, CNMA heat map, CNMA-circle plot. We use a motivating example to illustrate these plots. RESULTS: We identified 34 articles reporting CNMAs. A network diagram was the most common plot type used to visualise the data structure for CNMA (26/34 papers), but was unable to express the complex data structures and large number of components and potential combinations of components associated with CNMA. Therefore, we focused visualisation development around representing the data structure of a CNMA more completely. The CNMA-UpSet plot presents arm-level data and is suitable for networks with large numbers of components or combinations of components. Heat maps can be utilised to inform decisions about which pairwise interactions to consider for inclusion in a CNMA model. The CNMA-circle plot visualises the combinations of components which differ between trial arms and offers flexibility in presenting additional information such as the number of patients experiencing the outcome of interest in each arm. CONCLUSIONS: As CNMA becomes more widely used for the evaluation of multicomponent interventions, the novel CNMA-specific visualisations presented in this paper, which improve on the limitations of existing visualisations, will be important to aid understanding of the complex data structure and facilitate interpretation of the CNMA results.

Pharmacological and electronic cigarette interventions for smoking cessation in adults: component network meta-analyses.

BACKGROUND: Tobacco smoking is the leading preventable cause of death and disease worldwide. Stopping smoking can reduce this harm and many people would like to stop. There are a number of medicines licenced to help people quit globally, and e-cigarettes are used for this purpose in many countries. Typically treatments work by reducing cravings to smoke, thus aiding initial abstinence and preventing relapse. More information on comparative effects of these treatments is needed to inform treatment decisions and policies. OBJECTIVES: To investigate the comparative benefits, harms and tolerability of different smoking cessation pharmacotherapies and e-cigarettes, when used to help people stop smoking tobacco. SEARCH METHODS: We identified studies from recent updates of Cochrane Reviews investigating our interventions of interest. We updated the searches for each review using the Cochrane Tobacco Addiction Group (TAG) specialised register to 29 April 2022. SELECTION CRITERIA: We included randomised controlled trials (RCTs), cluster-RCTs and factorial RCTs, which measured smoking cessation at six months or longer, recruited adults who smoked combustible cigarettes at enrolment (excluding pregnant people) and randomised them to approved pharmacotherapies and technologies used for smoking cessation worldwide (varenicline, cytisine, nortriptyline, bupropion, nicotine replacement therapy (NRT) and e-cigarettes) versus no pharmacological intervention, placebo (control) or another approved pharmacotherapy. Studies providing co-interventions (e.g. behavioural support) were eligible if the co-intervention was provided equally to study arms. DATA COLLECTION AND ANALYSIS: We followed standard Cochrane methods for screening, data extraction and risk of bias (RoB) assessment (using the RoB 1 tool). Primary outcome measures were smoking cessation at six months or longer, and the number of people reporting serious adverse events (SAEs). We also measured withdrawals due to treatment. We used Bayesian component network meta-analyses (cNMA) to examine intervention type, delivery mode, dose, duration, timing in relation to quit day and tapering of nicotine dose, using odds ratios (OR) and 95% credibility intervals (CrIs). We calculated an effect estimate for combination NRT using an additive model. We evaluated the influence of population and study characteristics, provision of behavioural support and control arm rates using meta-regression. We evaluated certainty using GRADE. MAIN RESULTS: Of our 332 eligible RCTs, 319 (835 study arms, 157,179 participants) provided sufficient data to be included in our cNMA. Of these, we judged 51 to be at low risk of bias overall, 104 at high risk and 164 at unclear risk, and 118 reported pharmaceutical or e-cigarette/tobacco industry funding. Removing studies at high risk of bias did not change our interpretation of the results. Benefits We found high-certainty evidence that nicotine e-cigarettes (OR 2.37, 95% CrI 1.73 to 3.24; 16 RCTs, 3828 participants), varenicline (OR 2.33, 95% CrI 2.02 to 2.68; 67 RCTs, 16,430 participants) and cytisine (OR 2.21, 95% CrI 1.66 to 2.97; 7 RCTs, 3848 participants) were associated with higher quit rates than control. In absolute terms, this might lead to an additional eight (95% CrI 4 to 13), eight (95% CrI 6 to 10) and seven additional quitters per 100 (95% CrI 4 to 12), respectively. These interventions appeared to be more effective than the other interventions apart from combination NRT (patch and a fast-acting form of NRT), which had a lower point estimate (calculated additive effect) but overlapping 95% CrIs (OR 1.93, 95% CrI 1.61 to 2.34). There was also high-certainty evidence that nicotine patch alone (OR 1.37, 95% CrI 1.20 to 1.56; 105 RCTs, 37,319 participants), fast-acting NRT alone (OR 1.41, 95% CrI 1.29 to 1.55; 120 RCTs, 31,756 participants) and bupropion (OR 1.43, 95% CrI 1.26 to 1.62; 71 RCTs, 14,759 participants) were more effective than control, resulting in two (95% CrI 1 to 3), three (95% CrI 2 to 3) and three (95% CrI 2 to 4) additional quitters per 100 respectively. Nortriptyline is probably associated with higher quit rates than control (OR 1.35, 95% CrI 1.02 to 1.81; 10 RCTs, 1290 participants; moderate-certainty evidence), resulting in two (CrI 0 to 5) additional quitters per 100. Non-nicotine/placebo e-cigarettes (OR 1.16, 95% CrI 0.74 to 1.80; 8 RCTs, 1094 participants; low-certainty evidence), equating to one additional quitter (95% CrI -2 to 5), had point estimates favouring the intervention over control, but CrIs encompassed the potential for no difference and harm. There was low-certainty evidence that tapering the dose of NRT prior to stopping treatment may improve effectiveness; however, 95% CrIs also incorporated the null (OR 1.14, 95% CrI 1.00 to 1.29; 111 RCTs, 33,156 participants). This might lead to an additional one quitter per 100 (95% CrI 0 to 2). Harms There were insufficient data to include nortriptyline and non-nicotine EC in the final SAE model. Overall rates of SAEs for the remaining treatments were low (average 3%). Low-certainty evidence did not show a clear difference in the number of people reporting SAEs for nicotine e-cigarettes, varenicline, cytisine or NRT when compared to no pharmacotherapy/e-cigarettes or placebo. Bupropion may slightly increase rates of SAEs, although the CrI also incorporated no difference (moderate certainty). In absolute terms bupropion may cause one more person in 100 to experience an SAE (95% CrI 0 to 2). AUTHORS' CONCLUSIONS: The most effective interventions were nicotine e-cigarettes, varenicline and cytisine (all high certainty), as well as combination NRT (additive effect, certainty not rated). There was also high-certainty evidence for the effectiveness of nicotine patch, fast-acting NRT and bupropion. Less certain evidence of benefit was present for nortriptyline (moderate certainty), non-nicotine e-cigarettes and tapering of nicotine dose (both low certainty). There was moderate-certainty evidence that bupropion may slightly increase the frequency of SAEs, although there was also the possibility of no increased risk. There was no clear evidence that any other tested interventions increased SAEs. Overall, SAE data were sparse with very low numbers of SAEs, and so further evidence may change our interpretation and certainty. Future studies should report SAEs to strengthen certainty in this outcome. More head-to-head comparisons of the most effective interventions are needed, as are tests of combinations of these. Future work should unify data from behavioural and pharmacological interventions to inform approaches to combined support for smoking cessation.

MetaBayesDTA: codeless Bayesian meta-analysis of test accuracy, with or without a gold standard.

BACKGROUND: The statistical models developed for meta-analysis of diagnostic test accuracy studies require specialised knowledge to implement. This is especially true since recent guidelines, such as those in Version 2 of the Cochrane Handbook of Systematic Reviews of Diagnostic Test Accuracy, advocate more sophisticated methods than previously. This paper describes a web-based application - MetaBayesDTA - that makes many advanced analysis methods in this area more accessible. RESULTS: We created the app using R, the Shiny package and Stan. It allows for a broad array of analyses based on the bivariate model including extensions for subgroup analysis, meta-regression and comparative test accuracy evaluation. It also conducts analyses not assuming a perfect reference standard, including allowing for the use of different reference tests. CONCLUSIONS: Due to its user-friendliness and broad array of features, MetaBayesDTA should appeal to researchers with varying levels of expertise. We anticipate that the application will encourage higher levels of uptake of more advanced methods, which ultimately should improve the quality of test accuracy reviews.

Non-opioid analgesics for the prevention of chronic postsurgical pain: a systematic review and network meta-analysis.

BACKGROUND: Chronic postsurgical pain is common after surgery. Identification of non-opioid analgesics with potential for preventing chronic postsurgical pain is important, although trials are often underpowered. Network meta-analysis offers an opportunity to improve power and to identify the most promising therapy for clinical use and future studies. METHODS: We conducted a PRISMA-NMA-compliant systematic review and network meta-analysis of randomised controlled trials of non-opioid analgesics for chronic postsurgical pain. Outcomes included incidence and severity of chronic postsurgical pain, serious adverse events, and chronic opioid use. RESULTS: We included 132 randomised controlled trials with 23 902 participants. In order of efficacy, i.v. lidocaine (odds ratio [OR] 0.32; 95% credible interval [CrI] 0.17-0.58), ketamine (OR 0.64; 95% CrI 0.44-0.92), gabapentinoids (OR 0.67; 95% CrI 0.47-0.92), and possibly dexmedetomidine (OR 0.36; 95% CrI 0.12-1.00) reduced the incidence of chronic postsurgical pain at ≤6 months. There was little available evidence for chronic postsurgical pain at >6 months, combinations agents, chronic opioid use, and serious adverse events. Variable baseline risk was identified as a potential violation to the network meta-analysis transitivity assumption, so results are reported from a fixed value of this, with analgesics more effective at higher baseline risk. The confidence in these findings was low because of problems with risk of bias and imprecision. CONCLUSIONS: Lidocaine (most effective), ketamine, and gabapentinoids could be effective in reducing chronic postsurgical pain ≤6 months although confidence is low. Moreover, variable baseline risk might violate transitivity in network meta-analysis of analgesics; this recommends use of our methods in future network meta-analyses. SYSTEMATIC REVIEW PROTOCOL: PROSPERO CRD42021269642.

A multifaceted graphical display, including treatment ranking, was developed to aid interpretation of network meta-analysis.

OBJECTIVES: Network meta-analysis (NMA) is becoming a popular statistical tool for analyzing a network of evidence comparing more than two interventions. A particular advantage of NMA over pairwise meta-analysis is its ability to simultaneously compare multiple interventions including comparisons not previously trialed together, permitting intervention hierarchies to be created. Our aim was to develop a novel graphical display to aid interpretation of NMA to clinicians and decision-makers that incorporates ranking of interventions. STUDY DESIGN AND SETTING: Current literature was searched, scrutinized, and provided direction for developing the novel graphical display. Ranking results were often found to be misinterpreted when presented alone and, to aid interpretation and effective communication to inform optimal decision-making, need to be displayed alongside other important aspects of the analysis including the evidence networks and relative intervention effect estimates. RESULTS: Two new ranking visualizations were developed-the 'Litmus Rank-O-Gram' and the 'Radial SUCRA' plot-and embedded within a novel multipanel graphical display programmed within the MetaInsight application, with user feedback gained. CONCLUSION: This display was designed to improve the reporting, and facilitate a holistic understanding, of NMA results. We believe uptake of the display would lead to better understanding of complex results and improve future decision-making.

Origami plot: a novel multivariate data visualization tool that improves radar chart.

OBJECTIVES: We propose the origami plot, which maintains the original functionality of a radar chart and avoids potential misuse of its connected regions, with newly added features to better assist multicriteria decision-making. STUDY DESIGN AND SETTING: Built upon a radar chart, the origami plot adds additional auxiliary axes and points such that the area of the connected region of all dots is invariant to the ordering of axes. As such, it enables ranking different individuals by the overall performance for multicriteria decision-making while maintaining the intuitive visual appeal of the radar chart. We develop extensions of the origami plot, including the weighted origami plot, which allows reweighting of each attribute to define the overall performance, and the pairwise origami plot, which highlights comparisons between two individuals. RESULTS: We illustrate the different versions of origami plots using the hospital compare database developed by the Centers for Medicare & Medicaid Services (CMS). The plot shows individual hospital's performance on mortality, readmission, complication, and infection, as well as patient experience and timely and effective care, as well as their overall performance across these metrics. The weighted origami plot allows weighing the attributes differently when some are more important than others. We illustrate the potential use of the pairwise origami plot in electronic health records (EHR) system to monitor five clinical measures (body mass index [BMI]), fasting glucose level, blood pressure, triglycerides, and low-density lipoprotein ([LDL] cholesterol) of a patient across multiple hospital visits. CONCLUSION: The origami plot is a useful visualization tool to assist multicriteria decision making. It improves radar charts by avoiding potential misuse of the connected regions. It has several new features and allows flexible customization.

Double-counting of populations in evidence synthesis in public health: a call for awareness and future methodological development.

BACKGROUND: There is a growing interest in the inclusion of real-world and observational studies in evidence synthesis such as meta-analysis and network meta-analysis in public health. While this approach offers great epidemiological opportunities, use of such studies often introduce a significant issue of double-counting of participants and databases in a single analysis. Therefore, this study aims to introduce and illustrate the nuances of double-counting of individuals in evidence synthesis including real-world and observational data with a focus on public health. METHODS: The issues associated with double-counting of individuals in evidence synthesis are highlighted with a number of case studies. Further, double-counting of information in varying scenarios is discussed with potential solutions highlighted. RESULTS: Use of studies of real-world data and/or established cohort studies, for example studies evaluating the effectiveness of therapies using health record data, often introduce a significant issue of double-counting of individuals and databases. This refers to the inclusion of the same individuals multiple times in a single analysis. Double-counting can occur in a number of manners, such as, when multiple studies utilise the same database, when there is overlapping timeframes of analysis or common treatment arms across studies. Some common practices to address this include synthesis of data only from peer-reviewed studies, utilising the study that provides the greatest information (e.g. largest, newest, greater outcomes reported) or analysing outcomes at different time points. CONCLUSIONS: While common practices currently used can mitigate some of the impact of double-counting of participants in evidence synthesis including real-world and observational studies, there is a clear need for methodological and guideline development to address this increasingly significant issue.

Impact of program characteristics on weight loss in adult behavioral weight management interventions: systematic review and component network meta-analysis.

OBJECTIVE: Behavioral weight management programs (BWMPs) for adults lead to greater weight loss at 12 months than minimal-intervention control treatments. However, there is considerable heterogeneity in the content of BWMPs and outcomes of treatment. This study assessed the contribution of individual components of BWMPs, using Bayesian component network meta-analysis. METHODS: Randomized controlled trials of BWMPs in adults were identified (latest search: December 2019) and arms coded for presence or absence of 29 intervention components grouped by type, content, provider, mode of delivery, and intensity. RESULTS: A total of 169 studies (41 judged at high risk of bias) were included in the main analysis. Six components had effect estimates indicating clinically significant benefit and credible intervals (CrIs) excluding no difference: change in diet (mean difference [MD] = -1.84 kg, 95% CrI: -2.91 to -0.80); offering partial (MD = -2.12 kg, 95% CrI: -3.39 to -0.89) or total meal replacements (MD = -2.63 kg, 95% CrI: -4.58 to -0.73); delivery by a psychologist/counselor (MD = -1.45 kg, 95% CrI: -2.81 to -0.06) or dietitian (MD = -1.31 kg, 95% CrI: -2.40 to -0.24); and home setting (MD = -1.05 kg, 95% CrI: -2.02 to -0.09). CONCLUSIONS: Future program development should consider including these components; other approaches continue to warrant evaluation of effectiveness.

Anticoagulants for thrombosis prophylaxis in acutely ill patients admitted to hospital: systematic review and network meta-analysis.

OBJECTIVE: To assess the benefits and harms of different types and doses of anticoagulant drugs for the prevention of venous thromboembolism in patients who are acutely ill and admitted to hospital. DESIGN: Systematic review and network meta-analysis. DATA SOURCES: Cochrane CENTRAL, PubMed/Medline, Embase, Web of Science, clinical trial registries, and national health authority databases. The search was last updated on 16 November 2021. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: Published and unpublished randomised controlled trials that evaluated low or intermediate dose low-molecular-weight heparin, low or intermediate dose unfractionated heparin, direct oral anticoagulants, pentasaccharides, placebo, or no intervention for the prevention of venous thromboembolism in acutely ill adult patients in hospital. MAIN OUTCOME MEASURES: Random effects, bayesian network meta-analyses used four co-primary outcomes: all cause mortality, symptomatic venous thromboembolism, major bleeding, and serious adverse events at or closest timing to 90 days. Risk of bias was also assessed using the Cochrane risk-of-bias 2.0 tool. The quality of evidence was graded using the Confidence in Network Meta-Analysis framework. RESULTS: 44 randomised controlled trials that randomly assigned 90 095 participants were included in the main analysis. Evidence of low to moderate quality suggested none of the interventions reduced all cause mortality compared with placebo. Pentasaccharides (odds ratio 0.32, 95% credible interval 0.08 to 1.07), intermediate dose low-molecular-weight heparin (0.66, 0.46 to 0.93), direct oral anticoagulants (0.68, 0.33 to 1.34), and intermediate dose unfractionated heparin (0.71, 0.43 to 1.19) were most likely to reduce symptomatic venous thromboembolism (very low to low quality evidence). Intermediate dose unfractionated heparin (2.63, 1.00 to 6.21) and direct oral anticoagulants (2.31, 0.82 to 6.47) were most likely to increase major bleeding (low to moderate quality evidence). No conclusive differences were noted between interventions regarding serious adverse events (very low to low quality evidence). When compared with no intervention instead of placebo, all active interventions did more favourably with regard to risk of venous thromboembolism and mortality, and less favourably with regard to risk of major bleeding. The results were robust in prespecified sensitivity and subgroup analyses. CONCLUSIONS: Low-molecular-weight heparin in an intermediate dose appears to confer the best balance of benefits and harms for prevention of venous thromboembolism. Unfractionated heparin, in particular the intermediate dose, and direct oral anticoagulants had the least favourable profile. A systematic discrepancy was noted in intervention effects that depended on whether placebo or no intervention was the reference treatment. Main limitations of this study include the quality of the evidence, which was generally low to moderate due to imprecision and within-study bias, and statistical inconsistency, which was addressed post hoc. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42020173088.

Meta-analysis of dichotomous and ordinal tests with an imperfect gold standard.

Standard methods for the meta-analysis of medical tests, without assuming a gold standard, are limited to dichotomous data. Multivariate probit models are used to analyse correlated dichotomous data, and can be extended to model ordinal data. Within the context of an imperfect gold standard, they have previously been used for the analysis of dichotomous and ordinal test data from a single study, and for the meta-analysis of dichotomous tests. However, they have not previously been used for the meta-analysis of ordinal tests. In this article, we developed a Bayesian multivariate probit latent class model for the simultaneous meta-analysis of ordinal and dichotomous tests without assuming a gold standard, which also allows one to obtain summary estimates of joint test accuracy. We fitted the models using the software Stan, which uses a state-of-the-art Hamiltonian Monte Carlo algorithm, and we applied the models to a dataset in which studies evaluated the accuracy of tests, and test combinations, for deep vein thrombosis. We demonstrate the issues with dichotomising ordinal test accuracy data in the presence of an imperfect gold standard, before applying and comparing several variations of our proposed model which do not require the data to be dichotomised. The models proposed will allow researchers to more appropriately meta-analyse ordinal and dichotomous tests without a gold standard, potentially leading to less biased estimates of test accuracy. This may lead to a better understanding of which tests, and test combinations, should be used for any given medical condition.

Challenges of modelling approaches for network meta-analysis of time-to-event outcomes in the presence of non-proportional hazards to aid decision making: Application to a melanoma network.

BACKGROUND: Synthesis of clinical effectiveness from multiple trials is a well-established component of decision-making. Time-to-event outcomes are often synthesised using the Cox proportional hazards model assuming a constant hazard ratio over time. However, with an increasing proportion of trials reporting treatment effects where hazard ratios vary over time and with differing lengths of follow-up across trials, alternative synthesis methods are needed. OBJECTIVES: To compare and contrast five modelling approaches for synthesis of time-to-event outcomes and provide guidance on key considerations for choosing between the modelling approaches. METHODS: The Cox proportional hazards model and five other methods of estimating treatment effects from time-to-event outcomes, which relax the proportional hazards assumption, were applied to a network of melanoma trials reporting overall survival: restricted mean survival time, generalised gamma, piecewise exponential, fractional polynomial and Royston-Parmar models. RESULTS: All models fitted the melanoma network acceptably well. However, there were important differences in extrapolations of the survival curve and interpretability of the modelling constraints demonstrating the potential for different conclusions from different modelling approaches. CONCLUSION: The restricted mean survival time, generalised gamma, piecewise exponential, fractional polynomial and Royston-Parmar models can accommodate non-proportional hazards and differing lengths of trial follow-up within a network meta-analysis of time-to-event outcomes. We recommend that model choice is informed using available and relevant prior knowledge, model transparency, graphically comparing survival curves alongside observed data to aid consideration of the reliability of the survival estimates, and consideration of how the treatment effect estimates can be incorporated within a decision model.

Feasibility study for interactive reporting of network meta-analysis: experiences from the development of the MetaInsight COVID-19 app for stakeholder exploration, re-analysis and sensitivity analysis from living systematic reviews.

BACKGROUND: Network meta-analysis (NMA) has been increasingly adopted worldwide by Cochrane reviews, guideline developers and decision-making bodies to identify optimal treatment choices. However, NMA results are often produced statically, not allowing stakeholders to 'dig deeper' and interrogate with their own judgement. Additionally, amid the COVID-19 pandemic, unnecessary or duplicated reviews have been proposed which analyse from the same pool of evidence. We developed the 'MetaInsight COVID-19' app as a prototype for an interactive platform to eliminate such duplicated efforts, by empowering users to freely analyse the data and improve scientific transparency. METHODS: MetaInsight COVID-19 ( https://crsu.shinyapps.io/metainsightcovid/ ) was developed to conduct NMA with the evolving evidence on treatments for COVID-19. It was updated weekly between 19th May - 19th Oct 2020, incorporating new evidence identified from a living systematic review. RESULTS: The app includes embedded functions to facilitate study selection based on study characteristics, and displays the synthesised results in real time. It allows both frequentist and Bayesian NMA to be conducted as well as consistency and heterogeneity assessments. A demonstration of the app is provided and experiences of building such a platform are discussed. CONCLUSIONS: MetaInsight COVID-19 allows users to take control of the evidence synthesis using the analytic approach they deem appropriate to ascertain how robust findings are to alternative analysis strategies and study inclusion criteria. It is hoped that this app will help avoid many of the duplicated efforts when reviewing and synthesising the COVID-19 evidence, and, in addition, establish the desirability of an open platform format such as this for interactive data interrogation, visualisation, and reporting for any traditional or 'living' NMA.

Behavioural programmes for cigarette smoking cessation: investigating interactions between behavioural, motivational and delivery components in a systematic review and component network meta-analysis.

AIMS: To investigate the comparative and combined effectiveness of four types of components of behavioural interventions for cigarette smoking cessation: behavioural (e.g. counselling), motivational (e.g. focus on reasons to quit), delivery mode (e.g. phone) and provider (e.g. nurse). DESIGN: Systematic review and component network meta-analysis of randomised controlled trials identified from Cochrane reviews. Interventions included behavioural interventions for smoking cessation (including all non-pharmacological interventions, e.g. counselling, exercise, hypnotherapy, self-help materials), compared with another behavioural intervention or no support. Building on a 2021 review (CD013229), we conducted three analyses, investigating: comparative effectiveness of the components, whether models that allowed interactions between components gave different results to models assuming additivity, and predicted effect estimates for combined effects of components that had showed promise but where there were few trials. SETTING: Community and health-care settings. PARTICIPANTS: Adults who smoke tobacco. MEASUREMENTS: Smoking cessation at ≥6 months, preferring sustained, biochemically validated outcomes where available. FINDINGS: Three hundred and twelve trials (250 563 participants) were included. Fifty were at high risk of bias using Cochrane risk of bias tool, V1 (ROB1); excluding these studies did not change findings. Head-to-head comparisons of components suggested that support via text message (SMS) compared with telephone (OR 1.48, 95% CrI 1.13-1.94) or print materials (OR 1.44, 95% CrI 1.14-1.83) was more effective, and individual delivery was less effective than delivery as part of a group (OR 0.78, 95% CrI 0.64-0.95). There was no conclusive evidence of synergistic or antagonistic interactions when combining components that were commonly used together. Adding multiple components that are commonly used in behavioural counselling suggested clinically relevant and statistically conclusive evidence of benefit. Components with the largest effects that could be combined, but rarely have been, were estimated to increase the odds of quitting between two and threefold. For example, financial incentives delivered via SMS, with tailoring and a focus on how to quit, had an estimated OR of 2.94 (95% CrI 1.91-4.52). CONCLUSIONS: Among the components of behavioural support for smoking cessation, behavioural counselling and guaranteed financial incentives are associated with the greatest success. Incorporating additional components associated with effectiveness may further increase benefit, with delivery via text message showing particular promise.

Non-pharmacological interventions for preventing delirium in hospitalised non-ICU patients.

BACKGROUND: Delirium is an acute neuropsychological disorder that is common in hospitalised patients. It can be distressing to patients and carers and it is associated with serious adverse outcomes. Treatment options for established delirium are limited and so prevention of delirium is desirable. Non-pharmacological interventions are thought to be important in delirium prevention.  OBJECTIVES: To assess the effectiveness of non-pharmacological interventions designed to prevent delirium in hospitalised patients outside intensive care units (ICU). SEARCH METHODS: We searched ALOIS, the specialised register of the Cochrane Dementia and Cognitive Improvement Group, with additional searches conducted in MEDLINE, Embase, PsycINFO, CINAHL, LILACS, Web of Science Core Collection, ClinicalTrials.gov and the World Health Organization Portal/ICTRP to 16 September 2020. There were no language or date restrictions applied to the electronic searches, and no methodological filters were used to restrict the search. SELECTION CRITERIA: We included randomised controlled trials (RCTs) of single and multicomponent non-pharmacological interventions for preventing delirium in hospitalised adults cared for outside intensive care or high dependency settings. We only included non-pharmacological interventions which were designed and implemented to prevent delirium.  DATA COLLECTION AND ANALYSIS: Two review authors independently examined titles and abstracts identified by the search for eligibility and extracted data from full-text articles. Any disagreements on eligibility and inclusion were resolved by consensus. We used standard Cochrane methodological procedures. The primary outcomes were: incidence of delirium; inpatient and later mortality; and new diagnosis of dementia. We included secondary and adverse outcomes as pre-specified in the review protocol. We used risk ratios (RRs) as measures of treatment effect for dichotomous outcomes and between-group mean differences for continuous outcomes. The certainty of the evidence was assessed using GRADE. A complementary exploratory analysis was undertaker using a Bayesian component network meta-analysis fixed-effect model to evaluate the comparative effectiveness of the individual components of multicomponent interventions and describe which components were most strongly associated with reducing the incidence of delirium. MAIN RESULTS: We included 22 RCTs that recruited a total of 5718 adult participants. Fourteen trials compared a multicomponent delirium prevention intervention with usual care. Two trials compared liberal and restrictive blood transfusion thresholds. The remaining six trials each investigated a different non-pharmacological intervention. Incidence of delirium was reported in all studies.  Using the Cochrane risk of bias tool, we identified risks of bias in all included trials. All were at high risk of performance bias as participants and personnel were not blinded to the interventions. Nine trials were at high risk of detection bias due to lack of blinding of outcome assessors and three more were at unclear risk in this domain.  Pooled data showed that multi-component non-pharmacological interventions probably reduce the incidence of delirium compared to usual care (10.5% incidence in the intervention group, compared to 18.4% in the control group, risk ratio (RR) 0.57, 95% confidence interval (CI) 0.46 to 0.71, I2 = 39%; 14 studies; 3693 participants; moderate-certainty evidence, downgraded due to risk of bias).  There may be little or no effect of multicomponent interventions on inpatient mortality compared to usual care (5.2% in the intervention group, compared to 4.5% in the control group, RR 1.17, 95% CI 0.79 to 1.74, I2 = 15%; 10 studies; 2640 participants; low-certainty evidence downgraded due to inconsistency and imprecision).  No studies of multicomponent interventions reported data on new diagnoses of dementia.  Multicomponent interventions may result in a small reduction of around a day in the duration of a delirium episode (mean difference (MD) -0.93, 95% CI -2.01 to 0.14 days, I2 = 65%; 351 participants; low-certainty evidence downgraded due to risk of bias and imprecision). The evidence is very uncertain about the effect of multicomponent interventions on delirium severity (standardised mean difference (SMD) -0.49, 95% CI -1.13 to 0.14, I2=64%; 147 participants; very low-certainty evidence downgraded due to risk of bias and serious imprecision). Multicomponent interventions may result in a reduction in hospital length of stay compared to usual care (MD -1.30 days, 95% CI -2.56 to -0.04 days, I2=91%; 3351 participants; low-certainty evidence downgraded due to risk of bias and inconsistency), but little to no difference in new care home admission at the time of hospital discharge (RR 0.77, 95% CI 0.55 to 1.07; 536 participants; low-certainty evidence downgraded due to risk of bias and imprecision). Reporting of other adverse outcomes was limited.  Our exploratory component network meta-analysis found that re-orientation (including use of familiar objects), cognitive stimulation and sleep hygiene were associated with reduced risk of incident delirium. Attention to nutrition and hydration, oxygenation, medication review, assessment of mood and bowel and bladder care were probably associated with a reduction in incident delirium but estimates included the possibility of no benefit or harm.  Reducing sensory deprivation, identification of infection, mobilisation and pain control all had summary estimates that suggested potential increases in delirium incidence, but the uncertainty in the estimates was substantial.  Evidence from two trials suggests that use of a liberal transfusion threshold over a restrictive transfusion threshold probably results in little to no difference in incident delirium (RR 0.92, 95% CI 0.62 to 1.36; I2 = 9%; 294 participants; moderate-certainty evidence downgraded due to risk of bias).  Six other interventions were examined, but evidence for each was limited to single studies and we identified no evidence of delirium prevention.  AUTHORS' CONCLUSIONS: There is moderate-certainty evidence regarding the benefit of multicomponent non-pharmacological interventions for the prevention of delirium in hospitalised adults, estimated to reduce incidence by 43% compared to usual care. We found no evidence of an effect on mortality. There is emerging evidence that these interventions may reduce hospital length of stay, with a trend towards reduced delirium duration, although the effect on delirium severity remains uncertain. Further research should focus on implementation and detailed analysis of the components of the interventions to support more effective, tailored practice recommendations.