Cost-minimisation analysis alongside a pilot study of early Tissue Doppler Evaluation of Diastolic Dysfunction in Emergency Department Non-ST Elevation Acute Coronary Syndromes (TEDDy-NSTEACS).

OBJECTIVE: To estimate the cost implications of early angiography for patients with suspected non-ST elevation acute coronary syndrome (NSTEACS) using tissue Doppler imaging (TDI). DESIGN: A decision tree model was used to synthesise data from the pilot study and literature sources. Sensitivity analyses tested the impact of assumptions incorporated into the analysis. SETTING: Emergency department (ED), Brisbane, Australia. PARTICIPANTS: Patients with suspected NSTEACS. INTERVENTIONS: TDI as a diagnostic tool for triaging patients within 4 hours of presentation in addition to conventional risk stratification, compared with conventional risk stratification alone. DATA SOURCES: Resource used for diagnosis and management were recorded prospectively and costed for 51 adults who had echocardiography within 24 hours of admission. Costs for conventional care were based on observed data. Cost estimates for the TDI intervention assumed patients classified as high risk at TDI (E/e'>14) progressed early to angiography with an associated 1-day reduction in length of stay. PRIMARY OUTCOME MEASURES: Costs until discharge from the Australian healthcare perspective in 2016-2017 prices. RESULTS: Findings suggest that using TDI as a diagnostic tool for triaging patients with suspected NSTEACS is likely to be cost saving by $A1090 (95% credible interval: $A573 to $A1703) per patient compared with conventional care. The results are mainly driven by the assumed reduction in length of stay due to the inclusion of early TDI in clinical decision-making. CONCLUSIONS: This pilot study indicates that compared with conventional risk stratification, triaging patients presenting with suspected NSTEACS with TDI within 4 hours of ED presentation has potential cost savings. Findings assume a reduction in hospital stay is achieved for patients considered to be high risk at TDI. Larger, comparative studies with longer follow-up are needed to confirm the clinical effectiveness of TDI as a diagnostic strategy for NSTEACS, the assumed reduction in hospital stay and any cost saving.

Diagnostic accuracy of self-reported arthritis in the general adult population is acceptable.

OBJECTIVE: To summarize the diagnostic accuracy of self-reported osteoarthritis (OA), rheumatoid arthritis (RA), and arthritis (i.e., unspecified) in the general adult population. STUDY DESIGN AND SETTING: A systematic literature search identified studies reporting diagnostic data on self-reported diagnosis of OA, RA, or arthritis in adults in population-based or primary care samples. Index tests included any form of participant-reported presence of the condition. Reference tests included rheumatologist, physician, or health professional examination; medical record review; physician interview; laboratory tests; or radiography. Relevant articles were scored using the QUADAS tool. Diagnostic values were summarized using pooled estimates for sensitivity and specificity. RESULTS: The search strategy identified 16 articles: 11 for OA, 5 for RA, and 4 for arthritis. Four of 16 articles scored high on quality. The pooled sensitivity and specificity were 0.75 [95% confidence interval (CI): 0.56, 0.88] and 0.89 (95% CI: 0.77, 0.95) for OA, 0.88 (95% CI: 0.59, 0.97) and 0.93 (95% CI: 0.66, 0.99) for RA, and 0.71 (95% CI: 0.59, 0.80) and 0.79 (95% CI: 0.65, 0.89) for arthritis. There were not enough studies to conduct meta-analyses for joint-specific OA. CONCLUSION: The accuracy of self-reported OA and RA is acceptable for large-scale studies in which rheumatologist examination is not feasible. More high-quality studies are required to confirm the accuracy of self-reported arthritis and joint-specific OA.

Factors explaining the heterogeneity of effects of patient decision aids on knowledge of outcome probabilities: a systematic review sub-analysis.

BACKGROUND: There is considerable unexplained heterogeneity in previous meta-analyses of randomized controlled trials (RCTs) evaluating the effects of patient decision aids on the accuracy of knowledge of outcome probabilities. The purpose of this review was to explore possible effect modification by three covariates: the type of control intervention, decision aid quality and patients' baseline knowledge of probabilities. METHODS: A sub-analysis of studies previously identified in the 2011 Cochrane review on decision aids for people facing treatment and screening decisions was conducted. Additional unpublished data were requested from relevant study authors to maximize the number of eligible studies. RCTs (to 2009) comparing decision aids with standardized probability information to control interventions (lacking such information) and assessing the accuracy of patient knowledge of outcome probabilities were included. The proportions of patients with accurate knowledge of outcome probabilities in each group were converted into relative effect measures. Intervention quality was assessed using the International Patient Decision Aid Standards instrument (IPDASi) probabilities domain. RESULTS: A main effects analysis of 17 eligible studies confirmed that decision aids significantly improve the accuracy of patient knowledge of outcome probabilities (relative risk = 1.80 [1.51, 2.16]), with considerable heterogeneity (87%). The type of control did not modify effects. Meta-regression suggested that the IPDASi probabilities domain score (reflecting decision aid quality) is a potential effect modifier (P = 0.037), accounting for a quarter of the variability (R² = 0.28). Meta-regression indicated the control event rate (reflecting baseline knowledge) is a significant effect modifier (P = 0.001), with over half the variability in ln(OR) explained by the linear relationship with log-odds for the control group (R² = 0.52); this relationship was slightly strengthened after correcting for the statistical dependence of the effect measure on the control event rate. CONCLUSIONS: Patients' baseline level of knowledge of outcome probabilities is an important variable that explains the heterogeneity of effects of decision aids on improving accuracy of this knowledge. Greater relative effects are observed when the baseline proportion of patients with accurate knowledge is lower. This may indicate that decision aids are more effective in populations with lower knowledge.

Inconsistent definitions for intention-to-treat in relation to missing outcome data: systematic review of the methods literature.

BACKGROUND: Authors of randomized trial reports seem to hold a variety of views regarding the relationship between missing outcome data (MOD) and intention to treat (ITT). The objectives of this study were to systematically investigate how authors of methodology articles define ITT in the presence of MOD, how they recommend handling MOD under ITT, and to make a proposal for potential improvement in the definition and use of ITT in relation to MOD. METHODS AND FINDINGS: We systematically searched MEDLINE in February 2009 for methodological articles written in English that devoted at least one paragraph to ITT and two other paragraphs to either ITT or MOD. We excluded original trial reports, observational studies, and clinical systematic reviews. Working in teams of two, we independently extracted relevant information from each eligible article. Of 1007 titles and abstracts reviewed, 66 articles met eligibility criteria. Five (8%) did not provide a definition of ITT; 25 (38%) mentioned MOD but did not discuss its relationship to ITT; and 36 (55%) discussed the relationship of MOD with ITT. These 36 articles described one or more of three statements: complete follow-up is required for ITT (58%); ITT and MOD are separate issues (17%); and ITT requires a specific strategy for handling MOD (78%); 17 (47%) endorsed more than one relationship. The most frequently mentioned strategies for handling MOD within ITT were: using the last outcome carried forward (50%); sensitivity analysis (50%); and use of available data to impute missing data (46%). CONCLUSION: We found that there is no consensus on the definition of ITT in relation to MOD. For conceptual clarity, we suggest that both reports of randomized trials and systematic reviews separately consider and describe how they deal with participants with complete data and those with MOD.

Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review.

OBJECTIVE: To assess the reporting, extent, and handling of loss to follow-up and its potential impact on the estimates of the effect of treatment in randomised controlled trials. DESIGN: Systematic review. We calculated the percentage of trials for which the relative risk would no longer be significant under a number of assumptions about the outcomes of participants lost to follow-up. DATA SOURCES: Medline search of five top general medical journals, 2005-07. ELIGIBILITY CRITERIA: Randomised controlled trials that reported a significant binary primary patient important outcome. RESULTS: Of the 235 eligible reports identified, 31 (13%) did not report whether or not loss to follow-up occurred. In reports that did give the relevant information, the median percentage of participants lost to follow-up was 6% (interquartile range 2-14%). The method by which loss to follow-up was handled was unclear in 37 studies (19%); the most commonly used method was survival analysis (66, 35%). When we varied assumptions about loss to follow-up, results of 19% of trials were no longer significant if we assumed no participants lost to follow-up had the event of interest, 17% if we assumed that all participants lost to follow-up had the event, and 58% if we assumed a worst case scenario (all participants lost to follow-up in the treatment group and none of those in the control group had the event). Under more plausible assumptions, in which the incidence of events in those lost to follow-up relative to those followed-up is higher in the intervention than control group, results of 0% to 33% trials were no longer significant. CONCLUSION: Plausible assumptions regarding outcomes of patients lost to follow-up could change the interpretation of results of randomised controlled trials published in top medical journals.

Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid.

OBJECTIVE: To test the reliability and validity of specific instructions to classify blinding, when unclearly reported in randomized trials, as "probably done" or "probably not done." STUDY DESIGN AND SETTING: We assessed blinding of patients, health care providers, data collectors, outcome adjudicators, and data analysts in 233 randomized trials in duplicate and independently using detailed instructions. The response options were "definitely yes," "probably yes," "probably no," and "definitely no." We contacted authors for data verification (46% response). For each of the five questions, we assessed reliability by calculating the agreement between the two reviewers and validity by calculating the agreement between reviewers' consensus and verified data. RESULTS: The percentage with unclear blinding status varied between 48.5% (patients) and 84.1% (data analysts). Reliability was moderate for blinding of outcome adjudicators (κ=0.52) and data analysts (κ=0.42) and substantial for blinding of patients (κ=0.71), providers (κ=0.68), and data collectors (κ=0.65). The raw agreement between the consensus record and the author-verified record varied from 84.1% (blinding of data analysts) to 100% (blinding of health care providers). CONCLUSION: With the possible exception of blinding of data analysts, use of "probably yes" and "probably no" instead of "unclear" may enhance the assessment of blinding in trials.

LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact.

BACKGROUND: Incomplete ascertainment of outcomes in randomized controlled trials (RCTs) is likely to bias final study results if reasons for unavailability of patient data are associated with the outcome of interest. The primary objective of this study is to assess the potential impact of loss to follow-up on the estimates of treatment effect. The secondary objectives are to describe, for published RCTs, (1) the reporting of loss to follow-up information, (2) the analytic methods used for handling loss to follow-up information, and (3) the extent of reported loss to follow-up. METHODS: We will conduct a systematic review of reports of RCTs recently published in five top general medical journals. Eligible RCTs will demonstrate statistically significant effect estimates with respect to primary outcomes that are patient-important and expressed as binary data. Teams of 2 reviewers will independently determine eligibility and extract relevant information from each eligible trial using standardized, pre-piloted forms. To assess the potential impact of loss to follow-up on the estimates of treatment effect we will, for varying assumptions about the outcomes of participants lost to follow-up (LTFU), calculate (1) the percentage of RCTs that lose statistical significance and (2) the mean change in effect estimate across RCTs. The different assumptions we will test are the following: (1) none of the LTFU participants had the event; (2) all LTFU participants had the event; (3) all LTFU participants in the treatment group had the event; none of those in the control group had it (worst case scenario); (4) the event incidence among LTFU participants (relative to observed participants) increased, with a higher relative increase in the intervention group; and (5) the event incidence among LTFU participants (relative to observed participants) increased in the intervention group and decreased in the control group. DISCUSSION: We aim to make our objectives and methods transparent. The results of this study may have important implications for both clinical trialists and users of the medical literature.