Agreement of Risk-of -Bias varied in systematic reviews on acupuncture and was associated with methodological quality.
J Clin Epidemiol
; 129: 12-20, 2021 01.
Article
in En
| MEDLINE
| ID: mdl-32987161
ABSTRACT
OBJECTIVES:
The objective of the study was to evaluate the consistency of risk of bias assessments for overlapping randomized controlled trials (RCTs) included in systematic reviews (SRs) on acupuncture. STUDY DESIGN ANDSETTING:
Databases were searched for acupuncture SRs. A weighted kappa (κ) statistic was calculated, and logistic regression was used to explore the factors of disagreements.RESULTS:
We included 241 RCTs from 109 SRs on acupuncture. The percentage disagreements ranged from 25% to 44%, with moderate agreement for random sequence generation (κ = 0.57), allocation concealment (κ = 0.50), and incomplete outcome data (κ = 0.50), besides fair agreement for blinding of participants and personnel (κ = 0.44), blinding of outcome assessment (κ = 0.31), and selective reporting (κ = 0.39). Only 19% RCTs were evaluated completely consistent. Methodological quality (random sequence generation, odds ratio (OR) = 3.46), international cooperation (allocation concealment, OR = 0.14; incomplete outcome data, OR = 0.14; selective reporting, OR = 0.05), and risk of bias reporting completeness score (selective reporting, OR = 0.53) significantly affected the relative odds of disagreements.CONCLUSION:
The level of agreement varied from fair to moderate agreement depending on the risk of bias domain. Methodological quality appears to be an overarching factor to account for disagreements.Key words
Full text:
1
Database:
MEDLINE
Traditional Medicines:
Medicinas_tradicionales_de_asia
/
Medicina_china
Therapeutic Methods and Therapies TCIM:
Terapias_manuales
Main subject:
Acupuncture Therapy
/
Bias
/
Randomized Controlled Trials as Topic
/
Outcome Assessment, Health Care
/
Systematic Reviews as Topic
Type of study:
Clinical_trials
/
Etiology_studies
/
Risk_factors_studies
/
Systematic_reviews
Language:
En
Journal:
J Clin Epidemiol
Year:
2021
Type:
Article