The impact of blinding on estimated treatment effects in randomized clinical trials on acupuncture: A meta-epidemiological study.

OBJECTIVE: To evaluate the sole impact of blinding patients and outcome assessors in acupuncture randomized controlled trials (RCTs) on treatment effects while considering the type of outcome measures. METHODS: We searched databases for the meta-analyses on acupuncture with both blinded and non-blinded RCTs. Mixed-effects meta-regression models estimated the average ratio of odds ratios (ROR) and differences in standardized mean differences (dSMD) for non-blinded RCTs versus blinded mixed-effects meta-regression model. RESULTS: The study included 96 meta-analyses (1012 trials). The average ROR for lack of patient blinding was 1.08 (95% confidence intervals 0.79-1.49) in 18 meta-analyses with binary patient-reported outcomes. The average ROR for lack of outcome assessor blinding was 0.98 (0.77-1.24) in 43 meta-analyses with binary subjective outcomes. The average dSMD was -0.38 (-0.96 to 0.20) in 10 meta-analyses with continuous patient-reported outcomes. The average dSMD was -0.13 (-0.45 to 0.18) in 25 meta-analyses with continuous subjective outcomes. The results of the subgroup analysis were consistent with the primary analysis findings. CONCLUSIONS: Blinding of participants and outcome assessors does not significantly influence acupuncture treatment efficacy. It underscores the practical difficulties of blinding in acupuncture RCTs and the necessity to distinguish between trials with and without successful blinding to understand treatment expectations' effects. Enhancing blinding procedures' quality and assessment in future research is crucial for improving RCTs' internal validity and reliability.

Core outcomes were rarely reported overall in systematic reviews on acupuncture for osteoarthritis: a cross-sectional meta-epidemiological study.

OBJECTIVE: To identify a comprehensive list of outcomes and explore the reporting rate of core outcome sets (COS) and related factors in systematic reviews (SRs) of acupuncture for osteoarthritis (OA). STUDY DESIGN AND SETTING: Databases were searched for the relative SRs. Descriptive statistics were calculated as frequencies and percentages. Binary logistic regression was used to explore the factors affecting the reporting rate of COS. RESULTS: We included 59 SRs. Outcome measures reported in the SRs were classified into 11 domains and 67 unique outcomes. No SR completely reported COS. In COS released in 2016, 75% of outcomes (6/8) were only reported by ⩽5% SRs. In COS released in 2019, the reporting rate was very low (from 0% to 17%) for 73.3% of outcomes (11/15). SRs published in the most recent 5 years had a significantly greater possibility of reporting COS (odds ratio (OR) = 4.74, 95% confidence interval (CI) = 1.33 to 16.88, p = 0.016). CONCLUSION: Core outcomes were rarely reported in systematic reviews of acupuncture for OA, with considerable heterogeneity in the use of outcomes. The publication of COS in the COMET (Core Outcome Measures in Effectiveness Trials) database may help promote the reporting of COS. We encourage systematic reviewers to use relevant COS.

A search of only four key databases would identify most randomized controlled trials of acupuncture: A meta-epidemiological study.

Little research has been conducted to assess which specific databases should be searched when performing a systematic review (SR) on acupuncture. The current study aimed to identify key databases and the optimal database combination to retrieve randomized controlled trials (RCTs) on acupuncture for inclusion in SRs. A systematic search for SRs in the field of acupuncture was conducted in order to identify target databases and RCTs were extracted from the SRs that had searched all target databases. The proportions of SRs that had achieved 100%, 95%, or 90% recall of RCTs and the total recall of RCTs in various combinations of target databases were calculated. Sensitivity analysis was performed on those SRs that included 10 or more RCTs. CNKI, WanFang, VIP, PubMed, CENTRAL and Embase were regarded as target databases. A total of 4349 acupuncture RCTs were extracted from 286 SRs. Searching all six target databases retrieved 99.3% of all RCTs while 99.1% were recalled by searching the combination of CNKI, WanFang, PubMed and CENTRAL. There were no significant differences on total recall of RCTs (p = 0.549) or in the proportion of SRs with 90% recall of RCTs (97.2% vs. 97.6%; p = 0.794) between searching the above four and the full six target databases. Most results were similar in the sensitivity analysis. The combined retrieval power of CNKI, WanFang, PubMed and CENTRAL was considered an efficient choice to retrieve acupuncture RCTs included in SRs.

Agreement of Risk-of -Bias varied in systematic reviews on acupuncture and was associated with methodological quality.

OBJECTIVES: The objective of the study was to evaluate the consistency of risk of bias assessments for overlapping randomized controlled trials (RCTs) included in systematic reviews (SRs) on acupuncture. STUDY DESIGN AND SETTING: Databases were searched for acupuncture SRs. A weighted kappa (κ) statistic was calculated, and logistic regression was used to explore the factors of disagreements. RESULTS: We included 241 RCTs from 109 SRs on acupuncture. The percentage disagreements ranged from 25% to 44%, with moderate agreement for random sequence generation (κ = 0.57), allocation concealment (κ = 0.50), and incomplete outcome data (κ = 0.50), besides fair agreement for blinding of participants and personnel (κ = 0.44), blinding of outcome assessment (κ = 0.31), and selective reporting (κ = 0.39). Only 19% RCTs were evaluated completely consistent. Methodological quality (random sequence generation, odds ratio (OR) = 3.46), international cooperation (allocation concealment, OR = 0.14; incomplete outcome data, OR = 0.14; selective reporting, OR = 0.05), and risk of bias reporting completeness score (selective reporting, OR = 0.53) significantly affected the relative odds of disagreements. CONCLUSION: The level of agreement varied from fair to moderate agreement depending on the risk of bias domain. Methodological quality appears to be an overarching factor to account for disagreements.

Use and reporting of risk of bias tools in 825 systematic reviews of acupuncture: a cross-sectional study.

OBJECTIVE: To assess the use and reporting of risk of bias (RoB) tools in systematic reviews (SRs) of acupuncture. STUDY DESIGN AND SETTING: We extracted and analyzed information relating to RoB in acupuncture SRs via Medline, Embase and the Chinese CNKI (Chinese National Knowledge Infrastructure), WanFang and VIP databases from their inception to 24 November 2017. Three subgroup analyses were used to check the influence of language, journal type and impact factor, following which we used descriptive analysis. RESULTS: We included 825 acupuncture SRs, of which 48% used the Cochrane RoB tool. Only 36% used the latest version of the Cochrane Handbook (version 5.1.0 at time of writing) with higher proportions among Cochrane SRs (65%) versus non-Cochrane SRs (34%), and high impact factor journals (58%) versus low or no impact factor journals (28% and 38%, respectively). In the last decade, there were notable increases in the use of the Cochrane RoB tool and Cochrane Handbook version 5.1.0, of 43% and 19%, respectively. Chinese-language SRs demonstrated proportionally higher tendencies to report an incorrect Cochrane Handbook version, increasing by 14% in the last 5 years. Additionally, 7% SRs did not report any results, and only 10% reported relatively complete and adequate RoB assessment. Cochrane SRs reported more complete assessments than Chinese-language or non-Cochrane English-language SRs. CONCLUSION: Use and reporting of RoB tools were suboptimal. Proportionally, use of the Cochrane RoB tool and Cochrane Handbook version 5.1.0 was low but rising. Our results highlight the prevalence and concerns of using unsuitable tools and the issue of incomplete RoB reporting. RoB tool application requires further improvement.

Do acupuncture trials have lower risk of bias over the last five decades? A methodological study of 4 715 randomized controlled trials.

OBJECTIVE: To evaluate the change of the risk of bias (RoB) of acupuncture randomized controlled trials (RCTs) in the past five decades. METHODS: Multiple databases were searched. We included RCTs identified from systematic reviews (SRs) on acupuncture. General characteristics and RoB judgment for each domain were extracted. The proportions of RCTs at high and unclear RoB were calculated and the changes were examined by the Mann-Kendall test. RESULTS: We included 368 SRs including 4 715 RCTs. The rates of RCTs at unclear RoB were the highest in allocation concealment (63%), and at the lowest in incomplete outcome data (35%); in the last five decades, statistically significant reductions were found for random sequence generation (P < 0.001) and selective reporting (P = 0.01), and increases for blinding of participants and personnel (P < 0.001), blinding of outcome assessment (P < 0.001) and incomplete outcome data (P = 0.04). For the proportions of RCTs at high RoB, blinding of participants and personnel (47%) and blinding of outcome assessment (35%) were the poorest domains; there were no significant differences in changes for all domains. CONCLUSIONS: Although improvements concerning unclear risk were observed for random sequence generation and selective reporting, major issues remain for allocation concealment and blinding. It is imperative to use valid randomization, specify how it is conducted, and try to test for selection bias and the success of masking by using the Berger Exner test.

Risk of bias assessments and reporting quality of systematic reviews and randomized controlled trials examining acupuncture for depression: An overview and meta-epidemiology study.

OBJECTIVES: To assess the use of risk of bias (ROB) assessment tools and the reporting quality of ROB assessment results in systematic reviews (SRs) of acupuncture for depression, as well as to evaluate the ROB of depression-related randomized controlled trials (RCT). METHODS: Embase, Medline, Chinese Journal Full-Text Database (CJFD), VIP Chinese Technology Periodical Database, and WanFang Data Resource System of Digital Periodicals were searched from their inception to 24 November 2017. SRs of RCTs concerning acupuncture on depression were included. General characteristics and the information related to risk of bias in SRs were extracted. A descriptive analysis was used. RESULTS: Thirty-nine SRs were included. Of these, two (5%) did not perform a ROB assessment, 18.9% did not report the ROB assessment results, and 62.2% did not report the assessment results of each ROB item. Text descriptions and tables were commonly used in reporting forms. Only 32.4% of SRs reported support for judgment. The reporting rate of ROB assessment results was low in all items (13.5%-35.1%). Regarding RCTs, 59.7% used adequate randomization methods, 13.1% performed adequate allocation concealment, 12.5% performed adequate blinding of participants and personnel, 27.3% performed adequate blinding of the assessment outcomes, and 41.5% and 49.3% had a low ROB in terms of incomplete outcome data and selective outcome reporting, respectively. CONCLUSION: For the SRs of acupuncture for depression, the selection of ROB assessment tools needs to be optimized. The reporting quality is poor, and the overall ROB of RCTs is high. Therefore, the results may not be reliable.

[The comparison of different processing methods of Dendrobium loddigesii].

OBJECTIVE: To study the 4 different processing methods of Dendrobium loddigesii. and find a optimal method. METHODS: Drying in the shade, fire drying at different temperature, twist and fire drying, to scald by boiling water then twist and fire drying were used to process D. loddigesii and determined the content of polysaccharide after processed. RESULTS: The rate of dryed medical material was about 36%, and the content of polysaccharide was 16.39% which was scald by boiling water then twist and fire drying was higher than others. CONCLUSION: The method scald by boiling water then twist and fire drying is good for medical materials dried and the remaining of active component. It provide a scientific evidence to Chinese Pharmacopoeia 2005 and offer quantization index to the processing of Dendrobium loddigesii.