Customized guidance/training improved the psychometric properties of methodologically rigorous risk of bias instruments for non-randomized studies.
J Clin Epidemiol
; 136: 157-167, 2021 08.
Article
en En
| MEDLINE
| ID: mdl-33979663
ABSTRACT
OBJECTIVES:
To evaluate the impact of guidance and training on the inter-rater reliability (IRR), inter-consensus reliability (ICR) and evaluator burden of the Risk of Bias (RoB) in Non-randomized Studies (NRS) of Interventions (ROBINS-I) tool, and the RoB instrument for NRS of Exposures (ROB-NRSE). STUDY DESIGN ANDSETTING:
In a before-and-after study, seven reviewers appraised the RoB using ROBINS-I (n = 44) and ROB-NRSE (n = 44), before and after guidance and training. We used Gwet's AC1 statistic to calculate IRR and ICR.RESULTS:
After guidance and training, the IRR and ICR of the overall bias domain of ROBINS-I and ROB-NRSE improved significantly; with many individual domains showing either a significant (IRR and ICR of ROB-NRSE; ICR of ROBINS-I), or nonsignificant improvement (IRR of ROBINS-I). Evaluator burden significantly decreased after guidance and training for ROBINS-I, whereas for ROB-NRSE there was a slight nonsignificant increase.CONCLUSION:
Overall, there was benefit for guidance and training for both tools. We highly recommend guidance and training to reviewers prior to RoB assessments and that future research investigate aspects of guidance and training that are most effective.Palabras clave
Texto completo:
1
Banco de datos:
MEDLINE
Asunto principal:
Revisión por Pares
/
Proyectos de Investigación
/
Investigadores
/
Variaciones Dependientes del Observador
/
Diseño de Investigaciones Epidemiológicas
/
Investigación Biomédica
Tipo de estudio:
Clinical_trials
/
Etiology_studies
/
Guideline
/
Observational_studies
/
Prevalence_studies
/
Risk_factors_studies
Límite:
Adult
/
Female
/
Humans
/
Male
/
Middle aged
País/Región como asunto:
America do norte
/
Europa
Idioma:
En
Revista:
J Clin Epidemiol
Asunto de la revista:
EPIDEMIOLOGIA
Año:
2021
Tipo del documento:
Article