RESUMO
Risk of bias (RoB) assessments are a core element of evidence synthesis but can be time consuming and subjective. We aimed to develop a decision rule-based algorithm for RoB assessment of seroprevalence studies. We developed the SeroTracker-RoB algorithm. The algorithm derives seven objective and two subjective critical appraisal items from the Joanna Briggs Institute Critical Appraisal Checklist for Prevalence studies and implements decision rules that determine study risk of bias based on the items. Decision rules were validated using the SeroTracker seroprevalence study database, which included non-algorithmic RoB judgments from two reviewers. We quantified efficiency as the mean difference in time for the algorithmic and non-algorithmic assessments of 80 randomly selected articles, coverage as the proportion of studies where the decision rules yielded an assessment, and reliability using intraclass correlations comparing algorithmic and non-algorithmic assessments for 2070 articles. A set of decision rules with 61 branches was developed using responses to the nine critical appraisal items. The algorithmic approach was faster than non-algorithmic assessment (mean reduction 2.32 min [SD 1.09] per article), classified 100% (n = 2070) of studies, and had good reliability compared to non-algorithmic assessment (ICC 0.77, 95% CI 0.74-0.80). We built the SeroTracker-RoB Excel Tool, which embeds this algorithm for use by other researchers. The SeroTracker-RoB decision-rule based algorithm was faster than non-algorithmic assessment with complete coverage and good reliability. This algorithm enabled rapid, transparent, and reproducible RoB evaluations of seroprevalence studies and may support evidence synthesis efforts during future disease outbreaks. This decision rule-based approach could be applied to other types of prevalence studies.
Assuntos
Projetos de Pesquisa , Reprodutibilidade dos Testes , Estudos Soroepidemiológicos , Viés , Medição de RiscoRESUMO
BACKGROUND: Testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is largely passive, which impedes epidemic control. We defined active testing strategies for SARS-CoV-2 using reverse transcription polymerase chain reaction (RT-PCR) for groups at increased risk of acquiring SARS-CoV-2 in all Canadian provinces. METHODS: We identified 5 groups who should be prioritized for active RT-PCR testing: contacts of people who are positive for SARS-CoV-2, and 4 at-risk populations - hospital employees, community health care workers and people in long-term care facilities, essential business employees, and schoolchildren and staff. We estimated costs, human resources and laboratory capacity required to test people in each group or to perform surveillance testing in random samples. RESULTS: During July 8-17, 2020, across all provinces in Canada, an average of 41 751 RT-PCR tests were performed daily; we estimated this required 5122 personnel and cost $2.4 million per day ($67.8 million per month). Systematic contact tracing and testing would increase personnel needs 1.2-fold and monthly costs to $78.9 million. Conducted over a month, testing all hospital employees would require 1823 additional personnel, costing $29.0 million; testing all community health care workers and persons in long-term care facilities would require 11 074 additional personnel and cost $124.8 million; and testing all essential employees would cost $321.7 million, requiring 25 965 added personnel. Testing the larger population within schools over 6 weeks would require 46 368 added personnel and cost $816.0 million. Interventions addressing inefficiencies, including saliva-based sampling and pooling samples, could reduce costs by 40% and personnel by 20%. Surveillance testing in population samples other than contacts would cost 5% of the cost of a universal approach to testing at-risk populations. INTERPRETATION: Active testing of groups at increased risk of acquiring SARS-CoV-2 appears feasible and would support the safe reopening of the economy and schools more broadly. This strategy also appears affordable compared with the $169.2 billion committed by the federal government as a response to the pandemic as of June 2020.