SeroTracker-RoB: A decision rule-based algorithm for reproducible risk of bias assessment of seroprevalence studies.

Risk of bias (RoB) assessments are a core element of evidence synthesis but can be time consuming and subjective. We aimed to develop a decision rule-based algorithm for RoB assessment of seroprevalence studies. We developed the SeroTracker-RoB algorithm. The algorithm derives seven objective and two subjective critical appraisal items from the Joanna Briggs Institute Critical Appraisal Checklist for Prevalence studies and implements decision rules that determine study risk of bias based on the items. Decision rules were validated using the SeroTracker seroprevalence study database, which included non-algorithmic RoB judgments from two reviewers. We quantified efficiency as the mean difference in time for the algorithmic and non-algorithmic assessments of 80 randomly selected articles, coverage as the proportion of studies where the decision rules yielded an assessment, and reliability using intraclass correlations comparing algorithmic and non-algorithmic assessments for 2070 articles. A set of decision rules with 61 branches was developed using responses to the nine critical appraisal items. The algorithmic approach was faster than non-algorithmic assessment (mean reduction 2.32 min [SD 1.09] per article), classified 100% (n = 2070) of studies, and had good reliability compared to non-algorithmic assessment (ICC 0.77, 95% CI 0.74-0.80). We built the SeroTracker-RoB Excel Tool, which embeds this algorithm for use by other researchers. The SeroTracker-RoB decision-rule based algorithm was faster than non-algorithmic assessment with complete coverage and good reliability. This algorithm enabled rapid, transparent, and reproducible RoB evaluations of seroprevalence studies and may support evidence synthesis efforts during future disease outbreaks. This decision rule-based approach could be applied to other types of prevalence studies.

Protective effectiveness of previous SARS-CoV-2 infection and hybrid immunity against the omicron variant and severe disease: a systematic review and meta-regression.

BACKGROUND: The global surge in the omicron (B.1.1.529) variant has resulted in many individuals with hybrid immunity (immunity developed through a combination of SARS-CoV-2 infection and vaccination). We aimed to systematically review the magnitude and duration of the protective effectiveness of previous SARS-CoV-2 infection and hybrid immunity against infection and severe disease caused by the omicron variant. METHODS: For this systematic review and meta-regression, we searched for cohort, cross-sectional, and case-control studies in MEDLINE, Embase, Web of Science, ClinicalTrials.gov, the Cochrane Central Register of Controlled Trials, the WHO COVID-19 database, and Europe PubMed Central from Jan 1, 2020, to June 1, 2022, using keywords related to SARS-CoV-2, reinfection, protective effectiveness, previous infection, presence of antibodies, and hybrid immunity. The main outcomes were the protective effectiveness against reinfection and against hospital admission or severe disease of hybrid immunity, hybrid immunity relative to previous infection alone, hybrid immunity relative to previous vaccination alone, and hybrid immunity relative to hybrid immunity with fewer vaccine doses. Risk of bias was assessed with the Risk of Bias In Non-Randomized Studies of Interventions Tool. We used log-odds random-effects meta-regression to estimate the magnitude of protection at 1-month intervals. This study was registered with PROSPERO (CRD42022318605). FINDINGS: 11 studies reporting the protective effectiveness of previous SARS-CoV-2 infection and 15 studies reporting the protective effectiveness of hybrid immunity were included. For previous infection, there were 97 estimates (27 with a moderate risk of bias and 70 with a serious risk of bias). The effectiveness of previous infection against hospital admission or severe disease was 74·6% (95% CI 63·1-83·5) at 12 months. The effectiveness of previous infection against reinfection waned to 24·7% (95% CI 16·4-35·5) at 12 months. For hybrid immunity, there were 153 estimates (78 with a moderate risk of bias and 75 with a serious risk of bias). The effectiveness of hybrid immunity against hospital admission or severe disease was 97·4% (95% CI 91·4-99·2) at 12 months with primary series vaccination and 95·3% (81·9-98·9) at 6 months with the first booster vaccination after the most recent infection or vaccination. Against reinfection, the effectiveness of hybrid immunity following primary series vaccination waned to 41·8% (95% CI 31·5-52·8) at 12 months, while the effectiveness of hybrid immunity following first booster vaccination waned to 46·5% (36·0-57·3) at 6 months. INTERPRETATION: All estimates of protection waned within months against reinfection but remained high and sustained for hospital admission or severe disease. Individuals with hybrid immunity had the highest magnitude and durability of protection, and as a result might be able to extend the period before booster vaccinations are needed compared to individuals who have never been infected. FUNDING: WHO COVID-19 Solidarity Response Fund and the Coalition for Epidemic Preparedness Innovations.