ABSTRACT
BACKGROUND: The diagnostic challenges associated with the COVID-19 pandemic resulted in rapid development of diagnostic test methods for detecting SARS-CoV-2 infection. Serology tests to detect the presence of antibodies to SARS-CoV-2 enable detection of past infection and may detect cases of SARS-CoV-2 infection that were missed by earlier diagnostic tests. Understanding the diagnostic accuracy of serology tests for SARS-CoV-2 infection may enable development of effective diagnostic and management pathways, inform public health management decisions and understanding of SARS-CoV-2 epidemiology. OBJECTIVES: To assess the accuracy of antibody tests, firstly, to determine if a person presenting in the community, or in primary or secondary care has current SARS-CoV-2 infection according to time after onset of infection and, secondly, to determine if a person has previously been infected with SARS-CoV-2. Sources of heterogeneity investigated included: timing of test, test method, SARS-CoV-2 antigen used, test brand, and reference standard for non-SARS-CoV-2 cases. SEARCH METHODS: The COVID-19 Open Access Project living evidence database from the University of Bern (which includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) was searched on 30 September 2020. We included additional publications from the Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre) 'COVID-19: Living map of the evidence' and the Norwegian Institute of Public Health 'NIPH systematic and living map on COVID-19 evidence'. We did not apply language restrictions. SELECTION CRITERIA: We included test accuracy studies of any design that evaluated commercially produced serology tests, targeting IgG, IgM, IgA alone, or in combination. Studies must have provided data for sensitivity, that could be allocated to a predefined time period after onset of symptoms, or after a positive RT-PCR test. Small studies with fewer than 25 SARS-CoV-2 infection cases were excluded. We included any reference standard to define the presence or absence of SARS-CoV-2 (including reverse transcription polymerase chain reaction tests (RT-PCR), clinical diagnostic criteria, and pre-pandemic samples). DATA COLLECTION AND ANALYSIS: We use standard screening procedures with three reviewers. Quality assessment (using the QUADAS-2 tool) and numeric study results were extracted independently by two people. Other study characteristics were extracted by one reviewer and checked by a second. We present sensitivity and specificity with 95% confidence intervals (CIs) for each test and, for meta-analysis, we fitted univariate random-effects logistic regression models for sensitivity by eligible time period and for specificity by reference standard group. Heterogeneity was investigated by including indicator variables in the random-effects logistic regression models. We tabulated results by test manufacturer and summarised results for tests that were evaluated in 200 or more samples and that met a modification of UK Medicines and Healthcare products Regulatory Agency (MHRA) target performance criteria. MAIN RESULTS: We included 178 separate studies (described in 177 study reports, with 45 as pre-prints) providing 527 test evaluations. The studies included 64,688 samples including 25,724 from people with confirmed SARS-CoV-2; most compared the accuracy of two or more assays (102/178, 57%). Participants with confirmed SARS-CoV-2 infection were most commonly hospital inpatients (78/178, 44%), and pre-pandemic samples were used by 45% (81/178) to estimate specificity. Over two-thirds of studies recruited participants based on known SARS-CoV-2 infection status (123/178, 69%). All studies were conducted prior to the introduction of SARS-CoV-2 vaccines and present data for naturally acquired antibody responses. Seventy-nine percent (141/178) of studies reported sensitivity by week after symptom onset and 66% (117/178) for convalescent phase infection. Studies evaluated enzyme-linked immunosorbent assays (ELISA) (165/527; 31%), chemiluminescent assays (CLIA) (167/527; 32%) or lateral flow assays (LFA) (188/527; 36%). Risk of bias was high because of participant selection (172, 97%); application and interpretation of the index test (35, 20%); weaknesses in the reference standard (38, 21%); and issues related to participant flow and timing (148, 82%). We judged that there were high concerns about the applicability of the evidence related to participants in 170 (96%) studies, and about the applicability of the reference standard in 162 (91%) studies. Average sensitivities for current SARS-CoV-2 infection increased by week after onset for all target antibodies. Average sensitivity for the combination of either IgG or IgM was 41.1% in week one (95% CI 38.1 to 44.2; 103 evaluations; 3881 samples, 1593 cases), 74.9% in week two (95% CI 72.4 to 77.3; 96 evaluations, 3948 samples, 2904 cases) and 88.0% by week three after onset of symptoms (95% CI 86.3 to 89.5; 103 evaluations, 2929 samples, 2571 cases). Average sensitivity during the convalescent phase of infection (up to a maximum of 100 days since onset of symptoms, where reported) was 89.8% for IgG (95% CI 88.5 to 90.9; 253 evaluations, 16,846 samples, 14,183 cases), 92.9% for IgG or IgM combined (95% CI 91.0 to 94.4; 108 evaluations, 3571 samples, 3206 cases) and 94.3% for total antibodies (95% CI 92.8 to 95.5; 58 evaluations, 7063 samples, 6652 cases). Average sensitivities for IgM alone followed a similar pattern but were of a lower test accuracy in every time slot. Average specificities were consistently high and precise, particularly for pre-pandemic samples which provide the least biased estimates of specificity (ranging from 98.6% for IgM to 99.8% for total antibodies). Subgroup analyses suggested small differences in sensitivity and specificity by test technology however heterogeneity in study results, timing of sample collection, and smaller sample numbers in some groups made comparisons difficult. For IgG, CLIAs were the most sensitive (convalescent-phase infection) and specific (pre-pandemic samples) compared to both ELISAs and LFAs (P < 0.001 for differences across test methods). The antigen(s) used (whether from the Spike-protein or nucleocapsid) appeared to have some effect on average sensitivity in the first weeks after onset but there was no clear evidence of an effect during convalescent-phase infection. Investigations of test performance by brand showed considerable variation in sensitivity between tests, and in results between studies evaluating the same test. For tests that were evaluated in 200 or more samples, the lower bound of the 95% CI for sensitivity was 90% or more for only a small number of tests (IgG, n = 5; IgG or IgM, n = 1; total antibodies, n = 4). More test brands met the MHRA minimum criteria for specificity of 98% or above (IgG, n = 16; IgG or IgM, n = 5; total antibodies, n = 7). Seven assays met the specified criteria for both sensitivity and specificity. In a low-prevalence (2%) setting, where antibody testing is used to diagnose COVID-19 in people with symptoms but who have had a negative PCR test, we would anticipate that 1 (1 to 2) case would be missed and 8 (5 to 15) would be falsely positive in 1000 people undergoing IgG or IgM testing in week three after onset of SARS-CoV-2 infection. In a seroprevalence survey, where prevalence of prior infection is 50%, we would anticipate that 51 (46 to 58) cases would be missed and 6 (5 to 7) would be falsely positive in 1000 people having IgG tests during the convalescent phase (21 to 100 days post-symptom onset or post-positive PCR) of SARS-CoV-2 infection. AUTHORS' CONCLUSIONS: Some antibody tests could be a useful diagnostic tool for those in whom molecular- or antigen-based tests have failed to detect the SARS-CoV-2 virus, including in those with ongoing symptoms of acute infection (from week three onwards) or those presenting with post-acute sequelae of COVID-19. However, antibody tests have an increasing likelihood of detecting an immune response to infection as time since onset of infection progresses and have demonstrated adequate performance for detection of prior infection for sero-epidemiological purposes. The applicability of results for detection of vaccination-induced antibodies is uncertain.
Subject(s)
COVID-19 , SARS-CoV-2 , Humans , COVID-19/diagnosis , COVID-19/epidemiology , Antibodies, Viral , Immunoglobulin G , COVID-19 Vaccines , Pandemics , Seroepidemiologic Studies , Immunoglobulin MABSTRACT
QuantiFERON-TB Gold Plus (QFT-Plus) is the latest generation of interferon gamma release assays (IGRAs) to receive approval from the U.S. FDA, replacing its predecessor, QuantiFERON-TB Gold In-Tube (QFT-GIT). The novelty of QFT-Plus is that it elicits a response from CD8 T cells, in addition to CD4 T cells, thus collecting a broader response from T-cell subsets than QFT-GIT. It was developed with the aim to improve the detection of latent tuberculosis infection (LTBI), especially among recently exposed contacts, immunocompromised hosts, and young children. In this minireview, we summarize the performance of QFT-Plus compared with that of QFT-GIT among active tuberculosis (TB) patients (a surrogate for LTBI patients), high-risk populations, and low-risk individuals based on recent publications. Studies comparing QFT-Plus to QFT-GIT currently do not support the superior performance of QFT-Plus in individuals with active TB and LTBI. The difference in sensitivity between QFT-Plus and QFT-GIT in active TB patients was not significant in nearly all studies and ranged from -4.0 to 2.0%. Among high-risk groups, the agreement between QFT-Plus and QFT-GIT was 89.9 to 96.0% (kappa coefficient range, 0.80 to 0.91). The specificity in the low-risk population was slightly lower for QFT-Plus than for QFT-GIT, with the difference ranging from -7.4 to 0%. Further studies are needed to accurately evaluate the sensitivity of QFT-Plus in immunocompromised hosts and children. In addition, further evidence is required to validate a modified interpretation of QFT-Plus for the identification of false-positive results in low-risk health care workers.
Subject(s)
Latent Tuberculosis , Tuberculosis , Child , Child, Preschool , Health Personnel , Humans , Immunocompromised Host , Interferon-gamma Release Tests , Latent Tuberculosis/diagnosis , Tuberculin Test , Tuberculosis/diagnosisABSTRACT
Bio-behavioural surveys of people who inject drugs (PWID) evolved from unlinked anonymous monitoring (UAM) of human immunodeficiency virus (HIV) incidence and prevalence, which began in some high-income countries in the late 1980s. UAM was conducted purely for surveillance purposes and test results were not returned to participants. Later, the importance of collecting data on behavioural risk factors was recognised, leading to the development of bio-behavioural surveys of PWID, which today are conducted regularly in several countries. Typically, these surveys recruit participants from venues providing harm reduction services and involve behavioural questionnaires and dried blood spot (DBS) testing for HIV and hepatitis C (HCV). DBS test results are not returned to participants; instead, countries offer varied systems of on-site testing separate from the bio-behavioural testing or provide referrals to external testing services. In this commentary, we trace the history of bio-behavioural surveys of PWID from their origins to the present day to explain how the methodologies evolved, along with the ethical considerations underlying them. We highlight the dramatic improvements in treatments for HIV and HCV over the past thirty years and the corresponding need to ensure that bio-behavioural survey participants can access low-barrier and timely testing. We review the pros and cons of different strategies for providing test results to participants and argue that the return of DBS results collected as part of bio-behavioural surveys warrants consideration as an additional tool to improve testing access for participants. Any changes should be informed by the perspectives of participants, study site personnel and investigators.
ABSTRACT
Since 2015, the World Health Organization (WHO) has recommended prioritising testing and treatment of tuberculosis (TB) infection (TBI) in 11 high-risk groups. With new options emerging for TB preventive treatment, we conducted a scoping review, in consultation with the WHO's Global Tuberculosis Programme, to explore the evidence for other population groups at potentially high risk of progression to active TB. We searched six databases for preprints and articles published between 2000 and August 2022. 18 out of 33 668 screened records were included (six meta-analyses and 12 original research studies). Most were observational studies reporting the incidence of active TB in a risk group versus control. Glomerular diseases had the strongest association with active TB (standardised incidence ratio 23.36, 95% CI 16.76-31.68) based on an unpublished study. Other conditions associated with increased risk of active TB included hepatitis C, malignancies, diabetes mellitus, rheumatoid arthritis and vitamin D deficiency. Corticosteroid use was also associated with increased risk in several studies, although heterogeneous definitions of exposure and indications for use challenge interpretation. Despite methodological limitations of the identified studies, expanding the recommendations for TBI screening and treatment to new risk groups such as those reported here should be considered. Further group-specific systematic reviews may provide additional data for decision-making.
Subject(s)
Latent Tuberculosis , Tuberculosis , Humans , Latent Tuberculosis/diagnosis , Latent Tuberculosis/epidemiology , Population Groups , Risk Factors , Tuberculosis/diagnosis , Tuberculosis/epidemiology , Tuberculosis/prevention & control , World Health Organization , Meta-Analysis as Topic , Observational Studies as TopicABSTRACT
The Lancet Commission on Diagnostics highlighted a huge gap in access to diagnostic testing even for basic tests, particularly at the primary care level, and emphasised the need for countries to include diagnostics as part of their universal health coverage benefits packages. Despite the poor state of diagnostic-related services in low-income and middle-income countries (LMICs), little is known about the extent to which diagnostics are included in the health benefit packages. We conducted an analysis of seven Asian LMICs-Cambodia, India, Indonesia, Nepal, Pakistan, Philippines, Viet Nam-to understand this issue. We conducted a targeted review of relevant literature and applied a health financing framework to analyse the benefit packages available in each government-sponsored scheme. We found considerable heterogeneity in country approaches to diagnostics. Of the seven countries, only India has developed a national essential diagnostics list. No country presented a clear policy rationale on the inclusion of diagnostics in their scheme and the level of detail on the specific diagnostics which are covered under the schemes was also generally lacking. Government-sponsored insurance expansion in the eligible populations has reduced the out-of-pocket health payment burden in many of the countries but overall, there is a lack of access, availability and affordability for diagnostic-related services.
Subject(s)
National Health Programs , Humans , Indonesia , Nepal , Pakistan , Philippines , Vietnam , Cambodia , IndiaABSTRACT
BACKGROUND: Rapid antigen tests (RATs) were crucial during the COVID-19 pandemic. Information provided by the test manufacturer in product package inserts, also known as instructions for use (IFUs), is often the only data available to clinicians, public health professionals, and individuals on the diagnostic accuracy of these tests. We aimed to assess whether manufacturer IFU accuracy data aligned with evidence from independent research. METHODS: We searched company websites for package inserts for RATs that were included in the July 2022 update of the Cochrane meta-analysis of SARS-CoV-2 RATs, which served as a benchmark for research evidence. We fitted bivariate hierarchical models to obtain absolute differences in sensitivity and specificity between IFU and Cochrane Review estimates for each test, as well as overall combined differences. FINDINGS: We found 22 (100%) of 22 IFUs of the RATs included in the Cochrane Review. IFUs for 12 (55%) of 22 RATs reported statistically significantly higher sensitivity estimates than the Cochrane Review, and none reported lower estimates. The mean difference between IFU and Cochrane Review sensitivity estimates across tests was 12·0% (95% CI 7·5-16·6). IFUs in three (14%) of 22 diagnostic tests had significantly higher specificity estimates than the Cochrane Review and two (9%) of 22 had lower estimates. The mean difference between IFU and Cochrane Review specificity estimates across tests was 0·3% (95% CI 0·1-0·5). If 100 people with SARS-CoV-2 infection were tested with each of the tests in this study, on average 12 fewer people would be correctly diagnosed than is suggested by the package inserts. INTERPRETATION: Health professionals and the public should be aware that package inserts for SARS-CoV-2 RATs might provide an overly optimistic picture of the sensitivity of a test. Regulatory bodies should strengthen their requirements for the reporting of diagnostic accuracy data in package inserts and policy makers should demand independent validation data for decision making. FUNDING: None.
Subject(s)
COVID-19 , SARS-CoV-2 , Humans , COVID-19/diagnosis , Pandemics , Product Labeling , Sensitivity and Specificity , Systematic Reviews as TopicABSTRACT
With the Covid-19 pandemic and the introduction of the WHO's Essential Diagnostics List (EDL), increasing global attention is focused on the crucial role of diagnostics in achieving universal health coverage. To create national EDLs and to aid health system planning, it is vital to understand the most common conditions with which people present at primary care health facilities. We undertook a systematic review of the most common reasons for primary care visits in low- and middle-income countries. Six databases were searched for articles published between January 2009 and December 2019, with the search updated on MEDLINE to January 2021. Data on the most common patient reasons for encounter (RFEs) and provider diagnoses were collected. 17 of 22,279 screened articles were included. Most studies used unvalidated diagnostic classification systems or presented provider diagnosis data grouped by organ system, rather than presenting specific diagnoses. No studies included data from low-income countries. Only four studies (from Brazil, India, Nigeria and South Africa) using the ICPC-2 classification system contained RFE and provider diagnosis data and could be pooled. The top five RFEs from the four studies were headache, fever, back or low back symptom, cough and pain general/multiple sites. The top five diagnoses were uncomplicated hypertension, upper respiratory tract infection, type 2 diabetes, malaria and health maintenance/prevention. No psychological symptoms were among the top 10 pooled RFEs. There was more variation in top diagnoses between studies than top RFEs, showing the importance of creating location-specific lists of essential diagnostics for primary care. Future studies should aim to sample primary care facilities from across their country of study and use ICPC-3 to report both patient RFEs and provider diagnoses.
ABSTRACT
Cambodia has one of the highest dengue infection rates in Southeast Asia. Here we report quantitative entomological results of a large-scale cluster-randomised trial assessing the impact on vector populations of a package of vector control interventions including larvivorous guppy fish in household water containers, mosquito trapping with gravid-ovitraps, solid waste management, breeding-container coverage through community education and engagement for behavioural change, particularly through the participation of school children. These activities resulted in major reductions in Container Index, House Index, Breteau Index, Pupal Index and Adult Index (all p-values 0.002 or lower) in the Intervention Arm compared with the Control Arm in a series of household surveys conducted over a follow-up period of more than one year, although the project was not able to measure the longer-term sustainability of the interventions. Despite comparative reductions in Adult Index between the study arms, the Adult Index was higher in the Intervention Arm in the final household survey than in the first household survey. This package of biophysical and community engagement interventions was highly effective in reducing entomological indices for dengue compared with the control group, but caution is required in extrapolating the reduction in household Adult Index to a reduction in the overall population of adult Aedes mosquitoes, and in interpreting the relationship between a reduction in entomological indices and a reduction in the number of dengue cases. The package of interventions should be trialled in other locations.
Subject(s)
Culicidae/physiology , Dengue/epidemiology , Dengue/prevention & control , Mosquito Control/methods , Poecilia/physiology , Animals , Cambodia/epidemiology , Household Articles , Larva , Mosquito Vectors , Public Health , Water , Water SupplyABSTRACT
In northwest Tanzania, many artisanal small-scale miners (ASMs) and female sex workers (FSWs) live in informal communities surrounding mines where tuberculosis (TB) is highly prevalent. An active case finding (ACF) intervention to increase TB case notification was undertaken in two districts. Alongside this, a study was implemented to understand engagement with the intervention through: (1) quantitative questionnaires to 128 ASMs and FSWs, who either engaged or did not engage in the ACF intervention, to assess their views on TB; (2) qualitative interviews with 41 ASMs and FSWs, 36 community health workers (CHWs) and 30 community stakeholders. The mean perceived severity of TB score was higher in the engaged than in the non-engaged group (p = 0.01). Thematic analysis showed that health-seeking behaviour was similar across both groups but that individuals in the non-engaged group were more reluctant to give sputum samples, often because they did not understand the purpose. CHWs feared contracting TB on the job, and many noted that mining areas were difficult to access without transportation. Community stakeholders provided various recommendations to increase engagement. This study highlights reasons for engagement with a large-scale ACF intervention targeting key populations and presents insights from implementers and stakeholders on the implementation of the intervention.
Subject(s)
Sex Workers , Tuberculosis , Female , Humans , Mass Screening , Motivation , Tanzania/epidemiology , Tuberculosis/diagnosis , Tuberculosis/epidemiologyABSTRACT
The advent of affordable, portable ultrasound devices has led to increasing interest in the use of point-of-care ultrasound (POCUS) for the detection of pulmonary TB (PTB). We undertook a systematic review of the diagnostic accuracy of POCUS for PTB. Five databases were searched for articles published between January 2010 and June 2020. Risk of bias was assessed using QUADAS-2. Data on sensitivity and specificity of individual lung ultrasound findings were collected, with variable reference standards including PCR and sputum smear microscopy. Six of 3,919 reviewed articles were included: five in adults and one in children, with a total sample size of 564. Studies had high risk of bias in many domains. In adults, subpleural nodule and lung consolidation were the lung ultrasound findings with the highest sensitivities, ranging from 72.5% to 100.0% and 46.7% to 80.4%, respectively. Only one study reported specificity data. Variability in sensitivity may be due to variable reference standards or may imply operator dependence. There is insufficient evidence to judge the diagnostic accuracy of POCUS for PTB. There is also no consensus on the optimal protocols for acquiring and analysing POCUS images for PTB. New studies which minimise potential sources of bias are required to further assess the diagnostic accuracy of POCUS for PTB.
Subject(s)
Point-of-Care Systems , Point-of-Care Testing , Tuberculosis, Pulmonary/diagnostic imaging , Ultrasonography , Humans , Sensitivity and SpecificityABSTRACT
Nigeria accounts for 11% of the worldwide gap between estimated and reported individuals with tuberculosis (TB). Hard-to-reach communities on the Southern Nigeria coast experience many difficulties accessing TB services. We implemented an active case finding (ACF) intervention in Akwa Ibom and Cross River states utilizing three approaches: house-to-house/tent-to-tent screening, community outreach and contact investigation. To evaluate the impact, we compared TB notifications in intervention areas to baseline and control population notifications, as well as to expected notifications based on historical trends. We also gathered field notes from discussions with community volunteers who provided insights on their perspectives of the intervention. A total of 509,768 individuals were screened of which 12,247 (2.4%) had TB symptoms and 11,824 (96.5%) were tested. In total, 1015 (8.6%) of those identified as presumptive had confirmed TB-98.2% initiated treatment. Following implementation, TB notifications in intervention areas increased by 112.9% compared to baseline and increased by 138.3% when compared to expected notifications based on historical trends. In contrast, control population notifications increased by 101% and 49.1%, respectively. Community volunteers indicated a preference for community outreach activities. Multi-faceted, community-based interventions in Nigeria's coastal areas successfully increase TB detection for communities with poor access to health services.