Diagnostic accuracy and reproducibility of WHO-endorsed phenotypic drug susceptibility testing methods for first-line and second-line antituberculosis drugs.

In an effort to update and clarify policies on tuberculosis drug susceptibility testing (DST), the World Health Organization (WHO) commissioned a systematic review evaluating WHO-endorsed diagnostic tests. We report the results of this systematic review and meta-analysis of the diagnostic accuracy and reproducibility of phenotypic DST for first-line and second-line antituberculosis drugs. This review provides support for recommended critical concentrations for isoniazid and rifampin in commercial broth-based systems. Further studies are needed to evaluate critical concentrations for ethambutol and streptomycin that accurately detect susceptibility to these drugs. Evidence is limited on the performance of DST for pyrazinamide and second-line drugs.

Commercial serological tests for the diagnosis of active pulmonary and extrapulmonary tuberculosis: an updated systematic review and meta-analysis.

BACKGROUND: Serological (antibody detection) tests for tuberculosis (TB) are widely used in developing countries. As part of a World Health Organization policy process, we performed an updated systematic review to assess the diagnostic accuracy of commercial serological tests for pulmonary and extrapulmonary TB with a focus on the relevance of these tests in low- and middle-income countries. METHODS AND FINDINGS: We used methods recommended by the Cochrane Collaboration and GRADE approach for rating quality of evidence. In a previous review, we searched multiple databases for papers published from 1 January 1990 to 30 May 2006, and in this update, we add additional papers published from that period until 29 June 2010. We prespecified subgroups to address heterogeneity and summarized test performance using bivariate random effects meta-analysis. For pulmonary TB, we included 67 studies (48% from low- and middle-income countries) with 5,147 participants. For all tests, estimates were variable for sensitivity (0% to 100%) and specificity (31% to 100%). For anda-TB IgG, the only test with enough studies for meta-analysis, pooled sensitivity was 76% (95% CI 63%-87%) in smear-positive (seven studies) and 59% (95% CI 10%-96%) in smear-negative (four studies) patients; pooled specificities were 92% (95% CI 74%-98%) and 91% (95% CI 79%-96%), respectively. Compared with ELISA (pooled sensitivity 60% [95% CI 6%-65%]; pooled specificity 98% [95% CI 96%-99%]), immunochromatographic tests yielded lower pooled sensitivity (53%, 95% CI 42%-64%) and comparable pooled specificity (98%, 95% CI 94%-99%). For extrapulmonary TB, we included 25 studies (40% from low- and middle-income countries) with 1,809 participants. For all tests, estimates were variable for sensitivity (0% to 100%) and specificity (59% to 100%). Overall, quality of evidence was graded very low for studies of pulmonary and extrapulmonary TB. CONCLUSIONS: Despite expansion of the literature since 2006, commercial serological tests continue to produce inconsistent and imprecise estimates of sensitivity and specificity. Quality of evidence remains very low. These data informed a recently published World Health Organization policy statement against serological tests. Please see later in the article for the Editors' Summary.

13C-urea breath test for the diagnosis of Helicobacter pylori infection in children: a systematic review and meta-analysis.

BACKGROUND: The (13) C-urea breath test ((13) C-UBT) is a safe, noninvasive and reliable method for diagnosing H. pylori infection in adults. However, the test has shown variable accuracy in the pediatric population, especially in young children. We aimed to carry out a systematic review and meta-analysis to evaluate the performance of the (13) C-UBT diagnostic test for H. pylori infection in children. METHODS: We conducted a systematic review of the PubMed, Embase and Liliacs databases including studies from January 1998 to May 2009. Selection criteria included studies with at least 30 children and reporting the comparison of (13) C-UBT against a gold standard for H. pylori diagnosis. Thirty-one articles and 135 studies were included for analysis. Children were stratified in subgroups of <6 and ≥6 years of age, and we considered variables such as type of meal, cutoff value, tracer dose, and delta time for the analysis. DISCUSSION: The (13) C-UBT performance meta-analyses showed 1, good accuracy in all ages combined (sensitivity 95.9%, specificity 95.7%, LR+ 17.4, LR- 0.06, diagnostic odds ratio (DOR) 424.9), 2, high accuracy in children >6 years (sensitivity 96.6%, specificity 97.7%, LR+ 42.6, LR- 0.04, DOR 1042.7), 3, greater variability in accuracy estimates and on average a few percentage points lower, particularly specificity, in children ≤6 years (sensitivity 95%, specificity 93.5%, LR+ 11.7, LR- 0.12, DOR 224.8). Therefore, the meta-analysis shows that the (13) C-UBT test is less accurate for the diagnosis of H. pylori infection in young children, but adjusting cutoff value, pretest meal, and urea dose, this accuracy can be improved.

Utility of stool sample-based tests for the diagnosis of Helicobacter pylori infection in children.

OBJECTIVE: Helicobacter pylori antigen or DNA in stool are meant to detect the bacteria; however, in children the colonization of the gastric mucosa by H pylori is usually weak and fecal excretion of antigen or DNA varies considerably, challenging the utility of these tests in this age group. The aim of the present study was to carry out a systematic review and meta-analysis to evaluate the performance of stool H pylori DNA and antigen tests for the diagnosis of infection in children. METHODS: We conducted a systematic review and meta-analysis to assess the accuracy of stool tests for diagnosis of H pylori infection in children. We searched PubMed, EMBASE, and LILACS databases. Selection criteria included participation of at least 30 children and the use of a criterion standard for H pylori diagnosis. In a comprehensive search, we identified 48 studies. RESULTS: Regarding antigen-detection tests, enzyme-linked immunosorbent assay (ELISA) monoclonal antibodies showed the best performance, with sensitivity and specificity of 97%, positive likelihood ratio (LR+) of 29.9, and negative likelihood ratio (LR-) of 0.03. ELISA polyclonal antibodies had sensitivity of 92%, specificity of 93%, LR+ of 16.2, LR- of 0.09, and high heterogeneity (P < 0.0001). One-step monoclonal antibody tests demonstrated sensitivity of 88%, specificity of 93%, LR+ of 10.6, and LR- of 0.11. For DNA detection, polymerase chain reaction-based test showed sensitivity of 80.8%, specificity of 98%, LR+ of 17.1, and LR- of 0.18. CONCLUSIONS: Detection of H pylori antigen in stools with ELISA monoclonal antibodies is a noninvasive efficient test for diagnosis of infection in children. One-step tests showed low accuracy and more studies are needed to obtain a useful office-based screening test. The available molecular tests are still unreliable.

In-house nucleic acid amplification tests for the detection of Mycobacterium tuberculosis in sputum specimens: meta-analysis and meta-regression.

BACKGROUND: More than 200 studies related to nucleic acid amplification (NAA) tests to detect Mycobacterium tuberculosis directly from clinical specimens have appeared in the world literature since this technology was first introduced. NAA tests come as either commercial kits or as tests designed by the reporting investigators themselves (in-house tests). In-house tests vary widely in their accuracy, and factors that contribute to heterogeneity in test accuracy are not well characterized. Here, we used meta-analytical methods, including meta-regression, to identify factors related to study design and assay protocols that affect test accuracy in order to identify those factors associated with high estimates of accuracy. RESULTS: By searching multiple databases and sources, we identified 2520 potentially relevant citations, and analyzed 84 separate studies from 65 publications that dealt with in-house NAA tests to detect M. tuberculosis in sputum samples. Sources of heterogeneity in test accuracy estimates were determined by subgroup and meta-regression analyses. Among 84 studies analyzed, the sensitivity and specificity estimates varied widely; sensitivity varied from 9.4% to 100%, and specificity estimates ranged from 5.6% to 100%. In the meta-regression analysis, the use of IS6110 as a target, and the use of nested PCR methods appeared to be significantly associated with higher diagnostic accuracy. CONCLUSION: Estimates of accuracy of in-house NAA tests for tuberculosis are highly heterogeneous. The use of IS6110 as an amplification target, and the use of nested PCR methods appeared to be associated with higher diagnostic accuracy. However, the substantial heterogeneity in both sensitivity and specificity of the in-house NAA tests rendered clinically useful estimates of test accuracy difficult. Future development of NAA-based tests to detect M. tuberculosis from sputum specimens should take into consideration these findings in improving accuracy of in-house NAA tests.

Diagnostic accuracy of nucleic acid amplification tests for tuberculous meningitis: a systematic review and meta-analysis.

Conventional tests are not always helpful in making a diagnosis of tuberculous meningitis. We did a systematic review and meta-analysis to establish the summary accuracy of nucleic acid amplification (NAA) tests for tuberculous meningitis. We searched six electronic databases and contacted authors, experts, and manufacturers. Measures of diagnostic accuracy were pooled using a random effects model. 49 studies met our inclusion criteria. The summary estimates in 14 studies with commercial NAA tests were: sensitivity 0.56 (95% CI 0.46, 0.66), specificity 0.98 (0.97, 0.99), positive likelihood ratio 35.1 (19.0, 64.6), negative likelihood ratio 0.44 (0.33, 0.60), and diagnostic odds ratio 96.4 (42.8, 217.3). In the 35 studies with in-house ("home-brew") tests, the summary accuracy could not be established with confidence because of wide variability in test accuracy. On current evidence, commercial NAA tests show a potential role in confirming tuberculous meningitis diagnosis, although their overall low sensitivity precludes the use of these tests to rule out tuberculous meningitis with certainty.

Nucleic acid amplification tests in the diagnosis of tuberculous pleuritis: a systematic review and meta-analysis.

BACKGROUND: Conventional tests for tuberculous pleuritis have several limitations. A variety of new, rapid tests such as nucleic acid amplification tests--including polymerase chain reaction--have been evaluated in recent times. We conducted a systematic review to determine the accuracy of nucleic acid amplification (NAA) tests in the diagnosis of tuberculous pleuritis. METHODS: A systematic review and meta-analysis of 38 English and Spanish articles (with 40 studies), identified via searches of six electronic databases, hand searching of selected journals, and contact with authors, experts, and test manufacturers. Sensitivity, specificity, and other measures of accuracy were pooled using random effects models. Summary receiver operating characteristic curves were used to summarize overall test performance. Heterogeneity in study results was formally explored using subgroup analyses. RESULTS: Of the 40 studies included, 26 used in-house ("home-brew") tests, and 14 used commercial tests. Commercial tests had a low overall sensitivity (0.62; 95% confidence interval [CI] 0.43, 0.77), and high specificity (0.98; 95% CI 0.96, 0.98). The positive and negative likelihood ratios for commercial tests were 25.4 (95% CI 16.2, 40.0) and 0.40 (95% CI 0.24, 0.67), respectively. All commercial tests had consistently high specificity estimates; the sensitivity estimates, however, were heterogeneous across studies. With the in-house tests, both sensitivity and specificity estimates were significantly heterogeneous. Clinically meaningful summary estimates could not be determined for in-house tests. CONCLUSIONS: Our results suggest that commercial NAA tests may have a potential role in confirming (ruling in) tuberculous pleuritis. However, these tests have low and variable sensitivity and, therefore, may not be useful in excluding (ruling out) the disease. NAA test results, therefore, cannot replace conventional tests; they need to be interpreted in parallel with clinical findings and results of conventional tests. The accuracy of in-house nucleic acid amplification tests is poorly defined because of heterogeneity in study results. The clinical applicability of in-house NAA tests remains unclear.

Commercial nucleic-acid amplification tests for diagnosis of pulmonary tuberculosis in respiratory specimens: meta-analysis and meta-regression.

BACKGROUND: Hundreds of studies have evaluated the diagnostic accuracy of nucleic-acid amplification tests (NAATs) for tuberculosis (TB). Commercial tests have been shown to give more consistent results than in-house assays. Previous meta-analyses have found high specificity but low and highly variable estimates of sensitivity. However, reasons for variability in study results have not been adequately explored. We performed a meta-analysis on the accuracy of commercial NAATs to diagnose pulmonary TB and meta-regression to identify factors that are associated with higher accuracy. METHODOLOGY/PRINCIPAL FINDINGS: We identified 2948 citations from searching the literature. We found 402 articles that met our eligibility criteria. In the final analysis, 125 separate studies from 105 articles that reported NAAT results from respiratory specimens were included. The pooled sensitivity was 0.85 (range 0.36-1.00) and the pooled specificity was 0.97 (range 0.54-1.00). However, both measures were significantly heterogeneous (p<.001). We performed subgroup and meta-regression analyses to identify sources of heterogeneity. Even after stratifying by type of commercial test, we could not account for the variability. In the meta-regression, the threshold effect was significant (p = .01) and the use of other respiratory specimens besides sputum was associated with higher accuracy. CONCLUSIONS/SIGNIFICANCE: The sensitivity and specificity estimates for commercial NAATs in respiratory specimens were highly variable, with sensitivity lower and more inconsistent than specificity. Thus, summary measures of diagnostic accuracy are not clinically meaningful. The use of different cut-off values and the use of specimens other than sputum could explain some of the observed heterogeneity. Based on these observations, commercial NAATs alone cannot be recommended to replace conventional tests for diagnosing pulmonary TB. Improvements in diagnostic accuracy, particularly sensitivity, need to be made in order for this expensive technology to be worthwhile and beneficial in low-resource countries.

Antibody-based detection tests for the diagnosis of Helicobacter pylori infection in children: a meta-analysis.

BACKGROUND: Numerous serologic tests are available for the diagnosis of H. pylori infection in children. Common designs of antibody-based detection tests are ELISA and Western Blot (WB). For developing countries with limited laboratory resources and access, ELISA would be the preferred method because of its simplicity, lower cost and speed. Although in adults ELISA has proven to be highly accurate in diagnosing H. pylori infection; in children, it has shown variable accuracy. METHODS/FINDINGS: We conducted a systematic review and meta-analysis to assess the accuracy of antibody-based detection tests for the diagnosis of H. pylori infection in children. Selection criteria included participation of at least 30 children and the use of a gold standard for H. pylori diagnosis. In a comprehensive search we identified 68 studies. Subgroup analyses were carried out by technique, immunoglobulin class, and source of test (commercial and in-house). The results demonstrated: 1) WB tests showed high overall performance, sensitivity 91.3% (95% CI, 88.9-93.3), specificity 89% (95% CI, 85.7-91.9), LR+ 8.2 (95% CI, 5.1-13.3), LR- 0.06 (95% CI, 0.02-0.16), DOR 158.8 (95% CI, 57.8-435.8); 2) ELISA-IgG assays showed low sensitivity 79.2% (95% CI, 77.3-81.0) and high specificity (92.4%, 95% CI, 91.6-93.3); 3) ELISA commercial tests varied widely in performance (test for heterogeneity p<0.0001); and 4) In-house ELISA with whole-cell antigen tests showed the highest overall performance: sensitivity 94% (95% CI, 90.2-96.7), specificity 96.4% (95% CI, 94.2-97.9), LR+ 19.9 (95% CI, 7.9-49.8), LR- 0.08 (95% CI, 0.04-0.15) DOR 292.8 (95% CI, 101.8-841.7). CONCLUSIONS/SIGNIFICANCE: WB test and in-house ELISA with whole-cell antigen tests are the most reliable tests for the diagnosis of H. pylori infection in children. Antigens obtained from local strains of the community could partially explain the good overall accuracy of the in-house ELISA. Because of its cost and technical demands, in-house ELISA might be more suitable for use in developing countries.

Comparison of an interferon-gamma release assay with tuberculin skin testing in HIV-infected individuals.

RATIONALE: Although interferon (IFN)-gamma release assays are approved for the diagnosis of latent tuberculosis infection (LTBI), limited data exist regarding their performance in HIV infection. OBJECTIVES: To compare tuberculin skin test (TST) results to the commercial IFN-gamma release assay QuantiFERON-TB Gold In-Tube (QFT) for the diagnosis of LTBI in HIV-infected adults. METHODS: A total of 294 HIV-infected subjects sampled from two San Francisco cohorts underwent TST, using 5 TU of purified protein derivative, and QFT, measuring IFN-gamma response to Mycobacterium tuberculosis-specific RD-1 antigens. MAIN RESULTS: Of 294 participants, 205 (70%) returned for an evaluable TST. Concordance between QFT and TST was 89.3% (kappa=0.37, p=0.007). However, in subjects with positive test results by either TST or QFT, only 28% (8/29) had positive test results by both modalities. TST-positive/QFT-negative discordant results were found in 5.1% of subjects and TST-negative/QFT-positive discordance in 5.6%. Indeterminate QFT results occurred in 5.1%, all due to a failure to respond to the phytohemagglutinin-positive control. Subjects with a CD4(+) count of less than 100 cells/mm(3) had a relative risk of an indeterminate result of 4.24 (95% confidence interval, 1.55-11.61; p=0.003) compared with those with a CD4(+) count of 100 or more. CONCLUSIONS: Overall concordance between QFT and TST in HIV infection was high, but agreement among subjects with positive tests by either modality was low.