Assessing the Diagnostic Performance of New Commercial Interferon-γ Release Assays for Mycobacterium tuberculosis Infection: A Systematic Review and Meta-Analysis.

BACKGROUND: We compared 6 new interferon-γ release assays (IGRAs; hereafter index tests: QFT-Plus, QFT-Plus CLIA, QIAreach, Wantai TB-IGRA, Standard E TB-Feron, and T-SPOT.TB/T-Cell Select) with World Health Organization (WHO)-endorsed tests for tuberculosis infection (hereafter reference tests). METHODS: Data sources (1 January 2007-18 August 2021) were Medline, Embase, Web of Science, Cochrane Database of Systematic Reviews, and manufacturers' data. Cross-sectional and cohort studies comparing the diagnostic performance of index and reference tests were selected. The primary outcomes of interest were the pooled differences in sensitivity and specificity between index and reference tests. The certainty of evidence (CoE) was summarized using the GRADE approach. RESULTS: Eighty-seven studies were included (44 evaluated the QFT-Plus, 4 QFT-Plus CLIA, 3 QIAreach, 26 TB-IGRA, 10 TB-Feron [1 assessing the QFT-Plus], and 1 T-SPOT.TB/T-Cell Select). Compared to the QFT-GIT, QFT Plus's sensitivity was 0.1 percentage points lower (95% confidence interval [CI], -2.8 to 2.6; CoE: moderate), and its specificity 0.9 percentage points lower (95% CI, -1.0 to -.9; CoE: moderate). Compared to QFT-GIT, TB-IGRA's sensitivity was 3.0 percentage points higher (95% CI, -.2 to 6.2; CoE: very low), and its specificity 2.6 percentage points lower (95% CI, -4.2 to -1.0; CoE: low). Agreement between the QFT-Plus CLIA and QIAreach with QFT-Plus was excellent (pooled κ statistics of 0.86 [95% CI, .78 to .94; CoE: low]; and 0.96 [95% CI, .92 to 1.00; CoE: low], respectively). The pooled κ statistic comparing the TB-Feron and the QFT-Plus or QFT-GIT was 0.85 (95% CI, .79 to .92; CoE: low). CONCLUSIONS: The QFT-Plus and the TB-IGRA have very similar sensitivity and specificity as WHO-approved IGRAs.

Framework for the evaluation of new tests for tuberculosis infection.

The scale-up of tuberculosis (TB) preventive treatment (TPT) must be accelerated to achieve the targets set by the United Nations High-level Meeting on TB and the End TB Strategy. The scale-up of effective TPT is hampered by concerns about operational challenges to implement the existing tests for TB infection. New simpler tests could facilitate the scale-up of testing for TB infection. We present a framework for evaluation of new immunodiagnostic tests for the detection of TB infection, with an aim to facilitate their standardised evaluation and accelerate adoption into global and national policies and subsequent scale-up. The framework describes the principles to be considered when evaluating new tests for TB infection and provides guidance to manufacturers, researchers, regulators and other users on study designs, populations, reference standards, sample size calculation and data analysis and it is also aligned with the Global Strategy for TB Research and Innovation adopted by the World Health Assembly in 2020. In addition, we briefly describe technical issues that should be considered when evaluating new tests, including the safety for skin tests, costs incurred by patients and the health system, and operational characteristics.

Guidance for the Evaluation of Tuberculosis Diagnostics That Meet the World Health Organization (WHO) Target Product Profiles: An Introduction to WHO Process and Study Design Principles.

Existing high-priority target product profiles (TPPs) of the World Health Organization (WHO) establish important needs for tuberculosis (TB) diagnostic development. Building on this earlier work, this guidance series aims to provide study guidance for performing accuracy studies of novel diagnostic products that may meet the 4 high-priority WHO TPPs and thus enable adequate evidence generation to inform a WHO evidence review process. Diagnostic accuracy studies represent a fundamental step in the validation of all tests. Unfortunately, such studies often have limitations in design, execution, and reporting, leading to low certainty of the evidence about true test performance, which can delay or impede policy and scale-up decisions. This introductory paper outlines the following: (1) the purpose of this series of papers on study guidance; (2) WHO evidence needs and process for the development of policy guidelines for new TB diagnostic tests; and (3) study design considerations, ie, general diagnostic study considerations, intended use of test and role in the clinical pathway, choice of population and setting, index-test specific issues, suitable reference standard and comparators, study flow and specimen issues, and finally key issues beyond accuracy that should be considered. The other 4 papers in this series will provide more detailed guidance for each of the 4 WHO high-priority TPPs. By increasing the clarity around the clinical evaluation needs for tests that have the potential to meet the TPP specifications, we hope to support harmonized evidence generation and enable the WHO review process towards meeting the WHO End TB Strategy targets for reducing the incidence and mortality associated with TB.

Trade-offs between clinical performance and test accessibility in tuberculosis diagnosis: a multi-country modelling approach for target product profile development.

BACKGROUND: Tuberculosis continues to be a leading cause of infectious disease mortality, and effective screening and diagnosis remains crucial. Despite progress made, diagnostic gaps remain due to poor access to diagnostic tools and testing, particularly in rural and remote areas. As such, the development of target product profiles is essential in guiding the development of new diagnostic tools, however target product profiles often lack evidence-based information and do not consider trade-offs between test accuracy and accessibility. METHODS: A simulation-based model, in the form of a decision tree, was used to map out the baseline patient tuberculosis diagnostic pathway for individuals in Kenya, South Africa, and India. The model was then used to adapt this pathway to evaluate the trade-offs between increased access to testing and varying accuracy of new tuberculosis diagnostic tools within the health-care contexts of Kenya, South Africa, and India. The model aims to support target product profile development by quantifying the impact of new diagnostics on the standard of care. The model considered three diagnostic attributes, namely sample type (sputum vs non-sputum), site of testing (point of care, near point of care, and health setting) and turnaround time. FINDINGS: Our results indicate that per sample type, novel point-of-care tests would be the most accessible and even with lower sensitivities can achieve comparable or better case detection than the current standard of care in each country. Non-sputum diagnostics also have lower sensitivity requirements. Overall, target product profile parameters with reduced sensitivities from 70% for non-sputum and 78% for sputum tests could be accepted. INTERPRETATION: Diagnostics which bring tuberculosis tests and test results closer to the patient could reduce overall diagnostic loss despite potential reductions in sensitivity. This work provides a novel framework for guiding the future development of diagnostics, with an approach towards balancing accessibility and test performance. FUNDING: The Bill and Melinda Gates Foundation (INV-045721).

Systematic review of the economic impact of novel Mycobacterium tuberculosis specific antigen-based skin tests for detection of TB infection compared with tuberculin skin test and interferon-gamma release assays.

The Purified Protein Derivative tuberculin skin tests (TST) and blood-based Mycobacterium tuberculosis (M.tb) specific interferon-gamma release assays (IGRA) are the currently used tests for identifying individuals with TB infection for preventive treatment. However, challenges around access and implementation have limited their use. Novel M.tb specific skin tests (TBST) such as Diaskintest, ESAT6-CFP10 (C-TST), C-Tb (also known as Cy-Tb), and DPPD may provide accurate and scalable options but evidence synthesis on their economic impact is lacking. We conducted two separate systematic reviews to compare the costs and cost-effectiveness of (1) the novel skin tests TBST (primary), and (2) TST and IGRA tests (secondary), to support WHO guideline development. We searched for articles presenting economic evaluations of the diagnostic tests using a health provider perspective and related to TB infection in humans. We considered papers written in English, Chinese or Russian. In the primary review, eight studies for novel TBST were found. One study in Brazil assessed cost-effectiveness of C-TST and Diaskintest and seven in Russia assessed the Diaskintest, while none evaluated C-Tb or DPPD. The review showed on average, Diaskintest kit costs (in 2021 USD) $1.60 (1.50 - 1.70), while full unit costs were estimated at $5.07. C-TST unit cost was $9.96. The second review found 32 articles on IGRA and/or the TST. These presented an average TST full unit cost of $37.88, and $87.81 for IGRA. Studies' quality for TBST was limited while high-quality studies were found for TST and IGRA tests. In conclusion, there is limited evidence regarding the costs and cost-effectiveness of novel TBST. Conversely, there is substantial evidence for TST and IGRA tests, but most studies were performed in high-income and low-TB burden settings and their cost-effectiveness varied between and within risk groups without clear economic consensus.

Economic evaluation of novel Mycobacterium tuberculosis specific antigen-based skin tests for detection of TB infection: A modelling study.

Evidence on the economic impact of novel skin tests for tuberculosis infection (TBST) is scarce and limited by study quality. We used estimates on the cost-effectiveness of the use of TBST compared to current tuberculosis infection (TBI) tests to assess whether TBST are affordable and feasible to implement under different country contexts. A Markov model parametrised to Brazil, South Africa and the UK was developed to compare the cost-effectiveness of three TBI testing strategies: (1) Diaskintest (DST), (2) TST test, and (3) IGRA QFT test. Univariate and probabilistic sensitivity analyses over unit costs and main parameters were performed. Our modelling results show that Diaskintest saves $5.60 and gains 0.024 QALYs per patient and $8.40, and 0.01 QALYs per patient in Brazil, compared to TST and IGRA respectively. In South Africa, Diaskintest is also cost-saving at $4.39, with 0.015 QALYs per patient gained, compared to TST, and $64.41, and 0.007 QALYs per patient, compared to IGRA. In the UK, Diaskintest saves $73.33, and gaines 0.0351 QALYs per patient, compared to TST. However, Diaskintest, compared to IGRA, showed an incremental cost of $521.45 (95% CI (500.94-545.07)) per QALY, below the willingness-to-pay threshold of $20.223 per QALY. Diaskintest potentially saves costs and results in greater health gains than the TST and IGRA tests in Brazil and South Africa. In the UK Diaskintest would gain health but also be more costly. Our results have potential external validity because TBST remained cost-effective despite extensive sensitivity analyses.

A Systematic Review on the Safety of Mycobacterium tuberculosis-Specific Antigen-Based Skin Tests for Tuberculosis Infection Compared With Tuberculin Skin Tests.

Background: A systematic review showed that the accuracy of Mycobacterium tuberculosis antigen-based skin tests (TBSTs) for tuberculosis is similar to that of interferon γ release assay, but the safety of TBSTs has not been systematically reviewed. Methods: We searched for studies reporting injection site reactions (ISRs) and systemic adverse events associated with TBSTs. We searched Medline, Embase, e-library, the Chinese Biomedical Literature Database, and the China National Knowledge Infrastructure database for studies through 30 July 2021, and the database search was updated until 22 November 2022. Results: We identified 7 studies for Cy-Tb (Serum Institute of India), 7 (including 2 found through the updated search) for C-TST (Anhui Zhifei Longcom), and 11 for Diaskintest (Generium). The pooled risk of any injection site reactions (ISRs) due to Cy-Tb (n = 2931; 5 studies) did not differ significantly from that for tuberculin skin tests (TSTs; risk ratio, 1.05 [95% confidence interval, .70-1.58]). More than 95% of ISRs were reported as mild or moderate; common ISRs included pain, itching, and rash. In 1 randomized controlled study, 49 of 153 participants (37.6%) given Cy-Tb experience any systemic adverse event (eg, fever and headache), compared with 56 of 149 participants (37.6%) given TST (risk ratio, 0.85 [95% confidence interval, .6-1.2]). In a randomized controlled study in China (n = 14 579), the frequency of systemic adverse events in participants given C-TST was similar to that for TST, and the frequency of ISRs was similar to or lower than that for TST. Reporting of the safety data on Diaskintest was not standardized, precluding meta-analysis. Conclusion: The safety profile of TBSTs appears similar to that of TSTs and is associated with mostly mild ISRs.

The diagnostic performance of novel skin-based in-vivo tests for tuberculosis infection compared with purified protein derivative tuberculin skin tests and blood-based in vitro interferon-γ release assays: a systematic review and meta-analysis.

BACKGROUND: Novel skin-based tests for tuberculosis infection might present suitable alternatives to current tests; however, diagnostic performance of new tests compared with the purified protein derivative-tuberculin skin test (TST) or interferon-γ release assays (IGRA) needs systematic assessment. METHODS: In this systematic review and meta-analysis, we searched English (Medline OVID), Chinese (Chinese Biomedical Literature Database and the China National Knowledge Infrastructure), and Russian (e-library) databases from the inception of each database to May 15, 2019, (with updated search of the Russian and English databases on Oct, 20 2020) using terms "ESAT6" OR "CFP10" AND "skin test" AND "Tuberculosis" OR "C-Tb" OR "Diaskintest". We included studies reporting on the performance of index tests alone or compared with a comparator. Inclusion criteria varied according to review objectives and performance outcome, but reporting of test cut-offs for positivity applied to study population was required from all studies. We used a hierarchy of reference standards for tuberculosis infection consistent with the 2020 WHO framework to evaluate diagnostic performance. Two authors independently reviewed the titles and abstracts for English and Chinese (LF and MK) and Russian studies (MK and VN). Study quality was assessed with QUADAS-2. Pooled random-effects estimates are presented when appropriate for total agreement proportion, sensitivity in microbiologically confirmed tuberculosis and specificity in cohorts with low risk of tuberculosis infection. This study is registered with PROSPERO, CRD42019135572. FINDINGS: We identified 1466 original articles, of which 37 (2·5%) studies, including 10 915 individuals (7111 Diaskintest, 2744 C-Tb, 887 EC, 173 DPPD), were included in the qualitative analysis (29 [78%] studies of Diaskintest, five [15%] studies of C-Tb, two [5%] studies of EC-skintest, and one [3%] study of DPPD). 22 (1·5%) studies including 5810 individuals (3143 Diaskintest, 2129 C-Tb, 538 EC-skintest) were included in the quantitative analysis: 15 (68%) of Diaskintest, five (23%) of C-Tb, and two (9%) of EC-skintest. Tested sub-populations included individuals with HIV, children (0-18 years), and individuals exposed to tuberculosis. Studies were heterogeneous with moderate to high risk of bias. Nine head-to-head studies of index test versus TST and IGRA permitted direct comparisons and pooling. In a mixed cohort of people with and without tuberculosis, Diaskintest pooled agreement with IGRA was 87·16% (95% CI 79·47-92·24) and 55·45% (46·08-64·45) with TST-5 mm cut-off (TST5 mm). Diaskintest sensitivity was 91·18% (95% CI 81·72-95·98) compared with 88·24% (78·20-94·01) for TST5 mm, 89·66 (78·83-95·28) for IGRA QuantiFERON, and 90·91% (79·95-96·16) for TSPOT.TB. C-Tb agreement with IGRA in individuals with active tuberculosis was 79·80% (95% CI 76·10-83·07) compared with 78·92% (74·65-82·63) for TST5 mm/15 mm cut-off (TST5 mm/15 mm). TST5/15mm reflects threshold in cohorts that applied stratified cutoffs: 5 mm for HIV-infected, immunocompromised, or BCG-naive individuals, and 15mm for BCG-vaccinated immunocompetent individuals. C-Tb sensitivity was 74·52% (95% CI 70·39-78·25) compared with a sensitivity of 78·18% (67·75-85·94) for TST5 mm/15 mm, and 71·67% (63·44-78·68) for IGRA. Specificity was 97·85% (95% CI 93·96-99·25) for C-Tb versus 93·31% (90·22-95·48) for TST 15 mm cut-off and 99·15% (79·66-99·97) for IGRA. EC-skintest sensitivity was 86·06% (95% CI 82·39-89·07). INTERPRETATION: Novel skin-based tests for tuberculosis infection appear to perform similarly to IGRA or TST; however, study quality varied. Evaluation of test performance, patient-important outcomes, and diagnostic use in current clinical algorithms will inform implementation in key populations. FUNDING: StopTB (New Diagnostics Working Group) and FIND. TRANSLATIONS: For the Chinese and Russian translations of the abstract see Supplementary Materials section.

Recommendation mapping of the World Health Organization's guidelines on tuberculosis: A new approach to digitizing and presenting recommendations.

OBJECTIVE: Having up-to-date health policy recommendations accessible in one location is in high demand by guideline users. We developed an easy to navigate interactive approach to organize recommendations and applied it to tuberculosis (TB) guidelines of the World Health Organization (WHO). STUDY DESIGN: We used a mixed-methods study design to develop a framework for recommendation mapping with seven key methodological considerations. We define a recommendation map as an online repository of recommendations from several guidelines on a condition, providing links to the underlying evidence and expert judgments that inform them, allowing users to filter and cross-tabulate the search results. We engaged guideline developers, users, and health software engineers in an iterative process to elaborate the WHO eTB recommendation map. RESULTS: Applying the seven-step framework, we included 228 recommendations, linked to 103 guideline questions and organized the recommendation map according to key components of the health question, including the original recommendations and rationale (https://who.tuberculosis.recmap.org/). CONCLUSION: The recommendation mapping framework provides the entire continuum of evidence mapping by framing recommendations within a guideline questions' population, interventions, and comparators domains. Recommendation maps should allow guideline developers to organize their work meaningfully, standardize the automated publication of guidelines through links to the GRADEpro guideline development tool, and increase their accessibility and usability.

A systematic review of the diagnostic accuracy of artificial intelligence-based computer programs to analyze chest x-rays for pulmonary tuberculosis.

We undertook a systematic review of the diagnostic accuracy of artificial intelligence-based software for identification of radiologic abnormalities (computer-aided detection, or CAD) compatible with pulmonary tuberculosis on chest x-rays (CXRs). We searched four databases for articles published between January 2005-February 2019. We summarized data on CAD type, study design, and diagnostic accuracy. We assessed risk of bias with QUADAS-2. We included 53 of the 4712 articles reviewed: 40 focused on CAD design methods ("Development" studies) and 13 focused on evaluation of CAD ("Clinical" studies). Meta-analyses were not performed due to methodological differences. Development studies were more likely to use CXR databases with greater potential for bias as compared to Clinical studies. Areas under the receiver operating characteristic curve (median AUC [IQR]) were significantly higher: in Development studies AUC: 0.88 [0.82-0.90]) versus Clinical studies (0.75 [0.66-0.87]; p-value 0.004); and with deep-learning (0.91 [0.88-0.99]) versus machine-learning (0.82 [0.75-0.89]; p = 0.001). We conclude that CAD programs are promising, but the majority of work thus far has been on development rather than clinical evaluation. We provide concrete suggestions on what study design elements should be improved.

TB case detection in Tajikistan - analysis of existing obstacles.

BACKGROUND: Tajikistan National TB Control Program. OBJECTIVE: (1) To identify the main obstacles to increasing TB Detection in Tajikistan. (2) To identify interventions that improve TB detection. METHODS: Review of the available original research data, health normative base, health systems performance and national economic data, following WHO framework for detection of TB cases, which is based on three scenarios of why incident cases of TB may not be notified. RESULTS: Data analysis revealed that some aspects of TB case detection are more problematic than others and that there are gaps in the knowledge of specific obstacles to TB case detection. The phenomenon of "initial default" in Tajikistan has been documented; however, it needs to be studied further. The laboratory services detect infectious TB cases effectively; however, referrals of appropriate suspects for TB diagnosis may lag behind. The knowledge about TB in the general population has improved. Yet, the problem of TB related stigma persists, thus being an obstacle for effective TB detection. High economic cost of health services driven by under-the-table payments was identified as another barrier for access to health services. CONCLUSION: Health system strengthening should become a primary intervention to improve case detection in Tajikistan. More research on reasons contributing to the failure to register TB cases, as well as factors underlying stigma is needed.

Health-systems efficiency in the Russian Federation: tuberculosis control.

OBJECTIVE: To conduct a comprehensive assessment of the case-mix of patients admitted to tuberculosis hospitals and the reasons for their admission in four Russian regions: Ivanovo, Orel, Samara and Vladimir. We also sought to quantify the extent to which efficiency could be improved by reducing hospitalization rates and re-profiling hospital beds available in the tuberculosis-control system. METHODS: We used a standard questionnaire to determine how beds were being used and who was using the beds in tuberculosis facilities in four Russian regions. Data were collected to determine how 4306 tuberculosis beds were utilized as well as on the socioeconomic and demographic indicators, clinical parameters and reasons for hospitalization for 3352 patients. FINDINGS: Of the 3352 patients surveyed about 70% were male; the average age was 40; and rates of unemployment, disability and alcohol misuse were high. About one-third of beds were occupied by smear-positive or culture-positive tuberculosis patients; 20% were occupied by tuberculosis patients who were smear-negative and/or culture-negative; 20% were occupied by patients who no longer had tuberculosis; and 20% were unoccupied. If clinical and public health admission criteria were applied then < 50% of admissions would be justified and < 50% of the current number of beds would be required. Up to 85% of admissions and beds were deemed to be necessary when social problems and poor access to outpatient care were considered along with clinical and public health admission criteria. CONCLUSION: Much of the Russian Federation's large tuberculosis hospital infrastructure is unnecessary when clinical and public health criteria are used, but the large hospital infrastructure within the tuberculosis-control system has an important social support function. Improving the efficiency of the system will require the reform of health-system norms and regulations as they relate to resource allocation and clinical care and implementation of lower-cost approaches to case management for patients with social problems. Additionally, closer attention will need to be paid to the management of staff numbers in the tuberculosis system.