The technology behind TB DEPOT: a novel public analytics platform integrating tuberculosis clinical, genomic, and radiological data for visual and statistical exploration.

OBJECTIVE: Clinical research informatics tools are necessary to support comprehensive studies of infectious diseases. The National Institute of Allergy and Infectious Diseases (NIAID) developed the publicly accessible Tuberculosis Data Exploration Portal (TB DEPOT) to address the complex etiology of tuberculosis (TB). MATERIALS AND METHODS: TB DEPOT displays deidentified patient case data and facilitates analyses across a wide range of clinical, socioeconomic, genomic, and radiological factors. The solution is built using Amazon Web Services cloud-based infrastructure, .NET Core, Angular, Highcharts, R, PLINK, and other custom-developed services. Structured patient data, pathogen genomic variants, and medical images are integrated into the solution to allow seamless filtering across data domains. RESULTS: Researchers can use TB DEPOT to query TB patient cases, create and save patient cohorts, and execute comparative statistical analyses on demand. The tool supports user-driven data exploration and fulfills the National Institute of Health's Findable, Accessible, Interoperable, and Reusable (FAIR) principles. DISCUSSION: TB DEPOT is the first tool of its kind in the field of TB research to integrate multidimensional data from TB patient cases. Its scalable and flexible architectural design has accommodated growth in the data, organizations, types of data, feature requests, and usage. Use of client-side technologies over server-side technologies and prioritizing maintenance have been important lessons learned. Future directions are dynamically prioritized and key functionality is shared through an application programming interface. CONCLUSION: This paper describes the platform development methodology, resulting functionality, benefits, and technical considerations of a clinical research informatics application to support increased understanding of TB.

Performance of Qure.ai automatic classifiers against a large annotated database of patients with diverse forms of tuberculosis.

Availability of trained radiologists for fast processing of CXRs in regions burdened with tuberculosis always has been a challenge, affecting both timely diagnosis and patient monitoring. The paucity of annotated images of lungs of TB patients hampers attempts to apply data-oriented algorithms for research and clinical practices. The TB Portals Program database (TBPP, https://TBPortals.niaid.nih.gov) is a global collaboration curating a large collection of the most dangerous, hard-to-cure drug-resistant tuberculosis (DR-TB) patient cases. TBPP, with 1,179 (83%) DR-TB patient cases, is a unique collection that is well positioned as a testing ground for deep learning classifiers. As of January 2019, the TBPP database contains 1,538 CXRs, of which 346 (22.5%) are annotated by a radiologist and 104 (6.7%) by a pulmonologist-leaving 1,088 (70.7%) CXRs without annotations. The Qure.ai qXR artificial intelligence automated CXR interpretation tool, was blind-tested on the 346 radiologist-annotated CXRs from the TBPP database. Qure.ai qXR CXR predictions for cavity, nodule, pleural effusion, hilar lymphadenopathy was successfully matching human expert annotations. In addition, we tested the 12 Qure.ai classifiers to find whether they correlate with treatment success (information provided by treating physicians). Ten descriptors were found as significant: abnormal CXR (p = 0.0005), pleural effusion (p = 0.048), nodule (p = 0.0004), hilar lymphadenopathy (p = 0.0038), cavity (p = 0.0002), opacity (p = 0.0006), atelectasis (p = 0.0074), consolidation (p = 0.0004), indicator of TB disease (p = < .0001), and fibrosis (p = < .0001). We conclude that applying fully automated Qure.ai CXR analysis tool is useful for fast, accurate, uniform, large-scale CXR annotation assistance, as it performed well even for DR-TB cases that were not used for initial training. Testing artificial intelligence algorithms (encapsulating both machine learning and deep learning classifiers) on diverse data collections, such as TBPP, is critically important toward progressing to clinically adopted automatic assistants for medical data analysis.

Comparative analysis of genomic variability for drug-resistant strains of Mycobacterium tuberculosis: The special case of Belarus.

Mycobacterium tuberculosis (M.tb) is the leading cause of death from an infectious disease. Drug resistant tuberculosis (DR-TB) threatens to exacerbate challenges in diagnostics and treatment. It is important to monitor strains circulating in countries with heavy burden of DR-TB, to make informed decisions about treatment, and because in these countries there is an elevated probability that DR-TB may advance to the totally drug resistant form. The TB Portals Program (TBPP, https://TBPortals.niaid.nih.gov) formed a global network of participating institutions and hospitals collecting and analyzing de-identified clinical, imaging and socioeconomic data, augmenting these with genomic sequencing results. TB Portals database includes complete M.tb genomes, with the information about spoligotypes, strains, and genomic variants related to drug resistance. Within the framework of TB Portals, we created Data Exploration Portal (DEPOT), to facilitate visualization and statistical analysis of user-defined cohorts from the entire TB Portals database. A continuing TB Portals research objective is to actively monitor and examine genomic variability that may account for observed differences in DR-TB incident rates and/or difficulties with diagnosis and treatment. Our analysis identified that several genomic variants implicated in drug resistance or improved fitness of the pathogen, were significantly more frequent in M.tb strains circulating in Belarus in comparison with other countries. Further studies are necessary to reveal whether the corresponding genomic variants may explain unusually high burden of drug-resistant M.tb in Belarus and suggest improvements for diagnostic and drug therapies.

TB DEPOT (Data Exploration Portal): A multi-domain tuberculosis data analysis resource.

The NIAID TB Portals Program (TBPP) established a unique and growing database repository of socioeconomic, geographic, clinical, laboratory, radiological, and genomic data from patient cases of drug-resistant tuberculosis (DR-TB). Currently, there are 2,428 total cases from nine country sites (Azerbaijan, Belarus, Moldova, Georgia, Romania, China, India, Kazakhstan, and South Africa), 1,611 (66%) of which are multidrug- or extensively-drug resistant and 1,185 (49%), 863 (36%), and 952 (39%) of which contain X-ray, computed tomography (CT) scan, and genomic data, respectively. We introduce the Data Exploration Portal (TB DEPOT, https://depot.tbportals.niaid.nih.gov) to visualize and analyze these multi-domain data. The TB DEPOT leverages the TBPP integration of clinical, socioeconomic, genomic, and imaging data into standardized formats and enables user-driven, repeatable, and reproducible analyses. It furthers the TBPP goals to provide a web-enabled analytics platform to countries with a high burden of multidrug-resistant TB (MDR-TB) but limited IT resources and inaccessible data, and enables the reusability of data, in conformity with the NIH's Findable, Accessible, Interoperable, and Reusable (FAIR) principles. TB DEPOT provides access to "analysis-ready" data and the ability to generate and test complex clinically-oriented hypotheses instantaneously with minimal statistical background and data processing skills. TB DEPOT is also promising for enhancing medical training and furnishing well annotated, hard to find, MDR-TB patient cases. TB DEPOT, as part of TBPP, further fosters collaborative research efforts to better understand drug-resistant tuberculosis and aid in the development of novel diagnostics and personalized treatment regimens.

The TB Portals: an Open-Access, Web-Based Platform for Global Drug-Resistant-Tuberculosis Data Sharing and Analysis.

The TB Portals program is an international consortium of physicians, radiologists, and microbiologists from countries with a heavy burden of drug-resistant tuberculosis working with data scientists and information technology professionals. Together, we have built the TB Portals, a repository of socioeconomic/geographic, clinical, laboratory, radiological, and genomic data from patient cases of drug-resistant tuberculosis backed by shareable, physical samples. Currently, there are 1,299 total cases from five country sites (Azerbaijan, Belarus, Moldova, Georgia, and Romania), 976 (75.1%) of which are multidrug or extensively drug resistant and 38.2%, 51.9%, and 36.3% of which contain X-ray, computed tomography (CT) scan, and genomic data, respectively. The top Mycobacterium tuberculosis lineages represented among collected samples are Beijing, T1, and H3, and single nucleotide polymorphisms (SNPs) that confer resistance to isoniazid, rifampin, ofloxacin, and moxifloxacin occur the most frequently. These data and samples have promoted drug discovery efforts and research into genomics and quantitative image analysis to improve diagnostics while also serving as a valuable resource for researchers and clinical providers. The TB Portals database and associated projects are continually growing, and we invite new partners and collaborations to our initiative. The TB Portals data and their associated analytical and statistical tools are freely available at https://tbportals.niaid.nih.gov/.