An assessment of the reproducibility of reverse transcription digital PCR quantification of HIV-1.

Viral load monitoring in human immunodeficiency virus type 1 (HIV-1) infection is often performed using reverse transcription quantitative PCR (RT-qPCR) to observe response to treatment and identify the development of resistance. Traceability is achieved using a calibration hierarchy traceable to the International Unit (IU). IU values are determined using consensus agreement derived from estimations by different laboratories. Such a consensus approach is necessary due to the fact that there are currently no reference measurement procedures available that can independently assign a reference value to viral reference materials for molecular in vitro diagnostic tests. Digital PCR (dPCR) is a technique that has the potential to be used for this purpose. In this paper, we investigate the ability of reverse transcriptase dPCR (RT-dPCR) to quantify HIV-1 genomic RNA without calibration. Criteria investigated included the performance of HIV-1 RNA extraction steps, choice of reverse transcription approach and selection of target gene with assays performed in both single and duplex format. We developed a protocol which was subsequently applied by two independent laboratories as part of an external quality assurance (EQA) scheme for HIV-1 genome detection. Our findings suggest that RT-dPCR could be used as reference measurement procedure to aid the value assignment of HIV-1 reference materials to support routine calibration of HIV-1 viral load testing by RT-qPCR.

The performance of human cytomegalovirus digital PCR reference measurement procedure in seven external quality assessment schemes over four years.

A candidate digital PCR (dPCR)-based reference measurement procedure for quantification of human cytomegalovirus (hCMV) was evaluated in 10 viral load comparison schemes (seven external quality assessment (EQA) and three additional training schemes) organized by INSTAND e.V. over four years (between September 2014 and March 2018). Four metrology institutes participated in these schemes using the same extraction method and dPCR measurement procedure for the hCMV specific target sequence of UL54 gene. The calibration independent reference measurement procedure results from the metrology institutes were compared to the results of the clinical diagnostic laboratories applying hCMV qPCR measurement procedures calibrated to reference materials. While the criteria for the acceptable deviation from the target value interval for INSTAND's EQA schemes is from -0.8 log10 to +0.8 log10, the majority of dPCR results were between -0.2 log10 to +0.2 log10. Only 4 out of 45 results exceeded this interval with the maximum deviation of -0.542 log10. In the training schemes containing samples with lower hCMV concentrations, more than half of the results deviated less than ±0.2 log10 from the target value, while more than 95% deviated less than ±0.4 log10 from the target value. Evaluation of intra- and inter-laboratory variation of dPCR results confirmed high reproducibility and trueness of the method. This work demonstrates that dPCR has the potential to act as a calibration independent reference measurement procedure for the value assignment of hCMV calibration and reference materials to support qPCR calibration as well as ultimately for routine hCMV load testing.

Digital PCR can augment the interpretation of RT-qPCR Cq values for SARS-CoV-2 diagnostics.

Coronavirus disease 2019 (COVID-19) is an infectious, acute respiratory disease caused mainly by person-to-person transmission of the coronavirus SARS-CoV-2. Its emergence has caused a world-wide acute health crisis, intensified by the challenge of reliably identifying individuals likely to transmit the disease. Diagnosis is hampered by the many unknowns surrounding this disease, including those relating to infectious viral burden. This uncertainty is exacerbated by disagreement surrounding the clinical relevance of molecular testing using reverse transcription quantitative PCR (RT-qPCR) for the presence of viral RNA, most often based on the reporting of quantification cycles (Cq), which is also termed the cycle threshold (Ct) or crossing point (Cp). Despite it being common knowledge that Cqs are relative values varying according to a wide range of different parameters, there have been efforts to use them as though they were absolute units, with Cqs below an arbitrarily determined value, deemed to signify a positive result and those above, a negative one. Our results investigated the effects of a range of common variables on Cq values. These data include a detailed analysis of the effect of different carrier molecules on RNA extraction. The impact of sample matrix of buccal swabs and saliva on RNA extraction efficiency was demonstrated in RT-qPCR and the impact of potentially inhibiting compounds in urine along with bile salts were investigated in RT-digital PCR (RT-dPCR). The latter studies were performed such that the impact on the RT step could be separated from the PCR step. In this way, the RT was shown to be more susceptible to inhibitors than the PCR. Together, these studies demonstrate that the consequent variability of test results makes subjective Cq cut-off values unsuitable for the identification of infectious individuals. We also discuss the importance of using reliable control materials for accurate quantification and highlight the substantial role played by dPCR as a method for their development.

Monkeypox: another test for PCR.

Monkeypox was declared a public health emergency of international concern by the World Health Organization (WHO) on 23 July 2022. Between 1 January and 23 July 2022, 16,016 laboratory confirmed cases of monkeypox and five deaths were reported to WHO from 75 countries on all continents. Public health authorities are proactively identifying cases and tracing their contacts to contain its spread. As with COVID-19, PCR is the only method capable of being deployed at sufficient speed to provide timely feedback on any public health interventions. However, at this point, there is little information on how those PCR assays are being standardised between laboratories. A likely reason is that testing is still limited on a global scale and that detection, not quantification, of monkeypox virus DNA is the main clinical requirement. Yet we should not be complacent about PCR performance. As testing requirements increase rapidly and specimens become more diverse, it would be prudent to ensure PCR accuracy from the outset to support harmonisation and ease regulatory conformance. Lessons from COVID-19 should aid implementation with appropriate material, documentary and methodological standards offering dynamic mechanisms to ensure testing that most accurately guides public health decisions.

The Dangers of Using Cq to Quantify Nucleic Acid in Biological Samples: A Lesson From COVID-19.

BACKGROUND: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) RNA quantities, measured by reverse transcription quantitative PCR (RT-qPCR), have been proposed to stratify clinical risk or determine analytical performance targets. We investigated reproducibility and how setting diagnostic cutoffs altered the clinical sensitivity of coronavirus disease 2019 (COVID-19) testing. METHODS: Quantitative SARS-CoV-2 RNA distributions [quantification cycle (Cq) and copies/mL] from more than 6000 patients from 3 clinical laboratories in United Kingdom, Belgium, and the Republic of Korea were analyzed. Impact of Cq cutoffs on clinical sensitivity was assessed. The June/July 2020 INSTAND external quality assessment scheme SARS-CoV-2 materials were used to estimate laboratory reported copies/mL and to estimate the variation in copies/mL for a given Cq. RESULTS: When the WHO-suggested Cq cutoff of 25 was applied, the clinical sensitivity dropped to about 16%. Clinical sensitivity also dropped to about 27% when a simulated limit of detection of 106 copies/mL was applied. The interlaboratory variation for a given Cq value was >1000 fold in copies/mL (99% CI). CONCLUSION: While RT-qPCR has been instrumental in the response to COVID-19, we recommend Cq (cycle threshold or crossing point) values not be used to set clinical cutoffs or diagnostic performance targets due to poor interlaboratory reproducibility; calibrated copy-based units (used elsewhere in virology) offer more reproducible alternatives. We also report a phenomenon where diagnostic performance may change relative to the effective reproduction number. Our findings indicate that the disparities between patient populations across time are an important consideration when evaluating or deploying diagnostic tests. This is especially relevant to the emergency situation of an evolving pandemic.

Assessment of Digital PCR as a Primary Reference Measurement Procedure to Support Advances in Precision Medicine.

BACKGROUND: Genetic testing of tumor tissue and circulating cell-free DNA for somatic variants guides patient treatment of many cancers. Such measurements will be fundamental in the future support of precision medicine. However, there are currently no primary reference measurement procedures available for nucleic acid quantification that would support translation of tests for circulating tumor DNA into routine use. METHODS: We assessed the accuracy of digital PCR (dPCR) for copy number quantification of a frequently occurring single-nucleotide variant in colorectal cancer (KRAS c.35G>A, p.Gly12Asp, from hereon termed G12D) by evaluating potential sources of uncertainty that influence dPCR measurement. RESULTS: Concentration values for samples of KRAS G12D and wild-type plasmid templates varied by <1.2-fold when measured using 5 different assays with varying detection chemistry (hydrolysis, scorpion probes, and intercalating dyes) and <1.3-fold with 4 commercial dPCR platforms. Measurement trueness of a selected dPCR assay and platform was validated by comparison with an orthogonal method (inductively coupled plasma mass spectrometry). The candidate dPCR reference measurement procedure showed linear quantification over a wide range of copies per reaction and high repeatability and interlaboratory reproducibility (CV, 2%-8% and 5%-10%, respectively). CONCLUSIONS: This work validates dPCR as an SI-traceable reference measurement procedure based on enumeration and demonstrates how it can be applied for assignment of copy number concentration and fractional abundance values to DNA reference materials in an aqueous solution. High-accuracy measurements using dPCR will support the implementation and traceable standardization of molecular diagnostic procedures needed for advancements in precision medicine.

Detection of Rare Drug Resistance Mutations by Digital PCR in a Human Influenza A Virus Model System and Clinical Samples.

Digital PCR (dPCR) is being increasingly used for the quantification of sequence variations, including single nucleotide polymorphisms (SNPs), due to its high accuracy and precision in comparison with techniques such as quantitative PCR (qPCR) and melt curve analysis. To develop and evaluate dPCR for SNP detection using DNA, RNA, and clinical samples, an influenza virus model of resistance to oseltamivir (Tamiflu) was used. First, this study was able to recognize and reduce off-target amplification in dPCR quantification, thereby enabling technical sensitivities down to 0.1% SNP abundance at a range of template concentrations, a 50-fold improvement on the qPCR assay used routinely in the clinic. Second, a method was developed for determining the false-positive rate (background) signal. Finally, comparison of dPCR with qPCR results on clinical samples demonstrated the potential impact dPCR could have on clinical research and patient management by earlier (trace) detection of rare drug-resistant sequence variants. Ultimately this could reduce the quantity of ineffective drugs taken and facilitate early switching to alternative medication when available. In the short term such methods could advance our understanding of microbial dynamics and therapeutic responses in a range of infectious diseases such as HIV, viral hepatitis, and tuberculosis. Furthermore, the findings presented here are directly relevant to other diagnostic areas, such as the detection of rare SNPs in malignancy, monitoring of graft rejection, and fetal screening.

The use of digital PCR to improve the application of quantitative molecular diagnostic methods for tuberculosis.

BACKGROUND: Real-time PCR (qPCR) based methods, such as the Xpert MTB/RIF, are increasingly being used to diagnose tuberculosis (TB). While qualitative methods are adequate for diagnosis, the therapeutic monitoring of TB patients requires quantitative methods currently performed using smear microscopy. The potential use of quantitative molecular measurements for therapeutic monitoring has been investigated but findings have been variable and inconclusive. The lack of an adequate reference method and reference materials is a barrier to understanding the source of such disagreement. Digital PCR (dPCR) offers the potential for an accurate method for quantification of specific DNA sequences in reference materials which can be used to evaluate quantitative molecular methods for TB treatment monitoring. METHODS: To assess a novel approach for the development of quality assurance materials we used dPCR to quantify specific DNA sequences in a range of prototype reference materials and evaluated accuracy between different laboratories and instruments. The materials were then also used to evaluate the quantitative performance of qPCR and Xpert MTB/RIF in eight clinical testing laboratories. RESULTS: dPCR was found to provide results in good agreement with the other methods tested and to be highly reproducible between laboratories without calibration even when using different instruments. When the reference materials were analysed with qPCR and Xpert MTB/RIF by clinical laboratories, all laboratories were able to correctly rank the reference materials according to concentration, however there was a marked difference in the measured magnitude. CONCLUSIONS: TB is a disease where the quantification of the pathogen could lead to better patient management and qPCR methods offer the potential to rapidly perform such analysis. However, our findings suggest that when precisely characterised materials are used to evaluate qPCR methods, the measurement result variation is too high to determine whether molecular quantification of Mycobacterium tuberculosis would provide a clinically useful readout. The methods described in this study provide a means by which the technical performance of quantitative molecular methods can be evaluated independently of clinical variability to improve accuracy of measurement results. These will assist in ultimately increasing the likelihood that such approaches could be used to improve patient management of TB.

Assessing the accuracy of quantitative molecular microbial profiling.

The application of high-throughput sequencing in profiling microbial communities is providing an unprecedented ability to investigate microbiomes. Such studies typically apply one of two methods: amplicon sequencing using PCR to target a conserved orthologous sequence (typically the 16S ribosomal RNA gene) or whole (meta)genome sequencing (WGS). Both methods have been used to catalog the microbial taxa present in a sample and quantify their respective abundances. However, a comparison of the inherent precision or bias of the different sequencing approaches has not been performed. We previously developed a metagenomic control material (MCM) to investigate error when performing different sequencing strategies. Amplicon sequencing using four different primer strategies and two 16S rRNA regions was examined (Roche 454 Junior) and compared to WGS (Illumina HiSeq). All sequencing methods generally performed comparably and in good agreement with organism specific digital PCR (dPCR); WGS notably demonstrated very high precision. Where discrepancies between relative abundances occurred they tended to differ by less than twofold. Our findings suggest that when alternative sequencing approaches are used for microbial molecular profiling they can perform with good reproducibility, but care should be taken when comparing small differences between distinct methods. This work provides a foundation for future work comparing relative differences between samples and the impact of extraction methods. We also highlight the value of control materials when conducting microbial profiling studies to benchmark methods and set appropriate thresholds.

Ensuring accuracy in the development and application of nucleic acid amplification tests (NAATs) for infectious disease.

Diagnostic tests were heralded as crucial during the Coronavirus disease (COVID-19) pandemic with most of the key methods using bioanalytical approaches that detected larger molecules (RNA, protein antigens or antibodies) rather than conventional clinical biochemical techniques. Nucleic Acid Amplification Tests (NAATs), like the Polymerase Chain Reaction (PCR), and other molecular methods, like sequencing (that often work in combination with NAATs), were essential to the diagnosis and management during COVID-19. This was exemplified both early in the pandemic but also later on, following the emergence of new genetic SARS-CoV-2 variants. The 100 day mission to respond to future pandemic threats highlights the need for effective diagnostics, therapeutics and vaccines. Of the three, diagnostics represents the first opportunity to manage infectious diseases while also being the most poorly supported in terms of the infrastructure needed to demonstrate effectiveness. Where performance targets exist, they are not well served by consensus on how to demonstrate they are being met; this includes analytical factors such as limit of detection (LOD) false positive results as well as how to approach clinical evaluation. The selection of gold standards or use of epidemiological factors such as predictive value, reference ranges or clinical thresholds are seldom correctly considered. The attention placed on molecular diagnostic tests during COVID-19 illustrates important considerations and assumptions on the use of these methods for infectious disease diagnosis and beyond. In this manuscript, we discuss state-of-the-art approaches to diagnostic evaluation and explore how they may be better tailored to diagnostic techniques like NAATs to maximise the impact of these highly versatile bioanalytical tools, both generally and during future outbreaks.

Low unspliced cell-associated HIV RNA in early treated adolescents living with HIV on long suppressive ART.

Introduction: Initiation of antiretroviral treatment (ART) in patients early after HIV-infection and long-term suppression leads to low or undetectable levels of HIV RNA and cell-associated (CA) HIV DNA and RNA. Both CA-DNA and CA-RNA, overestimate the size of the HIV reservoir but CA-RNA as well as p24/cell-free viral RNA can be indicators of residual viral replication. This study describes HIV RNA amounts and levels of cytokines/soluble markers in 40 well-suppressed adolescents who initiated ART early in life and investigated which viral markers may be informative as endpoints in cure clinical trials within this population. Methods: Forty adolescents perinatally infected with HIV on suppressive ART for >5 years were enrolled in the CARMA study. HIV DNA and total or unspliced CA-RNA in PBMCs were analyzed by qPCR/RT-qPCR and dPCR/RT-dPCR. Cell-free HIV was determined using an ultrasensitive viral load (US-VL) assay. Plasma markers and p24 were analyzed by digital ELISA and correlations between total and unspliced HIV RNA and clinical markers, including age at ART, Western Blot score, levels of cytokines/inflammation markers or HIV CA-DNA, were tested. Results: CA-RNA was detected in two thirds of the participants and was comparable in RT-qPCR and RT-dPCR. Adolescents with undetectable CA-RNA showed significantly lower HIV DNA compared to individuals with detectable CA-RNA. Undetectable unspliced CA-RNA was positively associated with age at ART initiation and Western Blot score. We found that a higher concentration of TNF-α was predictive of higher CA-DNA and CA-RNA. Other clinical characteristics like US-VL, time to suppression, or percent CD4+ T-lymphocytes were not predictive of the CA-RNA in this cross-sectional study. Conclusions: Low CA-DNA after long-term suppressive ART is associated with lower CA-RNA, in concordance with other reports. Patients with low CA-RNA levels in combination with low CA-DNA and low Western Blot scores should be further investigated to characterize candidates for treatment interruption trials. Unspliced CA-RNA warrants further investigation as a marker that can be prioritized in paediatric clinical trials where the sample volume can be a significant limitation.

Development and optimization of a gas chromatography/mass spectrometry method for the analysis of thermochemolytic degradation products of phthiocerol dimycocerosate waxes found in Mycobacterium tuberculosis.

RATIONALE: The phthiocerol dimycocerosates (PDIMs) are certain stable and hydrophobic waxes found in the cell membrane of Mycobacterium tuberculosis, bacteria that cause an infectious disease of growing concern worldwide. Previous studies report the analysis of derivatives of the hydrolysed PDIMs from biological samples, following complex extraction and offline derivatization of PDIMs biomarkers, prior to their analysis by gas chromatography/mass spectrometry (GC/MS). METHODS: We developed and optimized a GC/MS method based on selected ion monitoring (SIM) to detect the derivatives produced via the thermally assisted hydrolysis and methylation (THM) of the PDIMs from the cell membrane of M. tuberculosis. The extraction of PDIMs from culture is simple, and their thermochemolysis is carried out automatically online, thus avoiding the time-consuming derivatization steps of hydrolysis and esterification, usually performed offline. RESULTS: For standard PDIMs in petroleum ether, our optimized method gave an excellent linearity (R(2) = 0.99) at concentrations between 0.172 and 27.5 ng/mL, a good precision (RSD = 11.42%), and a limit of detection (LOD) of 100 pg/mL. For the PDIMs extracted from dilutions of M. tuberculosis culture, the method gave good linearity (R(2) = 0.9685) and an estimated LOD of 400 CFU/mL (CFU = colony forming units) in sterile distilled water. CONCLUSIONS: A GC/MS(SIM) method is presented for the rapid and quantitative detection of M. tuberculosis, based on the online thermochemolysis of lipidic biomarkers extracted from the bacterial culture. The method has the potential to be applied in human and veterinary clinical laboratories for the rapid diagnosis of tuberculosis in infected biological samples.

Evaluation of Matrix-Assisted Laser Desorption Ionization-Time of Flight Mass Spectrometry for Molecular Typing of Acinetobacter baumannii in Comparison with Orthogonal Methods.

Colonization and subsequent health care-associated infection (HCAI) with Acinetobacter baumannii are a concern for vulnerable patient groups within the hospital setting. Outbreaks involving multidrug-resistant strains are associated with increased patient morbidity and mortality and poorer overall outcomes. Reliable molecular typing methods can help to trace transmission routes and manage outbreaks. In addition to methods deployed by reference laboratories, matrix-assisted laser desorption ionization-time of flight mass spectrometry (MALDI-TOF MS) may assist by making initial in-house judgments on strain relatedness. However, limited studies on method reproducibility exist for this application. We applied MALDI-TOF MS typing to A. baumannii isolates associated with a nosocomial outbreak and evaluated different methods for data analysis. In addition, we compared MALDI-TOF MS with whole-genome sequencing (WGS) and Fourier transform infrared spectroscopy (FTIR) as orthogonal methods to further explore their resolution for bacterial strain typing. A related subgroup of isolates consistently clustered separately from the main outbreak group by all investigated methods. This finding, combined with epidemiological data from the outbreak, indicates that these methods identified a separate transmission event unrelated to the main outbreak. However, the MALDI-TOF MS upstream approach introduced measurement variability impacting method reproducibility and limiting its reliability as a standalone typing method. Availability of in-house typing methods with well-characterized sources of measurement uncertainty could assist with rapid and dependable confirmation (or denial) of suspected transmission events. This work highlights some of the steps to be improved before such tools can be fully integrated into routine diagnostic service workflows for strain typing. IMPORTANCE Managing the transmission of antimicrobial resistance necessitates reliable methods for tracking outbreaks. We compared the performance of MALDI-TOF MS with orthogonal approaches for strain typing, including WGS and FTIR, for Acinetobacter baumannii isolates correlated with a health care-associated infection (HCAI) event. Combined with epidemiological data, all methods investigated identified a group of isolates that were temporally and spatially linked to the outbreak, yet potentially attributed to a separate transmission event. This may have implications for guiding infection control strategies during an outbreak. However, the technical reproducibility of MALDI-TOF MS needs to be improved for it to be employed as a standalone typing method, as different stages of the experimental workflow introduced bias influencing interpretation of biomarker peak data. Availability of in-house methods for strain typing of bacteria could improve infection control practices following increased reports of outbreaks of antimicrobial-resistant organisms during the COVID-19 pandemic, related to sessional usage of personal protective equipment (PPE).

Results of German external quality assessment schemes for SARS-CoV-2 antigen detection.

The COVID-19 pandemic illustrated the important role of diagnostic tests, including lateral flow tests (LFTs), in identifying patients and their contacts to slow the spread of infections. INSTAND performed external quality assessments (EQA) for SARS-CoV-2 antigen detection with lyophilized and chemically inactivated cell culture supernatant of SARS-CoV-2 infected Vero cells. A pre-study demonstrated the suitability of the material. Participants reported qualitative and/or quantitative antigen results using either LFTs or automated immunoassays for five EQA samples per survey. 711 data sets were reported for LFT detection in three surveys in 2021. This evaluation focused on the analytical sensitivity of different LFTs and automated immunoassays. The inter-laboratory results showed at least 94% correct results for non-variant of concern (VOC) SARS-CoV-2 antigen detection for viral loads of ≥ 4.75 × 106 copies/mL and SARS-CoV-2 negative samples. Up to 85% had success for a non-VOC viral load of ~ 1.60 × 106 copies/mL. A viral load of ~ 1.42 × 107 copies/mL of the Delta VOC was reported positive in > 96% of results. A high specificity was found with almost 100% negative SARS-CoV-2 antigen results for HCoV 229E and HCoV NL63 positive samples. Quantitative results correlated with increasing SARS-CoV-2 viral load but showed a broad scatter. This study shows promising SARS-CoV-2 antigen test performance of the participating laboratories, but further investigations with the now predominant Omicron VOC are needed.

Assessing the Variability of Cell-Associated HIV DNA Quantification through a Multicenter Collaborative Study.

Reliable and accurate quantification of cell-associated HIV DNA (CA HIV DNA) is critical for early infant diagnosis, clinical management of patients under therapy, and to inform new therapeutics efficacy. The present study assessed the variability of CA HIV DNA quantification obtained from various assays and the value of using reference materials to help harmonize the measurements. Using a common set of reagents, our multicenter collaborative study highlights significant variability of CA HIV DNA quantification and lower limit of quantification across assays. The quantification of CA HIV DNA from a panel of infected PBMCs can be harmonized through cross-subtype normalization but assay calibration with the commonly used 8E5 cell line failed to reduce quantification variability between assays, demonstrating the requirement to thoroughly evaluate reference material candidates to help improve the comparability of CA HIV DNA diagnostic assay performance. IMPORTANCE Despite a global effort, HIV remains a major public health burden with an estimated 1.5 million new infections occurring in 2020. HIV DNA is an important viral marker, and its monitoring plays a critical role in the fight against HIV: supporting diagnosis in infants and underpinning clinical management of patients under therapy. Our study demonstrates that HIV DNA measurement of the same samples can vary significantly from one laboratory to another, due to heterogeneity in the assay, protocol, and reagents used. We show that when carefully selected, reference materials can reduce measurement variability and harmonize HIV DNA quantification across laboratories, which will help contribute to improved diagnosis and clinical management of patients living with HIV.

Comparison of SARS-CoV-2 N gene real-time RT-PCR targets and commercially available mastermixes.

BACKGROUND: This study aimed to evaluate the impact of four different reverse transcription quantitative PCR (RT-qPCR) master mixes on the performance of SARS-CoV-2 diagnostic PCRs using three primer/probe assays targeting the N gene (A, B and C). The dynamic range and lowest detected quantity was determined using a SARS-CoV-2 partial N gene RNA transcript dilution series (100,000-1 copy/µl) and verified using 72 nose and throat swabs, 29 of which tested positive for SARS-CoV-2 RNA. RESULTS: Assay C consistently detected the lowest quantity of partial N gene RNA transcript with all mastermixes. The Takara One Step PrimeScript™ III RT-PCR Kit mastermix enabled all primer pairs to detect the entire dynamic range evaluated, with the Qiagen Quantifast and Thermofisher TaqPath 1-Step kits also performing well. Sequences from all three primer/probe sets tested in this study (assay A, B and C) have 100 % homology to ≥97 % of the of SARS-CoV-2 sequences available up to 31st December 2020 (n = 291,483 sequences). CONCLUSIONS: This work demonstrates that specific assays (in this case assay C) can perform well in terms of dynamic range and lowest detected quantity regardless of the mastermix used. However we also show that, by choosing the most appropriate mastermix, poorer performing primer pairs are also able to detect all of the template dilutions investigated. This work increases the potential options when choosing assays for SARS-CoV-2 diagnosis and provides solutions to enable them to work with optimal analytical sensitivity.

Single base mutations in the nucleocapsid gene of SARS-CoV-2 affects amplification efficiency of sequence variants and may lead to assay failure.

Reverse transcriptase quantitative PCR (RT-qPCR) is the main diagnostic assay used to detect SARS-CoV-2 RNA in respiratory samples. RT-qPCR is performed by specifically targeting the viral genome using complementary oligonucleotides called primers and probes. This approach relies on prior knowledge of the genetic sequence of the target. Viral genetic variants with changes to the primer/probe binding region may reduce the performance of PCR assays and have the potential to cause assay failure. In this work we demonstrate how two single nucleotide variants (SNVs) altered the amplification curve of a diagnostic PCR targeting the Nucleocapsid (N) gene and illustrate how threshold setting can lead to false-negative results even where the variant sequence is amplified. We also describe how in silico analysis of SARS-CoV-2 genome sequences available in the COVID-19 Genomics UK Consortium (COG-UK) and GISAID databases was performed to predict the impact of sequence variation on the performance of 22 published PCR assays. The vast majority of published primer and probe sequences contain sequence mismatches with at least one SARS-CoV-2 lineage. We recommend that visual observation of amplification curves is included as part of laboratory quality procedures, even in high throughput settings where thresholds are set automatically and that in silico analysis is used to monitor the potential impact of new variants on established assays. Ideally comprehensive in silico analysis should be applied to guide selection of highly conserved genomic regions to target with future SARS-CoV-2 PCR assays.

An inter-laboratory study to investigate the impact of the bioinformatics component on microbiome analysis using mock communities.

Despite the advent of whole genome metagenomics, targeted approaches (such as 16S rRNA gene amplicon sequencing) continue to be valuable for determining the microbial composition of samples. Amplicon microbiome sequencing can be performed on clinical samples from a normally sterile site to determine the aetiology of an infection (usually single pathogen identification) or samples from more complex niches such as human mucosa or environmental samples where multiple microorganisms need to be identified. The methodologies are frequently applied to determine both presence of micro-organisms and their quantity or relative abundance. There are a number of technical steps required to perform microbial community profiling, many of which may have appreciable precision and bias that impacts final results. In order for these methods to be applied with the greatest accuracy, comparative studies across different laboratories are warranted. In this study we explored the impact of the bioinformatic approaches taken in different laboratories on microbiome assessment using 16S rRNA gene amplicon sequencing results. Data were generated from two mock microbial community samples which were amplified using primer sets spanning five different variable regions of 16S rRNA genes. The PCR-sequencing analysis included three technical repeats of the process to determine the repeatability of their methods. Thirteen laboratories participated in the study, and each analysed the same FASTQ files using their choice of pipeline. This study captured the methods used and the resulting sequence annotation and relative abundance output from bioinformatic analyses. Results were compared to digital PCR assessment of the absolute abundance of each target representing each organism in the mock microbial community samples and also to analyses of shotgun metagenome sequence data. This ring trial demonstrates that the choice of bioinformatic analysis pipeline alone can result in different estimations of the composition of the microbiome when using 16S rRNA gene amplicon sequencing data. The study observed differences in terms of both presence and abundance of organisms and provides a resource for ensuring reproducible pipeline development and application. The observed differences were especially prevalent when using custom databases and applying high stringency operational taxonomic unit (OTU) cut-off limits. In order to apply sequencing approaches with greater accuracy, the impact of different analytical steps needs to be clearly delineated and solutions devised to harmonise microbiome analysis results.

Detection of Mycobacterium tuberculosis complex DNA in CD34-positive peripheral blood mononuclear cells of asymptomatic tuberculosis contacts: an observational study.

BACKGROUND: Haematopoietic stem cells expressing the CD34 surface marker have been posited as a niche for Mycobacterium tuberculosis complex bacilli during latent tuberculosis infection. Our aim was to determine whether M tuberculosis complex DNA is detectable in CD34-positive peripheral blood mononuclear cells (PBMCs) isolated from asymptomatic adults living in a setting with a high tuberculosis burden. METHODS: We did a cross-sectional study in Ethiopia between Nov 22, 2017, and Jan 10, 2019. Digital PCR (dPCR) was used to determine whether M tuberculosis complex DNA was detectable in PBMCs isolated from 100 mL blood taken from asymptomatic adults with HIV infection or a history of recent household or occupational exposure to an index case of human or bovine tuberculosis. Participants were recruited from HIV clinics, tuberculosis clinics, and cattle farms in and around Addis Ababa. A nested prospective study was done in a subset of HIV-infected individuals to evaluate whether administration of isoniazid preventive therapy was effective in clearing M tuberculosis complex DNA from PBMCs. Follow-up was done between July 20, 2018, and Feb 13, 2019. QuantiFERON-TB Gold assays were also done on all baseline and follow-up samples. FINDINGS: Valid dPCR data (ie, droplet counts >10 000 per well) were available for paired CD34-positive and CD34-negative PBMC fractions from 197 (70%) of 284 participants who contributed data to cross-sectional analyses. M tuberculosis complex DNA was detected in PBMCs of 156 of 197 participants with valid dPCR data (79%, 95% CI 74-85). It was more commonly present in CD34-positive than in CD34-negative fractions (154 [73%] of 197 vs 46 [23%] of 197; p<0·0001). Prevalence of dPCR-detected M tuberculosis complex DNA did not differ between QuantiFERON-negative and QuantiFERON-positive participants (77 [78%] of 99 vs 79 [81%] of 98; p=0·73), but it was higher in HIV-infected than in HIV-uninfected participants (67 [89%] of 75 vs 89 [73%] of 122, p=0·0065). By contrast, the proportion of QuantiFERON-positive participants was lower in HIV-infected than in HIV-uninfected participants (25 [33%] of 75 vs 73 [60%] of 122; p<0·0001). Administration of isoniazid preventive therapy reduced the prevalence of dPCR-detected M tuberculosis complex DNA from 41 (95%) of 43 HIV-infected individuals at baseline to 23 (53%) of 43 after treatment (p<0·0001), but it did not affect the prevalence of QuantiFERON positivity (17 [40%] of 43 at baseline vs 13 [30%] of 43 after treatment; p=0·13). INTERPRETATION: We report a novel molecular microbiological biomarker of latent tuberculosis infection with properties that are distinct from those of a commercial interferon-γ release assay. Our findings implicate the bone marrow as a niche for M tuberculosis in latently infected individuals. Detection of M tuberculosis complex DNA in PBMCs has potential applications in the diagnosis of latent tuberculosis infection, in monitoring response to preventive therapy, and as an outcome measure in clinical trials of interventions to prevent or treat latent tuberculosis infection. FUNDING: UK Medical Research Council.

Discordant bioinformatic predictions of antimicrobial resistance from whole-genome sequencing data of bacterial isolates: an inter-laboratory study.

Antimicrobial resistance (AMR) poses a threat to public health. Clinical microbiology laboratories typically rely on culturing bacteria for antimicrobial-susceptibility testing (AST). As the implementation costs and technical barriers fall, whole-genome sequencing (WGS) has emerged as a 'one-stop' test for epidemiological and predictive AST results. Few published comparisons exist for the myriad analytical pipelines used for predicting AMR. To address this, we performed an inter-laboratory study providing sets of participating researchers with identical short-read WGS data from clinical isolates, allowing us to assess the reproducibility of the bioinformatic prediction of AMR between participants, and identify problem cases and factors that lead to discordant results. We produced ten WGS datasets of varying quality from cultured carbapenem-resistant organisms obtained from clinical samples sequenced on either an Illumina NextSeq or HiSeq instrument. Nine participating teams ('participants') were provided these sequence data without any other contextual information. Each participant used their choice of pipeline to determine the species, the presence of resistance-associated genes, and to predict susceptibility or resistance to amikacin, gentamicin, ciprofloxacin and cefotaxime. We found participants predicted different numbers of AMR-associated genes and different gene variants from the same clinical samples. The quality of the sequence data, choice of bioinformatic pipeline and interpretation of the results all contributed to discordance between participants. Although much of the inaccurate gene variant annotation did not affect genotypic resistance predictions, we observed low specificity when compared to phenotypic AST results, but this improved in samples with higher read depths. Had the results been used to predict AST and guide treatment, a different antibiotic would have been recommended for each isolate by at least one participant. These challenges, at the final analytical stage of using WGS to predict AMR, suggest the need for refinements when using this technology in clinical settings. Comprehensive public resistance sequence databases, full recommendations on sequence data quality and standardization in the comparisons between genotype and resistance phenotypes will all play a fundamental role in the successful implementation of AST prediction using WGS in clinical microbiology laboratories.