Keep the quality high: the benefits of lot testing for the quality control of malaria rapid diagnostic tests.

BACKGROUND: The production and use of malaria rapid diagnostic tests (RDTs) has risen dramatically over the past 20 years. In view of weak or non-existing in vitro diagnostics (IVD) regulations and post-marketing surveillance (PMS) systems in malaria endemic countries, the World Health Organization, later joined by the Foundation for Innovative New Diagnostics, established an independent, centralized performance evaluation and Lot Testing (LT) programme to safeguard against poor quality of RDTs being distributed through the public health sector of malaria endemic countries. RDT performances and manufacturer quality management systems have evolved over the past decade raising questions about the future need for a centralized LT programme. RESULTS: Between 2007 and 2017, 6056 lots have been evaluated, representing approximately 1.6 Billion RDTs. A total of 69 lots (1.1%) failed the quality control. Of these failures, 26 were detected at receipt of the RDT lot in the LT laboratory, representing an estimated 7.9 million poor quality RDTs, and LT requesters were advised that RDTs were not of sufficient quality for use in patient management. Forty-three were detected after long-term storage in the laboratory, of which 24 (56%) were found to be due to a major issue with insufficient buffer volume in single use buffer vials, others predominantly showing loss of sensitivity. The annual cost of running the programme, based on expenses recorded in years 2014-2016, an estimated volume of 700 lots per year and including replenishment of quality control samples, was estimated at US$ 178,500 ($US 255 per lot tested). CONCLUSIONS: Despite the clear benefits of the centralized LT programme and its low cost compared with the potential costs of each country establishing its own PMS system for RDTs, funding concerns have made its future beyond 2020 uncertain. In order to manage the risks of misdiagnosis due to low quality RDTs, and to ensure the continued safety and reliability of malaria case management, there is a need to ensure that an effective and implementable approach to RDT quality control continues to be available to programmes in endemic countries.

WHO malaria nucleic acid amplification test external quality assessment scheme: results of distribution programmes one to three.

BACKGROUND: The World Health Organization (WHO) recommends parasite-based diagnosis of malaria. In recent years, there has been surge in the use of various kinds of nucleic-acid amplification based tests (NAATs) for detection and identification of Plasmodium spp. to support clinical care in high-resource settings and clinical and epidemiological research worldwide. However, these tests are not without challenges, including lack (or limited use) of standards and lack of reproducibility, due in part to variation in protocols amongst laboratories. Therefore, there is a need for rigorous quality control, including a robust external quality assessment (EQA) scheme targeted towards malaria NAATs. To this effect, the WHO Global Malaria Programme worked with the UK National External Quality Assessment Scheme (UK NEQAS) Parasitology and with technical experts to launch a global NAAT EQA scheme in January 2017. METHODS: Panels of NAAT EQA specimens containing five major species of human-infecting Plasmodium at various parasite concentrations and negative samples were created in lyophilized blood (LB) and dried blood spot (DBS) formats. Two distributions per year were sent, containing five LB and five DBS specimens. Samples were tested and validated by six expert referee laboratories prior to distribution. Between 37 and 45 laboratories participated in each distribution and submitted results using the online submission portal of UK NEQAS. Participants were scored based on their laboratory's stated capacity to identify Plasmodium species, and individual laboratory reports were sent which included performance comparison with anonymized peers. RESULTS: Analysis of the first three distributions revealed that the factors that most significantly affected performance were sample format (DBS vs LB), species and parasite density, while laboratory location and the reported methodology used (type of nucleic acid extraction, amplification, or DNA vs RNA target) did not significantly affect performance. Referee laboratories performed better than non-referee laboratories. CONCLUSIONS: Globally, malaria NAAT assays now inform a range of clinical, epidemiological and research investigations. EQA schemes offer a way for laboratories to assess and improve their performance, which is critical to safeguarding the reliability of data and diagnoses especially in situations where various NAAT methodologies and protocols are in use.

An assessment of false positive rates for malaria rapid diagnostic tests caused by non-Plasmodium infectious agents and immunological factors.

BACKGROUND: Malaria rapid diagnostic tests (RDTs) can produce false positive (FP) results in patients with human African trypanosomiasis and rheumatoid factor (RF), but specificity against other infectious agents and immunological factors is largely unknown. Low diagnostic specificity caused by cross-reactivity may lead to over-estimates of the number of malaria cases and over-use of antimalarial drugs, at the cost of not diagnosing and treating the true underlying condition. METHODS: Data from the WHO Malaria RDT Product Testing Programme was analysed to assess FP rates of 221 RDTs against four infectious agents (Chagas, dengue, Leishmaniasis and Schistosomiasis) and four immunological factors (anti-nuclear antibody, human anti-mouse antibody (HAMA), RF and rapid plasma regain). Only RDTs with a FP rate against clean negative samples less than 10% were included. Paired t-tests were used to compare product-specific FP rates on clean negative samples and samples containing non-Plasmodium infectious agents and immunological factors. RESULTS: Forty (18%) RDTs showed no FP results against any tested infectious agent or immunological factor. In the remaining RDTs significant and clinically relevant increases in FP rates were observed for samples containing HAMA and RF (P<0.001). There were significant correlations between product-matched FP rates for RF and HAMA on all RDT test bands (P<0.001), and FP rates for each infectious agent and immunological factor were also correlated between test bands of combination RDTs (P≤0.002). CONCLUSIONS: False positive results against non-Plasmodium infectious agents and immunological factors does not appear to be a universal property of malaria RDTs. However, since many malaria RDTs have elevated FP rates against HAMA and RF positive samples practitioners may need to consider the possibility of false positive results for malaria in patients with conditions that stimulate HAMA or RF.

Global survey of malaria rapid diagnostic test (RDT) sales, procurement and lot verification practices: assessing the use of the WHO-FIND Malaria RDT Evaluation Programme (2011-2014).

BACKGROUND: Malaria rapid diagnostic tests (RDTs) play a critical role in malaria case management, and assurance of quality is a key factor to promote good adherence to test results. Since 2007, the World Health Organization (WHO) and the Foundation for Innovative New Diagnostics (FIND) have coordinated a Malaria RDT Evaluation Programme, comprising a pre-purchase performance evaluation (product testing, PT) and a pre-distribution quality control of lots (lot testing, LT), the former being the basis of WHO recommendations for RDT procurement. Comprehensive information on malaria RDTs sold worldwide based on manufacturers' data and linked to independent performance data is currently not available, and detailed knowledge of procurement practices remains limited. METHODS: The use of the PT/LT Programme results as well as procurement and lot verification practices were assessed through a large-scale survey, gathering product-specific RDT sales and procurement data (2011-14 period) from a total of 32 manufacturers, 12 procurers and 68 National Malaria Control Programmes (NMCPs). RESULTS: Manufacturers' reports showed that RDT sales had more than doubled over the four years, and confirmed a trend towards increased compliance with the WHO procurement criteria (from 83% in 2011 to 93% in 2014). Country-level reports indicated that 74% of NMCPs procured only 'WHO-compliant' RDT products, although procurers' transactions datasets revealed a surprisingly frequent overlap of different products and even product types (e.g., Plasmodium falciparum-only and Plasmodium-pan) in the same year and country (60 and 46% of countries, respectively). Importantly, the proportion of 'non-complying' (i.e., PT low scored or not evaluated) products was found to be higher in the private health care sector than in the public sector (32% vs 5%), and increasing over time (from 22% of private sector sales in 2011 to 39% in 2014). An estimated 70% of the RDT market was covered by the LT programme. The opinion about the PT/LT Programmes was positive overall, and quality of RDTs as per the PT Programme was rated as the number one procurement criteria. CONCLUSIONS: This survey provided in-depth information on RDT sales and procurement dynamics, including the largely unstudied private sector, and demonstrated how the WHO-FIND Programme has positively influenced procurement practices in the public sector.