International external quality control assessment for the serological diagnosis of dengue infections.

BACKGROUND: Dengue is endemic to the tropics and subtropics, and the most frequent of arthropod-borne viral diseases. Reliable diagnosis of dengue infection is important not only in clinical care but also in disease surveillance, the control of outbreaks, and the development of new vaccines. The diagnosis of dengue infection is usually established by a variety of commercial or in-house serological protocols. The European Network for the Diagnostics of Imported Viral Diseases (ENIVD) recognized the need to survey the accuracy of dengue serological diagnostics in current use, and organized an external quality assurance (EQA) study of dengue serological practice in diagnostic laboratories. METHODS: A 15-sample panel, consisting of sera reactive against dengue plus specificity and negative controls, was sent to 48 laboratories for serological testing. The results returned by the participating laboratories were anonymized, scored, and subjected to comparison and statistical analysis. RESULTS: Ten laboratories rated all samples correctly with regard to IgM, and only three achieved the full score for IgG detection. The main handicaps in assay performance were suboptimal sensitivity of in-house IgM detection protocols by comparison with better-performing commercial ELISA tests, and the presence of IgG cross-reactivity with heterologous flaviviruses. Differences of detail in the methodology of dengue IgG antibody detection appear to underlie the disparities in accuracy observed between laboratories. CONCLUSION: This EQA study demonstrates that there is room for many laboratories to improve sensitivity in the detection of anti-dengue virus IgM antibodies, against the benchmark set by commercial antibody capture ELISA tests. The EQA shows also that cross-reactivity is a continuing issue, and IgG detection protocols must be optimized to increase their specificity.

External quality assessment study for ebolavirus PCR-diagnostic promotes international preparedness during the 2014 - 2016 Ebola outbreak in West Africa.

During the recent Ebola outbreak in West Africa several international mobile laboratories were deployed to the mainly affected countries Guinea, Sierra Leone and Liberia to provide ebolavirus diagnostic capacity. Additionally, imported cases and small outbreaks in other countries required global preparedness for Ebola diagnostics. Detection of viral RNA by reverse transcription polymerase chain reaction has proven effective for diagnosis of ebolavirus disease and several assays are available. However, reliability of these assays is largely unknown and requires serious evaluation. Therefore, a proficiency test panel of 11 samples was generated and distributed on a global scale. Panels were analyzed by 83 expert laboratories and 106 data sets were returned. From these 78 results were rated optimal and 3 acceptable, 25 indicated need for improvement. While performance of the laboratories deployed to West Africa was superior to the overall performance there was no significant difference between the different assays applied.

External quality assessment studies for laboratory performance of molecular and serological diagnosis of Chikungunya virus infection.

BACKGROUND: Since the re-emergence of Chikungunya virus (CHIKV) in Reunion in 2005 and the recent outbreak in the Caribbean islands with an expansion to the Americas the CHIK diagnostic became very important. OBJECTIVES: We evaluate the performance of laboratories regarding molecular and serological diagnostic of CHIK worldwide. STUDY DESIGN: A panel of 12 samples for molecular and 13 samples for serology were provided to 60 laboratories in 40 countries for evaluating the sensitivity and specificity of molecular and serology testing. RESULTS: The panel for molecular diagnostic testing was analysed by 56 laboratories returning 60 data sets of results whereas the 56 and 60 data sets were returned for IgG and IgM diagnostic from the participating laboratories. Twenty-three from 60 data sets performed optimal, 7 acceptable and 30 sets of results require improvement. From 50 data sets only one laboratory shows an optimal performance for IgM detection, followed by 9 data sets with acceptable and the rest need for improvement. From 46 IgG serology data sets 20 provide an optimal, 2 an acceptable and 24 require improvement performance. The evaluation of some of the diagnostic performances allows linking the quality of results to the in-house methods or commercial assays used. CONCLUSION: The external quality assurance for CHIK diagnostics provides a good overview on the laboratory performance regarding sensitivity and specificity for the molecular and serology diagnostic required for the quick and reliable analysis of suspected CHIK patients. Nearly half of the laboratories have to improve their diagnostic profile to achieve a better performance.

Detection of yellow fever virus: a comparison of quantitative real-time PCR and plaque assay.

Yellow fever virus quantitation is performed routinely by cultivation of virus containing samples using susceptible cells. Counting of the resulting plaques provides a marker for the number of infectious particles present in the sample. This assay usually takes up to 5 days before results are obtained and must be carried out under L2 or L3 laboratory conditions, depending on the yellow fever virus strain used. For clinical diagnosis of yellow fever virus infections the cell culture-based approach takes too long and is of limited practical relevance. Recently, due to its considerable sensitivity, PCR has become a promising method for virus detection. However, whilst PCR can detect virus-specific nucleic acids, it does not allow conclusions to be drawn regarding the infectious potential of the virus detected. Nonetheless, for diagnostic purposes, a rapid, specific and sensitive virus PCR is preferable. Therefore, two independent yellow fever virus-specific real-time PCR assays were established and compared the viral RNA loads to the results of a traditional plaque assay. The estimated ratio of yellow fever virus genomes to infectious particles was between 1000:1 and 5000:1; both approaches displayed a comparable precision of <45%. A significant correlation between genome number as determined by real-time PCR and the corresponding number of plaques in paired samples was found with a Pearson coefficient of correlation of r=0.88 (P<0.0001).

Second international diagnostic accuracy study for the serological detection of West Nile virus infection.

BACKGROUND: In recent decades, sporadic cases and outbreaks in humans of West Nile virus (WNV) infection have increased. Serological diagnosis of WNV infection can be performed by enzyme-linked immunosorbent assay (ELISA), immunofluorescence assay (IFA) neutralization test (NT) and by hemagglutination-inhibition assay. The aim of this study is to collect updated information regarding the performance accuracy of WNV serological diagnostics. METHODOLOGY/PRINCIPAL FINDINGS: In 2011, the European Network for the Diagnostics of Imported Viral Diseases-Collaborative Laboratory Response Network (ENIVD-CLRN) organized the second external quality assurance (EQA) study for the serological diagnosis of WNV infection. A serum panel of 13 samples (included sera reactive against WNV, plus specificity and negative controls) was sent to 48 laboratories involved in WNV diagnostics. Forty-seven of 48 laboratories from 30 countries participated in the study. Eight laboratories achieved 100% of concurrent and correct results. The main obstacle in other laboratories to achieving similar performances was the cross-reactivity of antibodies amongst heterologous flaviviruses. No differences were observed in performances of in-house and commercial test used by the laboratories. IFA was significantly more specific compared to ELISA in detecting IgG antibodies. The overall analytical sensitivity and specificity of diagnostic tests for IgM detection were 50% and 95%, respectively. In comparison, the overall sensitivity and specificity of diagnostic tests for IgG detection were 86% and 69%, respectively. CONCLUSIONS/SIGNIFICANCE: This EQA study demonstrates that there is still need to improve serological tests for WNV diagnosis. The low sensitivity of IgM detection suggests that there is a risk of overlooking WNV acute infections, whereas the low specificity for IgG detection demonstrates a high level of cross-reactivity with heterologous flaviviruses.

International external quality assessment of molecular detection of Rift Valley fever virus.

Rift Valley fever (RVF) is a viral zoonosis that primarily affects animals resulting in considerable economic losses due to death and abortions among infected livestock. RVF also affects humans with clinical symptoms ranging from an influenza-like illness to a hemorrhagic fever. Over the past years, RVF virus (RVFV) has caused severe outbreaks in livestock and humans throughout Africa and regions of the world previously regarded as free of the virus. This situation prompts the need to evaluate the diagnostic capacity and performance of laboratories worldwide. Diagnostic methods for RVFV detection include virus isolation, antigen and antibody detection methods, and nucleic acid amplification techniques. Molecular methods such as reverse-transcriptase polymerase chain reaction and other newly developed techniques allow for a rapid and accurate detection of RVFV. This study aims to assess the efficiency and accurateness of RVFV molecular diagnostic methods used by expert laboratories worldwide. Thirty expert laboratories from 16 countries received a panel of 14 samples which included RVFV preparations representing several genetic lineages, a specificity control and negative controls. In this study we present the results of the first international external quality assessment (EQA) for the molecular diagnosis of RVF. Optimal results were reported by 64% of the analyses, 21% of the analyses achieved acceptable results and 15% of the results revealed that there is need for improvement. Evenly good performances were achieved by specific protocols which can therefore be recommended as an accurate molecular protocol for the diagnosis of RVF. Other protocols showed uneven performances revealing the need for improved optimization and standardization of these protocols.

First international external quality assessment of molecular detection of Crimean-Congo hemorrhagic fever virus.

Crimean-Congo hemorrhagic fever (CCHF) is a zoonosis caused by a Nairovirus of the family Bunyaviridae. Infection is transmitted to humans mostly by Hyalomma ticks and also by direct contact with the blood or tissues of infected humans or viremic livestock. Clinical features usually include a rapid progression characterized by hemorrhage, myalgia and fever, with a lethality rate up to 30%. CCHF is one of the most widely distributed viral hemorrhagic fevers and has been reported in Africa, the Middle East and Asia, as well as parts of Europe. There is no approved vaccine or specific treatment against CCHF virus (CCHFV) infections. In this context, an accurate diagnosis as well as a reliable surveillance of CCHFV infections is essential. Diagnostic techniques include virus culture, serology and molecular methods, which are now increasingly used. The European Network for the Diagnostics of "Imported" Viral Diseases organized the first international external quality assessment of CCHVF molecular diagnostics in 2011 to assess the efficiency and accurateness of CCHFV molecular methods applied by expert laboratories. A proficiency test panel of 15 samples was distributed to the participants including 10 different CCHFV preparations generated from infected cell cultures, a preparation of plasmid cloned with the nucleoprotein of CCHFV, two CCHFV RNA preparations and two negative controls. Forty-four laboratories worldwide participated in the EQA study and 53 data sets were received. Twenty data sets (38%) met all criteria with optimal performance, 10 (19%) with acceptable performance, while 23 (43%) reported results showing a need for improvement. Differences in performance depended on the method used, the type of strain tested, the concentration of the sample tested and the laboratory performing the test. These results indicate that there is still a need for improving testing conditions and standardizing protocols for the molecular detection of Crimean-Congo hemorrhagic fever virus.

First international external quality assessment study on molecular and serological methods for yellow fever diagnosis.

OBJECTIVE: We describe an external quality assurance (EQA) study designed to assess the efficiency and accurateness of molecular and serological methods used by expert laboratories performing YF diagnosis. STUDY DESIGN: For molecular diagnosis evaluation, a panel was prepared of 14 human plasma samples containing specific RNA of different YFV strains (YFV-17D, YFV South American strain [Brazil], YFV IvoryC1999 strain), and specificity samples containing other flaviviruses and negative controls. For the serological panel, 13 human plasma samples with anti-YFV-specific antibodies against different strains of YFV (YFV-17D strain, YFV IvoryC1999 strain, and YFV Brazilian strain), as well as specificity and negative controls, were included. RESULTS: Thirty-six laboratories from Europe, the Americas, Middle East, and Africa participated in these EQA activities. Only 16% of the analyses reported met all evaluation criteria with optimal performance. Serial dilutions of YFV-17D showed that in general the methodologies reported provided a suitable sensitivity. Failures were mainly due to the inability to detect wild-type strains or the presence of false positives. Performance in the serological diagnosis varied, mainly depending on the methodology used. Anti-YFV IgM detection was not performed in 16% of the reports using IIF or ELISA techniques, although it is preferable for the diagnosis of YFV acute infections. A good sensitivity profile was achieved in general; however, in the detection of IgM antibodies a lack of sensitivity of anti-YFV antibodies against the vaccine strain 17D was observed, and of the anti-YFV IgG antibodies against a West African strain. Neutralization assays showed a very good performance; however, the unexpected presence of false positives underlined the need of improving the running protocols. CONCLUSION: This EQA provides information on each laboratory's efficacy of RT-PCR and serological YFV diagnosis techniques. The results indicate the need for improving serological and molecular diagnosis techniques and provide a follow-up of the diagnostic profiles.

Second external quality assurance study for the serological diagnosis of hantaviruses in Europe.

Hantaviruses are endemic throughout the world and hosted by rodents and insectivores. Two human zoonoses, hemorrhagic fever with renal syndrome (HFRS) and hantavirus pulmonary syndrome (HPS), are caused by hantaviruses and case fatality rates have reached 12% for HFRS and 50% for HPS in some outbreaks. Symptomatic hantavirus infections in Europe are summarised as HFRS mainly due to Puumala, Dobrava-Belgrade and Saaremaa virus. While HFRS has an overall low incidence in Europe, the number of cases varies from 100 per year in all Eastern and Southern Europe up to 1,000 per year only in Finland. To assess the quality of hantavirus diagnostics, the European Network for the Diagnostics of "Imported" Viral Diseases (ENIVD) organised a first external quality assurance (EQA) in 2002. The purpose of this second EQA study is to collect updated information on the efficiency and accurateness of hantavirus serological methods applied by expert laboratories. A serum panel of 14 samples was sent to 28 participants in Europe of which 27 sent results. Performance in hantavirus diagnosis varied not only on the method used but also on the laboratories and the subclass of antibodies tested. Commercial and in-house assays performed almost equally. Enzyme immunoassays were mainly used but did not show the best performances while immunoblot assays were the less employed and showed overall better performances. IgM antibodies were not detected in 61% of the positive IgM samples and IgM detection was not performed by 7% of the laboratories indicating a risk of overlooking acute infections in patients. Uneven performances using the same method is indicating that there is still a need for improving testing conditions and standardizing protocols.

2nd International external quality control assessment for the molecular diagnosis of dengue infections.

BACKGROUND: Currently dengue viruses (DENV) pose an increasing threat to over 2.5 billion people in over 100 tropical and sub-tropical countries worldwide. International air travel is facilitating rapid global movement of DENV, increasing the risk of severe dengue epidemics by introducing different serotypes. Accurate diagnosis is critical for early initiation of preventive measures. Different reverse transcriptase PCR (RT-PCR) methods are available, which should be evaluated and standardized. Epidemiological and laboratory-based surveillance is required to monitor and guide dengue prevention and control programmes, i.e., by mosquito control or possible vaccination (as soon as an effective and safe vaccine becomes available). OBJECTIVE: The purpose of the external quality assurance (EQA) study described is to assess the efficiency and accuracy of dengue molecular diagnosis methods applied by expert laboratories. STUDY DESIGN: A panel of 12 human plasma samples was distributed and tested for DENV-specific RNA. The panel comprised 9 samples spiked with different DENV serotypes (DENV-1 to DENV-4), including 10-fold dilution series of DENV-1 and DENV-3. Two specificity controls consisted of a sample with a pool of 4 other flaviviruses and a sample with chikungunya virus. A negative control sample was also included. RESULTS: Thirty-seven laboratories (from Europe, Middle East Asia, Asia, the Americas/Caribbean, and Africa) participated in this EQA study, and reports including 46 sets of results were returned. Performance among laboratories varied according to methodologies used. Only 5 (10.9%) data sets met all criteria with optimal performance, and 4 (8.7%) with acceptable performance, while 37 (80.4%) reported results showed the need for improvement regarding accomplishment of dengue molecular diagnosis. Failures were mainly due to lack of sensitivity and the presence of false positives. CONCLUSIONS: The EQA provides information on each laboratory's efficacy of RT-PCR techniques for dengue diagnosis and indicates for most laboratories an urgent need to improve sensitivity and specificity.