RespiDisk: a point-of-care platform for fully automated detection of respiratory tract infection pathogens in clinical samples.

We present the RespiDisk enabling the fully automated and multiplex point-of-care (POC) detection of (currently) up to 19 respiratory tract infection (RTI) pathogens from a single sample based on reverse transcriptase polymerase chain reaction (RT-PCR). RespiDisk comprises a RTI-specific implementation of the centrifugal microfluidic LabDisk platform and combines new and existing advanced unit operations for liquid control, thereby automating all assay steps only by a spinning frequency and temperature protocol in combination with the use of a permanent magnet for in situ bead handing. The capabilities of the system were demonstrated with 36 tested quality samples mimicking clinical conditions (clinical and/or cultured material suspended in transport medium or synthetic bronchoalveolar lavage (BAL)) from past external quality assessment (EQA) panels covering 13 of the 19 integrated RTI detection assays. In total, 36 samples × 19 assays/sample resulting in 684 assays were performed with the RespiDisk, and its analytical performance was in full agreement with the routine clinical workflow serving as reference. A strong feature of the platform is its universality since its components allow the simultaneous detection of a broad panel of bacteria and viruses in a single run, thereby enabling the differentiation between antibiotic-treatable diseases. Furthermore, the full integration of all necessary biochemical components enables a reduction of the hands-on time from manual to automated sample-to-answer analysis to about 5 min. The study was performed on an air-heated LabDisk Player instrument with a time-to-result of 200 min.

International external quality assessment for SARS-CoV-2 molecular detection and survey on clinical laboratory preparedness during the COVID-19 pandemic, April/May 2020.

Laboratory preparedness with quality-assured diagnostic assays is essential for controlling the current coronavirus disease (COVID-19) outbreak. We conducted an external quality assessment study with inactivated severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) samples to support clinical laboratories with a proficiency testing option for molecular assays. To analyse SARS-CoV-2 testing performance, we used an online questionnaire developed for the European Union project RECOVER to assess molecular testing capacities in clinical diagnostic laboratories.

Quality of molecular detection of vancomycin resistance in enterococci: results of 6 consecutive years of Quality Control for Molecular Diagnostics (QCMD) external quality assessment.

The quality of PCR to detect vancomycin-resistant enterococci (VRE) was evaluated by analysing their performance in six consecutive external quality assessment (EQA) schemes, organized annually since 2013 by Quality Control for Molecular Diagnostics. VRE EQA panels consisted of 12-14 heat-inactivated samples. Sensitivity was tested with vanA-positive Enterococcus faecium (E. faecium), vanB-positive E. faecium, E. faecalis or E. gallinarum or vanC-positive E. gallinarum in different concentrations. Vancomycin-susceptible enterococci, Staphylococcus aureus or sample matrix was used to study the specificity. Participants were asked to report the VRE resistance status of each sample. The detection rate of vanA-positive samples was already 95% in the 2013 EQA panel (range 94-97%) and remained stable over the years. The 2013 detection rate of vanB-positive samples was 82% but increased significantly by more than 10% in subsequent years (96% in 2014, 95% in 2015, 92% in 2016 and 93% in 2017/2018, p < 0.05). The vanC detection rate by the limited number of assays specifically targeting this gene was lower compared to vanA/B (range 55-89%). The number of false positives in the true-negative sample (8% in 2013 to 1.4% in 2018) as well as the van-gene-negative bacterial samples (4% in 2013 to 0% in 2018) declined over the years. In the six years of VRE proficiency testing to date, the detection of vanA-positive strains was excellent and an increased sensitivity in vanB detection as well as an increase in specificity was observed. Commercial and in-house assays performed equally well.

Statistical approach for optimization of external quality assurance (EQA) studies of molecular and serological viral diagnostics.

Management of viral diagnostic quality is based on external quality assurance (EQA), where laboratories involved in diagnostics of a targeted virus are offered to analyze a panel of blinded samples. The utility of EQAs is compromised because of the absence of an approach to EQA design which upfront defines acceptance criteria and associated statistical analysis ensuring fair and consistent interpretation. We offer a rigorous statistically based approach for EQA planning. Instead of a conventional performance characteristic (the score) which is calculated as the sum of the points for correctly identified samples in a blinded test panel, Youden index is used as the performance measure. Unlike the score, Youden index requires an estimate of sensitivity and specificity and incorporates the relationship of these performance parameters. Based on the assumption that the coordinator is a reputable expert of viral diagnostics, the performance of the coordinator's laboratory is defined as a proficiency standard for performance evaluation. The immediate goal of EQA is defined as to obtain a statistically reliable estimation for every laboratory whether its performance meets the proficiency standard, while the overall goal is to match every laboratory to its specific performance level. Dependence of informational capacities of test panel from the panel size and content is quantitatively analyzed and the optimal design and informational capacities of both idealized panels (whose size is not restricted by financial factors) and currently feasible panels are considered. Our approach provides the basis both for rational design of currently feasible EQA test panels and for an increased panel size.

Does proficiency testing improve the quality of hantavirus serodiagnostics? Experiences with INSTAND EQA schemes.

Hantavirus infections in Germany appear periodically with peak numbers every 2-3 years. The reported cases in the years 2007, 2010 and 2012 exceeded many times over those in the years in-between. In order to reveal faults of certain in vitro diagnostic assays (IVDs), to harmonize the performances of the individual assays and to improve the users' competence in interpreting the results, the National Consiliary Laboratory for Hantaviruses and INSTAND e.V. (Society for Promoting Quality Assurance in Medical Laboratories e.V.) established an external quality assessment (EQA) scheme for proficiency testing of hantavirus serodiagnostics. The first EQA scheme (pilot study) started in March 2009 with 58 participating laboratories from Germany and neighboring countries. Twice a year four serum samples were sent out to the participants to investigate whether the sample reflects an acute or past infection and to distinguish between infections with the hantavirus types Puumala virus (PUUV) and Dobrava-Belgrade virus (DOBV), both endemic in Central Europe. In addition, samples negative for anti-hantavirus antibodies were tested in order to examine the specificity of the IVDs applied in the participating laboratories. An increasing number of laboratories participated, with a maximum of 92 in March 2014. When summarizing in total 2592 test results, the laboratories reached an overall specificity of 96.7% and a sensitivity of 95% in their detection of a hantavirus infection. A correct distinction between acute and past infections was forwarded in 90-96% of replies of laboratories. Exact serotyping (PUUV vs. DOBV) of the infection was reported in 81-96% of replies with the lowest accuracy for past DOBV infections; cross-reactivities between diagnostic antigens of the two viruses as well as persistent IgM titers in humans may interfere with exact testing. The EQAs revealed acceptable results for the serodiagnostic of hantavirus infection including serotyping but further improvement is still needed.

International external quality assessment study for detection of monkeypox virus by PCR supporting laboratory preparedness during the 2022-2023 mpox outbreak and beyond.

BACKGROUND: Diagnostic capabilities and correspondent External Quality Assessments (EQA) are key for outbreak preparedness. To support diagnostic facilities with a quality assessment of newly established monkeypox virus (MPXV) molecular diagnostic workflows, Quality Control for Molecular Diagnostics (QCMD) and the Bundeswehr Institute of Microbiology (IMB) piloted an international EQA study conducting four challenges from autumn 2022 to summer 2023 during the global mpox outbreak. OBJECTIVES: To assess the performance (sensitivity/specificity) of molecular assays used by diagnostic laboratories. STUDY DESIGN: Inactivated EQA panels were prepared and distributed containing seven samples of clade Ia and clade IIb MPXV strains at different viral concentrations, two specificity controls with other zoonotic orthopoxviruses (vaccinia and cowpox virus) and a negative control. Assessment was based on reported qualitative testing results. RESULTS: In this outbreak-related EQA study, a total of 192 laboratories from 37 countries reported 346 qualitative datasets. Overall, core samples were correctly detected by approximately 92 % of participants in all four challenges. While sensitivity performance was acceptable in at least 90 % of datasets correctly reported even for educational MPXV-positive samples with low viral concentration [102 genome equivalents (GE)/mL], several laboratories reported the educational specificity controls as false positives or were unable to differentiate MPXV from related orthopoxviruses. CONCLUSIONS: Mpox is now a globally occurring infection with a demand for quality-assured diagnostic capabilities. The newly established EQA scheme presented here, offers a multi-purpose panel for orthopoxviruses with a focus on MPXV which will continue to ensure diagnostic quality in clinical settings with up-to-date sample panels.

Evaluation of the diagnostic capacities for emerging arboviral diseases in the international network MediLabSecure from 2014 to 2018 - Importance of external quality assessments.

BACKGROUND: Emerging infectious diseases pose an increasing threat to all nations around the world, including to developed countries. By definition, because they are rare or unknown, public health systems are not well prepared against these emerging diseases. To be fully prepared, countries must have implemented surveillance systems to monitor rare or unusual sanitary events. METHODS: The capacity of diagnostic laboratories is a key component of surveillance systems since they are in charge of identifying the pathogens responsible for outbreaks in a timely manner. The MediLabSecure project aims at implementing a comprehensive surveillance system for vector-borne diseases around the Mediterranean and Black Sea regions. From 2014 to 2018, the human-virology group of MediLabSecure notably supported the implementation of molecular diagnostic capacities for eight arboviruses and one coronavirus in 19 laboratories of its network through sharing of protocols and reagents, and technical training of the scientific staff of beneficiary laboratories. RESULTS: We report the results of External Quality Assessments for four of these viruses to assess the efficiency of the diagnostic for these threats emerging in the geographic area. The results for these EQA demonstrate the success of the project in the implementation of diagnostic technics for the identification of Dengue, Chikungunya, Zika, and West Niles viruses in laboratories that did not have the capacity before. However, results also show that some work is still to be done to strengthen the newly acquired capacity. CONCLUSION: The MediLabSecure project deployed an effort to build an efficient capacity in identifying and survey the emergence of arboviruses in the Mediterranean area. Diagnostic technics were successfully implemented in many of the laboratories of the network, but the effort must be maintained over time to strengthen these capacities.

Importance of external quality assessment for SARS-CoV-2 antigen detection during the COVID-19 pandemic.

BACKGROUND: Antigen testing has become an essential part of fighting the ongoing COVID-19 pandemic. With the continual increase in available tests, independent and extensive comparative evaluations using data from external quality assessment (EQA) studies to evaluate test performance between different users are required. OBJECTIVES: An EQA scheme was established to assess the sensitivity of antigen tests and the potential impact of circulating SARS-CoV-2 strains on their performance. STUDY DESIGN: Panels were prepared for three challenges in 2021 containing inactivated SARS-CoV-2-positive samples of various genetic strains (including variants of concern, VOCs) at different concentrations, and negative samples. Data was analysed based on qualitative testing results in relation to the antigen test used. RESULTS: Participants registered for each individual challenge in any combination. In total, 258 respondents from 27 countries worldwide were counted submitting 472 datasets. All core samples were correctly reported by 76.7 to 83.1% at participant level and by 73.5 to 83.8% at dataset level. Sensitivity differences could be shown in viral loads and SARS-CoV-2 strains/variants including the impact on performance by a B.1.1.7-like mutant strain with a deletion in the nucleoprotein gene. Lateral flow rapid antigen tests showed a higher rate of false negatives in general compared with automated point-of-care tests and laboratory ELISA/immunoassays. CONCLUSIONS: EQA schemes can provide valuable data to inform participants about weaknesses in their testing process or methods and support ongoing assay evaluations for regulatory approval or post-market surveillance.

Coordinated implementation of chikungunya virus reverse transcription-PCR.

A preformulated chikungunya virus real-time reverse transcription-PCR, quality-confirmed oligonucleotides, and noninfectious virus controls were distributed by the European Network for the Diagnosis of Imported Viral Diseases. An international proficiency study with 31 participants demonstrated that ad hoc implementation of molecular diagnostics was feasible and successful.

External Quality Assessment (EQA) for Molecular Diagnostics of Zika Virus: Experiences from an International EQA Programme, 2016⁻2018.

Quality Control for Molecular Diagnostics (QCMD), an international provider for External Quality Assessment (EQA) programmes, has introduced a programme for molecular diagnostics of Zika virus (ZIKV) in 2016, which has been continuously offered to interested laboratories since that time. The EQA schemes provided from 2016 to 2018 revealed that 86.7% (92/106), 82.4% (89/108), and 88.2% (90/102) of the participating laboratories reported correct results for all samples, respectively in 2016, 2017, and 2018. The review of results indicated a need for improvement concerning analytical sensitivity and specificity of the test methods. Comparison with the outcomes of other EQA initiatives briefly summarized here show that continuous quality assurance is important to improve laboratory performance and to increase preparedness with reliable diagnostic assays for effective patient management, infection and outbreak control.

Quality control assessment for the PCR diagnosis of tick-borne encephalitis virus infections.

BACKGROUND: Reverse transcriptase-polymerase chain reaction (RT-PCR) is an efficient method for the early detection of tick-borne encephalitis virus (TBEV) RNA in blood and serum samples taken prior to the appearance of antibodies. Improved diagnostics are critical for optimally detecting and managing TBE infections and quality control measures are therefore essential. OBJECTIVE: To assess the diagnostic quality of laboratories by performing an external quality assurance (EQA) programme for the molecular detection of TBE infections. STUDY DESIGN: A panel of 12 prepared human plasma samples were distributed and tested for the presence of TBEV-specific RNA. The panel comprised eight samples spiked with different TBEV strains of European, Siberian and Far Eastern subtypes, and included a 10-fold dilution series. Two specificity controls consisted of a sample with Louping ill virus (LIV) and a sample with a pool of four other flaviviruses, and two negative control samples were further included. RESULTS: Twenty-three laboratories from 16 European and 2 non-European countries participated in this EQA programme. Only two participants correctly identified all samples. Nine laboratories correctly identified 75.0-91.7% of the samples; seven laboratories correctly identified 54.5-66.7% and five laboratories correctly identified < or =50%. CONCLUSIONS: The EQA programme provides information on the quality of the RT-PCR methods used by the participating laboratories and indicates that most of these need to improve sensitivity and specificity of their molecular assays for TBEV.

Quality control assessment for the serological diagnosis of tick borne encephalitis virus infections.

BACKGROUND: The diagnosis of tick borne encephalitis (TBE) is mainly based on the demonstration of specific antibodies in serum when neurological disease is manifested. Improving diagnostics is the most important step in detecting and dealing with these pathogens. Quality control measures are essential for TBE diagnosis. OBJECTIVE: To assess an external quality assurance (EQA) program for the serologic diagnosis of TBE infections. STUDY DESIGN: A panel of 12 serum samples was sent out to be tested for the presence of TBE virus-specific IgM and IgG. This panel contained seven TBE-positive samples for IgM and/or IgG; three negative samples; two samples positive either for West Nile virus (WNV) or Dengue virus (DENV). RESULTS: Fourty-two laboratories from 25 European and 2 non-European countries participated in this EQA. The correct answer by each laboratory for all samples ranked between 58 and 96% and sera with IgM antibody positive for TBE were correctly recognized by 46-88% of the laboratories. Sera with IgG antibody positive for TBE were correctly recognized by 83-95% of the laboratories. False TBE-positive results were obtained with DENV, WNV or negative sera only for IgG-based assays. CONCLUSION: Correct results for at least 90% of the samples were obtained by 33 of 40 participating laboratories for IgM and for 16 of 42 laboratories for IgG.

A new quantitative real-time reverse transcriptase PCR assay and melting curve analysis for detection and genotyping of Ljungan virus strains.

Ljungan virus (LV), a new member of the Picornaviridae, recently isolated from vole species in both Sweden and the USA, is suspected to be pathogenic for humans as an aetiological agent in myocarditis, diabetes, neurological disease and perinatal disease. This study describes for the first time an RT-PCR assay that can identify and quantify LV infection in various tissue sample types using primers and two different minor-groove-binder probes targeting the 5'-untranslated region of the LV genome. The assay, evaluated using control samples derived from various virus cultures and rodent tissues, allows precise quantification of viral load over six orders of magnitude (10(1) to 10(6) viral copies per assay) for all known strains of LV with high sensitivity and specificity. Furthermore, a melting curve analysis (MCA) was developed using two amplicon-specific hybridisation probes that allows rapid genotyping of different LV strains. These new methods provide useful tools to investigate the putative role of LV as a pathogen in both rodents and humans.

First international diagnostic accuracy study for the serological detection of West Nile virus infection.

BACKGROUND: The diagnosis of an acute or convalescent West Nile (WN) virus infection can be confirmed by various serological assays such as enzyme immunoassay (EIA), immunofluorescence assay (IFA), or neutralisation test (NT) which are conducted by a growing number of laboratories. However, as the degree of proficiency may vary between laboratories, quality control measures for laboratory diagnostics are essential. METHODS: We have performed an external quality assurance (EQA) programme for the serological detection of WN virus infection to assess the diagnostic quality of laboratories. The participating laboratories received a proficiency panel of 10 coded lyophilised test samples comprising four antisera positive for WN antibodies as positive controls, three antisera positive for antibodies against other heterologous flaviviruses plus one multireactive unspecific serum as specificity controls, and two negative serum samples. RESULTS: Twenty-seven laboratories from 20 different countries in Europe, the Middle East, the Americas and Africa participated in this EQA programme. Applying the proficiency criteria of this study, only eight laboratories correctly analysed all samples with their respective EIA, IFA or NT methods. Eighteen laboratories correctly identified between 77.8 and 90% of the samples, and one laboratory identified only 70% correctly with a clear need to eliminate cross-reactivity with other antisera, particularly those elicited by yellow fever virus. Differentiation between the results for IgM and IgG was considered separately and revealed that IgM-antibodies were detected less frequently than IgG-antibodies (p < 0.001). However, the assay used was not a significant technical factor influencing laboratory performance. CONCLUSION: The EQA programme provides information on the quality of different serological assays used by the participating laboratories and indicates that most need to improve their assays, in particular to avoid cross-reactions with antibodies to heterologous flaviviruses.

Analysing myocardial tissue from explanted hearts of heart transplant recipients and multi-organ donors for the presence of parvovirus B19 DNA.

BACKGROUND: Parvovirus B19 (PVB19) is an erythrovirus causing diverse clinical manifestations ranging from asymptomatic or mild to more severe outcomes, dependent on the haematological and/or immunological status of the host. Reports of PVB19 infection as a causative agent of paediatric or adult inflammatory cardiac diseases, or of cardiac transplant rejection are rare. OBJECTIVES: To identify PVB19 and other cardiotropic viruses in the myocardium of heart transplant (HTx) recipients and multi-organ donors (MOD). Furthermore, to assess the prevalence of cardiotropic viral infection in inflammatory heart disease. STUDY DESIGN: Heart tissue samples from 110 explants were analysed for PVB19 using primers and a 5'-nuclease probe designed to amplify a 160-basepair PCR product from the VP1/NS1 gene region. Samples tested included those obtained from patients undergoing HTx or from MODs. The findings were correlated with clinical course, histologic analysis and serologic testing. Confirmation of the positive PCR-results was done by sequencing and in situ hybridisation. RESULTS: The new assay described here allows precise quantitation of viral load over 7 orders of magnitude (10(6) to 10(0)IU/assay). Measurable amounts of parvoviral genomes were detected in 4/56 (7%) explanted HTx-hearts and in 5/54 (9%) explanted MOD-hearts. CONCLUSIONS: The newly developed real-time PCR is a rapid, sensitive and specific method to detect PVB19 infection in heart tissue. It will be a useful tool to address important questions regarding viral infections transmitted by transplantation, acute infections, relapses and complications involving late or chronic rejection.

External quality control assessment in PCR diagnostics of dengue virus infections.

BACKGROUND: Increased travelling to countries endemic for dengue fever (DF) demands efficient laboratory diagnostics. Nucleic acid amplification techniques (NAT) are now frequently used for rapid diagnosis of imported viral diseases. Different PCR systems are available. OBJECTIVES: In order to assess the quality of molecular diagnostics of dengue virus infections, an external quality assurance (EQA) in PCR diagnostics was conducted. STUDY DESIGN: A panel of 10 human plasma samples was prepared and spiked with dengue virus types DEN-1 to DEN-4. In addition, a 10-fold dilution series (1:10-1:10(4) ) of DEN-3 virus was included. The panel was pre-tested by nested RT-PCR, in-house real-time PCR, and a commercial real-time PCR kit. The samples were inactivated by gamma irradiation and shipped in freeze dried state. Thirteen laboratories, within the European network for the diagnostics of imported viral diseases (ENIVD) took part using either single-round, nested, or real-time RT-PCR methods. Two laboratories used two methods in parallel, summarising up to 15 comparable results. RESULTS: 33-100% correct results were achieved. All laboratories detected DEN-2 correctly, followed by DEN-1 (14 positive results of 15), DEN-3 (12/15) and DEN-4 (11/15). Testing of the serial dilution revealed low sensitivity in many labs, with results ranging from 33 to 80% of correctly tested samples. CONCLUSION: The EQA gives a feedback of the quality of the RT-PCR system used by each respective laboratory. The different test systems and amplification conditions demonstrate the importance of external quality control measures.

Quality control assessment for the serological diagnosis of dengue virus infections.

BACKGROUND: A major drawback of modern society's rapidly increasing mobility is the ease with which dangerous infections can be imported into Europe. Often these infections are not diagnosed because physicians are not familiar with the symptoms and laboratory tests are not always available in local diagnostic centres. Improving diagnostics is the most important step in detecting and dealing with these pathogens and quality control measures are, therefore, essential tools. OBJECTIVES: To assess the diagnosis of imported dengue virus infections in Europe by (1) running a pre-evaluation panel (four serum samples, sent out in 1999) and optimising sample preparation and shipping procedures and (2) initiating an External Quality Assurance (EQA) program (20 serum samples, sent out in 2002). STUDY DESIGN: All serum samples sent out were to be tested for the presence of dengue virus-specific IgM and IgG. For the pre-evaluation panel, four samples were distributed (one sample IgM+/IgG+, one sample IgM-/IgG+, two samples IgM-/IgG-) and for the EQA 20 samples (12 samples IgM+/IgG+, five samples IgM-/lgG+, one sample lgM+/IgG- two samples IgM-/IgG-). 13 laboratories took part in the pre-evaluation panel and 18 laboratories participated in the first EQA run. RESULTS: For the pre-evaluation panel, the participants reported concurrent and correct results for 88% of the IgG-positive samples and for 100% of the IgG-negative samples. The results for the IgM-positive sample were correct in 91% of the reported tests and in 97% of the IgM-negative samples. For the EQA, the participants reported concurrent and correct results for 71% of the IgG-positive samples and 89% of the IgG-negative samples. 58% concurrent and correct results were reported for the IgM-positive samples and 97% for the IgM-negative samples. CONCLUSIONS: The results presented here demonstrate the importance of quality measures for imported viral pathogens like dengue viruses and clearly indicate the need for improving the existing test systems.

Quality control measures for the serological diagnosis of hantavirus infections.

BACKGROUND: With society's rapidly increasing mobility, patients infected with severe viral infections can become seriously ill at any place in Europe and elsewhere. Improving the diagnostics of these infections is the most important step in detecting the pathogens and dealing with them, and for this purpose, quality control measures are essential tools. OBJECTIVES: To assess the diagnostic reality for rare hantavirus infections in Europe by (1) running a pre-evaluation panel (four samples, sent out in 1999) to optimise sample preparation and shipping procedure and afterwards (2) starting an External Quality Assurance (EQA) program (20 samples, sent out in 2001). STUDY DESIGN: All samples sent out had to be tested for the presence of specific IgG and IgM antibodies against hantavirus. For the pre-evaluation panel, four samples were distributed (two samples IgG+/IgM-, one sample IgG-borderline/IgM-, one sample IgG-/IgM-), for the EQA 20 samples (six samples IgG+/IgM+, eight samples IgG+/IgM-, one sample IgG-borderline/IgM-, five samples IgG-/IgM-). Thirteen laboratories took part in the pre-evaluation panel, 18 laboratories participated in the first EQA run. RESULTS: For the pre-evaluation panel, the participants reported correct results for 64% of the IgG-positive samples (85% excluding borderline-positive sample), and 92% for the IgG-negative sample. IgM testing was correctly negative in all laboratories. For the EQA, the participants reported correct results for 76% of the IgG-positive samples, and 97% correct results for the IgG-negative samples. For the IgM-positive samples, 53% correct results were reported, and 98% correct results for the IgM-negative samples. CONCLUSIONS: The results presented here prove the importance of quality measures also for viruses only rarely suspected, like hantavirus, and they clearly demonstrate the need for improvement of the existing test systems.