The performance of human cytomegalovirus digital PCR reference measurement procedure in seven external quality assessment schemes over four years.

A candidate digital PCR (dPCR)-based reference measurement procedure for quantification of human cytomegalovirus (hCMV) was evaluated in 10 viral load comparison schemes (seven external quality assessment (EQA) and three additional training schemes) organized by INSTAND e.V. over four years (between September 2014 and March 2018). Four metrology institutes participated in these schemes using the same extraction method and dPCR measurement procedure for the hCMV specific target sequence of UL54 gene. The calibration independent reference measurement procedure results from the metrology institutes were compared to the results of the clinical diagnostic laboratories applying hCMV qPCR measurement procedures calibrated to reference materials. While the criteria for the acceptable deviation from the target value interval for INSTAND's EQA schemes is from -0.8 log10 to +0.8 log10, the majority of dPCR results were between -0.2 log10 to +0.2 log10. Only 4 out of 45 results exceeded this interval with the maximum deviation of -0.542 log10. In the training schemes containing samples with lower hCMV concentrations, more than half of the results deviated less than ±0.2 log10 from the target value, while more than 95% deviated less than ±0.4 log10 from the target value. Evaluation of intra- and inter-laboratory variation of dPCR results confirmed high reproducibility and trueness of the method. This work demonstrates that dPCR has the potential to act as a calibration independent reference measurement procedure for the value assignment of hCMV calibration and reference materials to support qPCR calibration as well as ultimately for routine hCMV load testing.

IFCC Working Group Recommendations for Correction of Bias Caused by Noncommutability of a Certified Reference Material Used in the Calibration Hierarchy of an End-User Measurement Procedure.

Establishing metrological traceability to an assigned value of a matrix-based certified reference material (CRM) that has been validated to be commutable among available end-user measurement procedures (MPs) is central to producing equivalent results for the measurand in clinical samples (CSs) irrespective of the clinical laboratory MPs used. When a CRM is not commutable with CSs, the bias due to noncommutability will be propagated to the CS results causing incorrect metrological traceability to the CRM and nonequivalent CS results among different MPs. In a commutability assessment, a conclusion that a CRM is commutable or noncommutable for use with a specific MP is made when the difference in bias between the CRM and CSs meets or does not meet a criterion for that specific MP when compared to other MPs. A conclusion regarding commutability or noncommutability requires that the magnitude of the difference in bias observed in the commutability assessment remains unchanged over time. This conclusion requires the CRM to be stable and no substantive changes in the MPs. These conditions should be periodically reverified. If an available CRM is determined to be noncommutable for a specific MP, that CRM can be used in the calibration hierarchy for that MP when an appropriately validated MP-specific correction for the noncommutability bias is included. We describe with examples how a MP-specific correction and its uncertainty can be developed and applied in a calibration hierarchy to achieve metrological traceability of results for CSs to the CRM's assigned value.

First amyloid ß1-42 certified reference material for re-calibrating commercial immunoassays.

INTRODUCTION: Reference materials based on human cerebrospinal fluid were certified for the mass concentration of amyloid beta (Aß)1-42 (Aß42 ). They are intended to be used to calibrate diagnostic assays for Aß42 . METHODS: The three certified reference materials (CRMs), ERM-DA480/IFCC, ERM-DA481/IFCC and ERM-DA482/IFCC, were prepared at three concentration levels and characterized using isotope dilution mass spectrometry methods. Roche, EUROIMMUN, and Fujirebio used the three CRMs to re-calibrate their immunoassays. RESULTS: The certified Aß42 mass concentrations in ERM-DA480/IFCC, ERM-DA481/IFCC, and ERM-DA482/IFCC are 0.45, 0.72, and 1.22 µg/L, respectively, with expanded uncertainties (k = 2) of 0.07, 0.11, and 0.18 µg/L, respectively. Before re-calibration, a good correlation (Pearson's r > 0.97), yet large biases, were observed between results from different commercial assays. After re-calibration the between-assay bias was reduced to < 5%. DISCUSSION: The Aß42 CRMs can ensure the equivalence of results between methods and across platforms for the measurement of Aß42 .

Certified reference material against PR3 ANCA IgG autoantibodies. From development to certification.

Background The importance of the standardisation of immunoassays for autoantibodies has been widely discussed. The appropriate use of certified reference materials (CRM) could contribute to a more accurate diagnosis and follow-up of a series of diseases such as small vessel-associated vasculitis. This is a systemic autoimmune disorder during which two autoantibodies can be present, MPO ANCA IgG and PR3 ANCA IgG. Results from different commercially available immunoassays used for PR3 ANCA IgG measurement can vary significantly. Therefore the potential for improvement using a suitable certified reference material was assessed and led to the development of a CRM. Methods Thirty clinical samples were evaluated using 10 immunoassays. The correlation between results from these assays was assessed in a pairwise manner. Feasibility studies were conducted in order to find a reference material format most suitable for the preparation of a CRM. Results The evaluation of two sets of 30 clinical samples with 10 assays showed that differences between assays can result in different interpretations for individual clinical samples. Most of the samples had the same result classification in all assays. However, six of the samples tested led to inconsistent results. Conclusions The correlation between results from clinical samples was systematically good for combinations of eight of those assays. Therefore, it should be possible to improve the comparability of results using a commutable CRM for calibration. Based on these studies, a final format for the CRM was selected and eventually produced and certified for its PR3 ANCA IgG content.

Commutability Assessment of Candidate Reference Materials for Pancreatic α-Amylase.

BACKGROUND: Measurement standardization of the catalytic concentration of α-amylase in serum is based on 3 pillars: the primary reference measurement procedure (PRMP), reference laboratories, and suitable certified reference materials (CRMs). Commutability is a prerequisite when using a CRM for calibration and trueness control of routine methods or for value transfer from the PRMP to end-user calibrators of routine methods through a calibration hierarchy. METHODS: We performed a commutability study with 30 serum pools and 5 candidate reference materials (RMs) for pancreatic α-amylase using an automated version of the PRMP and 5 different routine methods. Four candidate RMs had an artificial matrix, each with a different composition, and 1 candidate RM was based on human serum. Data were analyzed according to a linear regression analysis with prediction interval as described in the Clinical and Laboratory Standards Institute guideline EP30-A and a difference in bias analysis as described in the recommendations of the IFCC Working Group on Commutability. RESULTS: The commutability profile of the 4 candidate RMs with an artificial matrix was variable. Only 1 candidate RM, with human serum albumin in the matrix, showed a good profile like that of the candidate RM based on serum. The comparison of both commutability assessment approaches indicated some differences because of inconclusive results for the difference in bias approach, suggesting a large uncertainty on the commutability assessment. CONCLUSIONS: A CRM for pancreatic amylase in an artificial matrix can be commutable for routine methods using the same substrate as the PRMP, but the matrix composition is crucial.

IFCC Working Group Recommendations for Assessing Commutability Part 1: General Experimental Design.

Commutability is a property of a reference material (RM) that relates to the closeness of agreement between results for an RM and results for clinical samples (CSs) when measured by ≥2 measurement procedures (MPs). Commutability of RMs used in a calibration traceability scheme is an essential property for them to be fit for purpose. Similarly, commutability of trueness controls or external quality assessment samples is essential when those materials are used to assess trueness of results for CSs. This report is part 1 of a 3-part series describing how to assess commutability of RMs. Part 1 defines commutability and addresses critical components of the experimental design for commutability assessment, including selection of individual CSs, use of pooled CSs, qualification of MPs for inclusion, establishing criteria for the determination that an RM is commutable, generalization of commutability conclusions to future measurements made with the MPs included in the assessment, and information regarding commutability to be included in the certificate for an RM. Parts 2 and 3 in the series present 2 different statistical approaches to commutability assessment that use fixed criteria related to the medical decisions that will be made using the laboratory test results.

IFCC Working Group Recommendations for Assessing Commutability Part 3: Using the Calibration Effectiveness of a Reference Material.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator based on its ability to fulfill its intended use in a calibration traceability scheme to produce equivalent clinical sample (CS) results among different measurement procedures (MPs) for the same measurand. Three sources of systematic error are elucidated in the context of creating the calibration model for translating MP signals to measurand amounts: calibration fit, calibrator level trueness, and commutability. An example set of 40 CS results from 7 MPs is used to illustrate estimation of bias and variability for each MP. The candidate RM is then used to recalibrate each MP, and its effectiveness in reducing the systematic error among the MPs within an acceptable level of equivalence based on medical requirements confirms its commutability for those MPs. The RM is declared noncommutable for MPs for which, after recalibration, the CS results do not agree with those from other MPs. When a lack of agreement is found, other potential causes, including lack of calibration fit, should be investigated before concluding the RM is noncommutable. The RM is considered fit for purpose for those MPs where commutability is demonstrated.

IFCC Working Group Recommendations for Assessing Commutability Part 2: Using the Difference in Bias between a Reference Material and Clinical Samples.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator, trueness control, or external quality assessment sample based on the difference in bias between an RM and clinical samples (CSs) measured using 2 different measurement procedures (MPs). This difference in bias is compared with a criterion based on a medically relevant difference between an RM and CS results to make a conclusion regarding commutability. When more than 2 MPs are included, the commutability is assessed pairwise for all combinations of 2 MPs. This approach allows the same criterion to be used for all combinations of MPs included in the assessment. The assessment is based on an error model that allows estimation of various random and systematic sources of error, including those from sample-specific effects of interfering substances. An advantage of this approach is that the difference in bias between an RM and the average bias of CSs at the concentration (i.e., amount of substance present or quantity value) of the RM is determined and its uncertainty estimated. An RM is considered fit for purpose for those MPs for which commutability is demonstrated.

Inter-laboratory assessment of different digital PCR platforms for quantification of human cytomegalovirus DNA.

Quantitative PCR (qPCR) is an important tool in pathogen detection. However, the use of different qPCR components, calibration materials and DNA extraction methods reduces comparability between laboratories, which can result in false diagnosis and discrepancies in patient care. The wider establishment of a metrological framework for nucleic acid tests could improve the degree of standardisation of pathogen detection and the quantification methods applied in the clinical context. To achieve this, accurate methods need to be developed and implemented as reference measurement procedures, and to facilitate characterisation of suitable certified reference materials. Digital PCR (dPCR) has already been used for pathogen quantification by analysing nucleic acids. Although dPCR has the potential to provide robust and accurate quantification of nucleic acids, further assessment of its actual performance characteristics is needed before it can be implemented in a metrological framework, and to allow adequate estimation of measurement uncertainties. Here, four laboratories demonstrated reproducibility (expanded measurement uncertainties below 15%) of dPCR for quantification of DNA from human cytomegalovirus, with no calibration to a common reference material. Using whole-virus material and extracted DNA, an intermediate precision (coefficients of variation below 25%) between three consecutive experiments was noted. Furthermore, discrepancies in estimated mean DNA copy number concentrations between laboratories were less than twofold, with DNA extraction as the main source of variability. These data demonstrate that dPCR offers a repeatable and reproducible method for quantification of viral DNA, and due to its satisfactory performance should be considered as candidate for reference methods for implementation in a metrological framework.

The use of digital PCR to improve the application of quantitative molecular diagnostic methods for tuberculosis.

BACKGROUND: Real-time PCR (qPCR) based methods, such as the Xpert MTB/RIF, are increasingly being used to diagnose tuberculosis (TB). While qualitative methods are adequate for diagnosis, the therapeutic monitoring of TB patients requires quantitative methods currently performed using smear microscopy. The potential use of quantitative molecular measurements for therapeutic monitoring has been investigated but findings have been variable and inconclusive. The lack of an adequate reference method and reference materials is a barrier to understanding the source of such disagreement. Digital PCR (dPCR) offers the potential for an accurate method for quantification of specific DNA sequences in reference materials which can be used to evaluate quantitative molecular methods for TB treatment monitoring. METHODS: To assess a novel approach for the development of quality assurance materials we used dPCR to quantify specific DNA sequences in a range of prototype reference materials and evaluated accuracy between different laboratories and instruments. The materials were then also used to evaluate the quantitative performance of qPCR and Xpert MTB/RIF in eight clinical testing laboratories. RESULTS: dPCR was found to provide results in good agreement with the other methods tested and to be highly reproducible between laboratories without calibration even when using different instruments. When the reference materials were analysed with qPCR and Xpert MTB/RIF by clinical laboratories, all laboratories were able to correctly rank the reference materials according to concentration, however there was a marked difference in the measured magnitude. CONCLUSIONS: TB is a disease where the quantification of the pathogen could lead to better patient management and qPCR methods offer the potential to rapidly perform such analysis. However, our findings suggest that when precisely characterised materials are used to evaluate qPCR methods, the measurement result variation is too high to determine whether molecular quantification of Mycobacterium tuberculosis would provide a clinically useful readout. The methods described in this study provide a means by which the technical performance of quantitative molecular methods can be evaluated independently of clinical variability to improve accuracy of measurement results. These will assist in ultimately increasing the likelihood that such approaches could be used to improve patient management of TB.

Certified reference materials for testing of the presence/absence of Staphylococcus aureus enterotoxin A (SEA) in cheese.

Staphylococcal enterotoxins (SEs) account for a substantial number of food-poisoning outbreaks. European legislation (Commission Regulation 1441/2007) stipulates the reference procedure for SE analysis in milk and dairy products, which is based on extraction, dialysis concentration and immunochemical detection using one of two approved assays (VIDAS(®) SET2, Ridascreen(®) SET Total). However, certified reference materials (CRMs) are lacking to support laboratories in performing reliable detection of Staphylococcus aureus enterotoxin A (SEA) in relevant matrices at sub-nanogram per gram levels. The certification of a set of three reference materials (blank and two SEA-containing materials) for testing of the presence/absence of SEA in cheese is described. The reference procedure was applied in an intercomparison with 15 laboratories, and results were reported in a qualitative manner (presence or absence of SEA in the sample). No false-negative or false-positive results were obtained. The certified values were stated as diagnostic specificity (blank material) or diagnostic sensitivity (SEA-containing materials) and were 100 % in all cases. Stability studies demonstrated suitable material stability when stored cooled or frozen. An in-house study on the recovery of SEA in the cheese materials using a double-sandwich enzyme-linked immunosorbent assay (ELISA) revealed comparable recovery values of around 45 % at the two spiking levels and in both the SEA-containing CRMs as well as blank CRM freshly spiked prior to analysis. The values were also comparable over time and among different analysts. The materials provide valuable support to laboratories for method validation and method performance verification and will increase the reliability of measuring SEA in cheese.

Standardization of Nucleic Acid Tests for Clinical Measurements of Bacteria and Viruses.

Nucleic acid-based tests for infectious diseases currently used in the clinical laboratory and in point-of-care devices are diverse. Measurement challenges associated with standardization of quantitative viral load testing are discussed in relation to human cytomegalovirus, BK virus, and Epstein-Barr virus, while the importance of defining the performance of qualitative methods is illustrated with Mycobacterium tuberculosis and influenza virus. The development of certified reference materials whose values are traceable to higher-order standards and reference measurement procedures, using, for instance, digital PCR, will further contribute to the understanding of analytical performance characteristics and promote clinical data comparability.

Performance criteria for reference measurement procedures and reference materials.

The concept of metrological traceability of measurement results to property values assigned to measurement standards of higher metrological order or to the International System of Units (SI) through sequential calibrations, using reference materials and reference measurement procedures, plays a key role in ensuring that end user measurement procedures perform at an acceptable level in the clinical context. The aim is that measurement results produced over time or by different end users or with different end user measurement procedures for the same measurand will be equivalent within their corresponding uncertainties. These goals can only be reached under certain conditions and if requirements laid down in international standards on calibration concepts, reference measurement procedures and reference materials are fulfilled. Calibration hierarchies have to be implemented correctly and parameters contributing to measurement uncertainty and systematic bias need to be controlled and eliminated, respectively, by technically improving methods and reference materials and intermediate calibrators used for effectively achieving equivalence of measurement results and for meeting analytical performance requirements for in vitro diagnostic devices.

Evaluation of standardization capability of current cardiac troponin I assays by a correlation study: results of an IFCC pilot project.

BACKGROUND: As a part of an International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) project to prepare a commutable reference material for cardiac troponin I (cTnI), a pilot study evaluated current cTnI assays for measurement equivalence and their standardization capability. METHODS: cTnI-positive samples collected from 90 patients with suspected acute myocardial infarction were assessed for method comparison by 16 cTnI commercial assays according to predefined testing protocols. Seven serum pools prepared from these samples were also assessed. RESULTS: Each assay was assessed against median cTnI concentrations measured by 16 cTnI assays using Passing-Bablok regression analysis of 79 patient samples with values above each assay's declared detection limit. We observed a 10-fold difference in cTnI concentrations for lowest to highest measurement results. After mathematical recalibration of assays, the between-assay variation for patient samples reduced on average from 40% to 22% at low cTnI concentration, 37%-20% at medium concentration, and 29%-14% at high concentration. The average reduction for pools was larger at 16%, 13% and 7% for low, medium and high cTnI concentrations, respectively. Overall, assays demonstrated negligible bias after recalibration (y-intercept: -1.4 to 0.3 ng/L); however, a few samples showed substantial positive and/or negative differences for individual cTnI assays. CONCLUSIONS: All of the 16 commercial cTnI assays evaluated in the study demonstrated a significantly higher degree of measurement equivalence after mathematical recalibration, indicating that measurement harmonization or standardization would be effective at reducing inter-assay bias. Pooled sera behaved similarly to individual samples in most assays.

PAHs in baby food: assessment of three different processing techniques for the preparation of reference materials.

A feasibility study for producing a matrix reference material for selected polycyclic aromatic hydrocarbons (PAHs) in baby food is reported. A commercially available baby food, containing carrots, potatoes, tomato, white beans and meat, was spiked with the so-called 15 + 1 PAHs included in the PAHs priority list for food of the EU, at a mass fraction level of 1 µg/kg. The contaminated baby food was further processed by autoclaving, freezing or freeze drying. The homogeneity of the three materials (bottle-to-bottle variation) and their short-term (4 weeks) and long-term (18 months) stability at different temperatures were assessed. To this end, an analytical method based on a solid-liquid extraction followed by cleaning up with gel permeation chromatography (GPC) and solid phase extraction (SPE) and GC-IDMS determination, was validated in-house. It could be demonstrated that the procedure fulfilled the demands for application to the homogeneity and isochronous stability studies for the candidate reference materials targeted here. All three materials proved to be sufficiently homogeneous for the intended use. Measurements on the autoclaved material provided the most promising results in terms of envisaged shelf life, although freeze drying was also found to be a suitable processing technique for most of the investigated PAHs. These results are an important step towards the development of a matrix reference material for PAHs in a processed food matrix in a presentation very similar to routine samples.

Gaps in the traceability chain of human growth hormone measurements.

BACKGROUND: Human growth hormone (hGH) is measured for the diagnosis of secretion disorders. These measurements fall under the EU Directive 98/79/EC on in vitro diagnostic medical devices requiring traceability of commercial calibrator values to higher-order reference materials or procedures (Off J Eur Communities 1998 Dec 7;L 331:1-37). External quality assessment schemes show large discrepancies between results from different methods, even though most methods provide results traceable to the recommended International Standard (IS 98/574). The aim of this study was to investigate possible causes for these discrepancies. METHODS: We investigated the commutability and recovery of hGH in reconstituted IS 98/574. We tested different reconstitution protocols and used 4 different serum matrices for spiking. These IS preparations were measured together with serum samples. We quantified hGH by 5 different methods in 4 different laboratories. RESULTS: Results from the different methods correlated well for the serum samples. Mean discrepancies between results from different methods were ≤20%. None of the IS preparations was commutable for all the method comparisons. The recovery of hGH in preparations of IS 98/574 depended on the reconstitution protocol (>10-fold differences) and background matrix (relative differences ≤17% for different serum matrices). CONCLUSIONS: The use of different protocols for reconstitution and spiking of hGH reference preparations affects quantification by immunoassays, potentially leading to a bias between commercial methods, despite the use of calibrators with values claimed to be traceable to the same higher-order reference material.

The importance of commutability of reference materials used as calibrators: the example of ceruloplasmin.

BACKGROUND: Different methods for ceruloplasmin tend to give different results in external quality assessment schemes. During the production of the certified reference material ERM-DA470k/IFCC discrepant measurement results were also found for ceruloplasmin measured with different methods, and consequently the protein could not be certified in the material. METHODS: We performed a commutability study with 30 serum samples and the reference materials ERM-DA470, ERM-DA470k/IFCC, and ERM-DA472/IFCC, using 6 different methods. Data were analyzed according to the CLSI Guideline C53-A to assess whether the reference materials had the same behavior as the serum samples with respect to measurement results obtained with combinations of the methods used. RESULTS: Measurement results from different methods showed a good linear correlation for the serum samples. ERM-DA470 showed marked noncommutability for certain combinations of methods. ERM-DA470k/IFCC and ERM-DA472/IFCC were commutable for more combinations of methods. The lack of commutability of ERM-DA470 for certain combinations of methods correlates with results from the UK National External Quality Assessment Service showing discrepancies between results from these methods. For serum stored in the presence of sodium azide the results from different methods are essentially equivalent. CONCLUSIONS: Ceruloplasmin in ERM-DA470 is a fully documented example of a situation in which, due to lack of commutability, the use of a common material for calibration did not lead to harmonization .

A reference system for urinary albumin: current status.

BACKGROUND: Increased urinary excretion of albumin reflects kidney damage and is a recognized risk factor for progression of renal and cardiovascular disease. Considerable inter-method differences have been reported for both albumin and creatinine measurement results, and therefore the albumin-to-creatinine ratio. Measurement accuracy is unknown and there are no independent reference measurement procedures for albumin and no reference materials for either measurand in urine. METHODS: The National Kidney Disease Education Program (NKDEP) Laboratory Working Group and the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) have initiated joint projects to facilitate standardization of urinary albumin and creatinine measurement. RESULTS: A candidate LC-MS/MS reference measurement procedure for urinary albumin and candidate reference materials for urinary albumin and creatinine has been developed. The status of validations of these reference system components is reported. CONCLUSIONS: The development of certified reference materials and reference measurement procedures for urinary albumin will enable standardization of this important measurand.

Analysis of the physicochemical state of C-reactive protein in different preparations including 2 certified reference materials.

BACKGROUND: Standardization of clinical measurements of C-reactive protein (CRP) is based on the availability of reference materials. The serum protein reference material ERM-DA470 was used as a calibrant for various commercially available immunoassays but has now been exhausted. The recently released ERM-DA470k/IFCC was intended to fully replace ERM-DA470. However, the new material was not suited for the certification of CRP because of a bias introduced by the lyophilization process that caused loss of about 20% of CRP measurable by routine immunoassays, compared with the nonlyophilized material that was stored in a liquid frozen state. METHODS: We investigated the physicochemical state of CRP in a set of 4 lyophilized and 2 nonlyophilized serum-based CRP-containing materials by semi-native gel electrophoresis, Western blotting, and gel filtration. RESULTS: We detected a monomeric form of CRP (mCRP) in lyophilized materials at a concentration significantly higher than seen in the materials not subjected to lyophilization. Different reconstitution protocols led to variations of the monomeric CRP fraction found in reconstituted, previously lyophilized material. CONCLUSIONS: Most of the 20% loss in measured CRP after lyophilization of the material can be accounted for by the dissociation of natively pentameric CRP into subunits. The observed dissociation results from lyophilization and subsequent reconstitution of the material at insufficient concentration levels of calcium ions. In the presence of various protein forms, differences in antibody specificity and reactivity between immunoassays and alterations of stoichiometry of antigen-antibody interactions can contribute to the divergence of the measured values.