Assessment of WHO 07/202 reference material and human serum pools for commutability and for the potential to reduce variability among soluble transferrin receptor assays.

OBJECTIVES: The clinical use of soluble transferrin receptor (sTfR) as an iron status indicator is hindered by a lack of assay standardization and common reference ranges and decision thresholds. In 2009, the WHO and National Institute for Biological Standards and Controls (NIBSC) released a sTfR reference material (RM), 07/202, for assay standardization; however, a comprehensive, formal commutability study was not conducted. METHODS: This study evaluated the commutability of WHO 07/202 sTfR RM and human serum pools and the impacts of their use as common calibrators. Commutability was assessed for six different measurement procedures (MPs). Serum pools were prepared according to updated CLSI C37-A procedures (C37) or non-C37 procedures. The study design and analyses were based on Parts 2 and 3 of the 2018 IFCC Commutability in Metrological Traceability Working Group's Recommendations for Commutability Assessment. WHO 07/202 and serum pools were used for instrument/assay and mathematical recalibration, respectively, to determine if their use decreases inter-assay measurement variability for clinical samples. RESULTS: The WHO 07/202 RM dilutions were commutable for all 6 MPs assessed and, when used for instrument calibration, decreased inter-assay variability from 208 to 55.7 %. Non-C37 and C37 serum pools were commutable for all 6 MPs assessed and decreased inter-assay variability from 208 to 13.8 % and 4.6 %, respectively, when used for mathematical recalibration. CONCLUSIONS: All materials evaluated, when used as common calibrators, substantially decreased inter-assay sTfR measurement variability. MP calibration to non-C37 and C37 serum pools may reduce the sTfR IMPBR to a greater extent than WHO 07/202 RM.

Guidance on Which Calibrators in a Metrologically Traceable Calibration Hierarchy Must Be Commutable with Clinical Samples.

Equivalent results for the same measurand in clinical samples (CSs), measured using different end-user in-vitro diagnostic medical devices (IVD-MDs), are essential for the application of clinical practice guidelines for diagnosis, treatment, monitoring, or risk assessment. The International Organization for Standardization (ISO) document 17511:2020 specifies how to establish metrological traceability to the highest available reference system component to enable equivalent results among IVD-MDs. Commutability with CSs is an essential property of a reference material used as a calibrator in a calibration hierarchy. However, not all calibrators in a calibration hierarchy are required to be commutable; different calibration hierarchies have different requirements for which calibrators must be commutable with CSs. Because assessment of commutability is a substantial effort, it is therefore important to determine which calibrators need to be commutable when implementing a calibration hierarchy. We provide guidance on which calibrators must be commutable with CSs, when a correction for any noncommutability bias is appropriate, and when commutability of a calibrator with CSs is not required for various types of calibration hierarchies described in ISO 17511:2020.

Influence of reagent lots and multiple measuring systems on estimating the coefficient of variation from quality control data; implications for uncertainty estimation and interpretation of QC results.

Background Clinical laboratories use internal quality control (QC) data to calculate standard deviation (SD) and coefficient of variation (CV) to estimate uncertainty of results and to interpret QC results. We examined the influence of different instruments, and QC and reagent lots on the CV calculated from QC data. Methods Results for BioRad Multiqual frozen liquid QC samples over a 2-year interval were partitioned by QC and reagent lots. The mean and CV were calculated for each partition for each of three Abbott Architect c8000 instruments for measuring serum alanine amino transferase (ALT), creatinine (enzymatic), glucose and sodium. Results CVs differed among partitions and instruments for two QC levels by 5.8- and 3.3-fold for ALT, by 4.7- and 2.1-fold for creatinine, by 2.0- and 2.6-fold for glucose, and by 2.1- and 2.0-fold for sodium. Pooled CVs for two QC levels varied among instruments by 1.78- and 1.11-fold for ALT, by 1.63- and 1.11-fold for creatinine, by 1.08- and 1.06-fold for glucose, and by 1.24- and 1.31-fold for sodium. Conclusions The CVs from QC data varied substantially among QC and reagent lots and for different identical specification instruments. The CV used to estimate uncertainty for a measurement result or as the basis for interpreting individual QC results must be derived over a sufficient time interval to obtain a pooled CV that represents "typical" performance of a measuring system. An estimate of uncertainty provided to users of laboratory results will itself have uncertainty that can influence medical decisions.

IFCC Working Group Recommendations for Assessing Commutability Part 1: General Experimental Design.

Commutability is a property of a reference material (RM) that relates to the closeness of agreement between results for an RM and results for clinical samples (CSs) when measured by ≥2 measurement procedures (MPs). Commutability of RMs used in a calibration traceability scheme is an essential property for them to be fit for purpose. Similarly, commutability of trueness controls or external quality assessment samples is essential when those materials are used to assess trueness of results for CSs. This report is part 1 of a 3-part series describing how to assess commutability of RMs. Part 1 defines commutability and addresses critical components of the experimental design for commutability assessment, including selection of individual CSs, use of pooled CSs, qualification of MPs for inclusion, establishing criteria for the determination that an RM is commutable, generalization of commutability conclusions to future measurements made with the MPs included in the assessment, and information regarding commutability to be included in the certificate for an RM. Parts 2 and 3 in the series present 2 different statistical approaches to commutability assessment that use fixed criteria related to the medical decisions that will be made using the laboratory test results.

IFCC Working Group Recommendations for Assessing Commutability Part 3: Using the Calibration Effectiveness of a Reference Material.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator based on its ability to fulfill its intended use in a calibration traceability scheme to produce equivalent clinical sample (CS) results among different measurement procedures (MPs) for the same measurand. Three sources of systematic error are elucidated in the context of creating the calibration model for translating MP signals to measurand amounts: calibration fit, calibrator level trueness, and commutability. An example set of 40 CS results from 7 MPs is used to illustrate estimation of bias and variability for each MP. The candidate RM is then used to recalibrate each MP, and its effectiveness in reducing the systematic error among the MPs within an acceptable level of equivalence based on medical requirements confirms its commutability for those MPs. The RM is declared noncommutable for MPs for which, after recalibration, the CS results do not agree with those from other MPs. When a lack of agreement is found, other potential causes, including lack of calibration fit, should be investigated before concluding the RM is noncommutable. The RM is considered fit for purpose for those MPs where commutability is demonstrated.

IFCC Working Group Recommendations for Assessing Commutability Part 2: Using the Difference in Bias between a Reference Material and Clinical Samples.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator, trueness control, or external quality assessment sample based on the difference in bias between an RM and clinical samples (CSs) measured using 2 different measurement procedures (MPs). This difference in bias is compared with a criterion based on a medically relevant difference between an RM and CS results to make a conclusion regarding commutability. When more than 2 MPs are included, the commutability is assessed pairwise for all combinations of 2 MPs. This approach allows the same criterion to be used for all combinations of MPs included in the assessment. The assessment is based on an error model that allows estimation of various random and systematic sources of error, including those from sample-specific effects of interfering substances. An advantage of this approach is that the difference in bias between an RM and the average bias of CSs at the concentration (i.e., amount of substance present or quantity value) of the RM is determined and its uncertainty estimated. An RM is considered fit for purpose for those MPs for which commutability is demonstrated.

Multiple calibrator measurements improve accuracy and stability estimates of automated assays.

OBJECTIVES: The effects of combining multiple calibrations on assay accuracy (bias) and measurement of calibration stability were investigated for total triiodothyronine (TT3), vitamin B12 and luteinizing hormone (LH) using Beckman Coulter's Access 2 analyzer. METHODS: Three calibration procedures (CC1, CC2 and CC3) combined 12, 34 and 56 calibrator measurements over 1, 2, and 3 days. Bias was calculated between target values and average measured value over 3 consecutive days after calibration. Using regression analysis of calibrator measurements versus measurement date, calibration stability was determined as the maximum number of days before a calibrator measurement exceeded 5% tolerance limits. RESULTS: Competitive assays (TT3, vitamin B12) had positive time regression slopes, while sandwich assay (LH) had a negative slope. Bias values for TT3 were -2.49%, 1.49%, and -0.50% using CC1, CC2 and CC3 respectively, with calibrator stability of 32, 20, and 30 days. Bias values for vitamin B12 were 2.44%, 0.91%, and -0.50%, with calibrator stability of 4, 9, and 12 days. Bias values for LH were 2.26%, 1.44% and -0.29% with calibrator stability of >43, 39 and 36 days. Measured stability was more consistent across calibration procedures using percent change rather than difference from target: 26 days for TT3, 12 days for B12 and 31 days for LH. CONCLUSIONS: Averaging over multiple calibrations produced smaller bias, consistent with improved accuracy. Time regression slopes in percent change were unaffected by number of calibration measurements but calibrator stability measured from the target value was highly affected by the calibrator value at time zero.

Evaluation of Beckman Coulter DxI 800 immunoassay system using clinically oriented performance goals.

OBJECTIVES: We evaluated the analytical performance of 24 immunoassays using the Beckman Coulter DxI 800 immunoassay systems at Mayo Clinic, Rochester, MN for trueness, precision, detection limits, linearity, and consistency (across instruments and reagent lots). METHODS: Clinically oriented performance goals were defined using the following methods: trueness-published desirable accuracy limits, precision-published desirable biologic variation; detection limits - 0.1 percentile of patient test values, linearity - 50% of total error, and consistency-percentage test values crossing key decision points. Local data were collected for precision, linearity, and consistency. Data were provided by Beckman Coulter, Inc. for trueness and detection limits. RESULTS: All evaluated assays except total thyroxine were within the proposed goals for trueness. Most of the assays met the proposed goals for precision (86% of intra-assay results and 75% of inter-assay results). Five assays had more than 15% of the test results below the minimum detection limits. Carcinoembryonic antigen, total thyroxine and free triiodothyronine exceeded the proposed goals of ±6.3%, ±5% and ±5.7% for dilution linearity. All evaluated assays were within the proposed goals for instrument consistency. Lot-to-lot consistency results for cortisol, ferritin and total thyroxine exceeded the proposed goals of 3.3%, 11.4% and 7% at one medical decision level, while vitamin B12 exceeded the proposed goals of 5.2% and 3.8% at two decision levels. CONCLUSIONS: The Beckman Coulter DxI 800 immunoassay system meets most of these proposed goals, even though these clinically focused performance goals represent relatively stringent limits.