Allergy: Evaluation of 16 years (2007-2022) results of the shared external quality assessment program in Belgium, Finland, Portugal and The Netherlands.

OBJECTIVES: This paper evaluates 16 year results of the Allergy EQA program shared by EQA organisers in Belgium, Finland, Portugal, and The Netherlands. METHODS: The performance of Thermo Fisher and Siemens user groups (in terms of concordance between both groups, between laboratory CV, prevalence of clinically significant errors) and suitability of samples (stability and validity of dilution of patient samples) are evaluated using data of 192 samples in the EQA programs from 2007 to 2022. Measurands covered are total IgE, screens and mixes, specific IgE extracts and allergen components. RESULTS: There is perfect (53 %), acceptable (40 %) and poor (6 %) concordance between both method groups. In case of poor concordance the best fit with clinical data is seen for Thermo Fisher (56 %) and Siemens (26 %) respectively. The between laboratory CV evolves from 7.8 to 6.6 % (Thermo Fisher) and 7.3 to 7.7 % (Siemens). The prevalence of blunders by individual laboratories is stable for Siemens (0.4 %) and drops from 0.4 to 0.2 % for Thermo Fisher users. For IgE, the between year CV of the mean of both user groups is 1 %, and a fifteen-fold dilution of a patient sample has an impact of 2 and 4 % on the recovery of Thermo Fisher and Siemens user groups. CONCLUSIONS: The analytical performance of Thermo Fisher is slightly better than that of Siemens users but the clinical impact of this difference is limited. Stability of the sample and the low impact of dilution on the recovery of measurands demonstrates the suitability for purpose of the EQA program.

Feasibility for aggregation of commutable external quality assessment results to evaluate metrological traceability and agreement among results.

Objectives: External quality assessment (EQA) with commutable samples is used for assessing agreement of results for patients' samples. We investigated the feasibility to aggregate results from four different EQA schemes to determine the bias between different measurement procedures and a reference target value. Methods: We aggregated EQA results for creatinine from programs that used commutable EQA material by calculating the relative difference between individual participant results and the reference target value for each sample. The means and standard errors of the means were calculated for the relative differences. Results were partitioned by methods, manufacturers and instrument platforms to evaluate the biases for the measurement procedures. Results: Data aggregated for enzymatic methods had biases that varied from -8.2 to 3.8% among seven instrument platforms for creatinine at normal concentrations (61-85 µmol/L). EQA schemes differed in the evidence provided about the commutability of their samples, and in the amount of detail collected from participants regarding the measurement procedures which limited the ability to sub-divide aggregated data by instrument platforms and models. Conclusions: EQA data could be aggregated from four different programs using different commutable samples to determine bias among different measurement procedures. Criteria for commutability for EQA samples as well as standardization of reporting the measurement methods, reagents, instrument platforms and models used by participants are needed to improve the ability to aggregate the results for optimal assessment of performance of measurement procedures. Aggregating data from a larger number of EQA schemes is feasible to assess trueness on a global scale.

External quality assessment schemes for inorganic elements in the clinical laboratory: Lessons from the OELM scheme.

Measurements of inorganic elements in clinical laboratories produce results used for the diagnosis, the treatment and the monitoring of deficiencies or overloads. The main objective of External Quality Assessment Schemes is to verify, on a regular frequency, that clinical laboratory results correspond to the quality requirement for patient care. Therefore, External Quality Assessment Schemes represent an essential component of a laboratory's quality management system. However, External Quality Assessment Schemes within the same analytical field remain heterogeneous for different reasons such as samples, determination of assigned value, acceptable limits, content of the reports. The aim of this review was to describe and illustrate some major critical aspects of External Quality Assessment Schemes based on Occupational and Environmental Laboratory Medicine external quality assessment scheme experience.

Diagnostic performance of serological assays for anti-HBs testing: Results from a quality assessment program.

BACKGROUND: Post-vaccination testing after hepatitis B vaccination is indispensable to evaluate long-term immunological protection. Using a threshold level of antibodies against hepatitis B surface antigen (anti-HBs) to define serological protection, implies reproducible and valid measurements of different diagnostic assays. OBJECTIVES: In this study we assess the performance of currently used anti-HBs assays. STUDY DESIGN: In 2013, 45 laboratories participated in an external quality assessment program using pooled anti-HBs serum samples around the cutoff values 10IU/l and 100IU/l. Laboratories used either Axsym (Abbott Laboratories), Architect (Abbott Laboratories), Access (Beckman-Coulter), ADVIA Centaur anti-HBs2 (Siemens Healthcare Diagnostics), Elecsys, Modular or Cobas (Roche Diagnostics) or Vidas Total Quick (Biomerieux) for anti-HBs titre quantification. We analysed covariance using mixed-model repeated measures. To assess sensitivity/specificity and agreement, a true positive or true negative result was defined as an anti-HBs titre respectively above or below the cutoff value by ≥4 of 6 assays. RESULTS: Different anti-HBs assays were associated with statistically significant (P<0.05) differences in anti-HBs titres in all dilutions. Sensitivity and specificity ranged respectively from 64%-100% and 95%-100%. Agreement between assays around an anti-HBs titre cutoff value of 10IU/l ranged from 93%-100% and was 44% for a cutoff value of 100IU/l. CONCLUSIONS: Around a cutoff value of 10IU/l use of the Access assay may result in false-negative results. Concerning the cutoff value of 100IU/l, a sample being classified below or above this cutoff relied heavily on the specific assay used, with both the Architect and the Access resulting in false-negative results.

External Quality Assessment Scheme for reference laboratories - review of 8 years' experience.

We describe an External Quality Assessment Scheme (EQAS) intended for reference (calibration) laboratories in laboratory medicine and supervised by the Scientific Division of the International Federation of Clinical Chemistry and Laboratory Medicine and the responsible Committee on Traceability in Laboratory Medicine. The official EQAS website, RELA (www.dgkl-rfb.de:81), is open to interested parties. Information on all requirements for participation and results of surveys are published annually. As an additional feature, the identity of every participant in relation to the respective results is disclosed. The results of various groups of measurands (metabolites and substrates, enzymes, electrolytes, glycated hemoglobins, proteins, hormones, thyroid hormones, therapeutic drugs) are discussed in detail. The RELA system supports reference measurement laboratories preparing for accreditation according to ISO 17025 and ISO 15195. Participation in a scheme such as RELA is one of the requirements for listing of the services of a calibration laboratory by the Joint Committee on Traceability in Laboratory Medicine.

Proficiency testing/external quality assessment: current challenges and future directions.

BACKGROUND: Proficiency testing (PT), or external quality assessment (EQA), is intended to verify on a recurring basis that laboratory results conform to expectations for the quality required for patient care. CONTENT: Key factors for interpreting PT/EQA results are knowledge of the commutability of the samples used and the process used for target value assignment. A commutable PT/EQA sample demonstrates the same numeric relationship between different measurement procedures as that expected for patients' samples. Noncommutable PT/EQA samples frequently have a matrix-related bias of unknown magnitude that limits interpretation of results. PT/EQA results for commutable samples can be used to assess accuracy against a reference measurement procedure or a designated comparison method. In addition, the agreement of the results between different measurement procedures for commutable samples reflects that which would be seen for patients' samples. PT/EQA results for noncommutable samples must be compared to a peer group mean/median of results from participants who use measurement procedures that are expected to have the same or very similar matrix-related bias. Peer group evaluation is used to asses whether a laboratory is using a measurement procedure in conformance to the manufacturer's specifications and/or in conformance to other laboratories using the same technology. A noncommutable PT/EQA sample does not give meaningful information about the relationship of results for patients' samples between different measurement procedures. SUMMARY: PT/EQA provides substantial value to the practice of laboratory medicine by assessing the performance of individual laboratories and, when commutable samples are used, the status of standardization or harmonization among different measurement procedures.

Trueness verification and traceability assessment of results from commercial systems for measurement of six enzyme activities in serum: an international study in the EC4 framework of the Calibration 2000 project.

BACKGROUND: The in vitro diagnostics directive of the European Union requires traceability to higher order reference measurement procedures and materials for analytes in assuring the result trueness and comparability of laboratory measurements. Manufacturers must ensure that the systems they market are calibrated against available reference systems. Validation of metrologically traceable calibrations is, however, required. METHODS: A commutable serum-based material was analyzed in three reference laboratories and target values for six enzymes (ALT, AST, CK, GGT, LD, amylase) were assigned using IFCC reference measurement procedures. 70 laboratories in Germany, Italy, and The Netherlands measured the same enzymes in the material using procedures from six commercial companies. A system for maximum allowable error was developed from the biological variation model and the results of the various procedures were tested on their compliance to trueness and between-laboratory and within-laboratory variations relative to the maximum allowable. RESULTS: For ALT results were relatively good. >95% of laboratories using systems from Dade, Olympus, Ortho and Roche are expected to comply traceability within the biologically derived limits, and 94% respectively 89% from Abbott and Beckman. For AST and GGT only Dade respectively Olympus fully complied. For CK all companies showed significant bias. Nevertheless >95% of laboratories applying Abbott, Beckman and Roche systems will comply. Finally, LD and amylase measurements require significant improvement. Some manufacturers continue to sell on the European market assays giving results which are not traceable to the internationally accepted reference systems. CONCLUSIONS: The traceability of enzyme measurements obtained with routine procedures to internationally accepted IFCC reference systems is not yet satisfactorily accomplished in clinical practice.

External Quality Assessment in The Netherlands: time to introduce commutable survey specimens. Lessons from the Dutch "Calibration 2000" project.

The performance of suitable secondary reference material for the use of trueness control of six routinely measured clinical enzymes in the Dutch External Quality Assessment (EQA) scheme is described. The reference material of choice was selected using the split-patient-sample between-field method (twin study) design as described in an earlier study of the Calibration 2000 project in The Netherlands. This material, which was proven to be commutable for all wet chemistry systems, was implemented as the national enzyme calibrator. It consisted of a cryo-protected lyophilised serum with additions of recombinant human enzymes. Various batches of the frozen version of this material without cryo-protection additive, called native EQA samples, were used in the general EQA scheme for performance evaluation. The results of Calibration 2000 calibrated and non-Calibration 2000 calibrated laboratories were compared for both the regular (spiked with non-human enzymes) and native EQA samples in terms of precision and bias with established reference method values for the native samples. The regular samples showed mean between-laboratory CV ranges for all six enzymes involved (low-high) of 5.5-10.3% for the non-calibrated users vs. 4.6-10.8% for the calibrated users. For the native samples these respective ranges were 5.2-9.9% vs. 2.2-4.9%. Without exception, the group of Calibration 2000 calibrated users showed the lowest bias against the reference method values. Regular EQA samples (spiked with non-human enzymes) showed poorer performance than native samples and are not suitable for accuracy assessment purposes, the main aim of EQA schemes. Native samples that are commutable should be used for trueness control in current EQA schemes.

Comparison of procedures for evaluating laboratory performance in external quality assessment schemes for lead in blood and aluminum in serum demonstrates the need for common quality specifications.

BACKGROUND: The different scoring methods used by eight European External Quality Assessment Schemes (EQASs) for occupational and environmental laboratory medicine were compared to develop suitable quality specifications as a step toward harmonization. METHODS: Real results for blood lead and serum aluminum assays, reported by participants in Italian and United Kingdom EQASs, were evaluated according to individual scheme scoring criteria. The same results were then used to produce z scores using scheme-based between-laboratory SDs as the estimate of variability to determine whether simple performance-derived quality specifications produced better agreement among schemes. RESULTS: The schemes gave conflicting assessments of participants' performance, and participants judged to be successful by one scheme could be defined as performing inadequately by another. An approach proposed by Kenny et al. (Scand J Clin Lab Invest 1999;59:585), which uses clinical inputs to set targets for analytical imprecision, bias, and total error allowable, was then used to elaborate quality specifications. CONCLUSIONS: We suggest that the CLIA '88 recommendations for blood lead (+/- 40 micro g/L or +/- 10% of the target concentration, whichever is the greater) could be used as a quality specification, although a revision to +/- 30 micro g/L or +/- 10% is recommended. For serum aluminum, a suitable quality specification of +/- 5 micro g/L or +/- 20% of the target concentration, whichever is the greater, is suggested. These specifications may be used to compare laboratory performance across schemes.

Commutability assessment of potential reference materials using a multicenter split-patient-sample between-field-methods (twin-study) design: study within the framework of the Dutch project "Calibration 2000".

BACKGROUND: The Dutch project "Calibration 2000" aims at harmonization of laboratory results via calibration by development of commutable, matrix-based, secondary reference materials. An alternative approach to the NCCLS EP14 protocol for studying commutability of reference materials is presented, the "twin-study design", which in essence is a multicenter, split-patient-sample, between-field-methods protocol. METHODS: The study consisted of the simultaneous analysis of fresh patient sera and potential reference materials (PRMs) for HDL-cholesterol (HDL-C) by 86 laboratories forming 43 laboratory couples. Six subgroups of method combinations were formed. The patient sera were selected and interchanged by each laboratory couple. The PRMs consisted of three types: C37, prepared according to the NCCLS C37 protocol; Fro, frozen selectively pooled human serum; and Lyo, which was the same serum pool as Fro but lyophilized in the presence of sucrose. All PRMs were provided in three HDL-C concentrations. The regression line residuals for the PRMs were normalized by expressing them as multiples of the state-of-the-art within laboratory SD (SD(SA)). In addition, the extra contribution of each PRM to the total measurement uncertainty, CV(Netto), was calculated. RESULTS: Averaged over the three PRM concentrations, 1.6% of the C37 residuals were outside the 3 SD(SA) limit. For the Fro and Lyo PRMs, these values were 2.4% and 11.1%. CV(Netto) values for C37, Fro, and Lyo were 2.9%, 4.3%, and 5.3%, respectively. CONCLUSIONS: The present twin-study design, as a practical alternative to the NCCLS EP14 protocol, is a viable way of studying commutability characteristics of PRMs. The study suggests that the C37 PRMs are the best candidates for a future reference material.