Analytical performance specifications for external quality assessment - definitions and descriptions.

External Quality Assurance (EQA) is vital to ensure acceptable analytical quality in medical laboratories. A key component of an EQA scheme is an analytical performance specification (APS) for each measurand that a laboratory can use to assess the extent of deviation of the obtained results from the target value. A consensus conference held in Milan in 2014 has proposed three models to set APS and these can be applied to setting APS for EQA. A goal arising from this conference is the harmonisation of EQA APS between different schemes to deliver consistent quality messages to laboratories irrespective of location and the choice of EQA provider. At this time there are wide differences in the APS used in different EQA schemes for the same measurands. Contributing factors to this variation are that the APS in different schemes are established using different criteria, applied to different types of data (e.g. single data points, multiple data points), used for different goals (e.g. improvement of analytical quality; licensing), and with the aim of eliciting different responses from participants. This paper provides recommendations from the European Federation of Laboratory Medicine (EFLM) Task and Finish Group on Performance Specifications for External Quality Assurance Schemes (TFG-APSEQA) and on clear terminology for EQA APS. The recommended terminology covers six elements required to understand APS: 1) a statement on the EQA material matrix and its commutability; 2) the method used to assign the target value; 3) the data set to which APS are applied; 4) the applicable analytical property being assessed (i.e. total error, bias, imprecision, uncertainty); 5) the rationale for the selection of the APS; and 6) the type of the Milan model(s) used to set the APS. The terminology is required for EQA participants and other interested parties to understand the meaning of meeting or not meeting APS.

A new approach to define acceptance limits for hematology in external quality assessment schemes.

BACKGROUND: A study performed in 2007 comparing the evaluation procedures used in European external quality assessment schemes (EQAS) for hemoglobin and leukocyte concentrations showed that acceptance criteria vary widely. For this reason, the Hematology working group from the European Organisation for External Quality Assurance Providers in Laboratory Medicine (EQALM) decided to perform a statistical study with the aim of establishing appropriate acceptance limits (AL) allowing harmonization between the evaluation procedures of European EQAS organizers. METHODS: Eight EQAS organizers from seven European countries provided their hematology survey results from 2010 to 2012 for red blood cells (RBC), hemoglobin, hematocrit, mean corpuscular volume (MCV), white blood cells (WBC), platelets and reticulocytes. More than 440,000 data were collected. The relation between the absolute value of the relative differences between reported EQA results and their corresponding assigned value (U-scores) was modeled by means of an adaptation of Thompson's "characteristic function". Quantile regression was used to investigate the percentiles of the U-scores for each target concentration range. For deriving AL, focus was mainly on the upper percentiles (90th, 95th and 99th). RESULTS: For RBC, hemoglobin, hematocrit and MCV, no relation was found between the U-scores and the target concentrations for any of the percentiles. For WBC, platelets and reticulocytes, a relation with the target concentrations was found and concentration-dependent ALs were determined. CONCLUSIONS: The approach enabled to determine state of the art-based ALs, that were concentration-dependent when necessary and usable by various EQA providers. It could also easily be applied to other domains.

Recommendations for the application and follow-up of quality controls in medical laboratories.

This is a translation of the paper "Recommendations for the application and follow-up of quality controls in medical biology laboratories" published in French in the journal Annales de Biologie Clinique (Recommandations pour la mise en place et le suivi des contrôles de qualité dans les laboratoires de biologie médicale. Ann Biol Clin (Paris). 2019;77:577-97.). The recommendations proposed in this document are the result of work conducted jointly by the Network of Accredited Medical Laboratories (LABAC), the French Society of Medical Biology (SFBC) and the Federation of Associations for External Quality Assessment (FAEEQ). The different steps of the implementation of quality controls, based on a risk analysis, are described. The changes of reagent or internal quality control (IQC) materials batches, the action to be taken in case of non-conform IQC results, the choice of external quality assessment (EQA) scheme and interpretation of their results as well as the new issue of analyses performed on several automatic systems available in the same laboratory are discussed. Finally, the concept of measurement uncertainty, the robustness of the methods as well as the specificities of near-patient testing and rapid tests are described. These recommendations cannot apply for all cases we can find in medical laboratories. The implementation of an objective alternative strategy, supported with documented evidence, might be equally considered.

External quality assessment program for biochemical assays of human seminal plasma: a French 6-years experience.

BACKGROUND: In 1999, despite a longstanding use, the WHO manual for the examination of human semen finally proposed to assay several biochemical components of the seminal plasma for a functional exploration of the male accessory glands. At the same time, an international effort was made to standardize laboratory tests and to increase their performance through ISO 15189 accreditation. In this setting, participation to relevant external quality assessment (EQA) schemes is an essential requirement for laboratories. To fulfil this injunction, we have organized an EQA program for seminal biochemistry using presumed commutable samples. In this study, we aimed to report an overview of the French laboratory offer, the kinds of assays used, their performance as well as their likelihood of satisfying ISO15189 requirements for EQA. RESULTS: Between 2014 and 2019, we performed seven surveys. A median of six laboratories participated to each survey giving a ratio of one laboratory per 11.2 million inhabitants. Seven biomarkers are routinely assayed but the core set shared by all laboratories comprised citrate and zinc (prostate), fructose (seminal vesicles) and α-1, 4 glucosidase (epididymis). The use of CE-IVD marked methods concerned between 0 to 75% of overall assays. According to analytical specifications, 100% of laboratories results were compliant for zinc, 75% for citrate and α-1,4 glucosidase and 67% for fructose. By combining overall data in an empirical scoring system, we identified several types of seminal biomarkers: citrate, fructose and zinc appear as good candidates for a full accreditation, α-1,4 glucosidase still presents an analytical weakness, but prostatic acid phosphatase, free L-carnitine and glycerophosphocholine cannot be accredited in the current state. CONCLUSIONS: We organized the first French EQA program for seminal biochemistry to help local laboratories to face their legal requirement to be fully accredited by 2020. It could be improved still further but it gave us an oversight on the analytic landscape. Effective methods are available for a confident biochemical exploration of prostate and seminal vesicles. However, that of epididymis appeared unexpectedly fragile. This andrological issue should be addressed by dedicated recommendations from health authorities and scientific societies.

[Recommendations for the application and the follow-up of quality controls in medical biology laboratories]. / Recommandations pour la mise en place et le suivi des contrôles de qualité dans les laboratoires de biologie médicale.

The recommendations that we formulate in this document come from LABAC, SFBC and FAEEQ. They describe the different steps from the initial application of quality controls, based on risk analysis: the changes of reagent batches or internal quality controls (IQC) batches, the course when IQC are not in accordance with references, the choice of external quality evaluation and the interpretation of its results, the comparability of results obtained in several analysers used in the same laboratory. Lastly, measurement uncertainty, robustness of methods and specificities of near-patient biology and rapid tests are described. Note that these recommendations cannot develop all cases that we could find in laboratories. It remains necessary to carry out an objective strategy, supported with documentary evidences.

Guidelines for setting up an external quality assessment scheme for blood smear interpretation. Part II: survey preparation, statistical evaluation and reporting.

Blood smear analysis is a well-known technique in medical laboratories. The clinical relevance of this analysis and its interpretation are very important. Consequently, monitoring of laboratory performance by an external quality assessment scheme is strongly recommended. This article represents a very practical guidance document for External Quality Assessment Scheme (EQAS) organizers for setting up blood smear schemes. In the first part of the guidelines, the Hematology Working Group of the European External Committee for External Quality Assurance Programmes in Laboratory Medicine (EQALM) published practical information for the preparation of blood smears for use in an EQAS. Part II focuses on aspects such as survey preparation, statistical evaluation and reporting, and describes particular details for organizing blood morphology EQA surveys by means of virtual microscopy.

Guidelines for blood smear preparation and staining procedure for setting up an external quality assessment scheme for blood smear interpretation. Part I: Control material.

Blood smear analysis is a well known technique in medical laboratories. Clinical relevance of this analysis and its interpretation are very important. Consequently, monitoring of laboratory performance by an external quality assessment scheme is strongly recommended. Most starting external quality organizers set up a scheme for clinical chemistry. Due to a lack of guidance documents, many organizers are reluctant to offer a hematology scheme. This article aims to be a very practical guidance document for external quality assessment organizers for the set up of blood smear schemes.