RESUMO
Proficiency Testing (PT) External Quality Assessment (EQA) schemes are designed to ascertain the ability of individual laboratories to perform satisfactorily with respect to their peer laboratories or to limits imposed by external sources. Observed deviation of a laboratory result for a PT sample must be entirely attributed to the laboratory and not to the PT provider. To minimize the probability that deviations could be attributed to the PT provider, sample homogeneity should be assured. It is generally required that for quantitative parameters, the standard deviation among PT units should be calculated on the basis of duplicate measurements of at least 10 samples chosen at random, and the standard deviation among PT units should not exceed 0.3 times the standard deviation used to evaluate laboratories. Because this approach has important drawbacks, an alternative procedure is proposed by applying the theory of acceptance sampling to the assessment of sample heterogeneity for both quantitative and qualitative data and deriving acceptance limits on the basis of minimizing the probability of falsely evaluating laboratories. For obtaining acceptance limits for quantitative parameters, a distinction is made between laboratory evaluation using fixed limits on the one hand and laboratory evaluation using limits that are based on the variability of the reported results on the other hand. Sequential tests are proposed to evaluate sample heterogeneity by means of a comparison with the χ2 distribution. For qualitative parameters, acceptance-sampling plans are proposed that are based on minimizing the joint probability of rejecting batches that have a satisfactory amount of defective samples and accepting batches unnecessarily. The approach for quantitative parameters is applied on samples for a PT scheme of ethanol quantification and for qualitative parameters on the presence of monoblasts in a blood smear. It was found that five samples could already be enough to prove that the batch was homogeneous for quantitative parameters, although more than 20 samples were needed to prove homogeneity for qualitative parameters. This study describes a direct relation among the objective of an PT round, the criteria for evaluating the results, and the sample heterogeneity. When samples are effectively homogeneous, less measurements are needed than current practices require. A drawback of the proposed approach is that the number of samples to be tested is not known beforehand, and good knowledge of the analytical variability is crucial. The formulas to be applied are relatively simple. Despite the drawbacks, the proposed approach is generally applicable for both quantitative and qualitative data.
RESUMO
BACKGROUND: Harmonization of units is an important step to improve the comparability of clinical chemistry results, but few examples exist of successful harmonization efforts. We present the results of a pragmatic approach that was implemented in Belgium from 2012. METHODS: After a large consultation and information of stakeholders, preferred units were proposed for 140 assays, including the 23 immunoassays discussed in more detail here. The change occurred in two phases, first involving assays for which there was no change in the numerical result, then changes involving a change in numerical results. Laboratories were invited to participate in this harmonization on a voluntary basis. The project was based on a bottom-up approach, large consultation and the pragmatic choice of the proposed units, including conventional and SI units. RESULTS: The large heterogeneity of units was drastically reduced; adoption of the preferred units increased from 3% (insulin) - 45% (HCG) to 70% (insulin) - 96% (LH and FSH). Adoption of the preferred units was higher if it involved no change in numerical values (90%) than when there was a change (76%). CONCLUSIONS: We believe that the harmonization effort has reached its goals. Without aiming at implementing SI units for all parameters, our strategy was successful with a large majority of the laboratories switching to the proposed units. Moreover, the harmonization program is still progressing, with additional laboratories converting to the consensus units.