Retrospective cohort assessment of survival and complications of zygomatic implants in atrophic maxillae.

OBJECTIVES: To report on zygomatic implant (ZI) survival rate and associated complications through a longitudinal retrospective cohort assessment. MATERIAL AND METHODS: A total of 940 ZIs (rough: 781, machined: 159; immediate loading: 454, delayed loading: 486) and 451 standard implants (rough: 195, machined: 256; immediate loading: 58, delayed loading: 393) were placed in 302 adult patients with atrophic maxilla from December 1998 till September 2020. Following data collection reported complications were grouped based on their origin as infectious/ non-infectious biological and mechanical. Statistical analysis was performed to identify risk factors and preceding complications leading to implant loss (P < 0.05). RESULTS: The survival rate of ZI was found to be 89.9% and the average time between implant placement and an eventual loss was 4.8 years. The mean ZI follow-up period was 7.9 ± 4.9 years. Amongst the infectious biological complications, sinusitis was the most reported (n = 138) occurring at a mean follow-up time-point of 4.5 years, whereas infraorbital nerve hypoesthesia occurred more frequently in the non-infectious biological category (n = 8, meantime: 0.3 years). The prosthetic screw fracture was the most reported complication of mechanical origin (n = 29, meantime: 4 years). Furthermore, sinusitis, standard implant loss, zygomatic/peri-zygomatic region infection, and oroantral communication were significantly associated with ZI loss. CONCLUSIONS: ZI placement offered a high survival rate for the rehabilitation of severely atrophied maxilla with most losses occurring within the first 5 years at follow-up. The most frequently observed complication was sinusitis which tends to develop several years following implant placement.

Analytical performance of eight enzymatic assays for ethanol in serum evaluated by data from the Belgian external quality assessment scheme.

OBJECTIVES: Fast and reliable ethanol assays analysis are used in a clinical context for patients suspected of ethanol intoxication. Mostly, automated systems using an enzymatic reaction based on ethanol dehydrogenase are used. The manuscript focusses on the evaluation of the performance of these assays. METHODS: Data included 30 serum samples used in the Belgian EQA scheme from 2019 to 2021 and concentrations ranged from 0.13 to 3.70 g/L. A regression line between target concentrations and reported values was calculated to evaluate outliers, bias, variability and measurement uncertainty. RESULTS: A total of 1,611 results were taken into account. Bias was the highest for Alinity c over the whole concentration range and the lowest for Vitros for low concentrations and Cobas 8000 using the c702 module for high concentrations. The Architect and Cobas c501/c502 systems showed the lowest variability over the whole concentration range. Highest variability was observed for Cobas 8000 using the 702 module, Thermo Scientific and Alinity c. Cobas 8000 using the c702 module showed the highest measurement uncertainty for lower concentrations. For higher concentrations, Alinity c, Thermo Scientific and Vitros were the methods with the highest measurement uncertainty. CONCLUSIONS: The bias of the enzymatic techniques is nearly negligible for all methods except Alinity c. Variability differs strongly between measurement procedures. This study shows that the Alinity c has a worse measurement uncertainty than other systems for concentrations above 0.5 g/L. Overall, we found the differences in measurement uncertainty to be mainly influenced by the differences in variability.

External quality assessment providers' services appear to more impact the immunohaematology performance of laboratories than national regulatory and economic conditions.

OBJECTIVES: Medical laboratories may, at their own discretion, exceed but not undercut regulatory quality requirements. Available economic resources, however, may drive or hinder eagerness to exceed minimum requirements. Depending on the respective scopes of regulatory and economic framework conditions, differing levels of quality efforts to safeguard laboratory performance can be anticipated. However, this has not yet been investigated. METHODS: Immunohaematology external quality assessment (EQA) results collected by 26 EQA providers from their participant laboratories in 73 countries from 2004 to 2019 were evaluated. Error rates were aggregated in groups according to the respective national regulatory and economic framework conditions, to whether or not expert advice was provided in case of incorrect results, and the frequency of EQA samples. RESULTS: These representative data indicate no association between national regulatory (mandatory participation in EQA, monitoring of performance of individual laboratories by authorities, financial consequences of incorrect results) and economic (level of national income, share of national health expenditure) conditions to the quality performance of medical laboratories in immunohaematology. However, EQA providers' support for laboratories in the event of incorrect results appear to be associated with lower error rates, but a high EQA sample frequency with higher error rates. CONCLUSIONS: Further research into the impact of introducing or changing services of EQA providers is needed to confirm the results found in this first of its kind study.

A framework for evaluating the frequency of external quality assessment challenges.

BACKGROUND AND AIMS: No clear rules about the optimal frequency of organizing External Quality Assessment (EQA) rounds exist. More frequent challenges will facilitate faster responses and more reliable statistics. Adding extra samples leads to extra information, but the correlation between results from different samples reduces the extra information from additional samples. MATERIALS AND METHODS: Data were used for ALT and Albumin from the RCPAQAP EQA scheme. Every two weeks, laboratories analysed two samples. Correlation between results of different samples was calculated to determine the power of distinguishing poorly from well-performing laboratories. The power was compared to hypothetical cases of no correlation and one-sample-per-week to estimate the number of samples negated due to correlation. RESULTS: Correlation leads to negation of a number of samples, but not more than 50% of samples were negated. The number of negated samples was positively related with the correlation between EQA results. CONCLUSIONS: The proposed framework provides a quantitative evaluation of the impact of adding more EQA rounds or samples. A correlation exists and is higher for analyses performed closer in time, but the examples shown here did not show a detrimental effect on correctly evaluating laboratories.

Frequency of Participation in External Quality Assessment Programs Focused on Rare Diseases: Belgian Guidelines for Human Genetics Centers.

BACKGROUND: Participation in quality controls, also called external quality assessment (EQA) schemes, is required for the ISO15189 accreditation of the Medical Centers of Human Genetics. However, directives on the minimal frequency of participation in genetic quality control schemes are lacking or too heterogeneous, with a possible impact on health care quality. OBJECTIVE: The aim of this project is to develop Belgian guidelines on the frequency of participation in quality controls for genetic testing in the context of rare diseases. METHODS: A group of experts analyzed 90 EQA schemes offered by accredited providers and focused on analyses used for the diagnosis of rare diseases. On that basis, the experts developed practical recommendations about the minimal frequencies of participation of the Medical Centers of Human Genetics in quality controls and how to deal with poor performances and change management. These guidelines were submitted to the Belgian Accreditation Body and then reviewed and approved by the Belgian College of Human Genetics and Rare Diseases and by the National Institute for Health and Disability Insurance. RESULTS: The guidelines offer a decisional algorithm for the minimal frequency of participation in human genetics EQA schemes. This algorithm has been developed taking into account the scopes of the EQA schemes, the levels of experience, and the annual volumes of the Centers of Human Genetics in the performance of the tests considered. They include three key principles: (1) the recommended annual assessment of all genetic techniques and technological platforms, if possible through EQAs covering the technique, genotyping, and clinical interpretation; (2) the triennial assessment of the genotyping and interpretation of specific germline mutations and pharmacogenomics analyses; and (3) the documentation of actions undertaken in the case of poor performances and the participation to quality control the following year. The use of a Bayesian statistical model has been proposed to help the Centers of Human Genetics to determine the theoretical number of tests that should be annually performed to achieve a certain threshold of performance (eg, a maximal error rate of 1%). Besides, the guidelines insist on the role and responsibility of the national public health authorities in the follow-up of the quality of analyses performed by the Medical Centers of Human Genetics and in demonstrating the cost-effectiveness and rationalization of participation frequency in these quality controls. CONCLUSIONS: These guidelines have been developed based on the analysis of a large panel of EQA schemes and data collected from the Belgian Medical Centers of Human Genetics. They are applicable to other countries and will facilitate and improve the quality management and financing systems of the Medical Centers of Human Genetics.

Belgian rare diseases plan in clinical pathology: identification of key biochemical diagnostic tests and establishment of reference laboratories and financing conditions.

BACKGROUND: One objective of the Belgian Rare Diseases plan is to improve patients' management using phenotypic tests and, more specifically, the access to those tests by identifying the biochemical analyses used for rare diseases, developing new financing conditions and establishing reference laboratories. METHODS: A feasibility study was performed from May 2015 until August 2016 in order to select the financeable biochemical analyses, and, among them, those that should be performed by reference laboratories. This selection was based on an inventory of analyses used for rare diseases and a survey addressed to the Belgian laboratories of clinical pathology (investigating the annual analytical costs, volumes, turnaround times and the tests unavailable in Belgium and outsourced abroad). A proposal of financeable analyses, financing modalities, reference laboratories' scope and budget estimation was developed and submitted to the Belgian healthcare authorities. After its approval in December 2016, the implementation phase took place from January 2017 until December 2019. RESULTS: In 2019, new reimbursement conditions have been published for 46 analyses and eighteen reference laboratories have been recognized. Collaborations have also been developed with 5 foreign laboratories in order to organize the outsourcing and financing of 9 analyses unavailable in Belgium. CONCLUSIONS: In the context of clinical pathology and rare diseases, this initiative enabled to identify unreimbursed analyses and to meet the most crucial financial needs. It also contributed to improve patients' management by establishing Belgian reference laboratories and foreign referral laboratories for highly-specific analyses and a permanent surveillance, quality and financing framework for those tests.

NGS for (Hemato-) Oncology in Belgium: Evaluation of Laboratory Performance and Feasibility of a National External Quality Assessment Program.

Next-generation sequencing (NGS) is being integrated into routine clinical practice in the field of (hemato-) oncology to search for variants with diagnostic, prognostic, or therapeutic value at potentially low allelic frequencies. The complex sequencing workflows used require careful validation and continuous quality control. Participation in external quality assessments (EQA) helps laboratories evaluate their performance and guarantee the validity of tests results with the ultimate goal of ensuring high-quality patient care. Here, we describe three benchmarking trials performed during the period 2017-2018 aiming firstly at establishing the state-of-the-art and secondly setting up a NGS-specific EQA program at the national level in the field of clinical (hemato-) oncology in Belgium. DNA samples derived from cell line mixes and artificially mutated cell lines, designed to carry variants of clinical relevance occurring in solid tumors, hematological malignancies, and BRCA1/BRCA2 genes, were sent to Belgian human genetics, anatomic pathology, and clinical biology laboratories, to be processed following routine practices, together with surveys covering technical aspects of the NGS workflows. Despite the wide variety of platforms and workflows currently applied in routine clinical practice, performance was satisfactory, since participating laboratories identified the targeted variants with success rates ranging between 93.06% and 97.63% depending on the benchmark, and few false negative or repeatability issues were identified. However, variant reporting and interpretation varied, underlining the need for further standardization. Our approach showcases the feasibility of developing and implementing EQA for routine clinical practice in the field of (hemato-) oncology, while highlighting the challenges faced.

A critical view at the ISO 13528 and IUPAC's harmonized protocol approach for proficiency testing for homogeneity assessment for quantitative variables.

To ensure a correct interpretation of Proficiency Testing (PT) or External Quality Assessment (EQA) results, sample batches need to be homogeneous. The importance of homogeneity testing has been underlined by ISO 13528 and the IUPAC harmonized protocol for proficiency testing. They require that the batch heterogeneity should be smaller than 0.3σpt, with σpt the standard deviation for proficiency assessment according to ISO/IEC 17043:2010 and provide procedures for assessing the batch heterogeneity. In this study, a critical appraisal of these procedures is given. Firstly, an assessment is made of the influence of the criterion of 0.3σpt on laboratory evaluation. Secondly, the assessment procedure of the batch heterogeneity is evaluated, with an emphasis on the calculation and the evaluation of the measured batch standard deviation. It was found that the 0.3σpt criterion may be loosened without a detrimental effect on laboratory evaluation. In addition, it was shown that a flaw in the calculation procedure forces the batch standard deviation to be 0 with a probability of 21.4% for batch standard deviations of 0.3σpt and repeatability of 0.5σpt. The hypothesis test for accepting a batch exhibits a high probability of accepting the batch, even for batch standard deviations that are a multiple of 0.3σpt. To conclude, this study shows that the criteria for homogeneity check of PT items by ISO 13528 and the IUPAC protocol do not assure batch homogeneity. They may be a combination of a criterion that is too strict and a permissive assessment. Alternative assessment procedures should be followed.

To Win the Battle, First Know Your Enemy: Error Rates in Immunohematology External Quality Assessment Results.

BACKGROUND: As some errors in pretransfusion testing remain unrecognized, error rates and the resulting need for corrective measures are probably underestimated. External quality assessment (EQA) schemes could provide valuable input for identifying error-prone laboratory tests because they are designed to monitor test performance and errors. So far, however, there are only limited published data on error rates in such schemes. METHODS: The types and incidence of incorrect results in an EQA scheme for red cell immunohematology with 187 participating laboratories were examined. The results of 58 distributions between 1999 and 2017 were evaluated, considering also the employed determination methods. RESULTS: Out of a total of 58,726 results, 563 (0.96%) were incorrect. Error rates were 5.45% for antibody identification, 1.39% for Rh phenotyping, 0.83% for serologic cross-match, 0.60% for direct antiglobulin test, 0.20% for Kell phenotyping, 0.16% for antibody screening, and 0.14% for ABO phenotyping. During the observation period, 53 participants reported error-free results, while 37 reported one incorrect result and 97 repeatedly reported incorrect results for one or more analytes. Error rates obtained by manual methods significantly surpassed those obtained by automated methods (1.04 vs. 0.42%). The introduction of double testing with two different systems reduced error rates in Rh phenotyping from 1.55 to 0.50%. CONCLUSION: Risk assessment should consider that error rates in pretransfusion test results vary. These data delineate the error risk potential of individual laboratory tests and thus should aid in tailoring appropriate improvement measures.

Evidence for the positive impact of ISO 9001 and ISO 15189 quality systems on laboratory performance - evaluation of immunohaematology external quality assessment results during 19 years in Austria.

Background ISO 9001 and ISO 15189 have been established as continuative models for quality systems beyond national laws, mandatory standards and guidelines of expert associations regarding analytical and organisational performance of medical laboratories and transfusion services. Although widely used, their impact on laboratory performance has not been investigated. Methods We retrospectively analysed the results of 167 laboratories in 59 distributions of the Austrian red cell immunohaematology external quality assessment (EQA) scheme in the years 1999-2017. The performance for each parameter and trends of individual participants were compared with respect to certification or accreditation status of participants' quality systems and to laboratory type. Results Considering more than 52,000 EQA results, the absence or presence of a laboratory quality management system showed different error rates. Laboratories with ISO 9001 or ISO 15189 certification/accreditation had 0.7% incorrect results, while this rate was doubled without such quality systems (1.4%, p=0.0002). Statistically significant error reductions were seen upon ISO 9001/ISO 15189 implementation (1.3% before vs. 0.7% after; p=0.0468). Transfusion services had fewer errors (0.9%) compared to hospital and independent laboratories (both 1.2%). Conclusions Implementation and maintenance of quality systems according to ISO 9001 or ISO 15189 as well as laboratory specialisation result in better analytical performance as can be seen in immunohaematology EQA results. The conclusion is that these results apply to other laboratory tests and perhaps to other areas of health care.

A new approach to define acceptance limits for hematology in external quality assessment schemes.

BACKGROUND: A study performed in 2007 comparing the evaluation procedures used in European external quality assessment schemes (EQAS) for hemoglobin and leukocyte concentrations showed that acceptance criteria vary widely. For this reason, the Hematology working group from the European Organisation for External Quality Assurance Providers in Laboratory Medicine (EQALM) decided to perform a statistical study with the aim of establishing appropriate acceptance limits (AL) allowing harmonization between the evaluation procedures of European EQAS organizers. METHODS: Eight EQAS organizers from seven European countries provided their hematology survey results from 2010 to 2012 for red blood cells (RBC), hemoglobin, hematocrit, mean corpuscular volume (MCV), white blood cells (WBC), platelets and reticulocytes. More than 440,000 data were collected. The relation between the absolute value of the relative differences between reported EQA results and their corresponding assigned value (U-scores) was modeled by means of an adaptation of Thompson's "characteristic function". Quantile regression was used to investigate the percentiles of the U-scores for each target concentration range. For deriving AL, focus was mainly on the upper percentiles (90th, 95th and 99th). RESULTS: For RBC, hemoglobin, hematocrit and MCV, no relation was found between the U-scores and the target concentrations for any of the percentiles. For WBC, platelets and reticulocytes, a relation with the target concentrations was found and concentration-dependent ALs were determined. CONCLUSIONS: The approach enabled to determine state of the art-based ALs, that were concentration-dependent when necessary and usable by various EQA providers. It could also easily be applied to other domains.

Application of the characteristic function to evaluate and compare analytical variability in an external quality assessment scheme for serum ethanol.

BACKGROUND: As a cornerstone of quality management in the laboratory, External Quality Assessment (EQA) schemes are used to assess laboratory and analytical method performance. The characteristic function is used to describe the relation between the target concentration and the EQA standard deviation, which is an essential part of the evaluation process. The characteristic function is also used to compare the variability of different analytical methods. METHODS: We fitted the characteristic function to data from the Belgian External Quality Assessment program for serum ethanol. Data included results from headspace gas chromatography and the enzymatic methods of Abbott, Roche, Siemens, and Ortho-Clinical Diagnostics. We estimated the characteristic function with weighted nonlinear regression. By introducing dummy variables, we rewrote the original formula of the characteristic function to assess statistical inference for comparing the variability of the different analytical methods. RESULTS: The characteristic function fitted the data precisely. Comparison between methods showed that there was little difference between the estimated variability for low concentrations, and that the increase in SD with increasing target concentration was slower for Abbott and Roche than for the other methods. CONCLUSIONS: The characteristic function can successfully be introduced in clinical schemes, although its applicability to fit the data should always be assessed. Because of its easy parameterization, it can be used to assess differences in performance between analytical methods and to assess laboratory performance. The characteristic function also offers an alternative framework for coefficients of variation to describe variability of analytical methods.

Comparison of different approaches to evaluate External Quality Assessment Data.

In EQA programs, Z-scores are used to evaluate laboratory performance. They should indicate poorly performing laboratories, regardless of the presence of outliers. For this, two different types of approaches exist. The first type are "outlier-based" approaches, which first exclude outlying values, calculate the average and standard deviation on the remaining data and obtain Z-scores for all values (e.g., Grubbs and Dixon). The second type includes the "robust" approaches (e.g., Tukey and Qn or the algorithm recommended by ISO). The different approaches were assessed by randomly generated samples from the Normal and Student t distributions. Part of the sample data were contaminated with outliers. The number of false and true outliers was recorded and subsequently, Positive and Negative Predictive Values were derived. Also, the sampling mean and variability were calculated for location and scale estimators. The various approaches performed similarly for sample sizes above 10 and when outliers were at good distance from the centre. For smaller sample sizes and closer outliers, however, the approaches performed quite differently. Tukey's method was characterised by a high true and a high false outlier rate, while the ISO and Qn approaches demonstrated weak performance. Grubbs test yielded overall the best results.

A new statistical method for evaluating long-term analytical performance of laboratories applied to an external quality assessment scheme for flow cytometry.

BACKGROUND: The Belgian External Quality Assessment Scheme for Flow Cytometry evaluates the long-term analytical performance of participating laboratories by calculating a regression line between the target and reported values of each parameter for each laboratory during the past 3 years. This study aims to develop a method to find laboratories with aberrant variability or bias using robust techniques and to obtain robust estimates of the variability. METHODS: A method is proposed to find outliers with respect to the individual regression line, followed by a step to find regression lines with excessive variability and finally a step to find regression lines with high bias. RESULTS: The model was applied to the results obtained by 52 laboratories for CD4%. From the 1340 data points, 35 were determined to be regression outliers. The second step revealed one regression line with excessive variability; the third step detected three regression lines with exceeding bias. CONCLUSIONS: The methodology allows assessment of the long-term performance of laboratories, taking into account samples with different target values. Outliers in the first step indicate accidental mistakes, outliers in the second and third step point to high analytical variability or bias.

Current practices in antinuclear antibody testing: results from the Belgian External Quality Assessment Scheme.

BACKGROUND: This study aimed to assess the state-of-the-art of antinuclear antibody (ANA) testing as practiced in the Belgian and Luxembourg laboratories, using the results obtained in the Belgian National External Quality Assessment Scheme from 2000 to 2005. METHODS: During this period, nine samples with different specificities were sent for analysis. Participants were surveyed for methodology used and were asked to report staining pattern and titer of ANAs. In 2002, an attempt was made to improve the comparability of quantitative ANA results by the provision of a commercial reference material and to relate observed differences to methodology. RESULTS: With one exception, all participants employed a microscope-based indirect immunofluorescence assay with human epithelial cell line 2 cells. Most laboratories were accurate in describing the pattern. The percentage of unacceptable answers was greater for samples with borderline levels of antibody and for samples showing a cytoplasmic pattern. An improvement in the detection of anticentromere antibodies was observed. For all samples, a wide range of titers was reported. The provision of the secondary reference preparation led to improved inter-laboratory concordance. Comparison of methodology variables revealed a correlation between unstandardized titers and the power of the lamp of the microscope and the use of a dark room. CONCLUSIONS: The EQAS results presented in this work provide valuable insights into the state of the art of ANA testing as practiced in the Belgian and Luxembourg Laboratories and illustrate the important value of a national EQAS for ANA testing as a tool to improve performance and interlaboratory comparability of laboratory results.

Accuracy and reproducibility of automated estradiol-17beta and progesterone assays using native serum samples: results obtained in the Belgian external assessment scheme.

BACKGROUND: In 2005, a special survey in the Belgian External Quality Assessment focused on the performance of six automated immunoassay analysers most frequently used in Belgium for estradiol-17beta (E(2)) and progesterone. Results obtained were compared with values determined by reference method, isotope dilution-gas chromatograph/mass spectrometry (ID-GC/MS). METHODS: Five fresh frozen serum samples, without additives, from single donors and three pools from pregnant women were distributed to all registered Belgian laboratories. Total variation, bias, linear relationship within the reported range and linear regression were investigated. RESULTS: Inter-laboratory coefficients of variation ranged from 4 to 49% for E(2) and from 6 to 45% for progesterone. Bias ranged from -26 to 239% for E(2) and from -23 to 81% for progesterone. Several systems showed an upward bias for one particular sample of at least 25%. Weighted linear regression showed overall bias ranging from -8% to 32% for E(2) and from 7% to 41% for progesterone. CONCLUSIONS: Few automated methods succeed in having an excellent reproducibility for E(2) and progesterone. Given the high bias values it is suggested that, for performance testing, results be compared whenever possible with a reference method. The linear relationship as assessed by comparing results with those obtained by ID-GC/MS using samples from different donors was not assured for most methods.