Reaching consensus on communication of critical laboratory results using a collective intelligence method.

BACKGROUND: There is no consensus in the literature about what analytes or values should be informed as critical results and how they should be communicated. The main aim of this project is to establish consensual standards of critical results for the laboratories participating in the study. Among the project's secondary objectives, establishing consensual procedures for communication can be highlighted. METHODS: Consensus was reached among all participating laboratories establishing the basis for the construction of the initial model put forward for consensus in conjunction with the clinicians. A real-time Delphi, methodology "health consensus" (HC), with motivating and participative questions was applied. The physician was expected to choose a numeric value within a scale designed for each analyte. RESULTS: The medians of critical results obtained represent the consensus on critical results for outpatient and inpatient care. Both in primary care and in hospital care a high degree of consensus was observed for critical values proposed in the analysis of creatinine, digoxin, phosphorus, glucose, international normalized ratio (INR), leukocytes, magnesium, neutrophils, chloride, sodium, calcium and lithium. For the rest of critical results the degree of consensus obtained was "medium high". The results obtained showed that in 72% of cases the consensual critical value coincided with the medians initially proposed by the laboratories. CONCLUSIONS: The real-time Delphi has allowed obtaining consensual standards for communication of critical results among the laboratories participating in the study, which can serve as a basis for other organizations.

Category 1 external quality assessment program for serum creatinine.

BACKGROUND: The Commission of Analytical Quality and the Committee of External Quality Programs of Spanish Society of Laboratory Medicine (SEQC) in collaboration with the Dutch Foundation for the Quality organized the first national category 1 External Quality Assessment Programs (EQAP) pilot study. The aim is to evaluate the standardization of serum creatinine measurements in the Spanish laboratories through a category 1 external quality assurance program with commutable material and reference method assigned values. METHODS: A total of 87 Spanish laboratories were involved in this program in 2015. Each day a sample control was measured by duplicate during 6 consecutive days. Percentage deviations and coefficients of variation obtained were compared with quality specifications derived from biological variation. RESULTS: A total of 1044 creatinine results were obtained. Laboratories were coded in 11 different method-traceability combinations. Only enzymatic methods get all results within the acceptability limits. DISCUSSION: To participate in a category 1 EQAP is a valuable tool to assess the standardization degree in our country; a big effort should be made to promote laboratories to change their procedures and to use enzymatic creatinine methods, in order to achieve a satisfactory standardization degree for this important analyte.

Biologic Variation Approach to Daily Laboratory.

Biological variation gives valuable information about how the living organism regulates its constituents within and between subjects; this information on the behavior of body components allows us to derive consequences concerning reference populations and intervals. With a more pragmatic approach biological variation has three uses: setting the appropriate analytical performance specification for each analyte to limit the amount of error that laboratory could introduce in its measurements, to help distinguish health from disease, and to implement internal quality control with the automatic verification of results.

Quality indicators for extra-analytical processes in clinical laboratory: ten years’ experience / Indicadores de calidad para los procesos extra-analíticos en el laboratorio clínico: 10 años de experiencia

Introduction. The selection and definition of quality indicators is essential for proper control of processes. This is not always easy, particularly with extra-analytical indicators, due to the complexity and degree of comparison of processes between laboratories, and the fact that data collection is not always automated. For this reason, the indicators and specifications need to be dynamic and re-designed in accordance with changes in the system. The aim of this paper is to describe the methodology used in the selection and definition of quality indicators, and their specifications for extra-analytical processes in public laboratories in Catalonia. Material and methods. During the study period (2004-2013), the members of the working group reported the mean annual value for each indicator, and the overall yearly mean of all participants was calculated. These results were compared and analyzed during periodic meetings, with regards to the pre-established specifications of the different laboratories. Results. Quality indicators and their specifications are presented. The evaluation of the validity of each quality indicator was made taking into account aspects including usefulness of the indicator in process monitoring, a clear definition, and a precise and reliable quantification. This methodology has made it possible to contrast the validity of the indicators or to reconsider the specification. Conclusions. The last 10 years’ experience of the Catalonian Health Institute Working Group on Quality Indicators in designing indicators and establishing quality specifications has proved very useful for improving the monitoring of processes in clinical laboratories included in the group (AU)

Introducción. La selección y definición de los indicadores de la calidad es imprescindible para controlar adecuadamente un proceso. Ello no siempre es fácil, sobre todo en el caso de los indicadores extraanalíticos, dada la complejidad y grado de comparabilidad de los procesos entre laboratorios y la necesaria recogida de datos que en muchas ocasiones no está automatizada. Asimismo, los indicadores y especificaciones deben ser dinámicos y rediseñarse en función de los cambios del sistema. El objetivo de este trabajo es describir la metodología utilizada en la selección y definición de indicadores de calidad y especificaciones para los procesos extraanalíticos en los laboratorios públicos de Cataluña. Material y métodos. Durante el período de estudio (2004-2013), los miembros del grupo han informado del valor medio anual para cada indicador, y se ha calculado la media anual de todos los participantes para cada uno de ellos. Estos resultados se han comparado y analizado a través de reuniones periódicas, con respecto a las especificaciones preestablecidas de los diferentes laboratorios. Resultados. Se presentan los indicadores de calidad y sus especificaciones. La evaluación de la validez de cada indicador de calidad se llevó a cabo teniendo en cuenta los aspectos incluyendo la utilidad del indicador en la supervisión de procesos, una definición clara y una cuantificación precisa y fiable. Esta metodología ha permitido contrastar la validez de los indicadores o reconsiderar la especificación. Conclusiones. Los últimos 10 años de experiencia del Grupo de Trabajo del Instituto Catalán de la Salud de Indicadores de Calidad en el diseño de indicadores y en establecer especificaciones de calidad ha demostrado ser muy útil para mejorar el seguimiento de los procesos en los laboratorios clínicos integrados en el grupo (AU)

Evaluación multicéntrica de materiales para el control de calidad de los índices séricos / Multicenter evaluation of materials for the quality control of the serum indexes

Introducción. La hemólisis, la turbidez y la presencia de concentraciones elevadas de bilirrubina son las fuentes de interferencia más frecuentes en el laboratorio clínico. Muchos analizadores incorporan sistemas de detección de estos interferentes denominados «índices séricos» de hemólisis, ictericia y lipidemia. El grado de veracidad de los índices no suele ser verificado por la dificultad en conseguir materiales de referencia adecuados. En este trabajo se presentan los resultados de un estudio interlaboratorios de los índices hemólisis, ictericia y lipidemia empleando materiales de referencia con concentraciones conocidas de los interferentes. Material y métodos. En el estudio han participado los laboratorios clínicos de 10 centros con 7 analizadores distintos. Los materiales de referencia de índices séricos contenían concentraciones conocidas de bilirrubina, hemoglobina (hemolisado) y triglicéridos (Intralipid). Resultados. Todos los instrumentos proporcionaron resultados aceptables para el índice de ictericia y de hemólisis. Entre los analizadores que dan valores cuantitativos se encontraron resultados bajos en uno de los analizadores para los materiales que contenían Intralipid. Los analizadores que expresan el resultado en forma de un intervalo proporcionaron resultados correctos para los materiales con turbidez menor y bajos para el material con turbidez mayor. Conclusiones. Los materiales de referencia utilizados han demostrado su utilidad para verificar los índices séricos de ictericia, hemólisis y lipidemia en los analizadores. Generalmente los índices proporcionados por los instrumentos concuerdan entre sí y con los valores asignados. Las diferencias más importantes entre analizadores se encuentran en el índice de lipidemia (AU)

Introduction. Hemolysis, turbidity and the presence of high concentrations of bilirubin are the most frequent sources of interference in the clinical laboratory. Many analyzers incorporate detection systems for these interferents called “serum indexes” of hemolysis, icterus and lipidemia. The accuracy of such indexes is usually not verified by the difficulty in obtaining appropriate reference materials. In this work we show the results of an interlaboratory study of hemolysis, icterus and lipidemia indexes using reference materials containing known concentrations of these interfering substances. Material and methods. Ten clinical laboratories from different centres have participated in the study using 7 different analyzers. The reference materials for the serum indexes contained known concentrations of bilirubin, hemoglobin (hemolysate) and triglycerides (Intralipid). Results. All instruments provided acceptable results for the icterus and hemolysis index. Among the analyzers providing quantitative values, low results were found in one of the analyzers for materials containing Intralipid. The analyzers expressing the result as an interval provided correct results for materials with low turbidity but a low result for the material with the highest turbidity. Conclusions. The reference materials used have proved to be useful to verify the serum indexes for hemolysis, icterus and lipidemia in analyzers. The results obtained in different instruments generally agree among them and with the assigned values. The most important differences between analyzers were found in the lipidemia index (AU)

Rationale for using data on biological variation.

The aims of this study are: 1) to use the data included in the biological variation (BV) database to address the usability of BV estimates; and 2) to use different examples from the authors' laboratories to illustrate the use and the usefulness of BV data in laboratory medicine. The BV database is an essential tool for laboratory management. Examples of application of data derived from BV are given in this paper, such as analytical performance specifications that have been included in various quality control software designed to optimize operative rules; also they have been incorporated as acceptability limits in external quality assurance reports. BV data from pathological status are of utmost interest for monitoring patients and differences between the intra-individual coefficients of variation (CVI) estimated from healthy and patients are shown. However, for a number of analytes there are limited data available and for many there are no data, consequently new studies should be encouraged at an international level. In addition, developing international criteria to evaluate publications dealing with the estimation of BV components would be of the utmost interest. We are ready and willing to collaborate with such worthy initiatives. The first EFLM strategic conference on analytical performance specifications is an excellent opportunity for debating these ideas.

Biological variation database: structure and criteria used for generation and update.

BACKGROUND: Numerical data on the components of biological variation (BV) have many uses in laboratory medicine, including in the setting of analytical quality specifications, generation of reference change values and assessment of the utility of conventional reference values. METHODS: Generation of a series of up-to-date comprehensive database of components of BV was initiated in 1997, integrating the more relevant information found in publications concerning BV. A scoring system was designed to evaluate the robustness of the data included. The database has been updated every 2 years, made available on the Internet and derived analytical quality specifications for imprecision, bias and total allowable error included in the tabulation of data. RESULTS AND CONCLUSIONS: Our aim here is to document, in detail, the methodology we used to evaluate the reliability of the included data compiled from the published literature. To date, our approach has not been explicitly documented, although the principles have been presented at many symposia, courses and conferences.

Harmonization in hemolysis detection and prevention. A working group of the Catalonian Health Institute (ICS) experience.

BACKGROUND: Hemolysis is the main cause of non-quality samples in clinical laboratories, producing the highest percentage of rejections in the external assurance programs of preanalytical quality. The objective was to: 1) study the agreement between the detection methods and quantification of hemolysis; 2) establish comparable hemolysis interference limits for a series of tests and analytical methods; and 3) study the preanalytical variables which most influence hemolysis production. METHODS: Different hemoglobin concentration standards were prepared using the reference method. Agreement was studied between automated methods [hemolytic indexes (HI)] and reference method, as well as the interference according to hemolysis degree in various biochemical tests was measured. Preanalytical variables which could influence hemolysis production were studied: type of extraction, type of tubes, transport time, temperature and centrifugation conditions. RESULTS: Good agreement was obtained between hemoglobin concentrations measured using the reference method and HI, for the most of studied analyzers, particularly those giving quantitative HI. The hemolysis interference cut-off points obtained for the majority of tests studied (except LDH, K) are dependent on the method/analyzer utilized. Furthermore, discrepancies have been observed between interference limits recommended by the manufacturer. The preanalytical variables which produce a lower percentage of hemolysis rejections were: centrifugation at the extraction site, the use of lower volume tubes and a transport time under 15 min at room temperature. CONCLUSIONS: The setting of interference limits (cut-off) for each used test/method, and the study of preanalytical variability will assist to the results harmonization for this quality indicator.

Variación biológica. Revisión desde una perspectiva práctica / Biological variation. A review from a practical perspective

Los autores realizan una revisión exhaustiva sobre la variación biológica, con el objeto de resaltar su aplicación práctica en la rutina diaria del laboratorio clínico. Se describe brevemente el método de estimación de los componentes de la variación biológica y se detalla la base de datos actualizada bianualmente y disponible para los profesionales del sector. Se pormenoriza el uso práctico en el control interno del proceso analítico, en la evaluación de los datos del control interno y externo, así como en la detección de errores analíticos y extraanalíticos. Finalmente, se explica con claridad cómo notificar la posibilidad de un cambio significativo en el estado de salud del paciente en el informe analítico (AU)

This is an exhaustive review on biological variation, which aims to highlight its practical application in daily routine of clinical laboratories. The methodology to estimate the components of biological variation is summarised and a database, which is updated every two years and available to professionals of the area, is explained in detail. Daily application of data derived from biological variation in daily practice in internal and external quality control, as well as, in the detection of analytical and non-analytical errors is clearly explained. Last, but not least, examples are given on how to notify to clinicians on possible changes in patients health status (AU)

Aplicación del modelo Seis-Sigma en la mejora de la calidad analítica del laboratorio clínico / Application of the Six-Sigma model to improve analytical quality in the clinical laboratory

Introducción. El modelo Seis Sigma es una herramienta de gestión de la calidad que se basa en la medida de la variabilidad de un proceso, en términos de desviación típica o de fallos por millón. Implica haber definido previamente una especificación de la calidad para el proceso que se investiga. Material y método. Este trabajo estudia los datos obtenidos en los programas de garantía externa de la calidad de la Sociedad Española de Bioquímica Clínica y Patología Molecular (SEQC), con el propósito de deducir consecuencias prácticas que aseguren el diagnóstico y el seguimiento correctos del paciente, mediante el informe aportado por el laboratorio. Se incluyen magnitudes biológicas con especificaciones de la calidad definidas para situaciones clínicas concretas (colesterol, glucosa, glucohemoglobina y antígeno prostático específico total) y con valores de variación biológica bajos (ión sodio, albúmina), intermedios (colesterol, creatinina, glucosa) y altos (hierro, triglicéridos). El valor sigma se calcula mediante el cociente entre el límite de tolerancia establecido y la variabilidad del proceso. Resultados. Los valores sigma obtenidos son adecuados (>=3) si se toman especificaciones muy permisivas, mientras que no lo son cuando se desea cumplir la especificación derivada de la variación biológica. Ello indica que los instrumentos y métodos analíticos disponibles en nuestro mercado requieren un procedimiento de control de la calidad muy cuidadoso (procesamiento de varias muestras control, necesidad de realizar repeticiones, etc.). Conclusiones. En ningún caso se debe confundir el objetivo de alcanzar la calidad necesaria para el adecuado uso clínico del informe analítico con el de conseguir un laboratorio industrialmente productivo; ambos forman parte del concepto de calidad total(AU)

Introduction. The Six Sigma model is a management tool based on measuring process variability, in terms of standard deviation or defects per million. It involves defining the specifications of the quality desired for the process investigated. Material and method. This work uses data obtained by the laboratories participating in the external surveys organized by the Spanish Society of Clinical Biochemistry and Molecular Pathology (SEQC), with the aim of promoting practical recommendations for assuring satisfactory patient diagnosis or monitoring through the laboratory report. The analytes included have quality specifications defined for specific clinical situations (cholesterol, glucose, HbA1C, total PSA) and have narrow (albumin, sodium), medium (cholesterol, creatinine, glucose) and wide (iron, triglyceride) biological variations. Results from control materials with the relevant concentrations to make clinical decisions have been used in this study. Sigma matrix is calculated from the ratio between quality specification and process coefficient of variation. Results. Results obtained show that sigma values are good (>=3) when using permissive quality specifications, whereas they are poor if quality specifications are derived from biological variation. This finding indicates that instruments and methods available in our field require a strict quality control procedure (several control samples per run, repeated tests, etc.). Conclusions. The objective of obtaining the quality required for adequate clinical use, must not be confused with that of achieving an economically productive laboratory; both are part of the concept of total quality management(AU)

Variación biológica en patologías: revisión de datos y consecuencias clínicas / Biological variation in disease: data review and clinical consequences

Introducción. La variación biológica (VB) es la fluctuación fisiológica de los constituyentes de los fluidos humanos alrededor del punto homeostático, considerada de forma individual (CVI) o entre diferentes individuos. Los datos derivados de su estudio se usan como propuesta del valor de referencia de un cambio (VRC) entre resultados seriados de un mismo individuo. El VRC estimado a partir de individuos sanos se ha utilizado en el control de la evolución clínica de los pacientes con el fin de discriminar si se produce un cambio significativo en una serie de resultados analíticos. Objetivo. El objetivo del presente trabajo es revisar los datos de VB en situaciones patológicas para aplicarla al uso de la práctica clínica, especialmente en el seguimiento de pacientes. Material y método. El material usado en este estudio se recogió a partir de artículos referenciados en los buscadores electrónicos, libros y tesis doctorales. Se ha recopilado y ordenado alfabéticamente un total de 66 magnitudes biológicas en 34 situaciones patológicas. Resultados y conclusiones. Para la mayoría de las magnitudes estudiadas, los valores de CVI en estados patológicos son similares a los encontrados en individuos sanos. Sin embargo, para las magnitudes consideradas como marcadores específicos de órgano, los valores de CVI son muy diferentes (superiores o inferiores) a los obtenidos en personas sanas. Esto implica que los valores VRC procedentes de personas sanas pueden no ser adecuados para el seguimiento de los pacientes. Hay un riesgo de que se produzcan falsos positivos (o negativos) sobre cambios del estado de salud, con sus correspondientes implicaciones clínicas(AU)

Introduction. Biological variation (BV) refers to the natural fluctuation of a physiological constituent around the homeostatic set point within a person (CVI), as well as the natural variation between persons. The data derived from the components of BV are used to propose the reference change value (RCV) for monitoring patients. Objective. The aim of this review is to show the state of the art for biological variation data in non-healthy situations in order to have an indication of whether the data derived in specific pathological situations might be useful for clinical applications. Material and method. The information used in this study was retrieved from published articles referenced in electronic search systems, books and a doctoral thesis. The analytes studied were listed in alphabetical order. Results and conclusions. For the majority of quantities studied, CVI values are of the same order in disease and health: thus the use of RCV derived from healthy subjects for monitoring patients would be reasonable. However, for a small number of quantities considered to be disease specific markers, the CVI differed from those in health. This could mean that RCV derived from healthy CVI may not be appropriate for monitoring patients in certain diseases. Hence, disease specific RCV may be clinically useful(AU)

Within-subject biological variation in disease: collated data and clinical consequences.

Quantitative data on the components of biological variation (BV) are used for several purposes, including calculating the reference change value (RCV) required for the assessment of the significance of changes in serial results in an individual. Pathology may modify the set point in diseased patients and, more importantly, the variation around that set-point. Our aim was to collate all published BV data in situations other than health. We report the within-subject coefficient of variation (CV(I)) for 66 quantities in 34 disease states. We compared the results with the CV(I) determined in healthy individuals and examined whether the data derived in specific diseases could be useful for clinical applications. For the majority of quantities studied, CV(I) values are of the same order in disease and health: thus the use of RCV derived from healthy subjects for monitoring patients would be reasonable. However, for a small number of quantities considered to be disease specific markers, the CV(I) differed from those in health. This could mean that RCV derived from healthy CV(I) may be inappropriate for monitoring patients in certain diseases. Hence, disease-specific RCVs may be clinically useful.

Biological variation at long-term renal post-transplantation.

In laboratory testing the reference change value (RCV) is used to detect changes in a patient's clinical status, even before clinical signs are evident. In a previous study we determined the biological variation (BV) of a number of constituents during early post-transplantation in kidney recipients to calculate useful RCVs for this purpose. RCVs for creatinine and urate were identified as the most suitable and were different from those calculated from the normal population. The aim of the current study was to determine the BV components at long-term following renal transplantation to predict potential crises in transplant recipients who have been stable for a number of years. BV components for creatinine and urate were calculated in a new group of 40 kidney transplanted patients (26 men and 14 women, 29-71 years old) who had been stable for period of 4 to 7 years following transplantation (long-term post-TR group). An average of 8 samples per patient was obtained during a period of 1-2 years. Results were compared with those from our described group of recently transplanted patients (short-term post-TR group). There were no statistically significant differences between the groups with regard to within-subject variation or within-subject plus analytical variation (CVI+A) for any of the constituents studied. Distribution of CVI+A values in long-term post-TR was comparable to that of short-term post-TR values. Independence between creatinine and urate was maintained at long-term. The fact that BV components for creatinine and urate were similar in short- and long-term post-TR and that independence was maintained implies that the short-term post-TR RCV can also be applied in long-term post-TR patients. The RCV for predicting crises in this population represents an optimization of laboratory reporting and could be a valuable tool for clinical decision making.