The diagnostic accuracy of quality control rules.

Internal quality control in clinical chemistry laboratories are based on analyzing samples of stable control materials among the patient samples. The control results are interpreted by using quality control rules that usually are designed to detect systematic errors. The best rules have a high probability of error detection (Ped), i.e. to detect the maximal allowable (critical) systematic error and a low probability of false rejection (Pfr, false alarm). In this work we show that quality control rules can be represented by points on a ROC curve which appears when Ped is plotted against Pfr and only the control limit is varied. Further, we introduce a new method for choosing the optimal control limit, analogous to choosing the optimal operating point on the ROC curve of a diagnostic test. This decision needs knowledge of the pretest probability of a critical systematic error, the benefit of detecting it when it occurs and the cost of false alarm. The ROC curve analysis showed that if rules based on N = 2 are used, mean rules outperform Westgard rules because the ROC curve of the mean rules was lying above the ROC curves of the Westgard rules. A mean rule also had a lower maximum expected increase in the number of unacceptable patient results reported during the presence of an out-of-control error condition (Max E(NUF)) than comparable Westgard rules.

Stability of serum placental growth factor (PlGF) and soluble fms-like tyrosine kinase 1 (sFlt-1).

Placental growth factor (PlGF) and soluble fms-like tyrosine kinase 1 (sFlt-1) are biomarkers used for diagnosis and risk estimation of preeclampsia. Stability in room temperature (RT) may affect the usefulness of these analyses, as shipping at ambient temperature is the most practical and suitable way to ship samples. To date, scientific studies of such stability are lacking. We aimed to assess the stability of PlGF and sFlt-1 at RT in serum from pregnant women. In addition, a smaller study of stability at 4 °C was performed. Serum was collected from 69 pregnant women and stored at RT or at 4 °C for up to 192 h. Analytes were considered stable if the mean percent change ± 90 confidence interval of the mean was within the baseline concentration ± allowable bias. Allowable bias was calculated from data on biological variation. In addition, an instability equation was calculated to assess loss of stability, in line with recent European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) recommendations. The mean percent change was <3.5% for PlGF, <1% for sFlt-1 and <4.5% for sFlt-1/PlGF ratio up to 192 h. PlGF was considered stable for 168 h, and sFlt-1 and sFlt-1/PlGF ratios were considered stable for 192 h at RT. At 4 °C, PlGF was considered stable for 120 h, sFlt-1 for 168 h and sFlt-1/PlGF ratio for 120 h. Both PlGF and sFlt-1 as well as sFlt-1/PlGF ratio show sufficient stability (minimum 168 h) for samples to be shipped at RT.

Reference change values of FIB-4.

When comparing two analytical results for the same analyte, the clinicians may benefit from knowing the reference change values (RCVs) of the analyte. For Fibrosis-4 Index (FIB-4), a noninvasive test used for assessing the risk of liver fibrosis, no RCVs have been published for non-cirrhotic individuals. Therefore, we estimated RCVs for adults, using retrospectively collected data from outpatients with AST, ALT, and thrombocytes within the respective reference intervals. FIB-4 was calculated as (age × AST)/(thrombocytes × ALT0.5). From two FIB-4 values in each patient we calculated the RCVs parametrically and non-parametrically. For both methods, we estimated the limits of the central 90% of the distribution of the ratio between the second and the first measurement. We obtained data on 599 outpatients with two blood tests taken 3 - 972 (median 258) days apart. The RCVs were 0.72 - 1.40 and 0.72 - 1.43, respectively, using the parametric and non-parametric methods. The 5 and 95 percentiles were not statistically significantly associated with sex, age, level of analyte, or the time between the measurements. The within-subject biological variation of FIB-4 was estimated to be 13.9%. Conclusion: In 90% of the patients the ratio between the second and the first FIB-4 result was approximately 0.7 - 1.4.

Interpreting two TSH results from the same patient.

OBJECTIVES: When the patient's mean (setpoint) concentration of an analyte is unknown and the physician tries to judge the clinical condition from the analyte concentration in two separate specimens taken a time apart, we believe that the two values should be judged against a bivariate reference interval derived from clinically healthy and stable individuals, rather than using univariate reference limits and comparing the difference between the values against reference change values (RCVs). In this work we compared the two models, using s-TSH as an example. METHODS: We simulated two s-TSH measurement values for 100,000 euthyreot subjects, and plotted the second value against the first, along with a markup of the central 50, 60, 70, 80, 90, and 95 % of the bivariate distribution, in addition to the 2.5 and 97.5 percentile univariate reference limits and the 2.5 and 97.5 percentile RCVs. We also estimated the diagnostic accuracy of the combination of the 2.5 and 97.5 univariate percentile reference limits and the 2.5 and 97.5 percentile RCVs against the central 95 % of the bivariate distribution. RESULTS: Graphically, the combination of the 2.5 and 97.5 univariate reference limits and the 2.5 and 97.5 percentile RCVs did not accurately delineate the central 95 % of the bivariate distribution. Numerically, the sensitivity and specificity of the combination were 80.2 and 92.2 %, respectively. CONCLUSIONS: The concentrations of s-TSH measured in two samples taken at separate times from a clinically healthy and stable individual cannot be accurately interpreted using the combination of univariate reference limits and RCVs.

Calprotectin and CRP as biomarkers of cardiovascular disease risk in patients with chronic kidney disease: a follow-up study at 5 and 10 years.

Chronic kidney disease (CKD) and low-grade inflammation are associated with increased risk of cardiovascular disease (CVD). Calprotectin, a protein mainly secreted by activated neutrophils during inflammatory conditions, has been linked to CVD risk in general populations. The aim of this study was to evaluate the association of calprotectin with CVD risk in CKD patients, relative to C-reactive protein (CRP). One hundred and fifty-three patients with moderate CKD were prospectively followed up at 5 and 10 years. We used Cox regression modelling with stepwise adjustments for other relevant covariates (age, sex, cystatin C, previous CVD, systolic blood pressure, HDL cholesterol and HbA1c) to assess the association of baseline calprotectin and CRP with the risk of fatal or non-fatal CVD events. Twenty-nine and 44 patients experienced a CVD event during median follow-up of 4.8 and 10.9 years, respectively. Higher calprotectin was associated with increased CVD risk at both time points, which remained statistically significant after multivariable adjustments, including adjustment for CRP. For CRP, the associations did not remain statistically significant after final multivariable adjustments. In conclusion, we have shown that in patients with CKD, calprotectin was independently associated with the risk of future CVD events, suggesting that calprotectin may provide prognostic information of CVD risk.

Inflammatory markers and risk of cardiovascular mortality in relation to diabetes status in the HUNT study.

Inflammatory markers have been associated with increased risk of cardiovascular mortality in general populations. We assessed whether these associations differ by diabetes status. From a population-based cohort study (n = 62,237) we included all participants with diabetes (n = 1753) and a control group without diabetes (n = 1818). Cox regression models were used to estimate hazard ratios (HRs) with 95% confidence intervals (CI) for possible associations with cardiovascular mortality of 4 different inflammatory markers; C-reactive protein (CRP), calprotectin, neopterin and lactoferrin. During a median follow-up of 13.9 years, 728 (20.4%) died from cardiovascular disease (CVD). After adjustment for age, sex and diabetes, the associations of all inflammatory markers with risk of cardiovascular mortality were log-linear (all P ≤ 0.017 for trend) and did not differ according to diabetes status (all P ≥ 0.53 for interaction). After further adjustments for established risk factors, only CRP remained independently associated with cardiovascular mortality. HRs were 1.22 (1.12-1.32) per standard deviation higher loge CRP concentration and 1.91 (1.50-2.43) when comparing individuals in the top versus bottom quartile. The associations of CRP, calprotectin, lactoferrin and neopterin with cardiovascular mortality did not differ by diabetes, suggesting that any potential prognostic value of these markers is independent of diabetes status.

Testing the limits: the diagnostic accuracy of reference change values.

Reference change values (RCVs) are used by the physician to judge whether a change in analyte concentration from one sample to the next may represent a clinically significant change. Published RCVs are usually given as fixed percentages of the analyte concentration in the first sample. The accuracy of published RCVs is not well known. We obtained public-use data from the US National Health and Nutrition Examination Survey (NHANES) 2001-2002 to study the distribution of changes in the concentration of eight commonly used analytes. Specimens were obtained on two occasions 7-47 days apart from 279 to 411 individuals with an analyte concentration within the reference interval in both samples. The analytes were albumin, calcium, cholesterol, phosphate, potassium, sodium, hemoglobin and thrombocytes. For each analyte, normal within-subject biological coefficient of variation from the EFLM Working Group on Biological Variation and the NHANES analytical coefficient of variation were used to calculate the 5 and 95 percentile RCVs. These RCVs were calculated as fixed percentages of the analyte concentrations in the first sample and compared to the empirical 5 and 95 percentiles. The sensitivity of the RCVs in detecting changes outside the empirical percentiles ranged from 0.35 for sodium to 0.80 for albumin. The specificity of the RCVs in detecting changes inside the empirical percentiles ranged from 0.85 for potassium to 0.97 for thrombocytes. Calculating RCVs as fixed percentages of the analyte concentration in the first sample lessened the diagnostic accuracy. RCVs given as a function of the first result would perform better.

Using blood calprotectin as a measure of blood neutrophils.

Presently, bed-side or at home quantification of neutrophils in blood (b-neutrophils) is not practical, because cytometric methods are too expensive and technically demanding. We have explored whether calprotectin concentration in whole blood (b-calprotectin) might be a valid measure of b-neutrophils because this principle might be used in a simple and robust immunoassay device. We obtained heparin blood samples from 77 patients with possible neutropenia, most of them cancer patients treated with cytostatic drugs, and compared b-calprotectin with their b-neutrophils in a simultaneously taken EDTA-blood sample. The Spearman rank correlation coefficient between b-calprotectin and b-neutrophils was 0.986 (p < .0001). In a regression model of b-neutrophils as a function of age, gender, type of hematology instrument, total leukocyte count minus neutrophils, b-calprotectin, and plasma calprotectin (p-calprotectin), only b-calprotectin was a statistically significant predictor. B-neutrophils below 1 × 109/L was unlikely if b-calprotectin was above 50 mg/L. In conclusion, b-calprotectin, without adjusting for p-calprotectin, correlates closely with b-neutrophils and could be used to detect b-neutrophils below 1 × 109/L.

Diagnosing empty iron stores in women: unbound iron binding capacity (UIBC) versus soluble transferrin receptor (sTFR).

Unbound iron binding capacity (UIBC) is more accurate than total iron binding capacity (TIBC) and percent transferrin saturation in diagnosing empty iron stores. It is unknown whether UIBC is more or less accurate than soluble transferrin receptor (sTFR). We obtained public-use data from the U.S. National Health and Nutrition Examination Survey (NHANES) 2005-2006 to compare the accuray of UIBC and sTFR in diagnosing empty iron stores in 2337 women aged 12-49 years. We grouped the women according to CRP less than 5 mg/L and pregnancy (four groups) and used three definitions of empty iron stores: Serum ferritin less than 10, 15, and 20 µg/L. Receiver operating characteristic (ROC) curve analysis was used to estimate the diagnostic accuracy. UIBC showed a better diagnostic accuracy than sTFR in all groups and definitions of empty iron stores, except in nonpregnant women with CRP at least 5 mg/L when empty iron stores were defined as ferritin less than 10 and 15 µg/L. Two differences reached statistical significance: In nonpregnant women without inflammation the area under the ROC curve for UIBC was 0.830 compared to 0.793 for sTFR (p = .007) when empty iron stores were defined as ferritin less than 20 µg/L. The corresponding figures for pregnant women without inflammation were 0.843 for UIBC and 0.739 for sTFR (p = .003). In conclusion, UIBC is a more accurate test than sTFR in diagnosing empty iron stores in women without inflammation.

A new index of clinical utility for diagnostic tests.

Clinical utility of a diagnostic test depends on its diagnostic accuracy, the pretest probability of disease and the clinical consequences of the test results. Tools for evaluating clinical utility are scarce. We propose a new clinical utility index (CUI), which is the expected gain in utility (EGU) of the test divided by the EGU of an ideal test, both adjusted for EGU of the optimal clinical action without testing. The index expresses the relative benefit of using the test compared to using an optimal test when making a clinical decision. To illustrate how the index may be used, we estimated CUI for fasting glucose, both as a continuous and as a dichotomous test, at several values of pretest probability of diabetes mellitus and at two levels of cost/benefit-ratio. In the same clinical situations we also estimated CUI for the 2 h glucose tolerance test. Hemoglobin A1c ≥ 48 mmol/mol was used as a reference standard for diabetes mellitus. In this model, fasting glucose was clinically more useful as a continuous test than as a dichotomous one, based on CUIs. At pretest probability above the treatment threshold, fasting glucose as a continuous test was even more useful than the complete glucose tolerance test. These results are not necessarily generalizable; however, they show how the CUI can be used to select the most useful test in certain clinical situations.

Impact of different preanalytical conditions on results of lupus anticoagulant tests.

INTRODUCTION: The currently recommended preanalytical conditions for lupus anticoagulant (LA) analysis require analyzing samples in fresh or freshly frozen platelet-poor plasma. The aim of this study was to evaluate whether alternative and less cumbersome preanalytical procedures for LA testing give significantly different results compared to recommended conditions. MATERIALS AND METHODS: Citrated blood samples were drawn from 29 study participants, 15 with negative and 14 with positive LA results. The samples were processed according to the ISTH guideline for LA testing and compared to several alternative preanalytical conditions. Measurements were performed using the dilute Russell's viper venom time (DRVVT) and silica clotting time (SCT), both screen and confirm, on a STA-R Evolution analyzer. Stability criteria were based upon biological variation. RESULTS: All DRVVT tests (normalized screen, confirm, and screen/confirm ratio) met the stability criteria for all the preanalytical conditions. The SCT tests (normalized screen, confirm, and screen/confirm ratio) met the stability criteria only when treated according to the ISTH guideline, except for SCT normalized screen/confirm ratio which also met the stability criteria for double-centrifuged aliquoted plasma stored in room temperature for 24 hours and then analyzed "fresh" or after being frozen. One warfarin-treated patient was reclassified from positive to negative for DRVVT after the preanalytical modifications, while 2 of 29 participants became falsely positive for 2 of 8 conditions for SCT. CONCLUSIONS: The DRVVT assays met the criteria for stability for all preanalytical conditions tested, while the SCT assays should be interpreted with caution if the preanalytical guidelines from ISTH are not followed.