Predicting haemoglobin deferral using machine learning models: Can we use the same prediction model across countries?

BACKGROUND AND OBJECTIVES: Personalized donation strategies based on haemoglobin (Hb) prediction models may reduce Hb deferrals and hence costs of donation, meanwhile improving commitment of donors. We previously found that prediction models perform better in validation data with a high Hb deferral rate. We therefore investigate how Hb deferral prediction models perform when exchanged with other blood establishments. MATERIALS AND METHODS: Donation data from the past 5 years from random samples of 10,000 donors from Australia, Belgium, Finland, the Netherlands and South Africa were used to fit random forest models for Hb deferral prediction. Trained models were exchanged between blood establishments. Model performance was evaluated using the area under the precision-recall curve (AUPR). Variable importance was assessed using SHapley Additive exPlanations (SHAP) values. RESULTS: Across the validation datasets and exchanged models, the AUPR ranged from 0.05 to 0.43. Exchanged models performed similarly within validation datasets, irrespective of the origin of the training data. Apart from subtle differences, the importance of most predictor variables was similar in all trained models. CONCLUSION: Our results suggest that Hb deferral prediction models trained in different blood establishments perform similarly within different validation datasets, regardless of the deferral rate of their training data. Models learn similar associations in different blood establishments.

The added value of ferritin levels and genetic markers for the prediction of haemoglobin deferral.

BACKGROUND AND OBJECTIVES: On-site haemoglobin deferral for blood donors is sometimes necessary for donor health but demotivating for donors and inefficient for the blood bank. Deferral rates could be reduced by accurately predicting donors' haemoglobin status before they visit the blood bank. Although such predictive models have been published, there is ample room for improvement in predictive performance. We aim to assess the added value of ferritin levels or genetic markers as predictor variables in haemoglobin deferral prediction models. MATERIALS AND METHODS: Support vector machines with and without this information (the full and reduced model, respectively) are compared in Finland and the Netherlands. Genetic markers are available in the Finnish data and ferritin levels in the Dutch data. RESULTS: Although there is a clear association between haemoglobin deferral and both ferritin levels and several genetic markers, predictive performance increases only marginally with their inclusion as predictors. The recall of deferrals increases from 68.6% to 69.9% with genetic markers and from 79.7% to 80.0% with ferritin levels included. Subgroup analyses show that the added value of these predictors is higher in specific subgroups, for example, for donors with minor alleles on single-nucleotide polymorphism 17:58358769, recall of deferral increases from 73.3% to 93.3%. CONCLUSION: Including ferritin levels or genetic markers in haemoglobin deferral prediction models improves predictive performance. The increase in overall performance is small but may be substantial for specific subgroups. We recommend including this information as predictor variables when available, but not to collect it for this purpose only.

Individual and environmental determinants of serum ferritin levels: A structural equation model.

BACKGROUND AND OBJECTIVES: Serum ferritin levels are increasingly being used to assess iron stores. Considerable variation in ferritin levels within and between individuals has been observed, but our current understanding of factors that explain this variation is far from complete. We aim to combine multiple potential determinants in an integrative model, and investigate their relative importance and potential interactions. METHODS: We use ferritin measurements collected by Sanquin Blood Bank on both prospective (N = 59 596) and active blood donors (N = 78 318) to fit a structural equation model with three latent constructs (individual characteristics, donation history, and environmental factors). Parameters were estimated separately by sex and donor status. RESULTS: The model explained 25% of ferritin variance in prospective donors, and 40% in active donors. Individual characteristics and donation history were the most important determinants of ferritin levels in active donors. The association between environmental factors and ferritin was smaller but still substantial; higher exposure to air pollution was associated with higher ferritin levels, and this association was considerably stronger for active blood donors than for prospective donors. DISCUSSION: In active donors, individual characteristics explain 20% (17%) of ferritin variation, donation history explains 14% (25%) and environmental factors explain 5% (4%) for women (men). Our model presents known ferritin determinants in a broader perspective, allowing for comparison with other determinants as well as between new and active donors, or between men and women.

An international comparison of haemoglobin deferral prediction models for blood banking.

BACKGROUND AND OBJECTIVES: Blood banks use a haemoglobin (Hb) threshold before blood donation to minimize donors' risk of anaemia. Hb prediction models may guide decisions on which donors to invite, and should ideally also be generally applicable, thus in different countries and settings. In this paper, we compare the outcome of various prediction models in different settings and highlight differences and similarities. MATERIALS AND METHODS: Donation data of repeat donors from the past 5 years of Australia, Belgium, Finland, the Netherlands and South Africa were used to fit five identical prediction models: logistic regression, random forest, support vector machine, linear mixed model and dynamic linear mixed model. Only donors with five or more donation attempts were included to ensure having informative data from all donors. Analyses were performed for men and women separately and outcomes compared. RESULTS: Within countries and overall, different models perform similarly well. However, there are substantial differences in model performance between countries, and there is a positive association between the deferral rate in a country and the ability to predict donor deferral. Nonetheless, the importance of predictor variables across countries is similar and is highest for the previous Hb level. CONCLUSION: The limited impact of model architecture and country indicates that all models show similar relationships between the predictor variables and donor deferral. Donor deferral is found to be better predictable in countries with high deferral rates. Therefore, such countries may benefit more from deferral prediction models than those with low deferral rates.

Explainable haemoglobin deferral predictions using machine learning models: Interpretation and consequences for the blood supply.

BACKGROUND AND OBJECTIVES: Accurate predictions of haemoglobin (Hb) deferral for whole-blood donors could aid blood banks in reducing deferral rates and increasing efficiency and donor motivation. Complex models are needed to make accurate predictions, but predictions must also be explainable. Before the implementation of a prediction model, its impact on the blood supply should be estimated to avoid shortages. MATERIALS AND METHODS: Donation visits between October 2017 and December 2021 were selected from Sanquin's database system. The following variables were available for each visit: donor sex, age, donation start time, month, number of donations in the last 24 months, most recent ferritin level, days since last ferritin measurement, Hb at nth previous visit (n between 1 and 5), days since the nth previous visit. Outcome Hb deferral has two classes: deferred and not deferred. Support vector machines were used as prediction models, and SHapley Additive exPlanations values were used to quantify the contribution of each variable to the model predictions. Performance was assessed using precision and recall. The potential impact on blood supply was estimated by predicting deferral at earlier or later donation dates. RESULTS: We present a model that predicts Hb deferral in an explainable way. If used in practice, 64% of non-deferred donors would be invited on or before their original donation date, while 80% of deferred donors would be invited later. CONCLUSION: By using this model to invite donors, the number of blood bank visits would increase by 15%, while deferral rates would decrease by 60% (currently 3% for women and 1% for men).

Associations Between Symptoms, Donor Characteristics and IgG Antibody Response in 2082 COVID-19 Convalescent Plasma Donors.

Many studies already reported on the association between patient characteristics on the severity of COVID-19 disease outcome, but the relation with SARS-CoV-2 antibody levels is less clear. To investigate this in more detail, we performed a retrospective observational study in which we used the IgG antibody response from 11,118 longitudinal antibody measurements of 2,082 unique COVID convalescent plasma donors. COVID-19 symptoms and donor characteristics were obtained by a questionnaire. Antibody responses were modelled using a linear mixed-effects model. Our study confirms that the SARS-CoV-2 antibody response is associated with patient characteristics like body mass index and age. Antibody decay was faster in male than in female donors (average half-life of 62 versus 72 days). Most interestingly, we also found that three symptoms (headache, anosmia, nasal cold) were associated with lower peak IgG, while six other symptoms (dry cough, fatigue, diarrhoea, fever, dyspnoea, muscle weakness) were associated with higher IgG concentrations.

First results of a ferritin-based blood donor deferral policy in the Netherlands.

BACKGROUND: Whole blood donors are at risk of becoming iron deficient. To monitor iron stores, Sanquin implemented a new deferral policy based on ferritin levels, in addition to the traditional hemoglobin measurements. METHODS: Ferritin levels are determined in every fifth donation, as well as in all first-time donors. Donors with ferritin levels <15 ng/mL (WHO threshold) are deferred for 12 months; those ≥15 and ≤30 ng/mL for 6 months. The first results were analyzed and are presented here. RESULTS: The results show that 25% of women (N = 20151, 95% CI 24%-25%) and 1.6% of men (N = 10391, 95% CI 1.4%-1.8%) have ferritin levels ≤30 ng/mL at their first blood center visit. For repeat (non-first-time) donors, these proportions are higher: 53% of women (N = 28329, 95% CI 52%-54%) and 42% of men (N = 31089, 95% CI 41%-43%). After a 6-month deferral, in 88% of returning women (N = 3059, 95% CI 87%-89%) and 99% of returning men (N = 3736, 95% CI 98%-99%) ferritin levels were ≥15 ng/mL. After a 12-month deferral, in 74% of returning women (N = 486, 95% CI 70%-78%) and 95% of returning men (N = 479, 95% CI 94%-97%) ferritin levels increased to ≥15 ng/mL. CONCLUSION: Deferral of donors whose pre-donation ferritin levels were ≤30 ng/mL might prevent donors from returning with ferritin levels <15 ng/mL. This policy is promising to mitigate effects of repeated donations on iron stores.