Feasibility of smartphone colorimetry of the face as an anaemia screening tool for infants and young children in Ghana.

BACKGROUND: Anaemia affects approximately a quarter of the global population. When anaemia occurs during childhood, it can increase susceptibility to infectious diseases and impair cognitive development. This research uses smartphone-based colorimetry to develop a non-invasive technique for screening for anaemia in a previously understudied population of infants and young children in Ghana. METHODS: We propose a colorimetric algorithm for screening for anaemia which uses a novel combination of three regions of interest: the lower eyelid (palpebral conjunctiva), the sclera, and the mucosal membrane adjacent to the lower lip. These regions are chosen to have minimal skin pigmentation occluding the blood chromaticity. As part of the algorithm development, different methods were compared for (1) accounting for varying ambient lighting, and (2) choosing a chromaticity metric for each region of interest. In comparison to some prior work, no specialist hardware (such as a colour reference card) is required for image acquisition. RESULTS: Sixty-two patients under 4 years of age were recruited as a convenience clinical sample in Korle Bu Teaching Hospital, Ghana. Forty-three of these had quality images for all regions of interest. Using a naïve Bayes classifier, this method was capable of screening for anaemia (<11.0g/dL haemoglobin concentration) vs healthy blood haemoglobin concentration (≥11.0g/dL) with a sensitivity of 92.9% (95% CI 66.1% to 99.8%), a specificity of 89.7% (72.7% to 97.8%) when acting on unseen data, using only an affordable smartphone and no additional hardware. CONCLUSION: These results add to the body of evidence suggesting that smartphone colorimetry is likely to be a useful tool for making anaemia screening more widely available. However, there remains no consensus on the optimal method for image preprocessing or feature extraction, especially across diverse patient populations.

Validating a Sclera-Based Smartphone Application for Screening Jaundiced Newborns in Ghana.

OBJECTIVES: Reducing the burden of bilirubin-induced neurologic complications in low-resource countries requires reliable and accessible screening tools. We sought to optimize and validate a sclera-based smartphone application, Neonatal Scleral-Conjunctival Bilirubin (neoSCB), for screening neonatal jaundice. METHODS: Using a cross-sectional design, consecutive eligible infants (aged 0-28 days, in the hospital, not critically ill) were enrolled in Ghana from March 2019 to April 2020. Jaundice screening was performed with neoSCB (Samsung Galaxy S8) to quantify SCB and JM-105 (Dräger) for transcutaneous bilirubin (TcB). Screening values were compared with total serum bilirubin (TSB) measured at the point of care. RESULTS: Overall, 724 infants participated in the optimization and validation phases of the study. The analysis for validation included 336 infants with no previous treatment of jaundice. Single neoSCB image captures identified infants with TSB >14.62 mg/dL (250 µmol/L) with reasonably high sensitivity, specificity, and receiver operating characteristic area under the curve at 0.94 (95% confidence interval [CI], 0.91 to 0.97), 0.73 (95% CI, 0.68 to 0.78), and 0.90, respectively. These findings were comparable to the sensitivity and specificity of JM-105 (0.96 [95% CI, 0.90 to 0.99] and 0.81 [95% CI, 0.76 to 0.86], respectively). The TcB/TSB had a larger correlation coefficient (r = 0.93; P < .01) than SCB/TSB (r = 0.78; P < .01). Performance of both devices was lower in infants with previous phototherapy (n = 231). CONCLUSIONS: The diagnostic performance of neoSCB was comparable to JM-105 and is a potential, affordable, contact-free screening tool for neonatal jaundice.

Accurate device-independent colorimetric measurements using smartphones.

Smartphones provide an ideal platform for colorimetric measurements due to their low cost, portability and image quality. As with any imaging-based colorimetry system, ambient light and device variations introduce error which must be dealt with. We propose a novel processing method consisting of a one-time calibration stage to account for inter-phone variations, and an innovative use of ambient light subtraction with image pairs to account for variation in ambient light. Data collection is kept very simple, making it particularly useful for use in the field, since nothing additional is required in the images. Ambient subtraction is first demonstrated for a range of colors and phones (Samsung S8 and LG Nexus 5X), and the Subtracted Signal to Noise Ratio (SSNR) is defined as a metric for assessing whether an image pair is appropriate at the time of image capture. The experimentally determined SSNR threshold below which to suggest retaking the images is 3.4. The classification accuracy for results using the proposed calibration pipeline is then compared to the simplest image metadata-based alternative and is found to be greatly superior. Finally, a custom colorcard is shown to improve the accuracy of device-independent results for known smaller ranges of colors over a standard colorcard, making this a possible application-specific modification to the overall processing pipeline.

Smartphone screening for neonatal jaundice via ambient-subtracted sclera chromaticity.

Jaundice is a major cause of mortality and morbidity in the newborn. Globally, early identification and home monitoring are significant challenges in reducing the incidence of jaundice-related neurological damage. Smartphone cameras are promising as colour-based screening tools as they are low-cost, objective and ubiquitous. We propose a novel smartphone method to screen for neonatal jaundice by imaging the sclera. It does not rely on colour calibration cards or accessories, which may facilitate its adoption at scale and in less economically developed regions. Our approach is to explicitly address three confounding factors in relating colour to jaundice: (1) skin pigmentation, (2) ambient light, and (3) camera spectral response. (1) The variation in skin pigmentation is avoided by imaging the sclera. (2) With the smartphone screen acting as an illuminating flash, a flash/ no-flash image pair is captured using the front-facing camera. The contribution of ambient light is subtracted. (3) In principle, this permits a device- and ambient-independent measure of sclera chromaticity following a one-time calibration. We introduce the concept of Scleral-Conjunctival Bilirubin (SCB), in analogy with Transcutaneous Bilirubin (TcB). The scleral chromaticity is mapped to an SCB value. A pilot study was conducted in the UCL Hospital Neonatal Care Unit (n = 37). Neonates were imaged using a specially developed app concurrently with having a blood test for total serum bilirubin (TSB). The better of two models for SCB based on ambient-subtracted sclera chromaticity achieved r = 0.75 (p<0.01) correlation with TSB. Ambient subtraction improved chromaticity estimates in proof-of-principle laboratory tests and screening performance within our study sample. Using an SCB decision threshold of 190µmol/L, the sensitivity was 100% (specificity 61%) in identifying newborns with TSB>250µmol/L (area under receiver operating characteristic curve, AUROC, 0.86), and 92% (specificity 67%) in identifying newborns with TSB>205µmol/L (AUROC 0.85). These results are comparable to modern transcutaneous bilirubinometers.

Jaundice Eye Color Index (JECI): quantifying the yellowness of the sclera in jaundiced neonates with digital photography.

The sclera is arguably a better site than the skin to measure jaundice-especially in dark-skinned patients-since it is free of skin pigment (melanin), a major confounding factor. This work aims to show how the yellowness of the sclera can be quantified by digital photography in color spaces including the native RGB and CIE XYZ. We also introduce a new color metric we call "Jaundice Eye Color Index" (JECI) which allows the yellowness of jaundiced sclerae to be predicted for a specific total serum bilirubin level in the neonatal population.