Diagnostic accuracy of an automated microscope solution (miLab™) in detecting malaria parasites in symptomatic patients at point-of-care in Sudan: a case-control study.

BACKGROUND: Microscopic detection of malaria parasites is labour-intensive, time-consuming, and expertise-demanding. Moreover, the slide interpretation is highly dependent on the staining technique and the technician's expertise. Therefore, there is a growing interest in next-generation, fully- or semi-integrated microscopes that can improve slide preparation and examination. This study aimed to evaluate the clinical performance of miLab™ (Noul Inc., Republic of Korea), a fully-integrated automated microscopy device for the detection of malaria parasites in symptomatic patients at point-of-care in Sudan. METHODS: This was a prospective, case-control diagnostic accuracy study conducted in primary health care facilities in rural Khartoum, Sudan in 2020. According to the outcomes of routine on-site microscopy testing, 100 malaria-positive and 90 malaria-negative patients who presented at the health facility and were 5 years of age or older were enrolled consecutively. All consenting patients underwent miLab™ testing and received a negative or suspected result. For the primary analysis, the suspected results were regarded as positive (automated mode). For the secondary analysis, the operator reviewed the suspected results and categorized them as either negative or positive (corrected mode). Nested polymerase chain reaction (PCR) was used as the reference standard, and expert light microscopy as the comparator. RESULTS: Out of the 190 patients, malaria diagnosis was confirmed by PCR in 112 and excluded in 78. The sensitivity of miLab™ was 91.1% (95% confidence interval [CI] 84.2-95.6%) and the specificity was 66.7% (95% Cl 55.1-67.7%) in the automated mode. The specificity increased to 96.2% (95% Cl 89.6-99.2%), with operator intervention in the corrected mode. Concordance of miLab with expert microscopy was substantial (kappa 0.65 [95% CI 0.54-0.76]) in the automated mode, but almost perfect (kappa 0.97 [95% CI 0.95-0.99]) in the corrected mode. A mean difference of 0.359 was found in the Bland-Altman analysis of the agreement between expert microscopy and miLab™ for quantifying parasite counts. CONCLUSION: When used in a clinical context, miLab™ demonstrated high sensitivity but low specificity. Expert intervention was shown to be required to improve the device's specificity in its current version. miLab™ in the corrected mode performed similar to expert microscopy. Before clinical application, more refinement is needed to ensure full workflow automation and eliminate human intervention. Trial registration ClinicalTrials.gov: NCT04558515.

Patient-level performance evaluation of a smartphone-based malaria diagnostic application.

BACKGROUND: Microscopic examination is commonly used for malaria diagnosis in the field. However, the lack of well-trained microscopists in malaria-endemic areas impacted the most by the disease is a severe problem. Besides, the examination process is time-consuming and prone to human error. Automated diagnostic systems based on machine learning offer great potential to overcome these problems. This study aims to evaluate Malaria Screener, a smartphone-based application for malaria diagnosis. METHODS: A total of 190 patients were recruited at two sites in rural areas near Khartoum, Sudan. The Malaria Screener mobile application was deployed to screen Giemsa-stained blood smears. Both expert microscopy and nested PCR were performed to use as reference standards. First, Malaria Screener was evaluated using the two reference standards. Then, during post-study experiments, the evaluation was repeated for a newly developed algorithm, PlasmodiumVF-Net. RESULTS: Malaria Screener reached 74.1% (95% CI 63.5-83.0) accuracy in detecting Plasmodium falciparum malaria using expert microscopy as the reference after a threshold calibration. It reached 71.8% (95% CI 61.0-81.0) accuracy when compared with PCR. The achieved accuracies meet the WHO Level 3 requirement for parasite detection. The processing time for each smear varies from 5 to 15 min, depending on the concentration of white blood cells (WBCs). In the post-study experiment, Malaria Screener reached 91.8% (95% CI 83.8-96.6) accuracy when patient-level results were calculated with a different method. This accuracy meets the WHO Level 1 requirement for parasite detection. In addition, PlasmodiumVF-Net, a newly developed algorithm, reached 83.1% (95% CI 77.0-88.1) accuracy when compared with expert microscopy and 81.0% (95% CI 74.6-86.3) accuracy when compared with PCR, reaching the WHO Level 2 requirement for detecting both Plasmodium falciparum and Plasmodium vivax malaria, without using the testing sites data for training or calibration. Results reported for both Malaria Screener and PlasmodiumVF-Net used thick smears for diagnosis. In this paper, both systems were not assessed in species identification and parasite counting, which are still under development. CONCLUSION: Malaria Screener showed the potential to be deployed in resource-limited areas to facilitate routine malaria screening. It is the first smartphone-based system for malaria diagnosis evaluated on the patient-level in a natural field environment. Thus, the results in the field reported here can serve as a reference for future studies.