A novel electronic algorithm using host biomarker point-of-care tests for the management of febrile illnesses in Tanzanian children (e-POCT): A randomized, controlled non-inferiority trial.

BACKGROUND: The management of childhood infections remains inadequate in resource-limited countries, resulting in high mortality and irrational use of antimicrobials. Current disease management tools, such as the Integrated Management of Childhood Illness (IMCI) algorithm, rely solely on clinical signs and have not made use of available point-of-care tests (POCTs) that can help to identify children with severe infections and children in need of antibiotic treatment. e-POCT is a novel electronic algorithm based on current evidence; it guides clinicians through the entire consultation and recommends treatment based on a few clinical signs and POCT results, some performed in all patients (malaria rapid diagnostic test, hemoglobin, oximeter) and others in selected subgroups only (C-reactive protein, procalcitonin, glucometer). The objective of this trial was to determine whether the clinical outcome of febrile children managed by the e-POCT tool was non-inferior to that of febrile children managed by a validated electronic algorithm derived from IMCI (ALMANACH), while reducing the proportion with antibiotic prescription. METHODS AND FINDINGS: We performed a randomized (at patient level, blocks of 4), controlled non-inferiority study among children aged 2-59 months presenting with acute febrile illness to 9 outpatient clinics in Dar es Salaam, Tanzania. In parallel, routine care was documented in 2 health centers. The primary outcome was the proportion of clinical failures (development of severe symptoms, clinical pneumonia on/after day 3, or persistent symptoms at day 7) by day 7 of follow-up. Non-inferiority would be declared if the proportion of clinical failures with e-POCT was no worse than the proportion of clinical failures with ALMANACH, within statistical variability, by a margin of 3%. The secondary outcomes included the proportion with antibiotics prescribed on day 0, primary referrals, and severe adverse events by day 30 (secondary hospitalizations and deaths). We enrolled 3,192 patients between December 2014 and February 2016 into the randomized study; 3,169 patients (e-POCT: 1,586; control [ALMANACH]: 1,583) completed the intervention and day 7 follow-up. Using e-POCT, in the per-protocol population, the absolute proportion of clinical failures was 2.3% (37/1,586), as compared with 4.1% (65/1,583) in the ALMANACH arm (risk difference of clinical failure -1.7, 95% CI -3.0, -0.5), meeting the prespecified criterion for non-inferiority. In a non-prespecified superiority analysis, we observed a 43% reduction in the relative risk of clinical failure when using e-POCT compared to ALMANACH (risk ratio [RR] 0.57, 95% CI 0.38, 0.85, p = 0.005). The proportion of severe adverse events was 0.6% in the e-POCT arm compared with 1.5% in the ALMANACH arm (RR 0.42, 95% CI 0.20, 0.87, p = 0.02). The proportion of antibiotic prescriptions was substantially lower, 11.5% compared to 29.7% (RR 0.39, 95% CI 0.33, 0.45, p < 0.001). Using e-POCT, the most common indication for antibiotic prescription was severe disease (57%, 103/182 prescriptions), while it was non-severe respiratory infections using the control algorithm (ALMANACH) (70%, 330/470 prescriptions). The proportion of clinical failures among the 544 children in the routine care cohort was 4.6% (25/544); 94.9% (516/544) of patients received antibiotics on day 0, and 1.1% (6/544) experienced severe adverse events. e-POCT achieved a 49% reduction in the relative risk of clinical failure compared to routine care (RR 0.51, 95% CI 0.31, 0.84, p = 0.007) and lowered antibiotic prescriptions to 11.5% from 94.9% (p < 0.001). Though this safety study was an important first step to evaluate e-POCT, its true utility should be evaluated through future implementation studies since adherence to the algorithm will be an important factor in making use of e-POCT's advantages in terms of clinical outcome and antibiotic prescription. CONCLUSIONS: e-POCT, an innovative electronic algorithm using host biomarker POCTs, including C-reactive protein and procalcitonin, has the potential to improve the clinical outcome of children with febrile illnesses while reducing antibiotic use through improved identification of children with severe infections, and better targeting of children in need of antibiotic prescription. TRIAL REGISTRATION: ClinicalTrials.gov NCT02225769.

Recommendations for malaria prevention in moderate to low risk areas: travellers' choice and risk perception.

BACKGROUND: The considerable malaria decline in several countries challenges the strategy of chemoprophylaxis for travellers visiting moderate- to low-risk areas. An international consensus on the best strategy is lacking. It is essential to include travellers' opinions in the decision process. The preference of travellers regarding malaria prevention for moderate- to low-risk areas, related to their risk perception, as well as the reasons for their choices were investigated. METHODS: Prior to pre-travel consultation in the Travel Clinic, a self-administered questionnaire was given to travellers visiting moderate- to low-risk malaria areas. Four preventive options were proposed to the traveller, i.e., bite prevention only, chemoprophylaxis, stand-by emergency treatment alone, and stand-by emergency treatment with rapid diagnostic test. The information was accompanied by a risk scale for incidence of malaria, anti-malarial adverse drug reactions and other travel-related risks, inspired by Paling palettes from the Risk Communication Institute. RESULTS: A total of 391 travellers were included from December 2012 to December 2013. Fifty-nine (15%) opted for chemoprophylaxis, 116 (30%) for stand-by emergency treatment, 112 (29%) for stand-by emergency treatment with rapid diagnostic test, 100 (26%) for bite prevention only, and four (1%) for other choices. Travellers choosing chemoprophylaxis justified their choice for security reasons (42%), better preventive action (29%), higher efficacy (15%) and easiness (15%). The reasons for choosing stand-by treatment or bite prevention only were less medication consumed (29%), less adverse drug reactions (23%) and lower price (9%). Those who chose chemoprophylaxis were more likely to have used it in the past (OR = 3.0 (CI 1.7-5.44)), but were not different in terms of demographic, travel characteristics or risk behaviour. CONCLUSIONS: When travelling to moderate- to low-risk malaria areas, 85% of interviewees chose not to take chemoprophylaxis as malaria prevention, although most guidelines recommend it. They had coherent reasons for their choice. New recommendations should include shared decision-making to take into account travellers' preferences.

Can smartphones and tablets improve the management of childhood illness in Tanzania? A qualitative study from a primary health care worker's perspective.

BACKGROUND: The impact of the Integrated Management of Childhood Illness (IMCI) strategy has been less than anticipated because of poor uptake. Electronic algorithms have the potential to improve quality of health care in children. However, feasibility studies about the use of electronic protocols on mobile devices over time are limited. This study investigated constraining as well as facilitating factors that influence the uptake of a new electronic Algorithm for Management of Childhood Illness (ALMANACH) among primary health workers in Dar es Salaam, Tanzania. METHODS: A qualitative approach was applied using in-depth interviews and focus group discussions with altogether 40 primary health care workers from 6 public primary health facilities in the three municipalities of Dar es Salaam, Tanzania. Health worker's perceptions related to factors facilitating or constraining the uptake of the electronic ALMANACH were identified. RESULTS: In general, the ALMANACH was assessed positively. The majority of the respondents felt comfortable to use the devices and stated that patient's trust was not affected. Most health workers said that the ALMANACH simplified their work, reduced antibiotic prescription and gave correct classification and treatment for common causes of childhood illnesses. Few HWs reported technical challenges using the devices and complained about having had difficulties in typing. Majority of the respondents stated that the devices increased the consultation duration compared to routine practice. In addition, health system barriers such as lack of staff, lack of medicine and lack of financial motivation were identified as key reasons for the low uptake of the devices. CONCLUSIONS: The ALMANACH built on electronic devices was perceived to be a powerful and useful tool. However, health system challenges influenced the uptake of the devices in the selected health facilities.

Over-diagnosis of malaria by microscopy in the Kilombero Valley, Southern Tanzania: an evaluation of the utility and cost-effectiveness of rapid diagnostic tests.

BACKGROUND: Early and accurate diagnosis of febrile patients is essential to treat uncomplicated malaria cases properly, prevent severe malaria, and avert unnecessary anti-malarial treatments. Improper use of anti-malarials increases the risk of adverse drug reaction and the evolution of drug/parasite resistance. While microscopy is the most common form of malaria diagnosis, concerns over its accuracy have prompted the incorporation of malaria rapid diagnostic tests (RDTs) into many national malaria control programmes. METHODS: Over a three-month period, a direct comparison between microscopy and RDTs was made in a rural, private dispensary in the Kilombero Valley, Morogoro District, southern Tanzania, with the aim of estimating the extent of malaria over-diagnosis and over-treatment with anti-malarials. The study cohort was made up of patients referred by the dispensary's clinician for malaria testing. One hundred percent of patients approached agreed to participate in this study and were then tested using both microscopy and RDTs. Using the results from the comparison of the two tests at this dispensary, the potential cost effectiveness of introducing RDTs to a neighbouring public health centre was estimated on the basis of this centre's past malaria records spanning December 2007 to August 2011. RESULTS: At the private dispensary, the apparent prevalence of malaria was 78% based on microscopy whereas the true prevalence, calculated using RDTs as the gold standard, was estimated at 14%. This discrepancy indicates that when using microscopy as the sole diagnostic test, malaria is being over-diagnosed by approximately a factor of five in this setting. At the public clinic, apparent malaria prevalence based on microscopy was 74%. If similar rates of over-diagnosis are assumed, 5,285 patients of the 6,769 patients positively diagnosed with malaria using microscopy were likely given unnecessary anti-malarials, and their true cause of illness was not addressed. The introduction of RDTs to the public clinic would be highly cost-efficient, with an estimated net saving of over 96 USD/month. CONCLUSIONS: Compared with RDTs, microscopy led to almost four out of five patients being over-diagnosed with malaria in this rural part of Tanzania. A policy that encompasses both the private and public sectors of health care is needed to ensure quality diagnostic testing for febrile patients. With estimated prevalence at 14%, RDT introduction is recommended given WHO findings that RDTs are predicted to be cost-effective in prevalence areas of less than 20%. The use of RDTs in malaria diagnosis would not only reduce government spending but would prove beneficial to ensuring appropriate care and treatment of febrile illness.

Digitalizing Clinical Guidelines: Experiences in the Development of Clinical Decision Support Algorithms for Management of Childhood Illness in Resource-Constrained Settings.

Clinical decision support systems (CDSSs) can strengthen the quality of integrated management of childhood illness (IMCI) in resource-constrained settings. Several IMCI-related CDSSs have been developed and implemented in recent years. Yet, despite having a shared starting point, the IMCI-related CDSSs are markedly varied due to the need for interpretation when translating narrative guidelines into decision logic combined with considerations of context and design choices. Between October 2019 and April 2021, we conducted a comparative analysis of 4 IMCI-related CDSSs. The extent of adaptations to IMCI varied, but common themes emerged. Scope was extended to cover a broader range of conditions. Content was added or modified to enhance precision, align with new evidence, and support rational resource use. Structure was modified to increase efficiency, improve usability, and prioritize care for severely ill children. The multistakeholder development processes involved syntheses of recommendations from existing guidelines and literature; creation and validation of clinical algorithms; and iterative development, implementation, and evaluation. The common themes surrounding adaptations of IMCI guidance highlight the complexities of digitalizing evidence-based recommendations and reinforce the rationale for leveraging standards for CDSS development, such as the World Health Organization's SMART Guidelines. Implementation through multistakeholder dialogue is critical to ensure CDSSs can effectively and equitably improve quality of care for children in resource-constrained settings.

Electronic clinical decision support algorithms incorporating point-of-care diagnostic tests in low-resource settings: a target product profile.

Health workers in low-resource settings often lack the support and tools to follow evidence-based clinical recommendations for diagnosing, treating and managing sick patients. Digital technologies, by combining patient health information and point-of-care diagnostics with evidence-based clinical protocols, can help improve the quality of care and the rational use of resources, and save patient lives. A growing number of electronic clinical decision support algorithms (CDSAs) on mobile devices are being developed and piloted without evidence of safety or impact. Here, we present a target product profile (TPP) for CDSAs aimed at guiding preventive or curative consultations in low-resource settings. This document will help align developer and implementer processes and product specifications with the needs of end users, in terms of quality, safety, performance and operational functionality. To identify the characteristics of CDSAs, a multidisciplinary group of experts (academia, industry and policy makers) with expertise in diagnostic and CDSA development and implementation in low-income and middle-income countries were convened to discuss a draft TPP. The TPP was finalised through a Delphi process to facilitate consensus building. An agreement greater than 75% was reached for all 40 TPP characteristics. In general, experts were in overwhelming agreement that, given that CDSAs provide patient management recommendations, the underlying clinical algorithms should be human-interpretable and evidence-based. Whenever possible, the algorithm's patient management output should take into account pretest disease probabilities and likelihood ratios of clinical and diagnostic predictors. In addition, validation processes should at a minimum show that CDSAs are implementing faithfully the evidence they are based on, and ideally the impact on patient health outcomes. In terms of operational needs, CDSAs should be designed to fit within clinic workflows and function in connectivity-challenged and high-volume settings. Data collected through the tool should conform to local patient privacy regulations and international data standards.

Performance of Health Workers Using an Electronic Algorithm for the Management of Childhood Illness in Tanzania: A Pilot Implementation Study.

In low-resource settings, where qualified health workers (HWs) are scarce and childhood mortality high, rational antimicrobial prescription for childhood illnesses is a challenge. To assess whether smartphones running guidelines, as compared with paper support, improve consultation process and rational use of medicines for children, a pilot cluster-randomized controlled study was conducted in Tanzania. Nine primary health-care facilities (HFs) were randomized into three arms: 1) paper algorithm, 2) electronic algorithm on a smartphone, and 3) control. All HWs attending children aged 2-59 months for acute illness in intervention HFs were trained on a new clinical algorithm for management of childhood illness (ALMANACH) either on 1) paper or 2) electronic support; 4 months after training, consultations were observed. An expert consultation was the reference for classification and treatment. Main outcomes were proportion of children checked for danger signs, and antibiotics prescription rate. A total of 504 consultations (166, 171, and 167 in control, paper, and phone arms, respectively) were observed. The use of smartphones versus paper was associated with a significant increase in children checked for danger signs (41% versus 74%, P = 0.04). Antibiotic prescriptions rate dropped from 70% in the control to 26%, and 25% in paper and electronic arms. The HWs-expert agreement on pneumonia classification remained low (expert's pneumonia identified by HWs in 26%, 30%, and 39% of patients, respectively).Mobile technology in low-income countries is implementable and has a potential to improve HWs' performance. Additional point-of-care diagnostic tests are needed to ensure appropriate management. Improving the rational use of antimicrobial is a challenge that ALMANACH can help to take up.

Clinical features for diagnosis of pneumonia in children younger than 5 years: a systematic review and meta-analysis.

BACKGROUND: Pneumonia is the biggest cause of deaths in young children in developing countries, but early diagnosis and intervention can effectively reduce mortality. We aimed to assess the diagnostic value of clinical signs and symptoms to identify radiological pneumonia in children younger than 5 years and to review the accuracy of WHO criteria for diagnosis of clinical pneumonia. METHODS: We searched Medline (PubMed), Embase (Ovid), the Cochrane Database of Systematic Reviews, and reference lists of relevant studies, without date restrictions, to identify articles assessing clinical predictors of radiological pneumonia in children. Selection was based on: design (diagnostic accuracy studies), target disease (pneumonia), participants (children aged <5 years), setting (ambulatory or hospital care), index test (clinical features), and reference standard (chest radiography). Quality assessment was based on the 2011 Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) criteria. For each index test, we calculated sensitivity and specificity and, when the tests were assessed in four or more studies, calculated pooled estimates with use of bivariate model and hierarchical summary receiver operation characteristics plots for meta-analysis. FINDINGS: We included 18 articles in our analysis. WHO-approved signs age-related fast breathing (six studies; pooled sensitivity 0·62, 95% CI 0·26-0·89; specificity 0·59, 0·29-0·84) and lower chest wall indrawing (four studies; 0·48, 0·16-0·82; 0·72, 0·47-0·89) showed poor diagnostic performance in the meta-analysis. Features with the highest pooled positive likelihood ratios were respiratory rate higher than 50 breaths per min (1·90, 1·45-2·48), grunting (1·78, 1·10-2·88), chest indrawing (1·76, 0·86-3·58), and nasal flaring (1·75, 1·20-2·56). Features with the lowest pooled negative likelihood ratio were cough (0·30, 0·09-0·96), history of fever (0·53, 0·41-0·69), and respiratory rate higher than 40 breaths per min (0·43, 0·23-0·83). INTERPRETATION: Not one clinical feature was sufficient to diagnose pneumonia definitively. Combination of clinical features in a decision tree might improve diagnostic performance, but the addition of new point-of-care tests for diagnosis of bacterial pneumonia would help to attain an acceptable level of accuracy. FUNDING: Swiss National Science Foundation.

Managing the Sick Child in the Era of Declining Malaria Transmission: Development of ALMANACH, an Electronic Algorithm for Appropriate Use of Antimicrobials.

OBJECTIVE: To review the available knowledge on epidemiology and diagnoses of acute infections in children aged 2 to 59 months in primary care setting and develop an electronic algorithm for the Integrated Management of Childhood Illness to reach optimal clinical outcome and rational use of medicines. METHODS: A structured literature review in Medline, Embase and the Cochrane Database of Systematic Review (CDRS) looked for available estimations of diseases prevalence in outpatients aged 2-59 months, and for available evidence on i) accuracy of clinical predictors, and ii) performance of point-of-care tests for targeted diseases. A new algorithm for the management of childhood illness (ALMANACH) was designed based on evidence retrieved and results of a study on etiologies of fever in Tanzanian children outpatients. FINDINGS: The major changes in ALMANACH compared to IMCI (2008 version) are the following: i) assessment of 10 danger signs, ii) classification of non-severe children into febrile and non-febrile illness, the latter receiving no antibiotics, iii) classification of pneumonia based on a respiratory rate threshold of 50 assessed twice for febrile children 12-59 months; iv) malaria rapid diagnostic test performed for all febrile children. In the absence of identified source of fever at the end of the assessment, v) urine dipstick performed for febrile children <2 years to consider urinary tract infection, vi) classification of 'possible typhoid' for febrile children >2 years with abdominal tenderness; and lastly vii) classification of 'likely viral infection' in case of negative results. CONCLUSION: This smartphone-run algorithm based on new evidence and two point-of-care tests should improve the quality of care of <5 year children and lead to more rational use of antimicrobials.

New Algorithm for Managing Childhood Illness Using Mobile Technology (ALMANACH): A Controlled Non-Inferiority Study on Clinical Outcome and Antibiotic Use in Tanzania.

INTRODUCTION: The decline of malaria and scale-up of rapid diagnostic tests calls for a revision of IMCI. A new algorithm (ALMANACH) running on mobile technology was developed based on the latest evidence. The objective was to ensure that ALMANACH was safe, while keeping a low rate of antibiotic prescription. METHODS: Consecutive children aged 2-59 months with acute illness were managed using ALMANACH (2 intervention facilities), or standard practice (2 control facilities) in Tanzania. Primary outcomes were proportion of children cured at day 7 and who received antibiotics on day 0. RESULTS: 130/842 (15∙4%) in ALMANACH and 241/623 (38∙7%) in control arm were diagnosed with an infection in need for antibiotic, while 3∙8% and 9∙6% had malaria. 815/838 (97∙3%;96∙1-98.4%) were cured at D7 using ALMANACH versus 573/623 (92∙0%;89∙8-94∙1%) using standard practice (p<0∙001). Of 23 children not cured at D7 using ALMANACH, 44% had skin problems, 30% pneumonia, 26% upper respiratory infection and 13% likely viral infection at D0. Secondary hospitalization occurred for one child using ALMANACH and one who eventually died using standard practice. At D0, antibiotics were prescribed to 15∙4% (12∙9-17∙9%) using ALMANACH versus 84∙3% (81∙4-87∙1%) using standard practice (p<0∙001). 2∙3% (1∙3-3.3) versus 3∙2% (1∙8-4∙6%) received an antibiotic secondarily. CONCLUSION: Management of children using ALMANACH improve clinical outcome and reduce antibiotic prescription by 80%. This was achieved through more accurate diagnoses and hence better identification of children in need of antibiotic treatment or not. The building on mobile technology allows easy access and rapid update of the decision chart. TRIAL REGISTRATION: Pan African Clinical Trials Registry PACTR201011000262218.