Predictive value of pulse oximetry for mortality in infants and children presenting to primary care with clinical pneumonia in rural Malawi: A data linkage study.

BACKGROUND: The mortality impact of pulse oximetry use during infant and childhood pneumonia management at the primary healthcare level in low-income countries is unknown. We sought to determine mortality outcomes of infants and children diagnosed and referred using clinical guidelines with or without pulse oximetry in Malawi. METHODS AND FINDINGS: We conducted a data linkage study of prospective health facility and community case and mortality data. We matched prospectively collected community health worker (CHW) and health centre (HC) outpatient data to prospectively collected hospital and community-based mortality surveillance outcome data, including episodes followed up to and deaths within 30 days of pneumonia diagnosis amongst children 0-59 months old. All data were collected in Lilongwe and Mchinji districts, Malawi, from January 2012 to June 2014. We determined differences in mortality rates using <90% and <93% oxygen saturation (SpO2) thresholds and World Health Organization (WHO) and Malawi clinical guidelines for referral. We used unadjusted and adjusted (for age, sex, respiratory rate, and, in analyses of HC data only, Weight for Age Z-score [WAZ]) regression to account for interaction between SpO2 threshold (pulse oximetry) and clinical guidelines, clustering by child, and CHW or HC catchment area. We matched CHW and HC outpatient data to hospital inpatient records to explore roles of pulse oximetry and clinical guidelines on hospital attendance after referral. From 7,358 CHW and 6,546 HC pneumonia episodes, we linked 417 CHW and 695 HC pneumonia episodes to 30-day mortality outcomes: 16 (3.8%) CHW and 13 (1.9%) HC patients died. SpO2 thresholds of <90% and <93% identified 1 (6%) of the 16 CHW deaths that were unidentified by integrated community case management (iCCM) WHO referral protocol and 3 (23%) and 4 (31%) of the 13 HC deaths, respectively, that were unidentified by the integrated management of childhood illness (IMCI) WHO protocol. Malawi IMCI referral protocol, which differs from WHO protocol at the HC level and includes chest indrawing, identified all but one of these deaths. SpO2 < 90% predicted death independently of WHO danger signs compared with SpO2 ≥ 90%: HC Risk Ratio (RR), 9.37 (95% CI: 2.17-40.4, p = 0.003); CHW RR, 6.85 (1.15-40.9, p = 0.035). SpO2 < 93% was also predictive versus SpO2 ≥ 93% at HC level: RR, 6.68 (1.52-29.4, p = 0.012). Hospital referrals and outpatient episodes with referral decision indications were associated with mortality. A substantial proportion of those referred were not found admitted in the inpatients within 7 days of referral advice. All 12 deaths in 73 hospitalised children occurred within 24 hours of arrival in the hospital, which highlights delay in appropriate care seeking. The main limitation of our study was our ability to only match 6% of CHW episodes and 11% of HC episodes to mortality outcome data. CONCLUSIONS: Pulse oximetry identified fatal pneumonia episodes at HCs in Malawi that would otherwise have been missed by WHO referral guidelines alone. Our findings suggest that pulse oximetry could be beneficial in supplementing clinical signs to identify children with pneumonia at high risk of mortality in the outpatient setting in health centres for referral to a hospital for appropriate management.

Practical recommendations for the evaluation of improvement initiatives.

A lack of clear guidance for funders, evaluators and improvers on what to include in evaluation proposals can lead to evaluation designs that do not answer the questions stakeholders want to know. These evaluation designs may not match the iterative nature of improvement and may be imposed onto an initiative in a way that is impractical from the perspective of improvers and the communities with whom they work. Consequently, the results of evaluations are often controversial, and attribution remains poorly understood. Improvement initiatives are iterative, adaptive and context-specific. Evaluation approaches and designs must align with these features, specifically in their ability to consider complexity, to evolve as the initiative adapts over time and to understand the interaction with local context. Improvement initiatives often identify broadly defined change concepts and provide tools for care teams to tailor these in more detail to local conditions. Correspondingly, recommendations for evaluation are best provided as broad guidance, to be tailored to the specifics of the initiative. In this paper, we provide practical guidance and recommendations that funders and evaluators can use when developing an evaluation plan for improvement initiatives that seeks to: identify the questions stakeholders want to address; develop the initial program theory of the initiative; identify high-priority areas to measure progress over time; describe the context the initiative will be applied within; and identify experimental or observational designs that will address attribution.

A framework for learning about improvement: embedded implementation and evaluation design to optimize learning.

Improving health care involves many actors, often working in complex adaptive systems. Interventions tend to be multi-factorial, implementation activities diverse, and contexts dynamic and complicated. This makes improvement initiatives challenging to describe and evaluate as matching evaluation and program designs can be difficult, requiring collaboration, trust and transparency. Collaboration is required to address important epidemiological principles of bias and confounding. If this does not take place, results may lack credibility because the association between interventions implemented and outcomes achieved is obscure and attribution uncertain. Moreover, lack of clarity about what was implemented, how it was implemented, and the context in which it was implemented often lead to disappointment or outright failure of spread and scale-up efforts. The input of skilled evaluators into the design and conduct of improvement initiatives can be helpful in mitigating these potential problems. While evaluation must be rigorous, if it is too rigid necessary adaptation and learning may be compromised. This article provides a framework and guidance on how improvers and evaluators can work together to design, implement and learn about improvement interventions more effectively.

Quality improvement and emerging global health priorities.

Quality improvement approaches can strengthen action on a range of global health priorities. Quality improvement efforts are uniquely placed to reorient care delivery systems towards integrated people-centred health services and strengthen health systems to achieve Universal Health Coverage (UHC). This article makes the case for addressing shortfalls of previous agendas by articulating the critical role of quality improvement in the Sustainable Development Goal era. Quality improvement can stimulate convergence between health security and health systems; address global health security priorities through participatory quality improvement approaches; and improve health outcomes at all levels of the health system. Entry points for action include the linkage with antimicrobial resistance and the contentious issue of the health of migrants. The work required includes focussed attention on the continuum of national quality policy formulation, implementation and learning; alongside strengthening the measurement-improvement linkage. Quality improvement plays a key role in strengthening health systems to achieve UHC.

Effects of women's groups practising participatory learning and action on preventive and care-seeking behaviours to reduce neonatal mortality: A meta-analysis of cluster-randomised trials.

BACKGROUND: The World Health Organization recommends participatory learning and action (PLA) in women's groups to improve maternal and newborn health, particularly in rural settings with low access to health services. There have been calls to understand the pathways through which this community intervention may affect neonatal mortality. We examined the effect of women's groups on key antenatal, delivery, and postnatal behaviours in order to understand pathways to mortality reduction. METHODS AND FINDINGS: We conducted a meta-analysis using data from 7 cluster-randomised controlled trials that took place between 2001 and 2012 in rural India (2 trials), urban India (1 trial), rural Bangladesh (2 trials), rural Nepal (1 trial), and rural Malawi (1 trial), with the number of participants ranging between 6,125 and 29,901 live births. Behavioural outcomes included appropriate antenatal care, facility delivery, use of a safe delivery kit, hand washing by the birth attendant prior to delivery, use of a sterilised instrument to cut the umbilical cord, immediate wrapping of the newborn after delivery, delayed bathing of the newborn, early initiation of breastfeeding, and exclusive breastfeeding. We used 2-stage meta-analysis techniques to estimate the effect of the women's group intervention on behavioural outcomes. In the first stage, we used random effects models with individual patient data to assess the effect of groups on outcomes separately for the different trials. In the second stage of the meta-analysis, random effects models were applied using summary-level estimates calculated in the first stage of the analysis. To determine whether behaviour change was related to group attendance, we used random effects models to assess associations between outcomes and the following categories of group attendance and allocation: women attending a group and allocated to the intervention arm; women not attending a group but allocated to the intervention arm; and women allocated to the control arm. Overall, women's groups practising PLA improved behaviours during and after home deliveries, including the use of safe delivery kits (odds ratio [OR] 2.92, 95% CI 2.02-4.22; I2 = 63.7%, 95% CI 4.4%-86.2%), use of a sterile blade to cut the umbilical cord (1.88, 1.25-2.82; 67.6%, 16.1%-87.5%), birth attendant washing hands prior to delivery (1.87, 1.19-2.95; 79%, 53.8%-90.4%), delayed bathing of the newborn for at least 24 hours (1.47, 1.09-1.99; 68.0%, 29.2%-85.6%), and wrapping the newborn within 10 minutes of delivery (1.27, 1.02-1.60; 0.0%, 0%-79.2%). Effects were partly dependent on the proportion of pregnant women attending groups. We did not find evidence of effects on uptake of antenatal care (OR 1.03, 95% CI 0.77-1.38; I2 = 86.3%, 95% CI 73.8%-92.8%), facility delivery (1.02, 0.93-1.12; 21.4%, 0%-65.8%), initiating breastfeeding within 1 hour (1.08, 0.85-1.39; 76.6%, 50.9%-88.8%), or exclusive breastfeeding for 6 weeks after delivery (1.18, 0.93-1.48; 72.9%, 37.8%-88.2%). The main limitation of our analysis is the high degree of heterogeneity for effects on most behaviours, possibly due to the limited number of trials involving women's groups and context-specific effects. CONCLUSIONS: This meta-analysis suggests that women's groups practising PLA improve key behaviours on the pathway to neonatal mortality, with the strongest evidence for home care behaviours and practices during home deliveries. A lack of consistency in improved behaviours across all trials may reflect differences in local priorities, capabilities, and the responsiveness of health services. Future research could address the mechanisms behind how PLA improves survival, in order to adapt this method to improve maternal and newborn health in different contexts, as well as improve other outcomes across the continuum of care for women, children, and adolescents.

Pulse oximetry for children with pneumonia treated as outpatients in rural Malawi.

OBJECTIVE: To investigate implementation of outpatient pulse oximetry among children with pneumonia, in Malawi. METHODS: In 2011, 72 health-care providers at 18 rural health centres and 38 community health workers received training in the use of pulse oximetry to measure haemoglobin oxygen saturations. Data collected, between 1 January 2012 and 30 June 2014 by the trained individuals, on children aged 2-59 months with clinically diagnosed pneumonia were analysed. FINDINGS: Of the 14 092 children included in the analysis, 13 266 (94.1%) were successfully checked by oximetry. Among the children with chest indrawing and/or danger signs, those with a measured oxygen saturation below 90% were more than twice as likely to have been referred as those with higher saturations (84.3% [385/457] vs 41.5% [871/2099]; P < 0.001). The availability of oximetry appeared to have increased the referral rate for severely hypoxaemic children without chest indrawing or danger signs from 0% to 27.2% (P < 0.001). In the absence of oximetry, if the relevant World Health Organization (WHO) guidelines published in 2014 had been applied, 390/568 (68.7%) severely hypoxaemic children at study health centres and 52/84 (61.9%) severely hypoxaemic children seen by community health workers would have been considered ineligible for referral. CONCLUSION: Implementation of pulse oximetry by our trainees substantially increased the referrals of Malawian children with severe hypoxaemic pneumonia. When data from oximetry were excluded, retrospective application of the guidelines published by WHO in 2014 failed to identify a considerable proportion of severely hypoxaemic children eligible only via oximetry.

Measurement and valuation of health providers' time for the management of childhood pneumonia in rural Malawi: an empirical study.

BACKGROUND: Human resources are a major cost driver in childhood pneumonia case management. Introduction of 13-valent pneumococcal conjugate vaccine (PCV-13) in Malawi can lead to savings on staff time and salaries due to reductions in pneumonia cases requiring admission. Reliable estimates of human resource costs are vital for use in economic evaluations of PCV-13 introduction. METHODS: Twenty-eight severe and twenty-four very severe pneumonia inpatients under the age of five were tracked from admission to discharge by paediatric ward staff using self-administered timesheets at Mchinji District Hospital between June and August 2012. All activities performed and the time spent on each activity were recorded. A monetary value was assigned to the time by allocating a corresponding percentage of the health workers' salary. All costs are reported in 2012 US$. RESULTS: A total of 1,017 entries, grouped according to 22 different activity labels, were recorded during the observation period. On average, 99 min (standard deviation, SD = 46) were spent on each admission: 93 (SD = 38) for severe and 106 (SD = 55) for very severe cases. Approximately 40 % of activities involved monitoring and stabilization, including administering non-drug therapies such as oxygen. A further 35 % of the time was spent on injecting antibiotics. Nurses provided 60 % of the total time spent on pneumonia admissions, clinicians 25 % and support staff 15 %. Human resource costs were approximately US$ 2 per bed-day and, on average, US$ 29.5 per severe pneumonia admission and US$ 37.7 per very severe admission. CONCLUSIONS: Self-reporting was successfully used in this context to generate reliable estimates of human resource time and costs of childhood pneumonia treatment. Assuming vaccine efficacy of 41 % and 90 % coverage, PCV-13 introduction in Malawi can save over US$ 2 million per year in staff costs alone.

Cost-effectiveness and affordability of community mobilisation through women's groups and quality improvement in health facilities (MaiKhanda trial) in Malawi.

BACKGROUND: Understanding the cost-effectiveness and affordability of interventions to reduce maternal and newborn deaths is critical to persuading policymakers and donors to implement at scale. The effectiveness of community mobilisation through women's groups and health facility quality improvement, both aiming to reduce maternal and neonatal mortality, was assessed by a cluster randomised controlled trial conducted in rural Malawi in 2008-2010. In this paper, we calculate intervention cost-effectiveness and model the affordability of the interventions at scale. METHODS: Bayesian methods are used to estimate the incremental cost-effectiveness of the community and facility interventions on their own (CI, FI), and together (FICI), compared to current practice in rural Malawi. Effects are estimated with Monte Carlo simulation using the combined full probability distributions of intervention effects on stillbirths, neonatal deaths and maternal deaths. Cost data was collected prospectively from a provider perspective using an ingredients approach and disaggregated at the intervention (not cluster or individual) level. Expected Incremental Benefit, Cost-effectiveness Acceptability Curves and Expected Value of Information (EVI) were calculated using a threshold of $780 per disability-adjusted life-year (DALY) averted, the per capita gross domestic product of Malawi in 2013 international $. RESULTS: The incremental cost-effectiveness of CI, FI, and combined FICI was $79, $281, and $146 per DALY averted respectively, compared to current practice. FI is dominated by CI and FICI. Taking into account uncertainty, both CI and combined FICI are highly likely to be cost effective (probability 98% and 93%, EVI $210,423 and $598,177 respectively). Combined FICI is incrementally cost effective compared to either intervention individually (probability 60%, ICER $292, EIB $9,334,580 compared to CI). Future scenarios also found FICI to be the optimal decision. Scaling-up to the whole of Malawi, CI is of greatest value for money, potentially averting 13.0% of remaining annual DALYs from stillbirths, neonatal and maternal deaths for the equivalent of 6.8% of current annual expenditure on maternal and neonatal health in Malawi. CONCLUSIONS: Community mobilisation through women's groups is a highly cost-effective and affordable strategy to reduce maternal and neonatal mortality in Malawi. Combining community mobilisation with health facility quality improvement is more effective, more costly, but also highly cost-effective and potentially affordable in this context.

Opportunities to improve postpartum care for mothers and infants: design of context-specific packages of postpartum interventions in rural districts in four sub-Saharan African countries.

BACKGROUND: Postpartum maternal and infant mortality is high in sub-Saharan Africa and improving postpartum care as a strategy to enhance maternal and infant health has been neglected. We describe the design and selection of suitable, context-specific interventions that have the potential to improve postpartum care. METHODS: The study is implemented in rural districts in Burkina Faso, Kenya, Malawi and Mozambique. We used the four steps 'systems thinking' approach to design and select interventions: 1) we conducted a stakeholder analysis to identify and convene stakeholders; 2) we organised stakeholders causal analysis workshops in which the local postpartum situation and challenges and possible interventions were discussed; 3) based on comprehensive needs assessment findings, inputs from the stakeholders and existing knowledge regarding good postpartum care, a list of potential interventions was designed, and; 4) the stakeholders selected and agreed upon final context-specific intervention packages to be implemented to improve postpartum care. RESULTS: Needs assessment findings showed that in all study countries maternal, newborn and child health is a national priority but specific policies for postpartum care are weak and there is very little evidence of effective postpartum care implementation. In the study districts few women received postpartum care during the first week after childbirth (25 % in Burkina Faso, 33 % in Kenya, 41 % in Malawi, 40 % in Mozambique). Based on these findings the interventions selected by stakeholders mainly focused on increasing the availability and provision of postpartum services and improving the quality of postpartum care through strengthening postpartum services and care at facility and community level. This includes the introduction of postpartum home visits, strengthening postpartum outreach services, integration of postpartum services for the mother in child immunisation clinics, distribution of postpartum care guidelines among health workers and upgrading postpartum care knowledge and skills through training. CONCLUSION: There are extensive gaps in availability and provision of postpartum care for mothers and infants. Acknowledging these gaps and involving relevant stakeholders are important to design and select sustainable, context-specific packages of interventions to improve postpartum care.

Predictors of treatment failure for non-severe childhood pneumonia in developing countries--systematic literature review and expert survey--the first step towards a community focused mHealth risk-assessment tool?

BACKGROUND: Improved referral algorithms for children with non-severe pneumonia at the community level are desirable. We sought to identify predictors of oral antibiotic failure in children who fulfill the case definition of World Health Organization (WHO) non-severe pneumonia. Predictors of greatest interest were those not currently utilized in referral algorithms and feasible to obtain at the community level. METHODS: We systematically reviewed prospective studies reporting independent predictors of oral antibiotic failure for children 2-59 months of age in resource-limited settings with WHO non-severe pneumonia (either fast breathing for age and/or lower chest wall indrawing without danger signs), with an emphasis on predictors not currently utilized for referral and reasonable for community health workers. We searched PubMed, Cochrane, and Embase and qualitatively analyzed publications from 1997-2014. To supplement the limited published evidence in this subject area we also surveyed respiratory experts. RESULTS: Nine studies met criteria, seven of which were performed in south Asia. One eligible study occurred exclusively at the community level. Overall, oral antibiotic failure rates ranged between 7.8-22.9%. Six studies found excess age-adjusted respiratory rate (either WHO-defined very fast breathing for age or 10-15 breaths/min faster than normal WHO age-adjusted thresholds) and four reported young age as predictive for oral antibiotic failure. Of the seven predictors identified by the expert panel, abnormal oxygen saturation and malnutrition were most highly favored per the panel's rankings and comments. CONCLUSIONS: This review identified several candidate predictors of oral antibiotic failure not currently utilized in childhood pneumonia referral algorithms; excess age-specific respiratory rate, young age, abnormal oxygen saturation, and moderate malnutrition. However, the data was limited and there are clear evidence gaps; research in rural, low-resource settings with community health workers is needed.

Women's groups practising participatory learning and action to improve maternal and newborn health in low-resource settings: a systematic review and meta-analysis.

BACKGROUND: Maternal and neonatal mortality rates remain high in many low-income and middle-income countries. Different approaches for the improvement of birth outcomes have been used in community-based interventions, with heterogeneous effects on survival. We assessed the effects of women's groups practising participatory learning and action, compared with usual care, on birth outcomes in low-resource settings. METHODS: We did a systematic review and meta-analysis of randomised controlled trials undertaken in Bangladesh, India, Malawi, and Nepal in which the effects of women's groups practising participatory learning and action were assessed to identify population-level predictors of effect on maternal mortality, neonatal mortality, and stillbirths. We also reviewed the cost-effectiveness of the women's group intervention and estimated its potential effect at scale in Countdown countries. FINDINGS: Seven trials (119,428 births) met the inclusion criteria. Meta-analyses of all trials showed that exposure to women's groups was associated with a 37% reduction in maternal mortality (odds ratio 0.63, 95% CI 0.32-0.94), a 23% reduction in neonatal mortality (0.77, 0.65-0.90), and a 9% non-significant reduction in stillbirths (0.91, 0.79-1.03), with high heterogeneity for maternal (I(2)=58.8%, p=0.024) and neonatal results (I(2)=64.7%, p=0.009). In the meta-regression analyses, the proportion of pregnant women in groups was linearly associated with reduction in both maternal and neonatal mortality (p=0.026 and p=0.011, respectively). A subgroup analysis of the four studies in which at least 30% of pregnant women participated in groups showed a 55% reduction in maternal mortality (0.45, 0.17-0.73) and a 33% reduction in neonatal mortality (0.67, 0.59-0.74). The intervention was cost effective by WHO standards and could save an estimated 283,000 newborn infants and 41,100 mothers per year if implemented in rural areas of 74 Countdown countries. INTERPRETATION: With the participation of at least a third of pregnant women and adequate population coverage, women's groups practising participatory learning and action are a cost-effective strategy to improve maternal and neonatal survival in low-resource settings. FUNDING: Wellcome Trust, Ammalife, and National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care for Birmingham and the Black Country programme.

Political economy analysis of subnational health management in Kenya, Malawi and Uganda.

The need to bolster primary health care (PHC) to achieve the Sustainable Development Goal (SDG) targets for health is well recognized. In Eastern and Southern Africa, where governments have progressively decentralized health decision-making, health management is critical to PHC performance. While investments in health management capacity are important, so is improving the environment in which managers operate. Governance arrangements, management systems and power dynamics of actors can have a significant influence on health managers' ability to improve PHC access and quality. We conducted a problem-driven political economy analysis (PEA) in Kenya, Malawi and Uganda to explore local decision-making environments and how they affect management and governance practices for health. This PEA used document review and key informant interviews (N = 112) with government actors, development partners and civil societies in three districts or counties in each country (N = 9). We found that while decentralization should improve PHC by supporting better decisions in line with local priorities from community input, it has been accompanied by thick bureaucracy, path-dependent and underfunded budgets that result in trade-offs and unfulfilled plans, management support systems that are less aligned to local priorities, weak accountability between local government and development partners, uneven community engagement and insufficient public administration capacity to negotiate these challenges. Emergent findings suggest that coronavirus disease 2019 (COVID-19) not only resulted in greater pressures on health teams and budgets but also improved relations with central government related to better communication and flexible funding, offering some lessons. Without addressing the disconnection between the vision for decentralization and the reality of health managers mired in unhelpful processes and politics, delivering on PHC and universal health coverage goals and the SDG agenda will remain out of reach.

The Epidemiology of Hypoxemic Pneumonia among Young Infants in Malawi.

We describe hypoxemic pneumonia prevalence in outpatient and inpatient settings, in-hospital mortality, and clinical guideline performance for identifying hypoxemia in young infants in Malawi. In this retrospective analysis of a prospective cohort study, we investigate infants younger than 2 months participating in pneumonia surveillance at seven hospitals and 18 outpatient health centers in Malawi between 2011 and 2014. Logistic regression, multiple imputation with chained equations, and pattern mixture modeling were used to determine the association between peripheral capillary oxyhemoglobin saturation (SpO2) levels and hospital mortality. We describe outpatient clinician hospital referral recommendations based on clinical characteristics and SpO2 distributions. Among 1,879 analyzed cases, SpO2 < 90% was more prevalent among outpatient health center cases compared with hospitalized cases (22.6% versus 13.5%, 95% CI: 17.6-28.4% and 12.0-15.3%, respectively). A larger proportion of hospitalized infants had signs of respiratory distress compared with infants at health centers (67.7% versus 56.6%, P < 0.001) and most hospitalized infants were boys (56.7% versus 40.6%, P < 0.001). An SpO2 of 90-92% and < 90% was associated with similarly increased odds of in-hospital mortality (adjusted odds ratio [aOR]: 4.3 and 4.4, 95% CI: 1.7-11.1 and 1.8-10.5, respectively). Unrecorded, or unobtainable, SpO2 was highly associated with mortality (n = 127, aOR: 18.1; 95% CI: 7.6-42.8). Four of 22 (18%) infants at health centers who did not meet clinical referral criteria had an SpO2 ≤ 92%. Clinicians should consider hospital referral in young infants with a SpO2 ≤ 92%. Infants with unobtainable SpO2 readings should be considered a high-risk group, and hospital referral of these cases may be appropriate.

The NeoTree application: developing an integrated mHealth solution to improve quality of newborn care and survival in a district hospital in Malawi.

More than two-thirds of newborn lives could be saved worldwide if evidence-based interventions were successfully implemented. We developed the NeoTree application to improve quality of newborn care in resource-poor countries. The NeoTree is a fully integrated digital health intervention that combines immediate data capture, entered by healthcare workers (HCW) on admission, while simultaneously providing them with evidence-based clinical decision support and newborn care education. We conducted a mixed-methods intervention development study, codeveloping and testing the NeoTree prototype with HCWs in a district hospital in Malawi. Focus groups explored the acceptability and feasibility of digital health solutions before and after implementation of the NeoTree in the clinical setting. One-to-one theoretical usability workshops and a 1-month clinical usability study informed iterative changes, gathered process and clinical data, System Usability Scale (SUS) and perceived improvements in quality of care. HCWs perceived the NeoTree to be acceptable and feasible. Mean SUS before and after the clinical usability study were high at 80.4 and 86.1, respectively (above average is >68). HCWs reported high-perceived improvements in quality of newborn care after using the NeoTree on the ward. They described improved confidence in clinical decision-making, clinical skills, critical thinking and standardisation of care. Identified factors for successful implementation included a technical support worker. Coproduction, mixed-methods approaches and user-focused iterative development were key to the development of the NeoTree prototype, which was shown to be an agile, acceptable, feasible and highly usable tool with the potential to improve the quality of newborn care in resource-poor settings.

An assessment of PCV13 vaccine coverage using a repeated cross-sectional household survey in Malawi.

Background: The 13-valent pneumococcal conjugate vaccine (PCV13) was introduced in Malawi from November 2011 using a three dose primary series at 6, 10, and 14 weeks of age to reduce Streptococcus pneumoniae-related diseases. To date, PCV13 paediatric coverage in Malawi has not been rigorously assessed.  We used household surveys to longitudinally track paediatric PCV13 coverage in rural Malawi. Methods: Samples of 60 randomly selected children (30 infants aged 6 weeks to 4 months and 30 aged 4-16 months) were sought in each of 20 village clinic catchment 'basins' of Kabudula health area, Lilongwe, Malawi between March 2012 and June 2014. Child health information was reviewed and mothers interviewed to determine each child's PCV13 dose status and vaccine timing. The survey was completed six times in 4-8 month intervals. Survey inference was used to assess PCV13 dose coverage in each basin for each age group. All 20 basins were pooled to assess area-wide vaccination coverage over time, by age in months, and adherence to the vaccination schedule. Results: We surveyed a total of 8,562 children in six surveys; 82% were in the older age group. Overall, in age-eligible children, two-dose and three-dose coverage increased from 30% to 85% and 10% to 86%, respectively, between March 2012 and June 2014.  PCV13 coverage was higher in the older age group in all surveys. Although it varied by basin, PCV13 coverage was consistently delayed: median ages at first, second and third doses were 9, 15 and 21 weeks, respectively. Conclusion: In our rural study area, PCV13 introduction did not meet the Malawi Ministry of Health one-year three-dose 90% coverage target, but after 2 years reached levels likely to reduce the prevalence of both invasive and non-invasive paediatric pneumococcal diseases. Better adherence to the PCV13 schedule may reduce pneumococcal disease in younger Malawian children.

Correction: Predicting Hospitalised Paediatric Pneumonia Mortality Risk: An External Validation of RISC and mRISC, and Local Tool Development (RISC-Malawi) from Malawi.

[This corrects the article DOI: 10.1371/journal.pone.0168126.].

Opportunities and barriers in paediatric pulse oximetry for pneumonia in low-resource clinical settings: a qualitative evaluation from Malawi and Bangladesh.

OBJECTIVE: To gain an understanding of what challenges pulse oximetry for paediatric pneumonia management poses, how it has changed service provision and what would improve this device for use across paediatric clinical settings in low-income countries. DESIGN: Focus group discussions (FGDs), with purposive sampling and thematic analysis using a framework approach. SETTING: Community, front-line outpatient, and hospital outpatient and inpatient settings in Malawi and Bangladesh, which provide paediatric pneumonia care. PARTICIPANTS: Healthcare providers (HCPs) from Malawi and Bangladesh who had received training in pulse oximetry and had been using oximeters in routine paediatric care, including community healthcare workers, non-physician clinicians or medical assistants, and hospital-based nurses and doctors. RESULTS: We conducted six FGDs, with 23 participants from Bangladesh and 26 from Malawi. We identified five emergent themes: trust, value, user-related experience, sustainability and design. HCPs discussed the confidence gained through the use of oximeters, resulting in improved trust from caregivers and valuing the device, although there were conflicts between the weight given to clinical judgement versus oximeter results. HCPs reported the ease of using oximeters, but identified movement and physically smaller children as measurement challenges. Challenges in sustainability related to battery durability and replacement parts, however many HCPs had used the same device longer than 4 years, demonstrating robustness within these settings. Desirable features included back-up power banks and integrated respiratory rate and thermometer capability. CONCLUSIONS: Pulse oximetry was generally deemed valuable by HCPs for use as a spot-check device in a range of paediatric low-income clinical settings. Areas highlighted as challenges by HCPs, and therefore opportunities for redesign, included battery charging and durability, probe fit and sensitivity in paediatric populations. TRIAL REGISTRATION NUMBER: NCT02941237.

Usability Testing of a Reusable Pulse Oximeter Probe Developed for Health-Care Workers Caring for Children < 5 Years Old in Low-Resource Settings.

Hypoxemia measured by pulse oximetry predicts child pneumonia mortality in low-resource settings (LRS). Existing pediatric oximeter probes are prohibitively expensive and/or difficult to use, limiting LRS implementation. Using a human-centered design, we developed a low-cost, reusable pediatric oximeter probe for LRS health-care workers (HCWs). Here, we report probe usability testing. Fifty-one HCWs from Malawi, Bangladesh, and the United Kingdom participated, and seven experts provided reference measurements. Health-care workers and experts measured the peripheral arterial oxyhemoglobin saturation (SpO2) independently in < 5 year olds. Health-care worker measurements were classed as successful if recorded in 5 minutes (or shorter) and physiologically appropriate for the child, using expert measurements as the reference. All expert measurements were considered successful if obtained in < 5 minutes. We analyzed the proportion of successful SpO2 measurements obtained in < 1, < 2, and < 5 minutes and used multivariable logistic regression to predict < 1 minute successful measurements. We conducted four testing rounds with probe modifications between rounds, and obtained 1,307 SpO2 readings. Overall, 67% (876) of measurements were successful and achieved in < 1 minute, 81% (1,059) < 2 minutes, and 90% (1,181) < 5 minutes. Compared with neonates, increasing age (infant adjusted odds ratio [aOR]; 1.87, 95% confidence interval [CI]: 1.16, 3.02; toddler aOR: 4.33, 95% CI: 2.36, 7.97; child aOR; 3.90, 95% CI: 1.73, 8.81) and being asleep versus being calm (aOR; 3.53, 95% CI: 1.89, 6.58), were associated with < 1 minute successful measurements. In conclusion, we designed a novel, reusable pediatric oximetry probe that was effectively used by LRS HCWs on children. This probe may be suitable for LRS implementation.

Impact of the 13-Valent Pneumococcal Conjugate Vaccine on Clinical and Hypoxemic Childhood Pneumonia over Three Years in Central Malawi: An Observational Study.

BACKGROUND: The pneumococcal conjugate vaccine's (PCV) impact on childhood pneumonia during programmatic conditions in Africa is poorly understood. Following PCV13 introduction in Malawi in November 2011, we evaluated the case burden and rates of childhood pneumonia. METHODS AND FINDINGS: Between January 1, 2012-June 30, 2014 we conducted active pneumonia surveillance in children <5 years at seven hospitals, 18 health centres, and with 38 community health workers in two districts, central Malawi. Eligible children had clinical pneumonia per Malawi guidelines, defined as fast breathing only, chest indrawing +/- fast breathing, or, ≥1 clinical danger sign. Since pulse oximetry was not in the Malawi guidelines, oxygenation <90% defined hypoxemic pneumonia, a distinct category from clinical pneumonia. We quantified the pneumonia case burden and rates in two ways. We compared the period immediately following vaccine introduction (early) to the period with >75% three-dose PCV13 coverage (post). We also used multivariable time-series regression, adjusting for autocorrelation and exploring seasonal variation and alternative model specifications in sensitivity analyses. The early versus post analysis showed an increase in cases and rates of total, fast breathing, and indrawing pneumonia and a decrease in danger sign and hypoxemic pneumonia, and pneumonia mortality. At 76% three-dose PCV13 coverage, versus 0%, the time-series model showed a non-significant increase in total cases (+47%, 95% CI: -13%, +149%, p = 0.154); fast breathing cases increased 135% (+39%, +297%, p = 0.001), however, hypoxemia fell 47% (-5%, -70%, p = 0.031) and hospital deaths decreased 36% (-1%, -58%, p = 0.047) in children <5 years. We observed a shift towards disease without danger signs, as the proportion of cases with danger signs decreased by 65% (-46%, -77%, p<0.0001). These results were generally robust to plausible alternative model specifications. CONCLUSIONS: Thirty months after PCV13 introduction in Malawi, the health system burden and rates of the severest forms of childhood pneumonia, including hypoxemia and death, have markedly decreased.