The effect of a roving nurse mentor on household coverage and quality of care provided by community health worker teams in South Africa: a longitudinal study with a before, after and 6 months post design.

OBJECTIVE: Community health workers (CHW) are undertaking more complex tasks as part of the move towards universal health coverage in many low- and middle-income settings. They are expected to provide promotive and preventative care, make referrals to the local clinic, and follow up on non-attendees for a range of health conditions. CHW programmes can improve access to care for vulnerable communities, but many such programmes struggle due to inadequate supervision, low levels of CHW literacy, and the marginalized status of CHW in the health system. In this paper, we assess the effect of a roving nurse mentor on the coverage and quality of care of the CHW service in two vulnerable communities in South Africa. PARTICIPANTS: CHW, their supervisors, household members. INTERVENTION: Roving professional nurse mentor to build skills of supervisors and CHW teams. METHODS: Three household surveys to assess household coverage of the CHW service (baseline, end of the intervention, and 6 months after end of intervention); structured observations of CHW working in households to assess quality of care. RESULTS: The intervention led to a sustained 50% increase in the number of households visited by a CHW in the last year. While the proportion of appropriate health messages given to household members by CHW remained constant at approximately 50%, CHW performed a greater range of more complex tasks. They were more likely to visit new households to assess health needs and register the household in the programme, to provide care to pregnant women, children and people who had withdrawn from care. CHW were more likely to discuss with clients the barriers they were facing in accessing care and take notes during a visit. CONCLUSION: A nurse mentor can have a significant effect both on the quantity and quality of CHW work, allowing them to achieve their potential despite their marginalised status in the health system and their limited prior educational achievement. Supportive supervision is important in enabling the benefit of having a health cadre embedded in marginalised communities to be realised.

Systematic review of performance-enhancing health worker supervision approaches in low- and middle-income countries.

BACKGROUND: The strength of a health system-and ultimately the health of a population-depends to a large degree on health worker performance. However, insufficient support to build, manage and optimize human resources for health (HRH) in low- and middle-income countries (LMICs) results in inadequate health workforce performance, perpetuating health inequities and low-quality health services. METHODS: The USAID-funded Human Resources for Health in 2030 Program (HRH2030) conducted a systematic review of studies documenting supervision enhancements and approaches that improved health worker performance to highlight components associated with these interventions' effectiveness. Structured by a conceptual framework to classify the inputs, processes, and results, the review assessed 57 supervision studies since 2010 in approximately 29 LMICs. RESULTS: Of the successful supervision approaches described in the 57 studies reviewed, 44 were externally funded pilots, which is a limitation. Thirty focused on community health worker (CHW) programs. Health worker supervision was informed by health system data for 38 approaches (67%) and 22 approaches used continuous quality improvement (QI) (39%). Many successful approaches integrated digital supervision technologies (e.g., SmartPhones, mHealth applications) to support existing data systems and complement other health system activities. Few studies were adapted, scaled, or sustained, limiting reports of cost-effectiveness or impact. CONCLUSION: Building on results from the review, to increase health worker supervision effectiveness we recommend to: integrate evidence-based, QI tools and processes; integrate digital supervision data into supervision processes; increase use of health system information and performance data when planning supervision visits to prioritize lowest-performing areas; scale and replicate successful models across service delivery areas and geographies; expand and institutionalize supervision to reach, prepare, protect, and support frontline health workers, especially during health emergencies; transition and sustain supervision efforts with domestic human and financial resources, including communities, for holistic workforce support. In conclusion, effective health worker supervision is informed by health system data, uses continuous quality improvement (QI), and employs digital technologies integrated into other health system activities and existing data systems to enable a whole system approach. Effective supervision enhancements and innovations should be better integrated, scaled, and sustained within existing systems to improve access to quality health care.

Health services supervision in a protracted crisis: a qualitative study into supportive supervision practices in South Sudan.

BACKGROUND: The health system in South Sudan faces extreme domestic resource constraints, low capacity, and protracted humanitarian crises. Supportive supervision is believed to improve the quality of health care and service delivery by compensating for flaws in health workforce management. This study aimed to explore the current supervision practices in South Sudan and identify areas for quality improvement. METHODS: The study employed qualitative approaches to collect and analyse data from six purposefully selected counties. Data were collected from 194 participants using semi-structured interviews (43 health managers) and focus group discussions (151 health workers). Thematic content analysis was used to yield an in-depth understanding of the supervision practices in the health sector. RESULTS: The study found that integrated supportive supervision and monitoring visits were the main approaches used for health services supervision in South Sudan. Supportive supervision focused more on health system administration and less on clinical matters. Although fragmented, supportive supervision was carried out quarterly, while monitoring visits were either conducted monthly or ad hoc. Prioritization for supportive supervision was mainly data driven. Paper-based checklists were the most commonly used supervision tools. Many supervisors had no formal training on supportive supervision and only learned on the job. The health workers received on-site verbal feedback and, most times, on-the-job training sessions through coaching and mentorship. Action plans developed during supervision were inadequately followed up due to insufficient funding. Insecurity, poor road networks, lack of competent health managers, poor coordination, and lack of adequate means of transport were some of the challenges experienced during supervision. The presumed outcomes of supportive supervision were improvements in human resource management, drug management, health data reporting, teamwork, and staff respect for one another. CONCLUSION: Supportive supervision remains a daunting task in the South Sudan health sector due to a combination of external and health system factors. Our study findings suggest that strengthening the processes and providing inputs for supervision should be prioritized if quality improvement is to be attained. This necessitates stronger stewardship from the Ministry of Health, integration of different supervision practices, investment in the capacity of the health workforce, and health infrastructure development.

A rapid review of the impact of COVID-19 on clinical supervision practices of healthcare workers and students in healthcare settings.

AIMS: To synthesize available data on the impact of the COVID-19 pandemic on clinical supervision practices of healthcare workers and students in healthcare settings. DESIGN: A quantitative rapid review of the literature. DATA SOURCES: A search of MEDLINE, Embase, PsycINFO, the Cochrane Library and Scopus for English language papers published between December 2019 (initial onset of the pandemic) to March 2021. REVIEW METHODS: Using the World Health Organization and Cochrane guidelines for rapid reviews, following an identification of relevant papers and data extraction, a narrative synthesis approach was used to develop themes. RESULTS: Eight studies met the inclusion criteria. Four themes identified from data synthesis were nature and extent of disruptions to clinical supervision, unmet need for psychological support, supervisors also need support and unpacking telesupervision. Findings highlight the extent and nature of disruption to clinical supervision at the point of care. Further information on factors that facilitate high-quality telesupervision have come to light. CONCLUSION: The COVID-19 pandemic has placed tremendous burden on healthcare workers compromising their own health and well-being. It is essential to restore effective clinical supervision practices at the point of care, so as to enhance patient, healthcare worker and organizational outcomes into the post-COVID-19 pandemic period. IMPACT: This review has provided initial evidence on the adverse impacts of the COVID-19 pandemic on clinical supervision of healthcare workers and students at the point of care. Available evidence indicates the urgent need to restore effective and high-quality clinical supervision practices in health settings. The review has highlighted a paucity of studies in this area, calling for further high-quality studies.

Knowledge and practice pattern of integrated child development services scheme supervisors (AWS) following capacity building and remote supportive supervision.

Background: Nutritional status of under-5 children in India is not promising and lags far behind the WHO Global Nutrition Targets. Although the Integrated Child Development Services has been continuously delivered through Anganwadi centers since 1975, the burden of malnutrition still persists. Objectives: This study was conducted to estimate the knowledge and practice pattern of Anganwadi supervisors and the effect of capacity building through remote supportive supervision during the COVID-19 pandemic in Assam, India. Methods: A cross-sectional before-after study using a mixed methods approach was used to evaluate the knowledge pattern and service delivery of supervisors from each district of Assam. For qualitative assessment, telephone depth interviews were conducted. Results: Knowledge of supervisors in the beginning was 83.43% which improved by 7.97% at the end of the study. The highest burden of SAM children was in Tinsukia and Barpeta districts. On mapping, most districts with lower burden of SAM had supervisors with higher knowledge levels on Infant and Young Child Feeding practices. Qualitative assessment revealed house-to-house visit for ensuring service delivery and use of online platforms and phone calls for counseling. However, community resistance and lack of transport stood as a main challenge. Conclusion: Supportive supervision done remotely during the pandemic to enhance the performance of health workforce was found effective.

Does supportive supervision intervention improve community health worker knowledge and practices for community management of childhood diarrhea and pneumonia? Lessons for scale-up from Nigraan and Nigraan Plus trials in Pakistan.

BACKGROUND: Lack of programmatic support and supervision is one of the underlying reasons of the poor performance of Pakistan's Lady Health Worker Program (LHWP). This study describes the findings and potential for scale-up of a supportive supervision intervention in two districts of Pakistan for improving LHWs skills for integrated community case management (iCCM) of childhood diarrhea and pneumonia. METHODS: The intervention comprised an enhanced supervision training to lady health supervisors (LHSs) and written feedback to LHWs by LHSs, implemented in Districts Badin and Mirpur Khas (MPK). Clinical skills of LHWs and LHSs and supervision skills of LHSs were assessed before, during, and after the intervention using structured tools. RESULTS: LHSs' practice of providing written feedback improved between pre- and mid-intervention assessments in both trials (0% to 88% in Badin and 25% to 75% in MPK) in the study arm. Similarly, supervisory performance of study arm LHSs was better than that in the comparison arm in reviewing the treatment suggested by workers' (94% vs 13% in MPK and 94% vs 69% in Badin) during endline skills assessment in both trials. There were improvements in LHWs' skills for iCCM of childhood diarrhea and pneumonia in both districts. In intervention arm, LHWs' performance for correctly assessing for dehydration (28% to 92% in Badin and 74% to 96% in MPK), and measuring the respiratory rate correctly (12% to 44% in Badin and 46% to 79% in MPK) improved between baseline and endline assessments in both trials. Furthermore, study arm LHWs performed better than those in comparison arm in classifying diarrhea correctly during post-intervention skills assessment (68% vs 40% in Badin and 96% vs 83% in MPK). CONCLUSION: Supportive supervision including written feedback and frequent supervisor contact could improve the performance of community-based workers in managing diarrhea and pneumonia among children. Positive lessons for provincial scale-up can be drawn. Trial registration Both trials are registered with the 'Australian New Zealand Clinical Trials Registry'. Registration numbers: Nigraan Trial: ACTRN1261300126170; Nigraan Plus: ACTRN12617000309381.

Approaches to motivate physicians and nurses in low- and middle-income countries: a systematic literature review.

Poor health worker motivation, and the resultant shortages and geographic imbalances of providers, impedes the provision of quality care in low- and middle-income countries (LMICs). This systematic review summarizes the evidence on interventions used to motivate health workers in LMICs. A standardized keyword search strategy was employed across five databases from September 2007 -September 2017. Studies had to meet the following criteria: original study; doctors and/or nurses as target population for intervention(s); work motivation as study outcome; study design with clearly defined comparison group; categorized as either a supervision, compensation, systems support, or lifelong learning intervention; and conducted in a LMIC setting. Two independent reviewers screened 3845 titles and abstracts and, subsequently, reviewed 269 full articles. Seven studies were retained from China (n = 1), Ghana (n = 2), Iran (n = 1), Mozambique (n = 1), and Zambia (n = 2). Study data and risk of bias were extracted using a standardized form. Though work motivation was the primary study outcome, four studies did not provide an outcome definition and five studies did not describe use of a theoretical framework in the ascertainment. Four studies used a randomized trial-group design, one used a non-randomized trial-group design, one used a cross-sectional design, and one used a pretest-posttest design. All three studies that found a significant positive effect on motivational outcomes had a supervision component. Of the three studies that found no effects on motivation, two were primarily compensation interventions and the third was a systems support intervention. One study found a significant negative effect of a compensation intervention on health worker motivation. In conducting this systematic review, we found there is limited evidence on successful interventions to motivate health workers in LMICs. True effects on select categories of health workers may have been obscured given that studies included health workers with a wide range of social and professional characteristics. Robust studies that use validated and culturally appropriate tools to assess worker motivation are greatly needed in the Sustainable Development Goals era.

Community health workers at the dawn of a new era: 7. Recent advances in supervision.

BACKGROUND: Supervision is essential for optimizing performance and motivation of community health workers (CHWs). This paper, the seventh in our series, "Community health workers at the dawn of a new era", supplements the existing evidence on CHW supervision in low- and middle-income countries by reviewing what supervision approaches are employed in specific contexts, identifying potential facilitators of CHW supervision including mobile health (mHealth) interventions, and noting challenges of supervision including the relationship between supervision and other CHW programme elements. METHODS: For this exploratory research study on CHW supervision, we reviewed the supervisory interventions described in a compendium of 29 case studies of large-scale CHW programmes, performed an electronic search of multiple databases to identify articles related to CHW supervision published between 15 June 2017 and 1 December 2020, and from those articles followed additional references that appeared to be relevant for our results. RESULTS: We reviewed 55 case studies, academic articles, and grey literature resources as part of this exploratory research. A variety of supervision approaches have been adapted over time, which we grouped into five categories: external supervision, community supervision, group supervision, peer supervision, and dedicated supervision. These approaches are frequently used in combination. Digital (mHealth) technologies are being explored as potential facilitators of CHW supervision in both small- and large-scale programmes; however, evidence of their effectiveness remains limited to date. Inadequate support for supervisors is a major challenge, particularly given the numerous and varied roles they are expected to fulfil, spanning administrative, clinical, and supportive activities. Supervisors can help CHWs acquire other critical elements needed from the health system for them to perform more effectively: incentives to foster motivation, clarity of roles and tasks, adequate tools and supplies, appropriate knowledge and skills, and a safe work environment. CONCLUSION: In the absence of a universal "best approach" for CHW supervision, our recommendation is that countries and programmes prioritize homegrown evolution over time to suit the local context. In some cases, this may involve scaling up novel approaches that have proven effective at small scale or testing approaches that have worked in other countries.

Level of nurse supportive supervision and its influencing factors in long-term care facilities.

Quality of care provided by personal support workers (PSWs) in long-term care facilities (LTCFs) is associated with the supportive supervisory performance of registered nurses (RNs). To determine the level of supportive supervision of RNs and its influencing factors in LTCFs in East China, a cross-sectional survey was conducted in 12 LTCFs using self-designed sociodemographic questionnaires and the Chinese version of the Supportive Supervisory Scale. A total of 643 PSWs supervised by 260 RNs were surveyed. The average supportive supervision score was 59.60 ± 7.53, representing a moderate level of supervisory support. Supportive supervision was found to be positively correlated with the PSW's years of working, the RN's education, position, number of years in nursing, having access to managerial training as well as the RN/PSW ratio in the unit (p < 0.05). These factors can be modified to potentially influence the supportive capacity of nurse supervisors in LTCFs.

Tuberculosis treatment outcomes and associated factors in two states in Nigeria.

OBJECTIVE: To determine the treatment success rate among TB patients and associated factors in Anambra and Oyo, the two states with the largest burden of tuberculosis in Nigeria. METHODS: A health facility record review for 2016 was conducted in the two states (Anambra and Oyo). A checklist was used to extract relevant information from the records kept in each of the selected DOTS facilities to determine TB treatment success rates. Treatment success rate was defined as the proportion of new smear-positive TB cases registered under DOTS in a given year that successfully completed treatment, whether with bacteriologic evidence of success ('cured') or without ('treatment completed'). Treatment success rate was classified into good (≥85%) and poor (<85%) success rates using the 85% national target for TB treatment outcome. Data were analysed using descriptive statistics and chi-square at P < 0.05. RESULTS: There were 1281 TB treatment enrollees in 2016 in Anambra and 3809 in Oyo (total = 4835). An overall treatment success rate of 75.8% was achieved (Anambra-57.5%; Oyo-82.0%). The percentage cure rates were 61.5% for Anambra and 85.2% for Oyo. Overall, only 28.6% of the facilities in both states (Anambra-0.0%; Oyo-60.0%) had a good treatment success rate. More facilities in Anambra (100.0%) than Oyo (40.0%) had a poor treatment success rate (p < 0.001), as did more private/FBO (100.0%) than public health facilities (60.0%) (p = 0.009). All tertiary facilities had a poor treatment success rate followed by 87.5% of secondary health facilities and 56.5% of primary healthcare facilities (P = 0.035). CONCLUSION: Treatment success and cure rates in Anambra state were below the 85.0% of the recommended target set by the WHO. Geographical location, and level/tier and type of facility were factors associated with this. Interventions are recommended to address these problems.

OBJECTIF: Déterminer le taux de succès du traitement chez les patients TB et les facteurs associés à Anambra et Oyo, les deux Etats avec la plus grande charge de TB au Nigéria. MÉTHODES: Un examen des dossiers des établissements de santé pour 2016 a été réalisé dans les deux Etats (Anambra et Oyo). Une liste de contrôle a été utilisée pour extraire les informations pertinentes des registres conservés dans chacun des établissements DOTS sélectionnés afin de déterminer les taux de succès du traitement antituberculeux. Le taux de succès du traitement a été défini comme la proportion de nouveaux cas de TB à frottis positif enregistrés dans le cadre du DOTS au cours d'une année donnée qui ont terminé le traitement avec succès, que ce soit avec des preuves bactériologiques de succès («guéri¼) ou sans («traitement terminé¼) . Le taux de succès du traitement a été classé en bons (≥ 85%) et mauvais (<85%) taux de réussite en utilisant l'objectif national de 85% pour l'issue du traitement de la TB. Les données ont été analysées à l'aide de statistiques descriptives et du Chi carré à p <0,05. RÉSULTATS: Il y avait 1.281 personnes inscrites au traitement antituberculeux en 2016 à Anambra et 3.809 à Oyo (total = 4835). Un taux de succès global du traitement de 75,8% a été atteint (Anambra, 57,5%; Oyo, 82,0%). Les taux de guérison en pourcentage étaient de 61,5% pour Anambra et de 85,2% pour Oyo. Dans l'ensemble, seuls 28,6% des établissements des deux Etats (Anambra, 0,0%; Oyo, 60,0%) avaient un bon taux de réussite du traitement. Plus d'établissements à Anambra (100,0%) qu'à Oyo (40,0%) avaient un faible taux de réussite du traitement (p <0,001), tout comme plus d'établissements de santé privés/FBO (100,0%) que publics (60,0%) (p = 0,009). Tous les établissements tertiaires avaient un faible taux de réussite du traitement, suivis de 87,5% des établissements de santé secondaires et 56,5% des établissements de soins de santé primaires (p = 0,035). CONCLUSION: Le succès du traitement et les taux de guérison dans l'Etat d'Anambra étaient inférieurs aux 85,0% de l'objectif recommandé fixé par l'OMS. L'emplacement géographique, le niveau et le type d'établissement étaient des facteurs associés à cela. Des interventions sont recommandées pour résoudre ces problèmes.

Site preparedness and quality of HIV sentinel surveillance at antenatal care clinic sites in India, 2019.

BACKGROUND: Quality of HIV sentinel surveillance (HSS) depends on preparedness of the site and adherence to the standard operating procedures (SOPs) for HSS. A designated sentinel site is considered prepared for the round of sentinel surveillance based on the availability of infrastructure, human resource, and consumables. OBJECTIVES: The study objectives were to describe the site level preparedness and adherence to SOP of antenatal care clinic (ANC) sites during the 16th round of HSS in India. METHODS: This was a cross-sectional study based on the findings of the supervisory visits conducted by public health specialists in ANC sites during the 16th round of HSS from January to March 2019. Semi-structured checklists were used to assess site-preparedness and adherence to the SOP for HSS. All supervisors were expected to upload the filled pro forma to the HSS management information system (MIS). We present here a descriptive analysis of the uploaded visit reports. RESULTS: Of 870 HSS sites, 783 (90%) were visited, and 479 (61.2%) reports were uploaded to MIS. Preround HSS training was not attended by one-fifth (22.6%) of the site in-charges; 35.8% of them had never received any HSS training. SOP was followed at most (94%) of the sites. The most frequently reported problem at the sites was inadequate or delayed availability of consumables. CONCLUSION: The overall quality of site-level preparedness at antenatal clinic sites in India was good. Attention needs to be given to timely and adequate availability of consumables at sentinel sites along with proper administrative support and preround training of site in-charges.

Towards improved health service quality in Tanzania: contribution of a supportive supervision approach to increased quality of primary healthcare.

BACKGROUND: Universal Health Coverage only leads to the desired health outcomes if quality of health services is ensured. In Tanzania, quality has been a major concern for many years, including the problem of ineffective and inadequate routine supportive supervision of healthcare providers by council health management teams. To address this, we developed and assessed an approach to improve quality of primary healthcare through enhanced routine supportive supervision. METHODS: Mixed methods were used, combining trends of quantitative quality of care measurements with qualitative data mainly collected through in-depth interviews. The former allowed for identification of drivers of quality improvements and the latter investigated the perceived contribution of the new supportive supervision approach to these improvements. RESULTS: The results showed that the new approach managed to address quality issues that could be solved either solely by the healthcare provider, or in collaboration with the council. The new approach was able to improve and maintain crucial primary healthcare quality standards across different health facility level and owner categories in various contexts. CONCLUSION: Together with other findings reported in companion papers, we could show that the new supportive supervision approach not only served to assess quality of primary healthcare, but also to improve and maintain crucial primary healthcare quality standards. The new approach therefore presents a powerful tool to support, guide and drive quality improvement measures within council. It can thus be considered a suitable option to make routine supportive supervision more effective and adequate.

Towards improved health service quality in Tanzania: appropriateness of an electronic tool to assess quality of primary healthcare.

BACKGROUND: Progress in health service quality is vital to reach the target of Universal Health Coverage. However, in order to improve quality, it must be measured, and the assessment results must be actionable. We analyzed an electronic tool, which was developed to assess and monitor the quality of primary healthcare in Tanzania in the context of routine supportive supervision. The electronic assessment tool focused on areas in which improvements are most effective in order to suit its purpose of routinely steering improvement measures at local level. METHODS: Due to the lack of standards regarding how to best measure quality of care, we used a range of different quantitative and qualitative methods to investigate the appropriateness of the quality assessment tool. The quantitative methods included descriptive statistics, linear regression models, and factor analysis; the qualitative methods in-depth interviews and observations. RESULTS: Quantitative and qualitative results were overlapping and consistent. Robustness checks confirmed the tool's ability to assign scores to health facilities and revealed the usefulness of grouping indicators into different quality dimensions. Focusing the quality assessment on processes and structural adequacy of healthcare was an appropriate approach for the assessment's intended purpose, and a unique key feature of the electronic assessment tool. The findings underpinned the accuracy of the assessment tool to measure and monitor quality of primary healthcare for the purpose of routinely steering improvement measures at local level. This was true for different level and owner categories of primary healthcare facilities in Tanzania. CONCLUSION: The electronic assessment tool demonstrated a feasible option for routine quality measures of primary healthcare in Tanzania. The findings, combined with the more operational results of companion papers, created a solid foundation for an approach that could lastingly improve services for patients attending primary healthcare. However, the results also revealed that the use of the electronic assessment tool outside its intended purpose, for example for performance-based payment schemes, accreditation and other systematic evaluations of healthcare quality, should be considered carefully because of the risk of bias, adverse effects and corruption.

Outreach training and supportive supervision for malaria case management in Zambia: the effects of focused capacity building on indicators of diagnostic and clinical performance.

BACKGROUND: Accurate diagnosis of malaria and reduced reliance on presumptive treatment are crucial components of quality case management. From 2008 to 2012, the Improving Malaria Diagnostics project, in collaboration with the Zambia National Malaria Control Centre, implemented an external quality assurance scheme partially comprised of outreach training and supportive supervision (OTSS) in an effort to improve malaria case management across a spectrum of health facilities performing laboratory-based malaria diagnostics. OTSS assessments were conducted by project-trained laboratory and clinical supervisors on a regular basis and measured changes in health facility staff performance over time. Standardized supervision tools were used for data collection and guided OTSS teams to assess health facility infrastructure, record keeping practices, stores of supplies and consumables, good laboratory practices, and staff adherence to guidelines for the case management and diagnosis of suspected malaria cases via direct observations or record reviews. The structure of OTSS also allowed supervisors to provide ongoing support to clinicians and laboratory staff through regular mentoring and on-the-job training. RESULTS: This analysis included 88 laboratories and 64 clinics each with four repeated supervisory assessments. Over the course of the project there were significant declines in the number of laboratories experiencing stock-outs of microscopy reagents/consumables (p < 0.001) and significant increases in the number of laboratories instituting the use of microscopy positive controls (p < 0.01), conducting parasite counting (p < 0.05), and converting from a semi-quantitative to a quantitative parasite counting methodology (p < 0.001). Performance in malaria diagnostic and clinical practices [i.e. RDT use (mean(diff) = 14.3%, p < 0.001), blood slide preparation (mean(diff) = 14.7%, p < 0.001), blood slide staining and reading (mean(diff) = 14.0%, p < 0.001), fever case management (mean(diff) = 7.3%, p < 0.01)] and prescriber adherence to negative diagnostic test results (mean(diff) = 7.2%, p < 0.05) showed modest, but significant gains from assessment 1 to assessment 4. CONCLUSION: The external quality assurance scheme provided periodic representations of clinical and laboratory staff performance. OTSS-enrolled health facilities demonstrated improvements to malaria diagnostic skills, adoption of laboratory best practices, strengthened fever case management practices, and improved prescriber adherence to negative malaria test results.

The role of supportive supervision using mobile technology in monitoring and guiding program performance: a case study in Nigeria, 2015-2016.

BACKGROUND: Supportive supervision is one of the interventions that fosters program improvement by way of imparting knowledge and skills to health workers. The basic challenge in supportive supervision is the availability of data in real time for timely and effective feedback. Thus, the main objective of this study was to determine the contribution of real-time data collection during supportive supervision for timely feedback and generation of evidence for health intervention planning. METHODS: We analyzed supportive supervision records collected through handheld devices employing the open data kit (ODK) platform from July 2015 to June 2016. Supervision was conducted across the country by 592 World Health Organization (WHO) officers. The availability of real-time data and the distance of health facilities to the community were analyzed. RESULTS: During the study period, 90,396 health facilities were supervised. The average time spent during supervision varied from 1.53 to 3.78 h across the six geopolitical zones of the country. The average interval between completion of the supervisory checklist and synchronization with the server varied from 3.9 h to 7.5 h. The average distance between the health facility and a ward varied from 5 to 24 km. CONCLUSION: The use of handheld devices for supportive supervision provided real-time data from health facilities to state and zonal levels for analysis and feedback. Program officers used the findings to rectify process indicators in time for a better outcome.

Implementation research to assess a health workers performance-based management system in Nepal.

AIM: To test and refine a performance-based management system to improve health worker performance in Nepal. METHODS: A mixed-methods implementation research in three districts. The study assessed health workers' job satisfaction at the start and end of the study. Qualitative techniques were used to document processes, and routine health service data were analysed to measure outcomes. RESULTS: Job satisfaction significantly increased in six of nine key areas, and the proportion of staff absenteeism significantly declined in the study districts. It demonstrated an increase in immunisation coverage, the proportion of women who had a first antenatal check-up also having a fourth check-up and the proportion of childbirth in a health facility. The greatest perceived strengths of the system were its robust approach to performance planning and evaluation, supportive supervision, outcome-based job descriptions and a transparent reward system. A functional health facility environment, leadership and community engagement support successful implementation. CONCLUSION: The performance-based management system has the potential to increase health workers' job satisfaction, and it offers a tool to link facility-wide human resource management. A collaborative approach, ownership and commitment of the health system are critical to success. Considering the Nepal context, a management system that demonstrates a positive improvement has potential for improved health care delivery.

Improving community health worker performance through supportive supervision: a randomised controlled implementation trial in Pakistan.

AIM: To assess the effect of enhanced supportive supervision of lady health workers (LHWs) by lady health supervisors on integrated community case management of childhood pneumonia and diarrhoea. METHODS: A total of thirty-four supervisors were randomly assigned to intervention and comparison arms. The intervention included enhanced training of supervisors on supervisory skills and written feedback to LHWs by supervisors. The performance of both cadres was assessed three times. Household surveys judged caregiver practices. RESULTS: Intervention arm LHWs performed better than those in the comparison arm in assessing dehydration (92% [n = 25] vs 64% [n = 25]) and in classifying diarrhoea correctly (68% [n = 25] vs 40% [n = 25]). The two arms differed little in correct disease classification for pneumonia (44% [n = 25] vs 40% [n = 25]). Supervisory performance of intervention arm supervisors was better than that in the comparison arm in correcting the workers' clinical examination skills (64% [n = 25] vs 40% [n = 25]) and more frequent feedback. In the household survey, only 18% (n = 2182) intervention and 23% (n = 2197) comparison arm caregivers considered LHWs capable of providing diarrhoea and pneumonia care. Commodities for integrated community case management were not regularly available to workers. CONCLUSION: Supportive supervision can improve community case management performance. Support through refresher training, logistics and commodities is essential.

The impact of a human resource management intervention on the capacity of supervisors to support and supervise their staff at health facility level.

BACKGROUND: A systematic and structured approach to the support and supervision of health workers can strengthen the human resource management function at the district and health facility levels and may help address the current crisis in human resources for health in sub-Saharan Africa by improving health workers' motivation and retention. METHODS: A supportive supervision programme including (a) a workshop, (b) intensive training and (c) action learning sets was designed to improve human resource management in districts and health facilities in Tanzania. We conducted a randomised experimental design to evaluate the impact of the intervention. Data on the same measures were collected pre and post the intervention in order to identify any changes that occurred (between baseline and end of project) in the capacity of supervisors in intervention a + b and intervention a + b + c to support and supervise their staff. These were compared to supervisors in a control group in each of Tanga, Iringa and Tabora regions (n = 9). A quantitative survey of 95 and 108 supervisors and 196 and 187 health workers sampled at baseline and end-line, respectively, also contained open-ended responses which were analysed separately. RESULTS: Supervisors assessed their own competency levels pre- and post-intervention. End-line samples generally scored higher compared to the corresponding baseline in both intervention groups for competence activities. Significant differences between baseline and end-line were observed in the total scores on 'maintaining high levels of performance', 'dealing with performance problems', 'counselling a troubled employee' and 'time management' in intervention a + b. In contrast, for intervention a + b + c, a significant difference in distribution of scores was only found on 'counselling a troubled employee', although the end-line mean scores were higher than their corresponding baseline mean scores in all cases. Similar trends to those in the supervisors' reports are seen in health workers data in terms of more efficient supervision processes, although the increases are not as marked. CONCLUSION: A number of different indicators were measured to assess the impact of the supportive supervision intervention on the a + b and a + b + c intervention sites. The average frequency of supervision visits and the supervisors' competency levels across the facilities increased in both intervention types. This would suggest that the intervention proved effective in raising awareness of the importance of supervision and this understanding led to action in the form of more supportive supervision.

The impact of a supportive supervision intervention on health workers in Niassa, Mozambique: a cluster-controlled trial.

BACKGROUND: Regular supportive supervision is critical to retaining and motivating staff in resource-constrained settings. Previous studies have shown the particular contribution that supportive supervision can make to improving job satisfaction amongst over-stretched health workers in such settings. METHODS: The Support, Train and Empower Managers (STEM) study designed and implemented a supportive supervision intervention and measured its' impact on health workers using a controlled trial design with a three-arm pre- and post-study in Niassa Province in Mozambique. Post-intervention interviews with a small sample of health workers were also conducted. RESULTS: The quantitative measurements of job satisfaction, emotional exhaustion and work engagement showed no statistically significant differences between end-line and baseline. The qualitative data collected from health workers post the intervention showed many positive impacts on health workers not captured by this quantitative survey. CONCLUSIONS: Health workers perceived an improvement in their performance and attributed this to the supportive supervision they had received from their supervisors following the intervention. Reports of increased motivation were also common. An unexpected, yet important consequence of the intervention, which participants directly attributed to the supervision intervention, was the increase in participation and voice amongst health workers in intervention facilities.

Embedding systematic quality assessments in supportive supervision at primary healthcare level: application of an electronic Tool to Improve Quality of Healthcare in Tanzania.

BACKGROUND: Assessing quality of health services, for example through supportive supervision, is essential for strengthening healthcare delivery. Most systematic health facility assessment mechanisms, however, are not suitable for routine supervision. The objective of this study is to describe a quality assessment methodology using an electronic format that can be embedded in supervision activities and conducted by council health staff. METHODS: An electronic Tool to Improve Quality of Healthcare (e-TIQH) was developed to assess the quality of primary healthcare provision. The e-TIQH contains six sub-tools, each covering one quality dimension: infrastructure and equipment of the facility, its management and administration, job expectations, clinical skills of the staff, staff motivation and client satisfaction. As part of supportive supervision, council health staff conduct quality assessments in all primary healthcare facilities in a given council, including observation of clinical consultations and exit interviews with clients. Using a hand-held device, assessors enter data and view results in real time through automated data analysis, permitting immediate feedback to health workers. Based on the results, quality gaps and potential measures to address them are jointly discussed and actions plans developed. RESULTS: For illustrative purposes, preliminary findings from e-TIQH application are presented from eight councils of Tanzania for the period 2011-2013, with a quality score <75 % classed as 'unsatisfactory'. Staff motivation (<50 % in all councils) and job expectations (≤50 %) scored lowest of all quality dimensions at baseline. Clinical practice was unsatisfactory in six councils, with more mixed results for availability of infrastructure and equipment, and for administration and management. In contrast, client satisfaction scored surprisingly high. Over time, each council showed a significant overall increase of 3-7 % in mean score, with the most pronounced improvements in staff motivation and job expectations. CONCLUSIONS: Given its comprehensiveness, convenient handling and automated statistical reports, e-TIQH enables council health staff to conduct systematic quality assessments. Therefore e-TIQH may not only contribute to objectively identifying quality gaps, but also to more evidence-based supervision. E-TIQH also provides important information for resource planning. Institutional and financial challenges for implementing e-TIQH on a broader scale need to be addressed.