Effects of a performance and quality improvement intervention on the work environment in HIV-related care: a quasi-experimental evaluation in Zambia.

BACKGROUND: Human resource shortages and reforms in HIV-related care make it challenging for frontline health care providers in southern Africa to deliver high-quality services. At health facilities of the Zambian Defence Forces, a performance and quality improvement approach was implemented to improve HIV-related care and was evaluated in 2010/2011. Changes in providers' work environment and perceived quality of HIV-related care were assessed to complement data of provider performance. METHODS: The intervention involved on-site training, supportive supervision, and action planning focusing on detailed service delivery standards. The quasi-experimental evaluation collected pre- and post-intervention data from eight intervention and comparison facilities matched on defence force branch and baseline client volume. Overall, 101 providers responded to a 24-item questionnaire on the work environment, covering topics of drugs, supplies, and equipment; training, feedback, and supervision; compensation; staffing; safety; fulfilment; and HIV services quality. In bivariate analysis and multivariate analyses, we assessed changes within each study group and between the two groups. RESULTS: In the bivariate analysis, the intervention group providers reported improvements in the work environment on adequacy of equipment, feeling safe from harm, confidence in clinical skills, and reduced isolation, while the comparison group reported worsening of the work environment on supplies, training, safety, and departmental morale.In the multivariate analysis, the intervention group's improvement and the comparison group's decline were significant on perceived adequacy of drugs, supplies, and equipment; constructive feedback received from supervisor and co-workers; and feeling safe from physical harm (all P <0.01, except P <0.04 for equipment). Further, the item "provider lacks confidence in some clinical skills" declined in the intervention group but increased in the comparison group (P = -0.005). In multivariate analysis, changes in perceived quality of HIV care did not differ between study groups. Provider perceptions were congruent with observations of preparing drugs, supplies, equipment, and in service delivery of prevention of mother-to-child transmission of HIV and antiretroviral therapy follow-up care. CONCLUSIONS: The performance and quality improvement intervention implemented at Zambian Defence Forces' health facilities was associated with improvements in providers' perceptions of work environment consistent with the intervention's focus on commodities, skills acquisition, and receipt of constructive feedback.

Evaluation of a quality improvement intervention to prevent mother-to-child transmission of HIV (PMTCT) at Zambia defence force facilities.

BACKGROUND: The Zambian Defence Force (ZDF) is working to improve the quality of services to prevent mother-to-child transmission of HIV (PMTCT) at its health facilities. This study evaluates the impact of an intervention that included provider training, supportive supervision, detailed performance standards, repeated assessments of service quality, and task shifting of group education to lay workers. METHODS: Four ZDF facilities implementing the intervention were matched with four comparison sites. Assessors visited the sites before and after the intervention and completed checklists while observing 387 antenatal care (ANC) consultations and 41 group education sessions. A checklist was used to observe facilities' infrastructure and support systems. Bivariate and multivariate analyses were conducted of findings on provider performance during consultations. RESULTS: Among 137 women observed during their initial ANC visit, 52% came during the first 20 weeks of pregnancy, but 19% waited until the 28th week or later. Overall scores for providers' PMTCT skills rose from 58% at baseline to 73% at endline (p=0.003) at intervention sites, but remained stable at 52% at comparison sites. Especially large gains were seen at intervention sites in family planning counseling (34% to 75%, p=0.026), HIV testing during return visits (13% to 48%, p=0.034), and HIV/AIDS management during visits that did not include an HIV test (1% to 34%, p=0.004). Overall scores for providers' ANC skills rose from 67% to 74% at intervention sites, but declined from 65% to 59% at comparison sites; neither change was significant in the multivariate analysis. Overall scores for group education rose from 87% to 91% at intervention sites and declined from 78% to 57% at comparison sites. The overall facility readiness score rose from 73% to 88% at intervention sites and from 75% to 82% at comparison sites. CONCLUSIONS: These findings are relevant to civilian as well as military health systems in Zambia because the two are closely coordinated. Lessons learned include: the ability of detailed performance standards to draw attention to and strengthen areas of weakness; the benefits of training lay workers to take over non-clinical PMTCT tasks; and the need to encourage pregnant women to seek ANC early.

Improving performance of Zambia Defence Force antiretroviral therapy providers: evaluation of a standards-based approach.

BACKGROUND: The Zambia Defence Force (ZDF) has applied the Standards-Based Management and Recognition (SBM-R®) approach, which uses detailed performance standards, at some health facilities to improve HIV-related services offered to military personnel and surrounding civilian communities. This study examines the effectiveness of the SBM-R approach in improving facility readiness and provider performance at ZDF facilities. METHODS: We collected data on facility readiness and provider performance before and after the 2010-2012 intervention at 4 intervention sites selected for their relatively poor performance and 4 comparison sites. Assessors observed whether each facility met 16 readiness standards and whether providers met 9 performance standards during consultations with 354 returning antiretroviral therapy (ART) clients. We then calculated the percentages of criteria achieved for each readiness and performance standard and conducted bivariate and multivariate analyses of provider performance data. RESULTS: Facilities' ART readiness scores exceeded 80% before the intervention at both intervention and comparison sites. At endline, scores improved on 4 facility readiness standards in the intervention group but on only 1 standard in the comparison group. Multivariate analysis found that the overall provider performance score increased significantly in the intervention group (from 58% to 84%; P<.01) but not in the comparison group (from 62% to 70%). The before-and-after improvement in scores was significantly greater among intervention sites than among comparison sites for 2 standards-initial assessment of the client's condition and nutrition counseling. CONCLUSION: The standards-based approach, which involved intensive and mutually reinforcing intervention activities, showed modest improvements in some aspects of providers' performance during ART consultations. Further research is needed to determine whether improvements in provider performance affect client outcomes such as adherence to ART.