Point-of-care CD4 technology invalid result rates in public health care settings across five countries.

BACKGROUND: Since 2010, point-of-care (POC) CD4 testing platforms have been introduced in both urban and rural settings to expand access to testing by bringing diagnostic services closer to patients. We conducted an analysis of routinely collected CD4 testing data to determine the invalid result rates associated with POC CD4 testing. METHODS: We analyzed 981,152 CD4 testing records collected from Alere Pima Analyzers between January 2011 and December 2016 across five countries in sub-Saharan Africa. Routinely collected data and programmatic records were used to determine the rate of invalid test results per month, by facility type, and by operator based on cumulative usage during the study period. In addition, frequency of invalid test types and utilization of control beads were assessed. RESULTS: Across the five countries, 75,530 invalid messages were returned, resulting in an overall invalid result rate of 7.7%. The invalid result rate by country ranged from 6.6% to 11.2%. Invalid result rates were consistent across facility types. Invalid result rates were inversely correlated with operator usage: low volume operators (<50 tests over study period) experienced an invalid result rate of 10.2%, while high volume operators (>500 tests over study period) experienced an invalid result rate of 5.5%. Two invalid result types (exposure position control and reagent control) accounted for nearly 50% of invalid results. Routine data showed that control beads were run on 88.3% of days that the device was used. CONCLUSIONS: Our analysis found that the rate of invalid results was consistent across all types of health facilities, indicating that decentralization of POC CD4 testing to lower level health facilities did not exhibit high invalid result rates or increase cartridge wastage. Additionally, invalid result rates were inversely correlated to operator usage, with high-volume operators experiencing lower invalid result rates than low-volume operators. POC CD4 testing can, therefore, be performed in decentralized national testing programs; however, adequate training, quality assurance, routine monitoring, and ongoing mentorship should also be implemented for success.

Performance evaluation of tuberculosis smear microscopists working at rechecking laboratories in Ethiopia.

BACKGROUND: Tuberculosis is an infectious disease caused by the bacillus Mycobacterium tuberculosis. According to the Ethiopian Federal Ministry of Health's 2013-2014 report, the tuberculosis case detection rate was 53.7%, which was below the target of 81% set for that year. OBJECTIVE: This study assessed the performance of tuberculosis smear microscopists at external quality assessment rechecking laboratories in Ethiopia. METHODS: A cross-sectional study was conducted at 81 laboratories from April to July 2015. Panel slides were prepared and validated at the National Tuberculosis Reference Laboratory. The validated panel slides were used to evaluate the performance of microscopists at these laboratories compared with readers from the reference laboratory. RESULTS: A total of 389 external quality assessment rechecking laboratory microscopists participated in the study, of which 268 (68.9%) worked at hospitals, 241 (62%) had more than five years of work experience, 201 (51.7%) held Bachelors degrees, and 319 (82%) reported tuberculosis smear microscopy training. Overall, 324 (83.3%) participants scored ≥ 80%. Sensitivity for detecting tuberculosis bacilli was 84.5% and specificity was 93.1%. The overall percent agreement between participants and reference readers was 87.1 (kappa=0.72). All 10 slides were correctly read (i.e., scored 100%) by 80 (20.6%) participants, 156 (40.1%) scored 90% - 95%, 88 (22.6%) scored 80% - 85% and 65 (16.7%) scored below 80%. There were 806 (20.7%) total errors, with 143 (3.7%) major and 663 (17%) minor errors. CONCLUSION: The overall performance of participants in reading the slides showed good agreement with the reference readers. Most errors were minor, and the ability to detect tuberculosis bacilli can be improved through building the capacity of professionals.

Performance evaluation of malaria microscopists working at rechecking laboratories in Ethiopia.

BACKGROUND: Microscopic diagnosis of Giemsa-stained thick and thin blood films has remained the standard laboratory method for diagnosing malaria. High quality performance of microscopists that examine blood slides in health facilities remains critically important. MATERIALS AND METHODS: A cross-sectional study was conducted to assess the performance of 107 malaria microscopists working at 23 malaria rechecking laboratories in Ethiopia. A set of 12 blood film slides was distributed to each microscopist. Data was collected and exported to SPSS version 20 for analysis. Chi-square, sensitivity, specificity, percent agreement, and kappa scores were calculated to assess performance in detecting and identification of Plasmodium species. RESULTS: The mean age of the participants was 30 ± 5 yrs and most of them (54; 50.5%) were working at regional reference laboratories. Overall, the sensitivity of participants in detecting and identifying malaria parasite species was 96.8% and 56.7%, respectively. The overall agreement on detection and identification of malaria species was 96.8% (Kappa = 0.9) and 64.8% (Kappa = 0.33), respectively. The least accurately identified malaria parasite species was P. malariae (3/107; 2.8%) followed by P. ovale (35/107; 32.7%). Participants working at hospital laboratories had the highest percentage (72.3 %, Kappa=0.51) of accurate species identification. Study participants that had participated in malaria microscopy and quality assurance trainings were significantly better at quantifying parasite densities (P<0.001). CONCLUSION: The accuracy of parasite identification and quantification differed strongly between participants and expert microscopists. Therefore, regular competency assessment and training for malaria microscopists should be mandatory to assure proper diagnosis and management of malaria in Ethiopia.

Perceptions and attitudes toward SLMTA amongst laboratory and hospital professionals in Ethiopia.

BACKGROUND: Strengthening Laboratory Management Toward Accreditation (SLMTA) is a competency-based management training programme. Assessing health professionals' views of SLMTA provides feedback to inform program planning, implementation and evaluation of SLMTA's training, communication and mentorship components. OBJECTIVES: To assess laboratory professionals' and hospital chief executive officers' (CEOs) perceptions and attitudes toward the SLMTA programme in Ethiopia. METHODS: A cross-sectional descriptive survey was conducted in March 2013 using a structured questionnaire to collect qualitative data from 72 laboratory professionals and hospital CEOs from 17 health facilities, representing all regions and two city administrations in Ethiopia. Focus groups were conducted with laboratory professionals and hospital administration to gain insight into the strengths and challenges of the SLMTA programme so as to guide future planning and implementation. RESULTS: Ethiopian laboratory professionals at all levels had a supportive attitude toward the SLMTA programme. They believed that SLMTA substantially improved laboratory services and acted as a catalyst for total healthcare reform and improvement. They also noted that the SLMTA programme achieved marked progress in laboratory supply chain, sample referral, instrument maintenance and data management systems. In contrast, nearly half of the participating hospital CEOs, especially those associated with low-scoring laboratories, were sceptical about the SLMTA programme, believing that the benefits of SLMTA were outweighed by the level of human resources and time commitment required. They also voiced concerns about the cost and sustainability of SLMTA. CONCLUSION: This study highlights the need for stronger engagement and advocacy with hospital administration and the importance of addressing concerns about the cost and sustainability of the SLMTA programme.

Laboratory system strengthening and quality improvement in Ethiopia.

BACKGROUND: In 2010, a National Laboratory Strategic Plan was set forth in Ethiopia to strengthen laboratory quality systems and set the stage for laboratory accreditation. As a result, the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme was initiated in 45 Ethiopian laboratories. OBJECTIVES: This article discusses the implementation of the programme, the findings from the evaluation process and key challenges. METHODS: The 45 laboratories were divided into two consecutive cohorts and staff from each laboratory participated in SLMTA training and improvement projects. The average amount of supportive supervision conducted in the laboratories was 68 hours for cohort I and two hours for cohort II. Baseline and exit audits were conducted in 44 of the laboratories and percent compliance was determined using a checklist with scores divided into zero- to five-star rating levels. RESULTS: Improvements, ranging from < 1 to 51 percentage points, were noted in 42 laboratories, whilst decreases were recorded in two. The average scores at the baseline and exit audits were 40% and 58% for cohort I (p < 0.01); and 42% and 53% for cohort II (p < 0.01), respectively. The p-value for difference between cohorts was 0.07. At the exit audit, 61% of the first and 48% of the second cohort laboratories achieved an increase in star rating. Poor awareness, lack of harmonisation with other facility activities and the absence of a quality manual were challenges identified. CONCLUSION: Improvements resulting from SLMTA implementation are encouraging. Continuous advocacy at all levels of the health system is needed to ensure involvement of stakeholders and integration with other improvement initiatives and routine activities.