mHealth-community health worker telemedicine intervention for surgical site infection diagnosis: a prospective study among women delivering via caesarean section in rural Rwanda.

BACKGROUND: Surgical site infections (SSIs) cause a significant global public health burden in low and middle-income countries. Most SSIs develop after patient discharge and may go undetected. We assessed the feasibility and diagnostic accuracy of an mHealth-community health worker (CHW) home-based telemedicine intervention to diagnose SSIs in women who delivered via caesarean section in rural Rwanda. METHODS: This prospective cohort study included women who underwent a caesarean section at Kirehe District Hospital between September 2019 and March 2020. At postoperative day 10 (±3 days), a trained CHW visited the woman at home, provided wound care and transmitted a photo of the wound to a remote general practitioner (GP) via WhatsApp. The GP reviewed the photo and made an SSI diagnosis. The next day, the woman returned to the hospital for physical examination by an independent GP, whose SSI diagnosis was considered the gold standard for our analysis. We describe the intervention process indicators and report the sensitivity and specificity of the telemedicine-based diagnosis. RESULTS: Of 787 women included in the study, 91.4% (n=719) were located at their home by the CHW and all of them (n=719, 100%) accepted the intervention. The full intervention was completed, including receipt of GP telemedicine diagnosis within 1 hour, for 79.0% (n=623). The GPs diagnosed 30 SSIs (4.2%) through telemedicine and 38 SSIs (5.4%) through physical examination. The telemedicine sensitivity was 36.8% and specificity was 97.6%. The negative predictive value was 96.4%. CONCLUSIONS: Implementation of an mHealth-CHW home-based intervention in rural Rwanda and similar settings is feasible. Patients' acceptance of the intervention was key to its success. The telemedicine-based SSI diagnosis had a high negative predictive value but a low sensitivity. Further studies must explore strategies to improve accuracy, such as accompanying wound images with clinical data or developing algorithms using machine learning.

The Effect and Feasibility of mHealth-Supported Surgical Site Infection Diagnosis by Community Health Workers After Cesarean Section in Rural Rwanda: Randomized Controlled Trial.

BACKGROUND: The development of a surgical site infection (SSI) after cesarean section (c-section) is a significant cause of morbidity and mortality in low- and middle-income countries, including Rwanda. Rwanda relies on a robust community health worker (CHW)-led, home-based paradigm for delivering follow-up care for women after childbirth. However, this program does not currently include postoperative care for women after c-section, such as SSI screenings. OBJECTIVE: This trial assesses whether CHW's use of a mobile health (mHealth)-facilitated checklist administered in person or via phone call improved rates of return to care among women who develop an SSI following c-section at a rural Rwandan district hospital. A secondary objective was to assess the feasibility of implementing the CHW-led mHealth intervention in this rural district. METHODS: A total of 1025 women aged ≥18 years who underwent a c-section between November 2017 and September 2018 at Kirehe District Hospital were randomized into the three following postoperative care arms: (1) home visit intervention (n=335, 32.7%), (2) phone call intervention (n=334, 32.6%), and (3) standard of care (n=356, 34.7%). A CHW-led, mHealth-supported SSI diagnostic protocol was delivered in the two intervention arms, while patients in the standard of care arm were instructed to adhere to routine health center follow-up. We assessed intervention completion in each intervention arm and used logistic regression to assess the odds of returning to care. RESULTS: The majority of women in Arm 1 (n=295, 88.1%) and Arm 2 (n=226, 67.7%) returned to care and were assessed for an SSI at their local health clinic. There were no significant differences in the rates of returning to clinic within 30 days (P=.21), with high rates found consistently across all three arms (Arm 1: 99.7%, Arm 2: 98.4%, and Arm 3: 99.7%, respectively). CONCLUSIONS: Home-based post-c-section follow-up is feasible in rural Africa when performed by mHealth-supported CHWs. In this study, we found no difference in return to care rates between the intervention arms and standard of care. However, given our previous study findings describing the significant patient-incurred financial burden posed by traveling to a health center, we believe this intervention has the potential to reduce this burden by limiting patient travel to the health center when an SSI is ruled out at home. Further studies are needed (1) to determine the acceptability of this intervention by CHWs and patients as a new standard of care after c-section and (2) to assess whether an app supplementing the mHealth screening checklist with image-based machine learning could improve CHW diagnostic accuracy. TRIAL REGISTRATION: ClinicalTrials.gov NCT03311399; https://clinicaltrials.gov/ct2/show/NCT03311399.

Telemedicine for Surgical Site Infection Diagnosis in Rural Rwanda: Concordance and Accuracy of Image Reviews.

BACKGROUND: In rural Africa where access to medical personnel is limited, telemedicine can be leveraged to empower community health workers (CHWs) to support effective postpartum home-based care after cesarean section (c-section). As a first step toward telemedicine, we assessed the sensitivity, specificity, and interrater reliability of image-based diagnosis of surgical site infections (SSIs) among women delivering via c-section at a rural Rwandan Hospital. METHODS: Women ≥18 years who underwent c-section from March to October 2017 at Kirehe District Hospital (KDH) were enrolled. On postoperative day 10 at KDH, participants underwent a physical examination by a general practitioner, who provided a diagnosis of SSI or no SSI. Trained CHWs photographed patients' incisions and the collected images were shown to six physicians, who upon review, assigned one of the following diagnoses to each image: definite SSI, suspected SSI, suspected no SSI, and definite no SSI, which were compared with the diagnoses based on physical exam. We report the sensitivity and specificity and assessed reviewer agreement using Gwet's AC1. RESULTS: 569 images were included, with 61 women (10.7%) diagnosed with an SSI. Of the 3414 image-reviews, 49 (1.4%) could not be assigned diagnoses due to image quality. The median sensitivity and specificity were 0.83 and 0.69, respectively. The Gwet's AC1 estimate for binary classification was 0.46. CONCLUSIONS: We demonstrate decent accuracy but only moderate consistency for photograph-based SSI diagnosis. Strategies to improve overall agreement include providing clinical information to accompany photographs, providing a baseline photograph for comparison, and implementing photograph-taking processes aimed at improving image quality.

Diagnosing Post-Cesarean Surgical Site Infections in Rural Rwanda: Development, Validation, and Field Testing of a Screening Algorithm for Use by Community Health Workers.

Background: We aimed to develop and validate a screening algorithm to assist community health workers (CHWs) in identifying surgical site infections (SSIs) after cesarean section (c-section) in rural Africa. Methods: Patients were adult women who underwent c-section at a Rwandan rural district hospital between March and October 2017. A CHW administered a nine-item clinical questionnaire 10 ± 3 days post-operatively. Independently, a general practitioner (GP) administered the same questionnaire and assessed SSI presence by physical examination. The GP's SSI diagnosis was used as the gold standard. Using a simplified Classification and Regression Tree analysis, we identified a subset of screening questions with maximum sensitivity for the GP and CHW and evaluated the subset's sensitivity and specificity in a validation dataset. Then, we compared the subset's results when implemented in the community by CHWs with health center-reported SSI. Results: Of the 596 women enrolled, 525 (88.1%) completed the clinical questionnaire. The combination of questions concerning fever, pain, and discolored drainage maximized sensitivity for both the GPs (sensitivity = 96.8%; specificity = 85.6%) and CHWs (sensitivity = 87.1%; specificity = 73.8%). In the validation dataset, this subset had sensitivity of 95.2% and specificity of 83.3% for the GP-administered questions and sensitivity of 76.2% and specificity of 81.4% for the CHW-administered questions. In the community screening, the overall percent agreement between CHW and health center diagnoses was 81.1% (95% confidence interval: 77.2%-84.6%). Conclusions: We identified a subset of questions that had good predictive features for SSI, but its sensitivity was lower when administered by CHWs in a clinical setting, and it performed poorly in the community. Methods to improve diagnostic ability, including training or telemedicine, must be explored.

The impact of an mHealth monitoring system on health care utilization by mothers and children: an evaluation using routine health information in Rwanda.

Maternal and child mortality rates remain unacceptably high globally, particularly in sub-Saharan Africa. A popular approach to counter these high rates is interventions delivered using mobile phones (mHealth). However, few mHealth interventions have been implemented nationwide and there has been little evaluation of their effectiveness, particularly at scale. Therefore, we evaluated the Rwanda RapidSMS programme-one of the few mHealth programmes in Africa that is currently operating nationwide. Using interrupted time series analysis and monthly data routinely reported by public health centres (n = 461) between 2012 and 2016, we studied the impact of RapidSMS on four indicators: completion of four antenatal care visits, deliveries in a health facility, postnatal care visits and malnutrition screening. We stratified all analyses based on whether the district received concurrent additional supports, including staff and equipment (10 out of 30 Districts). We found that community health workers in Rwanda sent more than 9.3 million messages using RapidSMS, suggesting the programme was successfully implemented. We found that the implementation of the RapidSMS system combined with additional support including training, supervision and equipment provision increased the use of maternal and child health services. In contrast, implementing the RapidSMS system alone was ineffective. This suggests that mHealth programmes alone may be insufficient to improve the use of health services. Instead, they should be considered as a part of more comprehensive interventions that provide the necessary equipment and health system capacity to support them.

Assessing the perspectives of users and beneficiaries of a community health worker mHealth tracking system for mothers and children in Rwanda.

INTRODUCTION: Mobile Health (mHealth) programs have increasingly been used to tackle maternal and child health problems in low and middle income countries. However, few studies have evaluated how these programs have been perceived by intended users and beneficiaries. Therefore, we explored perceptions of healthcare officials and beneficiaries regarding RapidSMS Rwanda, an mHealth system used by Community Health Workers (CHWs) that was scaled up nationwide in 2013. METHODS: We conducted key informant interviews and focus group discussions with key stakeholders, providers, and beneficiaries of maternal and child health services at both the national and community levels. Semi-structured interviews were used to assess perceptions about the impact of and challenges facing the RapidSMS system. Interviews and focus group discussions were recorded (with the exception of one), transcribed verbatim, and analyzed. RESULTS: We conducted a total of 28 in-depth interviews and 10 focus group discussions (93 total participants). A majority of respondents believed that RapidSMS contributed to reducing maternal and child mortality rates. RapidSMS was generally accepted by both CHWs and parents. Participants identified insufficient training, a lack of equipment, and low CHW motivation as the main challenges facing RapidSMS. CONCLUSION: Our findings suggest that an mHealth program can be well accepted by both policymakers, health providers, and the community. We also found significant technical challenges that have likely reduced its impact. Addressing these challenges will serve to strengthen future mHealth programs.

Using mobile health technology and community health workers to identify and refer caesarean-related surgical site infections in rural Rwanda: a randomised controlled trial protocol.

INTRODUCTION: Surgical site infections (SSIs) are a significant cause of morbidity and mortality in low-income and middle-income countries, where rates of SSIs can reach 30%. Due to limited access, there is minimal follow-up postoperatively. Community health workers (CHWs) have not yet been used for surgical patients in most settings. Advancements in telecommunication create an opportunity for mobile health (mHealth) tools to support CHWs. We aim to evaluate the use of mHealth technology to aid CHWs in identification of SSIs and promote referral of patients back to healthcare facilities. METHODS AND ANALYSIS: Prospective randomised controlled trial conducted at Kirehe District Hospital, Rwanda, from November 2017 to November 2018. Patients ≥18 years who undergo caesarean section are eligible. Non-residents of Kirehe District or patients who remain in hospital >10 days postoperatively will be excluded. Patients will be randomised to one of three arms. For arm 1, a CHW will visit the patient's home on postoperative day 10 (±3 days) to administer an SSI screening protocol (fever, pain or purulent drainage) using an electronic tablet. For arm 2, the CHW will administer the screening protocol over the phone. For both arms 1 and 2, the CHW will refer patients who respond 'yes' to any of the questions to a health facility. For arm 3, patients will not receive follow-up care. Our primary outcome will be the impact of the mHealth-CHW intervention on the rate of return to care for patients with an SSI. ETHICS AND DISSEMINATION: The study has received ethical approval from the Rwandan National Ethics Committee and Partners Healthcare. Results will be disseminated to Kirehe District Hospital, Rwanda Ministry of Health, Rwanda Surgical Society, Partners In Health, through conferences and peer-reviewed publications. TRIAL REGISTRATION NUMBER: NCT03311399.

Using Electronic Medical Record Data to Improve HIV Patient Monitoring, Clinical Decision-Making, and Quality Improvement: Lessons from Rwanda.

In developing countries, clinical guidelines and patient follow-up are primarily paper-based. We describe the use of Electronic Medical Record data for evidence-based clinical decisions and improved HIV patients monitoring in rural Rwanda.

Data for Program Management: An Accuracy Assessment of Data Collected in Household Registers by Community Health Workers in Southern Kayonza, Rwanda.

Community health workers (CHWs) collect data for routine services, surveys and research in their communities. However, quality of these data is largely unknown. Utilizing poor quality data can result in inefficient resource use, misinformation about system gaps, and poor program management and effectiveness. This study aims to measure CHW data accuracy, defined as agreement between household registers compared to household member interview and client records in one district in Eastern province, Rwanda. We used cluster-lot quality assurance sampling to randomly sample six CHWs per cell and six households per CHW. We classified cells as having 'poor' or 'good' accuracy for household registers for five indicators, calculating point estimates of percent of households with accurate data by health center. We evaluated 204 CHW registers and 1,224 households for accuracy across 34 cells in southern Kayonza. Point estimates across health centers ranged from 79 to 100% for individual indicators and 61 to 72% for the composite indicator. Recording error appeared random for all but the widely under-reported number of women on modern family planning method. Overall, accuracy was largely 'good' across cells, with varying results by indicator. Program managers should identify optimum thresholds for 'good' data quality and interventions to reach them according to data use. Decreasing variability and improving quality will facilitate potential of these routinely-collected data to be more meaningful for community health program management. We encourage further studies assessing CHW data quality and the impact training, supervision and other strategies have on improving it.

Nationwide implementation of integrated community case management of childhood illness in Rwanda.

BACKGROUND: Between 2008 and 2011, Rwanda introduced integrated community case management (iCCM) of childhood illness nationwide. Community health workers in each of Rwanda's nearly 15,000 villages were trained in iCCM and equipped for empirical diagnosis and treatment of pneumonia, diarrhea, and malaria; for malnutrition surveillance; and for comprehensive reporting and referral services. METHODS: We used data from the Rwanda health management information system (HMIS) to calculate monthly all-cause under-5 mortality rates, health facility use rates, and community-based treatment rates for childhood illness in each district. We then compared a 3-month baseline period prior to iCCM implementation with a seasonally matched comparison period 1 year after iCCM implementation. Finally, we compared the actual changes in all-cause child mortality and health facility use over this time period with the changes that would have been expected based on baseline trends in Rwanda. RESULTS: The number of children receiving community-based treatment for diarrhea and pneumonia increased significantly in the 1-year period after iCCM implementation, from 0.83 cases/1,000 child-months to 3.80 cases/1,000 child-months (P = .01) and 0.25 cases/1,000 child-months to 5.28 cases/1,000 child-months (P<.001), respectively. On average, total under-5 mortality rates declined significantly by 38% (P<.001), and health facility use declined significantly by 15% (P = .006). These decreases were significantly greater than would have been expected based on baseline trends. CONCLUSIONS: This is the first study to demonstrate decreases in both child mortality and health facility use after implementing iCCM of childhood illness at a national level. While our study design does not allow for direct attribution of these changes to implementation of iCCM, these results are in line with those of prior studies conducted at the sub-national level in other low-income countries.

Rwanda 20 years on: investing in life.

Two decades ago, the genocide against the Tutsis in Rwanda led to the deaths of 1 million people, and the displacement of millions more. Injury and trauma were followed by the effects of a devastated health system and economy. In the years that followed, a new course set by a new government set into motion equity-oriented national policies focusing on social cohesion and people-centred development. Premature mortality rates have fallen precipitously in recent years, and life expectancy has doubled since the mid-1990s. Here we reflect on the lessons learned in rebuilding Rwanda's health sector during the past two decades, as the country now prepares itself to take on new challenges in health-care delivery.