Crossing the digital divide: The workload of manual data entry for integration between mobile health applications and eHealth infrastructure.

Background: Many digital health interventions (DHIs), including mobile health (mHealth) apps, aim to improve both client outcomes and efficiency like electronic medical record systems (EMRS). Although interoperability is the gold standard, it is also complex and costly, requiring technical expertise, stakeholder permissions, and sustained funding. Manual data linkage processes are commonly used to "integrate" across systems and allow for assessment of DHI impact, a best practice, before further investment. For mHealth, the manual data linkage workload, including related monitoring and evaluation (M&E) activities, remains poorly understood. Methodology: As a baseline study for an open-source app to mirror EMRS and reduce healthcare worker (HCW) workload while improving care in the Nurse-led Community-based Antiretroviral therapy Program (NCAP) in Lilongwe, Malawi, we conducted a time-motion study observing HCWs completing data management activities, including routine M&E and manual data linkage of individual-level app data to EMRS. Data management tasks should reduce or end with successful app implementation and EMRS integration. Data was analysed in Excel. Results: We observed 69:53:00 of HCWs performing routine NCAP service delivery tasks: 39:52:00 (57%) was spent completing M&E data related tasks of which 15:57:00 (23%) was spent on manual data linkage workload, alone. Conclusion: Understanding the workload to ensure quality M&E data, including to complete manual data linkage of mHealth apps to EMRS, provides stakeholders with inputs to drive DHI innovations and integration decision making. Quantifying potential mHealth benefits on more efficient, high-quality M&E data may trigger new innovations to reduce workloads and strengthen evidence to spur continuous improvement.

"We have been so patient because we know where we are coming from" Exploring the acceptability and feasibility of a mobile electronic medical record system designed for community-based antiretroviral therapy in Lilongwe, Malawi.

Background: Mobile health (mHealth) is reshaping healthcare delivery, especially in HIV management. The World Health Organization advocates for mHealth to provide healthcare workers (HCWs) with real-time data, enhancing patient care. However, in Malawi's Lighthouse Trust antiretroviral therapy (ART) clinic, the nurse-led community-based ART (NCAP) program faces hurdles with data management due to lack of access to electronic medical records systems (EMRS) in the community setting. EMRS is not typically available in differentiated service delivery settings where reliable power and internet are often unavailable. We used human-centered design (HCD) processes to create a mobile EMRS prototype, the Community-based ART Retention and Suppression (CARES) app. We explore progress to simplify workflow for HCWs and improve client care. Methods: To evaluate the CARES app's feasibility and acceptability among NCAP HCWs, we conducted in-depth interviews among 15 NCAP HCWs. We used a rapid qualitative analysis approach guided by the extended Technology Acceptance Model. The study complied with the Consolidated Criteria for Reporting Qualitative Research (COREQ). Results: As a likely result of HCD, HCWs demonstrated high expectations for the CARES app to improve healthcare delivery and data management. However, challenges such as app performance, data integration, and system navigation were significant barriers to acceptance or feasibility. Despite challenges, HCWs remained optimistic about the potential for CARES to enhance NCAP clinical decision-making and data flow. HCWs emphasized the need for continuous training and stakeholder engagement, improved infrastructure, data security protections, and establishing the CARES app and EMRS integration to facilitate CARES' longterm success at scale. Conclusion: The study's findings underscore the importance of HCD for mHealth buy-in. As HCWs were invested in CARES success, they remained optimistic that the app could enhance NCAP services if user experience and app performance improved. Incorporation of HCW feedback would help deliver beyond the promise of CARES.

Centering healthcare workers in digital health design: Usability and acceptability of two-way texting to improve retention in antiretroviral therapy in a public HIV clinic in Lilongwe, Malawi.

New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low- and middle-income countries, like Malawi, appropriate digital health applications (apps) must fit into local clinic, connectivity and resource constraints. We describe the human centered design (HCD) and development process of an open-source, hybrid, two-way texting (2wT) system to improve ART retention. We detail the critical role of diverse healthcare workers (HCWs) in the HCD process to inform app usability, create buy-in, and ensure appropriate optimization for the local context. We optimized 2wT usability and acceptability over three HCD phases: 1) informal feedback sessions with diverse 2wT stakeholders, 2) a small pilot, and 3) key informant interviews. Phase one included four sessions with diverse HCWs, including "expert ART clients", clinical, technical, supervisory, and evaluation teams to inform 2wT design. In phase 2, a small pilot with 50 participating ART clients aimed to inform implementation improvement. Phase three included interviews with ten HCWs to deepen understanding of 2wT acceptability and usability, documenting strengths and weaknesses to inform optimization. Multi-phase feedback sessions with HCWs helped refine 2wT language and message timing for both weekly and tailored client-specific visit reminders. The pilot led to improvements in educational materials to guide client responses and ease interaction with HCWs. In interviews, the HCWs appreciated the HCD co-creation process, suggested ways to increase access for low-literacy clients or those without consistent phone access, and felt integrating 2wT with other eHealth platforms would improve scalability. Inclusion of HCWs across phases of HCD design, adaption, and optimization increased 2wT usability and acceptability among HCWs in this setting. Engaging HCWs into 2wT co-ownership from inception appears successful in co-creation of an app that will meet HCW needs, and therefore, enhance support for 2wT clients to attend visits and remain in care.

Cost-effectiveness analysis of two-way texting (2wT) intervention to improve ART retention among newly-initiated antiretroviral therapy clients in Malawi.

Background: Retention in HIV care is crucial for improved health outcomes. Malawi has a high HIV prevalence and struggles with retention despite significant progress in controlling the epidemic. Mobile health (mHealth) interventions, such as two-way texting (2wT), have shown promise in improving anti-retroviral therapy (ART) retention. We explore the cost-effectiveness of a 2wT intervention in Lighthouse Trust's Martin Preuss Center (MPC) in Lilongwe, Malawi, that sends automated SMS visit reminders, weekly motivational messages, and supports direct communication between clients and healthcare workers. Methods: Costs and retention rates were compared between 2wT and standard of care (SOC) for 468 clients enrolled in each. Incremental cost-effectiveness ratios (ICERs) were calculated. Scenario analyses were conducted to estimate costs if 2wT expanded. Results: The 2wT group had higher retention (80%) than SOC (67%) at 12 months post-ART initiation. For 468 clients, the total annual costs for 2wT were $36,670.38 as compared to SOC costs at $33,458.72, resulting in an ICER of $24,705. Among scenarios, the ICER was -$105,315 if 2wT expanded to all new clients (2678 at MPC and -$723,739 as 2wT expanded to other four high-burden facilities (2901 clients), suggesting high cost savings if 2wT was effectively scaled. Conclusion: The 2wT intervention appears cost-effective to improve ART retention among new ART initiates in a high-burden ART clinic. While mHealth interventions have potential limitations, their benefits in improving patient outcomes and cost savings support their integration into HIV care programs.

The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: findings from a quasi-experimental study in Lilongwe, Malawi.

Background: Retaining clients on antiretroviral therapy (ART) is challenging especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi. Methods: Between August 2021 - June 2023, a quasi-experimental study compared outcomes between two cohorts of new ART clients: 1) those opting into 2wT with combined automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as "the proportion clients ≤6 months of ART initiation eligible for 2wT". 2wT effectiveness was assessed in time-to-event analysis comparing Kaplan-Meier plots of 6- and 12-month retention between 2wT and SoC using a log-rank test. The effect of 2wT on ART drop out was estimated using multivariable Cox proportional hazard models, adjusting for sex, age and WHO stage at ART initiation. Results: Of the 1,146 clients screened, 645 were ineligible (56%) largely due to lack of phone access (393/645; 61%) and illiteracy (149/645; 23%): a reach of 44%. Among 468 2wT participants, the 12-month probability of ART retention was 91% (95%CI: 88% - 93%) compared to 75% (95%CI: 71% - 79%) among 468 SoC participants (p<0.0001). Compared to SoC participants, 2wT participants had a 62% lower hazard of dropping out of ART care at all time points (hazard ratio 0.38, 95% CI: 0.26-0.54; p<0.001). Conclusions: Not all clients were reached with 2wT. For those who opted-in, 2wT reduced drop out throughout the first year on ART and significantly increased 12-month retention. The proactive 2wT approach should be expanded as a complement to other interventions in routine, low-resource settings to improve ART retention.

How much does it cost to retain antiretroviral therapy (ART) clients in care? Routine financial costs of retention interventions at Lighthouse Trust's Martin Preuss Centre (MPC) in Lilongwe, Malawi.

Introduction: Antiretroviral therapy (ART) improves the health of people living with HIV (PLHIV). However, a high loss to follow-up, particularly in the first year after ART initiation, is problematic. The financial expenses related to client retention in low- and middle-income countries (LMICs) in sub-Saharan Africa are not well understood. This study aimed to comprehensively assess and quantify the financial costs associated with routine ART retention care at Lighthouse Trust's (LT) Martin Preuss Centre (MPC), a large, public ART clinic in Lilongwe, Malawi. Methods: We performed activity-based microcosting using routine data to assess the expenses related to routine ART retention services at the MPC for 12 months, January-December 2021. MPC provides an "ART Buddy" from ART initiation to 12 months. The MPC's Back-to-Care (B2C) program traces clients who miss ART visits at any time. Clients may be traced and return to care multiple times per year. We assessed client retention costs for the first 12 months of treatment with ART and conducted a sensitivity analysis. Results: The total annual cost of ART retention interventions at the MPC was $237,564. The proactive Buddy phase incurred $108,504; personnel costs contributed $97,764. In the reactive B2C phase, the total cost was $129,060, with personnel expenses remaining substantial at $73,778. The Buddy unit cost was $34 per client. The reactive B2C intervention was $17 per tracing event. On average, the unit cost for ART retention in the first year of ART averaged $22 per client. Conclusion: This study sheds light on the financial dimensions of ART retention interventions at the MPC of LTs. ART retention is both costly and critical for helping clients adhere to visits and remain in care. Continued investment in the human resources needed for both proactive and reactive retention efforts is critical to engaging and retaining patients on lifetime ART.

Centering healthcare workers in developing digital health interventions: usability and acceptability of a two-way texting retention intervention in a public HIV clinic in Lilongwe, Malawi.

Background: New initiates on antiretroviral therapy (ART) are at high risk of treatment discontinuation, putting their health at risk. In low-resource settings, like Malawi, appropriate digital health applications must fit into local connectivity and resource constraints. Target users' perspectives are critical for app usability, buy-in and optimization. We describe the formative stages of the design of a two-way text-based (2wT) system of tailored reminders and adherence messages for new ART initiates and share results from key informant interviews with HCWs focused on app usability and acceptability. Methods: Using a co-creation approach with clients, clinical, technical and evaluation teams and over app development, we held four informal user feedback sessions, a small pilot with 50 clients, and ten key informant (KIIs) to deepen our understanding of healthcare workers (HCWs) needs, acceptability and usability. Results: Formative research informed the design of interactive client-to-HCW communication, refining of the language and timing of weekly text blast motivational messages and tailored client-specific visit reminders. Informal feedback from HCW stakeholders also informed educational materials to enhance 2wT client understanding of how to report transfers, request visit date changes and ask questions related to their visits. In KII, HCWs noted their appreciation for the co-creation process, believing that the participatory HCD process and responsive design team enabled the development of a highly acceptable and usable 2wT digital tool. HCWs also suggested future improvements to promote inclusion of clients of varying literacy levels and economic backgrounds as well as integrating with other health platforms to improve uptake of 2wT. Conclusions: Inclusion of HCWs increased perceptions of app usability and acceptability among HCWs. HCWs believe that 2wT will improve on-time ART visit attendance and provide valuable early retention in care support. The co-creation approach appears successful in designing an app that will meet HCW needs and, therefore, support client adherence to visits.

"It reminds me and motivates me": Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi.

BACKGROUND: Early retention of people living with HIV (PLHIV) in antiretroviral therapy (ART) programs is critical to improve individual clinical outcomes and viral load suppression. Although many mobile health (mHealth) interventions aim to improve retention in care, there is still lack of evidence on mHealth success or failure, including from patient's perspectives. We describe the human-centered design (HCD) process and assess patient usability and acceptability of a two-way texting (2wT) intervention to improve early retention among new ART initiates at Lighthouse Trust clinic in Lilongwe, Malawi. METHODS: An iterative HCD approach focused on patient and provider users' needs, incorporating feedback from multidisciplinary teams to adapt 2wT for the local, public clinic context. We present mixed-methods usability and acceptability results from 100 participants, 50 at 3-months and 50 at 6-months, post 2wT enrollment, and observations of these same patients completing core tasks of the 2wT system. RESULTS: Among the 100 usability respondents, 95% were satisfied with visit reminders, and 88% would recommend reminders and motivational messages to friends; however, 17% were worried about confidentiality. In observation of participant task completion, 94% were able to successfully confirm visit attendance and 73% could request appointment date change. More participants in 4-6 months group completed tasks correctly compared to 1-3 months group, although not significantly different (78% vs. 66%, p = 0.181). Qualitative results were overwhelmingly positive, but patients did note confusion with transfer reporting and concern that 2wT would not reach patients without mobile phones or with lower literacy. CONCLUSION: The 2wT app for early ART retention appears highly usable and acceptable, hopefully creating a solid foundation for lifelong engagement in care. The HCD approach put the local team central in this process, ensuring that both patients' and Lighthouse's priorities, policies, and practices were forefront in 2wT optimization, raising the likelihood of 2wT success in other routine program contexts.

Virologic failure and switch to second-line antiretroviral therapy in children with HIV in Lilongwe, Malawi: an observational cohort study.

BACKGROUND: As routine viral load testing among HIV-infected individuals on antiretroviral therapy (ART) expands, virologic failure (VF) among children in developing countries remains poorly understood. We assessed the rate of VF, the proportion failing who were subsequently switched to second-line ART and factors associated with VF among children ≤18 y. METHODS: An observation cohort study among 1312 children at two public clinics in Lilongwe, Malawi who initiated a first-line ART regimen between January 2014 and December 2017 and remained on treatment for ≥6 mo was conducted. Kaplan-Meier methods estimated the probabilities of VF. Univariable and multivariable Poisson regression models were used to explore predictors of VF. RESULT: Overall, 16% (208/1312) of children experienced VF with an incidence rate of 10.1 events per 100 person-years. Of the 208, 184 (88%) were switched to second-line ART: 68 (43%) switched the same day VF was confirmed and 106 (66%) switched within 90 d of confirmed VF. Use of a Nevirapine (NVP)-based regimen and initiating ART in 2016-2017 compared with 2014-2015 were independent predictors of VF. CONCLUSION: VF is common among children receiving ART. The findings suggest that VF can be reduced by phasing out NVP-based regimen and by ensuring optimal adherence to ART.