Expert perspectives on essential parameters to monitor during childbirth in low resource settings: a Delphi study in sub-Saharan Africa.

OBJECTIVE: There is no consensus on the essential parameters to monitor during childbirth, when to start, and the rate of monitoring them. User disagreement contributes to inconsistent use of the twelve-item modified World Health Organization partograph that is started when the cervix is at least 4 cm dilated. The inconsistent use is associated with poor outcomes at birth. Our objective was to identify the perspectives of childbirth experts on what and when to routinely monitor during childbirth in low resource settings as we develop a more acceptable childbirth clinical decision support tool. METHOD: We carried out a Delphi study with two survey rounds in early 2018. The online questionnaire covered the partograph items like foetal heart, cervical dilation, and blood pressure, and their monitoring rates. We invited panellists with experience of childbirth care in sub-Saharan Africa. Consensus was pre-set at 70% panellists rating a parameter and we gathered some qualitative reasons for choices. RESULTS: We analysed responses of 76 experts from 13 countries. There was consensus on six important parameters including foetal heart rate, amniotic fluid clearness, cervical dilation, strength of uterine contractions, maternal pulse, and blood pressure. Two in three experts expressed support for changing the monitoring intervals for some parameters in the partograph. 63% experts would raise the partograph starting point while 58% would remove some items from it. Consensus was reached on monitoring the cervical dilation at 4-hourly intervals and there was agreement on monitoring the foetal heart rate one-hourly. However, other parameters only showed majority intervals and without reaching agreement scores. The suggested intervals were two-hourly for strength of uterine contractions, and four-hourly for amniotic fluid thickness, maternal pulse and blood pressure. The commonest reason for their opinions was the more demanding working conditions. CONCLUSION: There was agreement on six partograph items being essential for routine monitoring at birth, but the frequency of monitoring could be changed. To increase acceptability, revisions to birth monitoring guidelines have to be made in consideration of opinions and working conditions of several childbirth experts in low resource settings.

Leveraging mHealth usage logs to inform health worker performance in a Resource-Limited setting: Case example of mUzima use for a chronic disease program in Western Kenya.

BACKGROUND: Health systems in low- and middle-income countries (LMICs) can be strengthened when quality information on health worker performance is readily available. With increasing adoption of mobile health (mHealth) technologies in LMICs, there is an opportunity to improve work-performance and supportive supervision of workers. The objective of this study was to evaluate usefulness of mHealth usage logs (paradata) to inform health worker performance. METHODOLOGY: This study was conducted at a chronic disease program in Kenya. It involved 23 health providers serving 89 facilities and 24 community-based groups. Study participants, who already used an mHealth application (mUzima) during clinical care, were consented and equipped with an enhanced version of the application that captured usage logs. Three months of log data were used to determine work performance metrics, including: (a) number of patients seen; (b) days worked; (c) work hours; and (d) length of patient encounters. PRINCIPAL FINDINGS: Pearson correlation coefficient for days worked per participant as derived from logs as well as from records in the Electronic Medical Record system showed a strong positive correlation between the two data sources (r(11) = .92, p < .0005), indicating mUzima logs could be relied upon for analyses. Over the study period, only 13 (56.3%) participants used mUzima in 2,497 clinical encounters. 563 (22.5%) of encounters were entered outside of regular work hours, with five health providers working on weekends. On average, 14.5 (range 1-53) patients were seen per day by providers. CONCLUSIONS / SIGNIFICANCE: mHealth-derived usage logs can reliably inform work patterns and augment supervision mechanisms made particularly challenging during the COVID-19 pandemic. Derived metrics highlight variabilities in work performance between providers. Log data also highlight areas of suboptimal use, of the application, such as for retrospective data entry for an application meant for use during the patient encounter to best leverage built-in clinical decision support functionality.

Data Cleaning Process for mHealth Log Data to Inform Health Worker Performance.

Log data, captured during use of mobile health (mHealth) applications by health providers, can play an important role in informing nature of user engagement with the application. The log data can also be employed in understanding health provider work patterns and performance. However, given that these logs are raw data, they require robust cleaning and curation if accurate conclusions are to be derived from analyzing them. This paper describes a systematic data cleaning process for mHealth-derived logs based on Broeck's framework, which involves iterative screening, diagnosis, and treatment of the log data. For this study, log data from the demonstrative mUzima mHealth application are used. The employed data cleaning process uncovered data inconsistencies, duplicate logs, missing data within logs that required imputation, among other issues. After the data cleaning process, only 39,229 log records out of the initial 91,432 usage logs (42.9%) could be included in the final dataset suitable for analyses of health provider work patterns. This work highlights the significance of having a systematic data cleaning approach for log data to derive useful information on health provider work patterns and performance.

An Algorithm (LaD) for Monitoring Childbirth in Settings Where Tracking All Parameters in the World Health Organization Partograph Is Not Feasible: Design and Expert Validation.

BACKGROUND: After determining the key childbirth monitoring items from experts, we designed an algorithm (LaD) to represent the experts' suggestions and validated it. In this paper we describe an abridged algorithm for labor and delivery management and use theoretical case to compare its performance with human childbirth experts. OBJECTIVE: The objective of this study was to describe the LaD algorithm, its development, and its validation. In addition, in the validation phase we wanted to assess if the algorithm was inferior, equivalent, or superior to human experts in recommending the necessary clinical actions during childbirth decision making. METHODS: The LaD algorithm encompasses the tracking of 6 of the 12 childbirth parameters monitored using the World Health Organization (WHO) partograph. It has recommendations on how to manage a patient when parameters are outside the normal ranges. We validated the algorithm with purposively selected experts selecting actions for a stratified sample of patient case scenarios. The experts' selections were compared to obtain pairwise sensitivity and false-positive rates (FPRs) between them and the algorithm. RESULTS: The mean weighted pairwise sensitivity among experts was 68.2% (SD 6.95; 95% CI 59.6-76.8), whereas that between experts and the LaD algorithm was 69.4% (SD 17.95; 95% CI 47.1-91.7). The pairwise FPR among the experts ranged from 12% to 33% with a mean of 23.9% (SD 9.14; 95% CI 12.6-35.2), whereas that between experts and the algorithm ranged from 18% to 43% (mean 26.3%; SD 10.4; 95% CI 13.3-39.3). The was a correlation (mean 0.67 [SD 0.06]) in the actions selected by the expert pairs for the different patient cases with a reliability coefficient (α) of .91. CONCLUSIONS: The LaD algorithm was more sensitive, but had a higher FPR than the childbirth experts, although the differences were not statistically significant. An electronic tool for childbirth monitoring with fewer WHO-recommended parameters may not be inferior to human experts in labor and delivery clinical decision support.

High-Fidelity Prototyping for Mobile Electronic Data Collection Forms Through Design and User Evaluation.

BACKGROUND: Mobile data collection systems are often difficult to use for nontechnical or novice users. This can be attributed to the fact that developers of such tools do not adequately involve end users in the design and development of product features and functions, which often creates interaction challenges. OBJECTIVE: The main objective of this study was to assess the guidelines for form design using high-fidelity prototypes developed based on end-user preferences. We also sought to investigate the association between the results from the System Usability Scale (SUS) and those from the Study Tailored Evaluation Questionnaire (STEQ) after the evaluation. In addition, we sought to recommend some practical guidelines for the implementation of the group testing approach particularly in low-resource settings during mobile form design. METHODS: We developed a Web-based high-fidelity prototype using Axure RP 8. A total of 30 research assistants (RAs) evaluated this prototype in March 2018 by completing the given tasks during 1 common session. An STEQ comprising 13 affirmative statements and the commonly used and validated SUS were administered to evaluate the usability and user experience after interaction with the prototype. The STEQ evaluation was summarized using frequencies in an Excel sheet while the SUS scores were calculated based on whether the statement was positive (user selection minus 1) or negative (5 minus user selection). These were summed up and the score contributions multiplied by 2.5 to give the overall form usability from each participant. RESULTS: Of the RAs, 80% (24/30) appreciated the form progress indication, found the form navigation easy, and were satisfied with the error messages. The results gave a SUS average score of 70.4 (SD 11.7), which is above the recommended average SUS score of 68, meaning that the usability of the prototype was above average. The scores from the STEQ, on the other hand, indicated a 70% (21/30) level of agreement with the affirmative evaluation statements. The results from the 2 instruments indicated a fair level of user satisfaction and a strong positive association as shown by the Pearson correlation value of .623 (P<.01). CONCLUSIONS: A high-fidelity prototype was used to give the users experience with a product they would likely use in their work. Group testing was done because of scarcity of resources such as costs and time involved especially in low-income countries. If embraced, this approach could help assess user needs of the diverse user groups. With proper preparation and the right infrastructure at an affordable cost, usability testing could lead to the development of highly usable forms. The study thus makes recommendations on the practical guidelines for the implementation of the group testing approach particularly in low-resource settings during mobile form design.

Midlevel Maternity Providers' Preferences of a Childbirth Monitoring Tool in Low-Income Health Units in Uganda.

A third of women in childbirth are inadequately monitored, partly due to the tools used. Some stakeholders assert that the current labour monitoring tools are not efficient and need improvement to become more relevant to childbirth attendants. The study objective was to explore the expectations of maternity service providers for a mobile childbirth monitoring tool in maternity facilities in a low-income country like Uganda. Semi-structured interviews of purposively selected midwives and doctors in rural-urban childbirth facilities in Uganda were conducted before thematic data analysis. The childbirth providers expected a tool that enabled fast and secure childbirth record storage and sharing. They desired a tool that would automatically and conveniently register patient clinical findings, and actively provide interactive clinical decision support on a busy ward. The tool ought to support agreed upon standards for good pregnancy outcomes but also adaptable to the patient and their difficult working conditions. The tool functionality should include clinical data management and real-time decision support to the midwives, while the non-functional attributes include versatility and security.

Computerized Childbirth Monitoring Tools for Health Care Providers Managing Labor: A Scoping Review.

BACKGROUND: Proper monitoring of labor and childbirth prevents many pregnancy-related complications. However, monitoring is still poor in many places partly due to the usability concerns of support tools such as the partograph. In 2011, the World Health Organization (WHO) called for the development and evaluation of context-adaptable electronic health solutions to health challenges. Computerized tools have penetrated many areas of health care, but their influence in supporting health staff with childbirth seems limited. OBJECTIVE: The objective of this scoping review was to determine the scope and trends of research on computerized labor monitoring tools that could be used by health care providers in childbirth management. METHODS: We used key terms to search the Web for eligible peer-reviewed and gray literature. Eligibility criteria were a computerized labor monitoring tool for maternity service providers and dated 2006 to mid-2016. Retrieved papers were screened to eliminate ineligible papers, and consensus was reached on the papers included in the final analysis. RESULTS: We started with about 380,000 papers, of which 14 papers qualified for the final analysis. Most tools were at the design and implementation stages of development. Three papers addressed post-implementation evaluations of two tools. No documentation on clinical outcome studies was retrieved. The parameters targeted with the tools varied, but they included fetal heart (10 of 11 tools), labor progress (8 of 11), and maternal status (7 of 11). Most tools were designed for use in personal computers in low-resource settings and could be customized for different user needs. CONCLUSIONS: Research on computerized labor monitoring tools is inadequate. Compared with other labor parameters, there was preponderance to fetal heart monitoring and hardly any summative evaluation of the available tools. More research, including clinical outcomes evaluation of computerized childbirth monitoring tools, is needed.

Usability in Mobile Electronic Data Collection Tools: Form Developers' Views.

Mobile Electronic Data Collection Tools (MEDCTs) are created by form developers to collect data. Usability being one of the top quality attributes is of great concern to developers of any interactive applications. However, little is known about the form developers' understanding of usability, how they measure usability and their limitations in designing for usability. We conducted an empirical study where we aimed at getting the developers' views on usability by interviewing 8 form developers. These are creators of forms used for data collection. We found that developers knew about usability, but it was not their main focus during form development. Challenges included constraining deadlines, software limitations and the insufficient communication with the field users to establish the usability needs. Furthermore, the methods used to evaluate the usability of created forms varied amongst developers and these included in-house evaluations and feedback from piloting sessions with end users.