Analysis of user interactions with a digital health wallet for enabling care continuity in the context of an ongoing pandemic.

BACKGROUND: The onset of COVID-19 and related policy responses made it difficult to study interactive health informatics solutions in clinical study settings. Instrumented log and event data from interactive systems capture temporal details that can be used to generate insights about care continuity during ongoing pandemics. OBJECTIVE: To investigate user interactions with a digital health wallet (DHW) system for addressing care continuity challenges in chronic disease management in the context of an ongoing pandemic. MATERIALS AND METHODS: We analyzed user interaction log data generated by clinicians, nurses, and patients from the deployment of a DHW in a feasibility study conducted during the COVID-19 pandemic in Kenya. We used the Hamming distance from Information Theory to quantify deviations of usage patterns extracted from the events data from predetermined workflow sequences supported by the platform. RESULTS: Nurses interacted with all the user interface elements relevant to triage. Clinicians interacted with only 43% of elements relevant to consultation, while patients interacted with 67% of the relevant user interface elements. Nurses and clinicians deviated from the predetermined workflow sequences by 42% and 36%, respectively. Most deviations pertained to users going back to previous steps in their usage workflow. CONCLUSIONS: User interaction log analysis is a valuable alternative method for generating and quantifying user experiences in the context of ongoing pandemics. However, researchers should mitigate the potential disruptions of the actual use of the studied technologies as well as use multiple approaches to investigate user experiences of health technology during pandemics.

Quantifying the impact of COVID-19 on essential health services: a comparison of interrupted time series analysis using Prophet and Poisson regression models.

BACKGROUND: Coronavirus disease 2019 (COVID-19) altered healthcare utilization patterns. However, there is a dearth of literature comparing methods for quantifying the extent to which the pandemic disrupted healthcare service provision in sub-Saharan African countries. OBJECTIVE: To compare interrupted time series analysis using Prophet and Poisson regression models in evaluating the impact of COVID-19 on essential health services. METHODS: We used reported data from Uganda's Health Management Information System from February 2018 to December 2020. We compared Prophet and Poisson models in evaluating the impact of COVID-19 on new clinic visits, diabetes clinic visits, and in-hospital deliveries between March 2020 to December 2020 and across the Central, Eastern, Northern, and Western regions of Uganda. RESULTS: The models generated similar estimates of the impact of COVID-19 in 10 of the 12 outcome-region pairs evaluated. Both models estimated declines in new clinic visits in the Central, Northern, and Western regions, and an increase in the Eastern Region. Both models estimated declines in diabetes clinic visits in the Central and Western regions, with no significant changes in the Eastern and Northern regions. For in-hospital deliveries, the models estimated a decline in the Western Region, no changes in the Central Region, and had different estimates in the Eastern and Northern regions. CONCLUSIONS: The Prophet and Poisson models are useful in quantifying the impact of interruptions on essential health services during pandemics but may result in different measures of effect. Rigor and multimethod triangulation are necessary to study the true effect of pandemics on essential health services.