Strategies for Digital Clinical Teaching During the COVID Pandemic: A Scoping Review.

Widespread "lockdowns" during the COVID pandemic in 2020-2021 restricted medical students' access to patients. We used a scoping review with exploratory thematic synthesis to examine how reports of digital clinical teaching during the first year of the COVID pandemic could inform digital clinical teaching in the post-pandemic world. We looked at strategies used and outcomes reported, lessons learned about how best to use digital methods for clinical teaching, and learning theories used. The eighty-three articles included in the final review fell into four groups. These were telehealth interventions; virtual case-based teaching; multi-modal virtual rotations; and a small group of "other" strategies. Telehealth reports indicated that COVID has probably accelerated the adoption of telehealth, and these skills will be required in future curricula. Engagement with virtual case-based teaching was problematic. Virtual rotations were particularly valued in specialties that relied on visual interpretation such as radiology and dermatology. For general clinical specialties, digital clinical teaching was not a satisfactory substitute for real clinical exposure because it lacked the complexity of usual clinical practice. Sixty-seven articles reported students' reactions only, and 16 articles reported a change in knowledge or skills. Demands on instructors were considerable. Few studies were theorized and none tested theory, which limited their transferability. While telehealth teaching may be a valuable addition to some curricula, digital clinical teaching is unlikely substantially to replace exposure to real patients outside of specialties that rely on visual interpretation. High demands on instructors suggest little potential for new, scalable digital clinical offerings after COVID.

Analysing 3429 digital supervisory interactions between Community Health Workers in Uganda and Kenya: the development, testing and validation of an open access predictive machine learning web app.

BACKGROUND: Despite the growth in mobile technologies (mHealth) to support Community Health Worker (CHW) supervision, the nature of mHealth-facilitated supervision remains underexplored. One strategy to support supervision at scale could be artificial intelligence (AI) modalities, including machine learning. We developed an open access, machine learning web application (CHWsupervisor) to predictively code instant messages exchanged between CHWs based on supervisory interaction codes. We document the development and validation of the web app and report its predictive accuracy. METHODS: CHWsupervisor was developed using 2187 instant messages exchanged between CHWs and their supervisors in Uganda. The app was then validated on 1242 instant messages from a separate digital CHW supervisory network in Kenya. All messages from the training and validation data sets were manually coded by two independent human coders. The predictive performance of CHWsupervisor was determined by comparing the primary supervisory codes assigned by the web app, against those assigned by the human coders and calculating observed percentage agreement and Cohen's kappa coefficients. RESULTS: Human inter-coder reliability for the primary supervisory category of messages across the training and validation datasets was 'substantial' to 'almost perfect', as suggested by observed percentage agreements of 88-95% and Cohen's kappa values of 0.7-0.91. In comparison to the human coders, the predictive accuracy of the CHWsupervisor web app was 'moderate', suggested by observed percentage agreements of 73-78% and Cohen's kappa values of 0.51-0.56. CONCLUSIONS: Augmenting human coding is challenging because of the complexity of supervisory exchanges, which often require nuanced interpretation. A realistic understanding of the potential of machine learning approaches should be kept in mind by practitioners, as although they hold promise, supportive supervision still requires a level of human expertise. Scaling-up digital CHW supervision may therefore prove challenging. TRIAL REGISTRATION: This was not a clinical trial and was therefore not registered as such.

Lessons from the design, development and implementation of a three-dimensional (3D) neonatal resuscitation training smartphone application: Life-saving Instruction for Emergencies (LIFE app).

Neonatal mortality remains disproportionately high in sub-Saharan Africa partly due to insufficient numbers of adequately trained and skilled front-line health workers. Opportunities for improving neonatal care may result from upskilling frontline health workers using innovative technological approaches. This practice paper describes the key steps involved in the design, development and implementation of an innovative smartphone-based training application using an agile, human-centred design approach. The Life-saving Instruction for Emergencies (LIFE) app is a three-dimension (3D) scenario-based mobile app for smartphones and is free to download. Two clinical modules are currently included with further scenarios planned. Whilst the focus of the practice paper is on the lessons learned during the design and development process, we also share key learning related to project management and sustainability plans, which we hope will help researchers working on similar projects.

Training, supervision and performance of Community Health Workers in the delivery of ear and hearing care to 321 community members in rural Uganda.

OBJECTIVES: Community Health Workers are one way to address the shortage of ear and hearing care specialists in low-resource settings. However, there are few reports evaluating training and service delivery by Community Health Workers. DESIGN, SETTING AND PARTICIPANTS: We trained 13 Community Health Workers in primary ear and hearing care in Mukono District, Uganda. Community Health Workers attended a two-day training workshop and received remote supervision thereafter during service delivery in the community. An ear camp was held at the local health centre every two months, where a local ENT specialist could assess referred cases. MAIN OUTCOME MEASURES: Clinical and diagnostic skills and decision-making were assessed using an Objective Structured Clinical Examination, with scores recorded at baseline and six months. Service delivery was evaluated by analysing the following: (i) number of individuals evaluated; (ii) treatments delivered; (iii) cases referred for specialist opinion; (iv) proportion of appropriately referred cases; and (v) agreement between Community Health Worker and specialist diagnosis. RESULTS: Observed Structured Clinical Examination scores were high and stable for six months. 312 individuals were screened in the community by the Community Health Workers, with 298 classified as having an abnormality. Care was delivered in the community to 167 of these, and the remaining 131 referred to the ear camp. Diagnostic agreement was 39%, but 98% of referrals were deemed "appropriate" by the ENT specialist. 27 individuals self-presented to the ear camp without prior assessment by a Community Health Worker, and 97% of these were deemed appropriate. CONCLUSION: Trained Community Health Workers can play an important role in delivering ear and hearing services. Future work should look to explore this model in other contexts and/or compare it to other models of service delivery.

Online interprofessional education related to chronic illness for health professionals: a scoping review.

This scoping review focuses on identifying the quantity and quality of research evidence available with regard to online interprofessional education related to chronic disease management. Recent advances have seen the emergence of information communication technology and digital health solutions that may improve monitoring of and self-management of chronic disease. With the growing chronic disease burden globally, and the advancement of information communication technology, digital health solutions may improve chronic disease monitoring and self-management. However, health professionals are slow to utilize this technology in chronic disease management. Online education has the potential to enhance utilization of digital health solutions across interprofessional healthcare teams. This scoping review focuses on online interprofessional education and eLearning strategies used to promote engagement and achievement of learning outcomes between health care professionals in chronic disease management. A systematic search of the literature yielded 3112 papers; 15 studies were included in the review following an independent screening process. The review found very limited research for online interprofessional education related to chronic disease so it is not feasible to comment or draw conclusions in relation to its impact on interprofessional learning, student engagement in education or its impact in practice, services or health outcomes. Research methodology and online eLearning strategies varied across studies, highlighting the need for further rigorous studies that include consistency in online interprofessional education strategies, evaluations and study methods.

Evaluation of Adaptive Feedback in a Smartphone-Based Game on Health Care Providers' Learning Gain: Randomized Controlled Trial.

BACKGROUND: Although smartphone-based emergency care training is more affordable than traditional avenues of training, it is still in its infancy, remains poorly implemented, and its current implementation modes tend to be invariant to the evolving learning needs of the intended users. In resource-limited settings, the use of such platforms coupled with gamified approaches remains largely unexplored, despite the lack of traditional training opportunities, and high mortality rates in these settings. OBJECTIVE: The primary aim of this randomized experiment is to determine the effectiveness of offering adaptive versus standard feedback, on the learning gains of clinicians, through the use of a smartphone-based game that assessed their management of a simulated medical emergency. A secondary aim is to examine the effects of learner characteristics and learning spacing with repeated use of the game on the secondary outcome of individualized normalized learning gain. METHODS: The experiment is aimed at clinicians who provide bedside neonatal care in low-income settings. Data were captured through an Android app installed on the study participants' personal phones. The intervention, which was based on successful attempts at a learning task, included adaptive feedback provided within the app to the experimental arm, whereas the control arm received standardized feedback. The primary end point was completion of the second learning session. Of the 572 participants enrolled between February 2019 and July 2019, 247 (43.2%) reached the primary end point. The primary outcome was standardized relative change in learning gains between the study arms as measured by the Morris G effect size. The secondary outcomes were the participants individualized normalized learning gains. RESULTS: The effect of adaptive feedback on care providers' learning gain was found to be g=0.09 (95% CI -0.31 to 0.46; P=.47). In exploratory analysis, using normalized learning gains, when subject-treatment interaction and differential time effect was controlled for, this effect increased significantly to 0.644 (95% CI 0.35 to 0.94; P<.001) with immediate repetition, which is a moderate learning effect, but reduced significantly by 0.28 after a week. The overall learning change from the app use in both arms was large and may have obscured a direct effect of feedback. CONCLUSIONS: There is a considerable learning gain between the first two rounds of learning with both forms of feedback and a small added benefit of adaptive feedback after controlling for learner differences. We suggest that linking the adaptive feedback provided to care providers to how they space their repeat learning session(s) may yield higher learning gains. Future work might explore in more depth the feedback content, in particular whether or not explanatory feedback (why answers were wrong) enhances learning more than reflective feedback (information about what the right answers are). TRIAL REGISTRATION: Pan African Clinical Trial Registry (PACTR) 201901783811130; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=5836. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/13034.

Exploring perceptions, barriers, and enablers for delivery of primary ear and hearing care by community health workers: a photovoice study in Mukono District, Uganda.

BACKGROUND: Hearing loss is a prevalent but neglected disease, especially in low- or middle-income countries. The role of Community Health Workers (CHWs) to deliver primary ear and hearing care has been explored in several studies from a technical standpoint, but understanding perceptions, barriers, and enablers of such an approach from the perspective of CHWs themselves through a health equity lens has been less well documented. METHODS: This qualitative study used photovoice to explore the views and experiences of CHWs in the Seeta Nazigo Parish of Mukono District in the delivery of ear and hearing care in the community. CHWs were trained in ear and hearing care, and provided with digital cameras to capture photographs related to their work in the community over the following 3 months. Individual interviews regarding the photographs were held at the end of each month, in addition to one focus group discussion. A community workshop was convened at the end of the study to display the photos. Thematic analysis of photographs was conducted using Braune and Clarkes six-step framework. We also used the data to explore potential roles for key stakeholders in primary ear and hearing care, and how photovoice may facilitate their engagement. RESULTS: 13 CHWs participated in the study. Several themes were generated from analysis. CHWs perceived a high burden of ear and hearing disorders in their community and recognised the role they could play in tackling that burden. Potential barriers identified included a lack of equipment, training, and supervision of CHWs; logistical, financial, or psychological barriers to community participation; and the widespread use of traditional medicine. CHWs identified roles for the government and NGO bodies to enable and support delivery of ear and hearing care in the community. The community workshop was a useful method to engage key stakeholders in this topic. CONCLUSIONS: Photovoice is a powerful method to capture issues affecting CHWs. Here it was used to identify a number of perceptions, barriers and enablers to the delivery of ear and hearing care. Our results may inform future strategy in the field of ear and hearing care, and the potential use of photovoice to enact sociocultural change.

Participatory approaches, local stakeholders and cultural relevance facilitate an impactful community-based project in Uganda.

Sanitation is a major global challenge that is often addressed at national and international levels, while community opinions and beliefs are neglected. To promote water, sanitation and hygiene (WASH) we organized a cross-cultural knowledge exchange workshop to assess participatory methods for engaging local stakeholders. The workshop included 22 participants from all sectors of society. Practical solutions to sanitation challenges were identified and later shared with a local community. Qualitative and quantitative analyses were used to assess impact and showed participatory methods were highly valued to encourage information sharing among widely varied stakeholders, and that video was a particularly successful approach when engaging with local communities. An 8-month follow-up survey of village members revealed excellent information recall, positive behaviour changes and a desire for future visits. Our evidence suggests that community-based participation helped identify solutions to WASH issues affecting rural communities in resource-poor settings. Engaging in a multicultural knowledge-share was particularly valuable as it enabled participants to recognize they have common challenges and allowed them to share low-cost solutions from their different communities. Our use of video was widely viewed as an ideal means of circulating findings, as it communicated information to people with a wide variety of community roles and to all age groups. Its relevance was increased by adopting a culturally appropriate context by involving local communities in workshop activities. We recommend that research in low- and middle-income countries should be mindful of the environmental context in which WASH is implemented, and encourage acceptance by engaging with communities through the use of varied participatory methods.

'We are the people whose opinions don't matter'. A photovoice study exploring challenges faced by community health workers in Uganda.

Understanding the experiences of community health workers (CHWs) through the use of participatory visual methods (PVMs) has been relatively underexplored. One such PVM is photovoice, which involves the capture of photographic images related to issues of social importance. In this study, we explore challenges faced by eight CHWs in Mukono District, Uganda through the use of photovoice. Over a six-week period, CHWs captured 62 relevant photographs. Subsequent individual interviews and group discussions were held with the CHWs regarding the content of the photographs. Using traditional content analysis, a range of themes related to perceived challenges faced by the CHWs were highlighted, including poor infrastructure, insufficient on-going training and supervision, relationships with other health professionals and equipment supplies. Suggestions were raised as to why such challenges existed and how they could be addressed; mainly through increased roles of the government and supporting NGOs. Overall, photovoice was generally a feasible method to highlight the challenges faced by CHWs, however community acceptability regarding image capture and consent taking may prove challenging, given past historical experiences. The use of photovoice in this study highlighted the need to address the multiple and complex challenges faced by CHWs in order to help them fulfil their roles.

Prioritarian principles for digital health in low resource settings.

This theoretical paper argues for prioritarianism as an ethical underpinning for digital health in contexts of extreme disadvantage. In support of this claim, the paper develops three prioritarian principles for making ethical decisions for digital health programme design, grounded in the normative position that the greater the need (of the marginalised), the stronger the moral claim. The principles are positioned as an alternative view to the prevailing utilitarian approach to digital health, which the paper argues is not sufficient to address the needs of the worst off. As researchers of digital health, we must ensure that the most globally marginalised are not overlooked by overtly technocentric implementation practices. Consequently, the paper concludes by advocating for use of the three principles to support stronger critical reflection on the ethics involved in the design and implementation of digital health programmes.

Using mobile technologies to support the training of community health workers in low-income and middle-income countries: mapping the evidence.

INTRODUCTION: This paper maps the evidence published between 2000 and 2018 on the use of mobile technologies to train community health workers (CHWs) in low- and middle-income countries (LMICs) across nine areas of global healthcare, including the neglected areas of disability and mental health. METHODS: We used an evidence mapping methodology, based on systematic review guidelines, to systematically and transparently assess the available evidence-base. We searched eight scientific databases and 54 grey literature sources, developed explicit inclusion criteria, and coded all included studies at full text for key variables. The included evidence-base was visualised and made accessible through heat mapping and the development of an online interactive evidence interface. RESULTS: The systematic search for evidence identified a total of 2530 citations of which 88 met the full inclusion criteria. Results illustrate overall gaps and clusters of evidence. While the evidence map shows a positive shift away from information dissemination towards approaches that use more interactive learner-centred pedagogies, including supervision and peer learning, this was not seen across all areas of global health. Areas of neglect remain; no studies of trauma, disability, nutrition or mental health that use information dissemination, peer learning or supervision for training CHWs in LMICs were found. CONCLUSION: The evidence map shows significant gaps in the use of mobile technologies for training, particularly in the currently neglected areas of global health. Significant work will be needed to improve the evidence-base, including assessing the quality of mobile-based training programmes.

Evaluation of Adaptive Feedback in a Smartphone-Based Serious Game on Health Care Providers' Knowledge Gain in Neonatal Emergency Care: Protocol for a Randomized Controlled Trial.

BACKGROUND: Although smartphone-based clinical training to support emergency care training is more affordable than traditional avenues of training, it is still in its infancy and remains poorly implemented. In addition, its current implementations tend to be invariant to the evolving learning needs of the intended users. In resource-limited settings, the use of such platforms coupled with serious-gaming approaches remain largely unexplored and underdeveloped, even though they offer promise in terms of addressing the health workforce skill imbalance and lack of training opportunities associated with the high neonatal mortality rates in these settings. OBJECTIVE: This randomized controlled study aims to assess the effectiveness of offering adaptive versus standard feedback through a smartphone-based serious game on health care providers' knowledge gain on the management of a neonatal medical emergency. METHODS: The study is aimed at health care workers (physicians, nurses, and clinical officers) who provide bedside neonatal care in low-income settings. We will use data captured through an Android smartphone-based serious-game app that will be downloaded to personal phones belonging to the study participants. The intervention will be adaptive feedback provided within the app. The data captured will include the level of feedback provided to participants as they learn to use the mobile app, and performance data from attempts made during the assessment questions on interactive tasks participants perform as they progress through the app on emergency neonatal care delivery. The primary endpoint will be the first two complete rounds of learning within the app, from which the individuals' "learning gains" and Morris G intervention effect size will be computed. To minimize bias, participants will be assigned to an experimental or a control group by a within-app random generator, and this process will be concealed to both the study participants and the investigators until the primary endpoint is reached. RESULTS: This project was funded in November 2016. It has been approved by the Central University Research Ethics Committee of the University of Oxford and the Scientific and Ethics Review Unit of the Kenya Medical Research Institute. Recruitment and data collection began from February 2019 and will continue up to July 31, 2019. As of July 18, 2019, we enrolled 541 participants, of whom 238 reached the primary endpoint, with a further 19 qualitative interviews conducted to support evaluation. Full analysis will be conducted once we reach the end of the study recruitment period. CONCLUSIONS: This study will be used to explore the effectiveness of adaptive feedback in a smartphone-based serious game on health care providers in a low-income setting. This aspect of medical education is a largely unexplored topic in this context. In this randomized experiment, the risk of performance bias across arms is moderate, given that the active ingredient of the intervention (ie, knowledge) is a latent trait that is difficult to comprehensively control for in a real-world setting. However, the influence of any resulting bias that has the ability to alter the results will be assessed using alternative methods such as qualitative interviews. TRIAL REGISTRATION: Pan African Clinical Trials Registry PACTR201901783811130; https://pactr.samrc.ac.za/TrialDisplay. aspx?TrialID=5836. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/13034.

The role of community health workers in addressing the global burden of ear disease and hearing loss: a systematic scoping review of the literature.

INTRODUCTION: Community health workers (CHWs) have the potential to improve access to ear and hearing services for people across low-income or middle-income countries, remote, underserved, or resource-poor areas of the world. We performed a systematic scoping review to identify evidence on how CHWs are currently deployed in the prevention, screening, diagnosis, treatment and management of ear disease and hearing loss; methods to train and support CHWs in this context; and cost-effectiveness of CHWs. METHODS: We performed a systematic search of the literature from September 1978 to 18 March 2018 from 11 major databases and the grey literature. RESULTS: We identified 38 original studies that met the inclusion criteria, taking place across South Asia (n=13), Oceania (n=7), North America (n=7), South America (n=6) and Africa (n=5). 23 studies showed CHWs can increase community participation in screening. They can conduct screening using whispered voice tests, noisemakers for neonatal screening, automated audiological tests and otoscopy. Eight studies focused specifically on the evaluation of programmes to train CHWs, and three provided a general programme description. Three studies documented a role of CHWs in the treatment of ear disease or hearing loss, such as performing ear washouts, instillation of topical antibiotics or fitting of hearing aids. Only one study provided an indepth cost-utility analysis regarding the use of CHWs to conduct hearing screening, and no studies commented on the role of CHWs in the prevention of hearing loss. CONCLUSION: CHWs have been employed in diverse ways to address the global burden of ear disease and hearing loss. Future research needs to explore the role of CHWs in preventative strategies, identify optimum methods to train and support CHWs, and explore their cost-effectiveness.

Scoping review assessing the evidence used to support the adoption of mobile health (mHealth) technologies for the education and training of community health workers (CHWs) in low-income and middle-income countries.

OBJECTIVES: Undertake a systematic scoping review to determine how a research evidence base, in the form of existing systematic reviews in the field of mobile health (mHealth), constitutes education and training for community health workers (CHWs) who use mobile technologies in everyday work. The review was informed by the following research questions: does educational theory inform the design of the education and training component of mHealth interventions? How is education and training with mobile technology by CHWs in low-income and middle-income countries categorised by existing systematic reviews? What is the basis for this categorisation? SETTING: The review explored the literature from 2000 to 2017 to investigate how mHealth interventions have been positioned within the available evidence base in relation to their use of formal theories of learning. RESULTS: The scoping review found 24 primary studies that were categorised by 16 systematic reviews as supporting CHWs' education and training using mobile technologies. However, when formal theories of learning from educational research were used to recategorise these 24 primary studies, only four could be coded as such. This identifies a problem with how CHWs' education and training using mobile technologies is understood and categorised within the existing evidence base. This is because there is no agreed on, theoretically informed understanding of what counts as learning. CONCLUSION: The claims made by mHealth researchers and practitioners regarding the learning benefits of mobile technology are not based on research results that are underpinned by formal theories of learning. mHealth suffers from a reductionist view of learning that underestimates the complexities of the relationship between pedagogy and technology. This has resulted in miscategorisations of what constitutes CHWs' education and training within the existing evidence base. This can be overcome by informed collaboration between the health and education communities.

Ongoing training of community health workers in low-income andmiddle-income countries: a systematic scoping review of the literature.

OBJECTIVES: Understanding the current landscape of ongoing training for community health workers (CHWs) in low-income and middle-income countries (LMICs) is important both for organisations responsible for their training, as well as researchers and policy makers. This scoping review explores this under-researched area by mapping the current delivery implementation and evaluation of ongoing training provision for CHWs in LMICs. DESIGN: Systematic scoping review. DATA SOURCES: MEDLINE, Embase, AMED, Global Health, Web of Science, Scopus, ASSIA, LILACS, BEI and ERIC. STUDY SELECTION: Original studies focusing on the provision of ongoing training for CHWs working in a country defined as low income and middle income according to World Bank Group 2012 classification of economies. RESULTS: The scoping review found 35 original studies that met the inclusion criteria. Ongoing training activities for CHWs were described as supervision (n=19), inservice or refresher training (n=13) or a mixture of both (n=3). Although the majority of studies emphasised the importance of providing ongoing training, several studies reported no impact of ongoing training on performance indicators. The majority of ongoing training was delivered inperson; however, four studies reported the use of mobile technologies to support training delivery. The outcomes from ongoing training activities were measured and reported in different ways, including changes in behaviour, attitudes and practice measured in a quantitative manner (n=16), knowledge and skills (n=6), qualitative assessments (n=5) or a mixed methods approach combining one of the aforementioned modalities (n=8). CONCLUSIONS: This scoping review highlights the diverse range of ongoing training for CHWs in LMICs. Given the expansion of CHW programmes globally, more attention should be given to the design, delivery, monitoring and sustainability of ongoing training from a health systems strengthening perspective.

Physical, psychological, sexual, and systemic abuse of children with disabilities in East Africa: Mapping the evidence.

Children with disabilities (CWDs) are at a higher risk of being maltreated than are typical children. The evidence base on the abuse of children with disabilities living in low- and middle-income countries is extremely limited but the problem is particularly acute in East Africa. We don't know the types of evidence that exist on this topic. This problem is compounded by the fact that key indicators of disability, such as reliable prevalence rates, are not available currently. This paper addresses this serious problem by mapping the existing evidence-base to document the coverage, patterns, and gaps in existing research on the abuse of children with disabilities in East Africa. An evidence map, following systematic review guidelines, was conducted and included a systematic search, transparent and structured data extraction, and critical appraisal. Health and social science databases (Medline, EMBASE, PsychInfo, Taylor&Francis, Web of Science, and SAGE) were systematically searched for relevant studies. A substantive grey literature search was also conducted. All empirical research on the abuse of CWDs in East Africa was eligible for inclusion: Data on abuse was systematically extracted and the research evidence, following critical appraisal, mapped according to the type of abuse and disability condition, highlighting gaps and patterns in the evidence-base. 6005 studies were identified and screened, of which 177 received a full-text assessment. Of these, 41 studies matched the inclusion criteria. By mapping the available data and reports and systematically assessing their trustworthiness and relevance, we highlight significant gaps in the available evidence base. Clear patterns emerge that show a major data gap and lack of research on sexual abuse of children with disabilities and an identifiable lack of methodological quality in many relevant studies. These make the development of a concerted and targeted research effort to tackle the abuse of children with disabilities in East Africa extremely difficult. This needs to be addressed urgently if the abuse of children with disabilities is to be prioritised by the global health community.