Healthcare workers' informal uses of mobile phones and other mobile devices to support their work: a qualitative evidence synthesis.

BACKGROUND: Healthcare workers sometimes develop their own informal solutions to deliver services. One such solution is to use their personal mobile phones or other mobile devices in ways that are unregulated by their workplace. This can help them carry out their work when their workplace lacks functional formal communication and information systems, but it can also lead to new challenges. OBJECTIVES: To explore the views, experiences, and practices of healthcare workers, managers and other professionals working in healthcare services regarding their informal, innovative uses of mobile devices to support their work. SEARCH METHODS: We searched MEDLINE, Embase, CINAHL and Scopus on 11 August 2022 for studies published since 2008 in any language. We carried out citation searches and contacted study authors to clarify published information and seek unpublished data. SELECTION CRITERIA: We included qualitative studies and mixed-methods studies with a qualitative component. We included studies that explored healthcare workers' views, experiences, and practices regarding mobile phones and other mobile devices, and that included data about healthcare workers' informal use of these devices for work purposes. DATA COLLECTION AND ANALYSIS: We extracted data using an extraction form designed for this synthesis, assessed methodological limitations using predefined criteria, and used a thematic synthesis approach to synthesise the data. We used the 'street-level bureaucrat' concept to apply a conceptual lens to our findings and prepare a line of argument that links these findings. We used the GRADE-CERQual approach to assess our confidence in the review findings and the line-of-argument statements. We collaborated with relevant stakeholders when defining the review scope, interpreting the findings, and developing implications for practice. MAIN RESULTS: We included 30 studies in the review, published between 2013 and 2022. The studies were from high-, middle- and low-income countries and covered a range of healthcare settings and healthcare worker cadres. Most described mobile phone use as opposed to other mobile devices, such as tablets. We have moderate to high confidence in the statements in the following line of argument. The healthcare workers in this review, like other 'street-level bureaucrats', face a gap between what is expected of them and the resources available to them. To plug this gap, healthcare workers develop their own strategies, including using their own mobile phones, data and airtime. They also use other personal resources, including their personal time when taking and making calls outside working hours, and their personal networks when contacting others for help and advice. In some settings, healthcare workers' personal phone use, although unregulated, has become a normal part of many work processes. Some healthcare workers therefore experience pressure or expectations from colleagues and managers to use their personal phones. Some also feel driven to use their phones at work and at home because of feelings of obligation towards their patients and colleagues. At best, healthcare workers' use of their personal phones, time and networks helps humanise healthcare. It allows healthcare workers to be more flexible, efficient and responsive to the needs of the patient. It can give patients access to individual healthcare workers rather than generic systems and can help patients keep their sensitive information out of the formal system. It also allows healthcare workers to communicate with each other in more personalised, socially appropriate ways than formal systems allow. All of this can strengthen healthcare workers' relationships with community members and colleagues. However, these informal approaches can also replicate existing social hierarchies and deepen existing inequities among healthcare workers. Personal phone use costs healthcare workers money. This is a particular problem for lower-level healthcare workers and healthcare workers in low-income settings as they are likely to be paid less and may have less access to work phones or compensation. Out-of-hours use may also be more of a burden for lower-level healthcare workers, as they may find it harder to ignore calls when they are at home. Healthcare workers with poor access to electricity and the internet are less able to use informal mobile phone solutions, while healthcare workers who lack skills and training in how to appraise unendorsed online information are likely to struggle to identify trustworthy information. Informal digital channels can help healthcare workers expand their networks. But healthcare workers who rely on personal networks to seek help and advice are at a disadvantage if these networks are weak. Healthcare workers' use of their personal resources can also lead to problems for patients and can benefit some patients more than others. For instance, when healthcare workers store and share patient information on their personal phones, the confidentiality of this information may be broken. In addition, healthcare workers may decide to use their personal resources on some types of patients, but not others. Healthcare workers sometimes describe using their personal phones and their personal time and networks to help patients and clients whom they assess as being particularly in need. These decisions are likely to reflect their own values and ideas, for instance about social equity and patient 'worthiness'. But these may not necessarily reflect the goals, ideals and regulations of the formal healthcare system. Finally, informal mobile phone use plugs gaps in the system but can also weaken the system. The storing and sharing of information on personal phones and through informal channels can represent a 'shadow IT' (information technology) system where information about patient flow, logistics, etc., is not recorded in the formal system. Healthcare workers may also be more distracted at work, for instance, by calls from colleagues and family members or by social media use. Such challenges may be particularly difficult for weak healthcare systems. AUTHORS' CONCLUSIONS: By finding their own informal solutions to workplace challenges, healthcare workers can be more efficient and more responsive to the needs of patients, colleagues and themselves. But these solutions also have several drawbacks. Efforts to strengthen formal health systems should consider how to retain the benefits of informal solutions and reduce their negative effects.

Effects of the Informed Health Choices primary school intervention on the ability of children in Uganda to assess the reliability of claims about treatment effects: a cluster-randomised controlled trial.

BACKGROUND: Claims about what improves or harms our health are ubiquitous. People need to be able to assess the reliability of these claims. We aimed to evaluate an intervention designed to teach primary school children to assess claims about the effects of treatments (ie, any action intended to maintain or improve health). METHODS: In this cluster-randomised controlled trial, we included primary schools in the central region of Uganda that taught year-5 children (aged 10-12 years). We excluded international schools, special needs schools for children with auditory and visual impairments, schools that had participated in user-testing and piloting of the resources, infant and nursery schools, adult education schools, and schools that were difficult for us to access in terms of travel time. We randomly allocated a representative sample of eligible schools to either an intervention or control group. Intervention schools received the Informed Health Choices primary school resources (textbooks, exercise books, and a teachers' guide). Teachers attended a 2 day introductory workshop and gave nine 80 min lessons during one school term. The lessons addressed 12 concepts essential to assessing claims about treatment effects and making informed health choices. We did not intervene in the control schools. The primary outcome, measured at the end of the school term, was the mean score on a test with two multiple-choice questions for each of the 12 concepts and the proportion of children with passing scores on the same test. This trial is registered with the Pan African Clinical Trial Registry, number PACTR201606001679337. FINDINGS: Between April 11, 2016, and June 8, 2016, 2960 schools were assessed for eligibility; 2029 were eligible, and a random sample of 170 were invited to recruitment meetings. After recruitment meetings, 120 eligible schools consented and were randomly assigned to either the intervention group (n=60, 76 teachers and 6383 children) or control group (n=60, 67 teachers and 4430 children). The mean score in the multiple-choice test for the intervention schools was 62·4% (SD 18·8) compared with 43·1% (15·2) for the control schools (adjusted mean difference 20·0%, 95% CI 17·3-22·7; p<0·00001). In the intervention schools, 3967 (69%) of 5753 children achieved a predetermined passing score (≥13 of 24 correct answers) compared with 1186 (27%) of 4430 children in the control schools (adjusted difference 50%, 95% CI 44-55). The intervention was effective for children with different levels of reading skills, but was more effective for children with better reading skills. INTERPRETATION: The use of the Informed Health Choices primary school learning resources, after an introductory workshop for the teachers, led to a large improvement in the ability of children to assess claims about the effects of treatments. The results show that it is possible to teach primary school children to think critically in schools with large student to teacher ratios and few resources. Future studies should address how to scale up use of the resources, long-term effects, including effects on actual health choices, transferability to other countries, and how to build on this programme with additional primary and secondary school learning resources. FUNDING: Research Council of Norway.

Effects of the Informed Health Choices podcast on the ability of parents of primary school children in Uganda to assess claims about treatment effects: a randomised controlled trial.

BACKGROUND: As part of the Informed Health Choices project, we developed a podcast called The Health Choices Programme to help improve the ability of people to assess claims about the benefits and harms of treatments. We aimed to evaluate the effects of the podcast on the ability of parents of primary school children in Uganda to assess claims about the effects of treatments. METHODS: We did this randomised controlled trial in central Uganda. We recruited parents of children aged 10-12 years who were in their fifth year of school at 35 schools that were participating in a linked trial of the Informed Health Choices primary school resources. The parents were randomly allocated (1:1), via a web-based random number generator with block sizes of four and six, to listen to either the Informed Health Choices podcast (intervention group) or typical public service announcements about health issues (control group). Randomisation was stratified by parents' highest level of formal education attained (primary school, secondary school, or tertiary education) and the allocation of their children's school in the trial of the primary school resources (intervention vs control). The primary outcome, measured after listening to the entire podcast, was the mean score and the proportion of parents with passing scores on a test with two multiple choice questions for each of nine key concepts essential to assessing claims about treatments (18 questions in total). We did intention-to-treat analyses. This trial is registered with the Pan African Clinical Trial Registry, number PACTR201606001676150. FINDINGS: We recruited parents between July 21, 2016, and Oct 7, 2016. We randomly assigned 675 parents to the podcast group (n=334) or the public service announcement group (n=341); 561 (83%) participants completed follow-up. The mean score for parents in the podcast group was 67·8% (SD 19·6) compared with 52·4% (17·6) in the control group (adjusted mean difference 15·5%, 95% CI 12·5-18·6; p<0·0001). In the podcast group, 203 (71%) of 288 parents had a predetermined passing score (≥11 of 18 correct answers) compared with 103 (38%) of 273 parents in the control group (adjusted difference 34%, 95% CI 26-41; p<0·0001). No adverse events were reported. INTERPRETATION: Listening to the Informed Health Choices podcast led to a large improvement in the ability of parents to assess claims about the effects of treatments. Future studies should assess the long-term effects of use of the podcast, the effects on actual health choices and outcomes, and how transferable our findings are to other countries. FUNDING: Research Council of Norway.

Prioritising Key Concepts for informed health choices in cancer: An evidence-based online educational programme.

Objective: The overabundance of health misinformation has undermined people's capacity to make evidence-based, informed choices about their health. Using the Informed Health Choices (IHC) Key Concepts (KCs), we are developing a two-stage education programme, Informed Health Choices-Cancer (IHC-C), to provide those impacted by cancer with the knowledge and skills necessary to think critically about the reliability of health information and claims and make well-informed choices. Stage 1 seeks to prioritise the most relevant Key Concepts. Methods: A project group and a patient and carer participation group completed a two-round prioritisation process. The process involved disseminating pre-reading materials, training sessions, and a structured judgement form to evaluate concepts for inclusion. Data from each round were analysed to reach a consensus on the concepts to include. Results: Fourteen participants were recruited and completed the first-round prioritisation. Fifteen participants undertook the second-round prioritisation. Nine Key Concepts were selected for the programme across five training sessions and two consensus meetings. Conclusion: The prioritised concepts identified represent the most pertinent aspects of cancer-related information for those impacted by the disease. By incorporating these concepts into educational materials and communication strategies, healthcare providers and organisations can potentially help cancer patients, survivors, and their loved ones to recognise and combat cancer-related misinformation more effectively. Innovation: This study introduces a participatory prioritisation process, which integrates the expertise of healthcare professionals with the insights of patients and carers, thereby enhancing the programme's relevance and applicability.

Use of the informed health choices educational intervention to improve secondary students' ability to think critically about health interventions in Uganda: A cluster-randomized trial.

AIM: The aim was to evaluate the effect of the Informed Health Choices (IHC) educational intervention on secondary students' ability to assess health-related claims and make informed choices. METHODS: In a cluster-randomized trial, we randomized 80 secondary schools (students aged 13-17 years) in Uganda to the intervention or control (usual curriculum). The intervention included a 2-day teacher training workshop, 10 lessons accessed online by teachers and delivered in one school term. The lesson plans were developed for classrooms equipped with a blackboard or a blackboard and projector. The lessons addressed nine prioritized concepts. We used two multiple-choice questions for each concept to evaluate the students' ability to assess claims and make informed choices. The primary outcome was the proportion of students with a passing score (≥9 of 18 questions answered correctly). RESULTS: Eighty schools consented and were randomly allocated. A total of 2477 students in the 40 intervention schools and 2376 students in the 40 control schools participated in this trial. In the intervention schools, 1364 (55%) of students that completed the test had a passing score compared with 586 (25%) of students in the control schools (adjusted difference 33%, 95% CI 26%-39%). CONCLUSIONS: The IHC secondary school intervention improved students' ability to think critically and make informed choices. Well-designed digital resources may improve access to educational material, even in schools without computers or other information and communication technology (ICT). This could facilitate scaling-up use of the resources and help to address inequities associated with limited ICT access.

Effects of the Informed Health Choices secondary school intervention: A prospective meta-analysis.

AIM: The aim of this prospective meta-analysis was to synthesize the results of three cluster-randomized trials of an intervention designed to teach lower-secondary school students (age 14-16) to think critically about health choices. METHODS: We conducted the trials in Kenya, Rwanda, and Uganda. The intervention included a 2- to 3-day teacher training workshop, digital resources, and ten 40-min lessons. The lessons focused on nine key concepts. We did not intervene in control schools. The primary outcome was a passing score on a test (≥9 of 18 multiple-choice questions answered correctly). We performed random effects meta-analyses to estimate the overall adjusted odds ratios. Secondary outcomes included effects of the intervention on teachers. RESULTS: Altogether, 244 schools (11,344 students) took part in the three trials. The overall adjusted odds ratio was 5.5 (95% CI: 3.0-10.2; p < 0.0001) in favor of the intervention (high certainty evidence). This corresponds to 33% (95% CI: 25-40%) more students in the intervention schools passing the test. Overall, 3397 (58%) of 5846 students in intervention schools had a passing score. The overall adjusted odds ratio for teachers was 13.7(95% CI: 4.6-40.4; p < 0.0001), corresponding to 32% (95% CI: 6%-57%) more teachers in the intervention schools passing the test (moderate certainty evidence). Overall, 118 (97%) of 122 teachers in intervention schools had a passing score. CONCLUSIONS: The intervention led to a large improvement in the ability of students and teachers to think critically about health choices, but 42% of students in the intervention schools did not achieve a passing score.

Effects of the Informed Health Choices secondary school intervention on the ability of students in Rwanda to think critically about health choices: A cluster-randomized trial.

AIM: The aim of this trial was to evaluate the effects of the Informed Health Choices intervention on the ability of students in Rwandan to think critically and make Informed Health Choices. METHODS: We conducted a two-arm cluster-randomized trial in 84 lower secondary schools from 10 districts representing five provinces of Rwanda. We used stratified randomization to allocate schools to the intervention or control. One class in each intervention school had ten 40-min lessons taught by a trained teacher in addition to the usual curriculum. Control schools followed the usual curriculum. The primary outcome was a passing score (≥ 9 out of 18 questions answered correctly) for students on the Critical Thinking about Health Test completed within 2 weeks after the intervention. We conducted an intention-to-treat analysis using generalized linear mixed models, accounting for the cluster design using random intercepts. RESULTS: Between February 25 and March 29, 2022, we recruited 3,212 participants. We assigned 1,572 students and 42 teachers to the intervention arm and 1,556 students and 42 teachers to the control arm. The proportion of students who passed the test in the intervention arm was 915/1,572 (58.2%) compared to 302/1,556 (19.4%) in the control arm, adjusted odds ratio 10.6 (95% CI: 6.3-17.8), p < 0.0001, adjusted difference 37.2% (95% CI: 29.5%-45.0%). CONCLUSIONS: The intervention is effective in helping students think critically about health choices. It was possible to improve students' ability to think critically about health in the context of a competence-based curriculum in Rwanda, despite challenging postpandemic conditions.

Effects of the informed health choices secondary school intervention on the ability of students in Kenya to think critically about health choices: A cluster-randomized trial.

AIM: There is an overabundance of claims about the advantages and disadvantages of health interventions. People need to be able to appraise the reliability of these claims. The aim of this two-arm cluster-randomized trial was to evaluate the Informed Health Choices secondary school intervention designed to teach students to assess claims about the effects of health actions and make informed decisions. METHODS: We conducted the trial among students from 80 secondary schools in five subcounties in Kenya. We used stratified randomization to allocate schools to the intervention or control arm. The intervention included a 2-day teacher training workshop and 10 lessons that addressed nine prioritized key concepts for assessing claims about treatment effects. We did not intervene in the control schools. The primary outcome was the proportion of students with a passing score (≥ 9/18 correct answers) on the Critical Thinking about Health test, which included two multiple-choice questions for each concept. RESULTS: Between May 11, 2022, and July 8, 2022, we recruited 3362 students and 80 teachers. We allocated 1863 students and 40 teachers to the intervention and 1499 students and 40 teachers to the control arm. In the intervention schools, 1149/1863 (61.7%) of students achieved a passing score compared to 511/1499 (34.1%) in the control schools (odds ratio 3.6 (95% CI 2.5-5.2), p < 0.0001). CONCLUSIONS: The intervention had a large effect on students' ability to think critically about health interventions. It is possible to integrate the learning of critical thinking about health within Kenya secondary school curriculum.

What should the standard be for passing and mastery on the Critical Thinking about Health Test? A consensus study.

OBJECTIVE: Most health literacy measures rely on subjective self-assessment. The Critical Thinking about Health Test is an objective measure that includes two multiple-choice questions (MCQs) for each of the nine Informed Health Choices Key Concepts included in the educational resources for secondary schools. The objective of this study was to determine cut-off scores for passing (the border between having and not having a basic understanding and the ability to apply the nine concepts) and mastery (the border between having mastered and not having mastered them). DESIGN: Using a combination of two widely used methods: Angoff's and Nedelsky's, a panel judged the likelihood that an individual on the border of passing and another on the border of having mastered the concepts would answer each MCQ correctly. The cut-off scores were determined by summing up the probability of answering each MCQ correctly. Their independent assessments were summarised and discussed. A nominal group technique was used to reach a consensus. SETTING: The study was conducted in secondary schools in East Africa. PARTICIPANTS: The panel included eight individuals with 5 or more years' experience in the following areas: evaluation of critical thinking interventions, curriculum development, teaching of lower secondary school and evidence-informed decision-making. RESULTS: The panel agreed that for a passing score, students had to answer 9 of the 18 questions and for a mastery score, 14 out of 18 questions correctly. CONCLUSION: There was wide variation in the judgements made by individual panel members for many of the questions, but they quickly reached a consensus on the cut-off scores after discussions.

Prioritisation of Informed Health Choices (IHC) key concepts to be included in lower secondary school resources: A consensus study.

BACKGROUND: The Informed Health Choices Key Concepts are principles for thinking critically about healthcare claims and deciding what to do. The Key Concepts provide a framework for designing curricula, learning resources, and evaluation tools. OBJECTIVES: To prioritise which of the 49 Key Concepts to include in resources for lower secondary schools in East Africa. METHODS: Twelve judges used an iterative process to reach a consensus. The judges were curriculum specialists, teachers, and researchers from Kenya, Uganda, and Rwanda. After familiarising themselves with the concepts, they pilot-tested draft criteria for selecting and ordering the concepts. After agreeing on the criteria, nine judges independently assessed all 49 concepts and reached an initial consensus. We sought feedback on the draft consensus from other stakeholders, including teachers. After considering the feedback, nine judges independently reassessed the prioritised concepts and reached a consensus. The final set of concepts was determined after user-testing prototypes and pilot-testing the resources. RESULTS: The first panel of judges prioritised 29 concepts. Based on feedback from teachers, students, curriculum specialists, and members of the research team, two concepts were dropped. A second panel of nine judges prioritised 17 of the 27 concepts that emerged from the initial prioritisation and feedback. Based on feedback on prototypes of lessons and pilot-testing a set of 10 lessons, we determined that it was possible to introduce nine concepts in 10 single-period (40-minute) lessons. We included eight of the 17 prioritised concepts and one additional concept. CONCLUSION: Using an iterative process with explicit criteria, we prioritised nine concepts as a starting point for students to learn to think critically about healthcare claims and choices.

Teaching critical thinking about health information and choices in secondary schools: human-centred design of digital resources.

Background: Learning to thinking critically about health information and choices can protect people from unnecessary suffering, harm, and resource waste. Earlier work revealed that children can learn these skills, but printing costs and curricula compatibility remain important barriers to school implementation. We aimed to develop a set of digital learning resources for students to think critically about health that were suitable for use in Kenyan, Rwandan, and Ugandan secondary schools. Methods: We conducted work in two phases collaborating with teachers, students, schools, and national curriculum development offices using a human-centred design approach. First, we conducted context analyses and an overview of teaching strategies, prioritised content and collected examples. Next, we developed lessons and guidance iteratively, informed by data from user-testing, individual and group interviews, and school pilots. Results: Final resources include online lesson plans, teachers' guide, and extra resources, with lesson plans in two modes, for use in a classroom equipped with a blackboard/flip-chart and a projector. The resources are accessible offline for use when electricity or Internet is lacking. Teachers preferred the projector mode, as it provided structure and a focal point for class attention. Feedback was largely positive, with teachers and students appreciating the learning and experiencing it as relevant. Four main challenges included time to teach lessons; incorrect comprehension; identifying suitable examples; and technical, logistical, and behavioural challenges with a student-computer mode that we piloted. We resolved challenges by simplifying and combining lessons; increasing opportunities for review and assessment; developing teacher training materials, creating a searchable set of examples; and deactivating the student-computer mode. Conclusion: Using a human-centred design approach, we created digital resources for teaching secondary school students to think critically about health actions and for training teachers. Be smart about your health resources are open access and can be translated or adapted to other settings.

Developing digital contact tracing tailored to haulage in East Africa to support COVID-19 surveillance: a protocol.

INTRODUCTION: At the peak of Uganda's first wave of SARS-CoV-2 in May 2020, one in three COVID-19 cases was linked to the haulage sector. This triggered a mandatory requirement for a negative PCR test result at all ports of entry and exit, resulting in significant delays as haulage drivers had to wait for 24-48 hours for results, which severely crippled the regional supply chain.To support public health and economic recovery, we aim to develop and test a mobile phone-based digital contact tracing (DCT) tool that both augments conventional contact tracing and also increases its speed and efficiency. METHODS AND ANALYSIS: To test the DCT tool, we will use a stratified sample of haulage driver journeys, stratified by route type (regional and local journeys).We will include at least 65% of the haulage driver journeys ~83 200 on the network through Uganda. This allows us to capture variations in user demographics and socioeconomic characteristics that could influence the use and adoption of the DCT tool. The developed DCT tool will include a mobile application and web interface to collate and intelligently process data, whose output will support decision-making, resource allocation and feed mathematical models that predict epidemic waves.The main expected result will be an open source-tested DCT tool tailored to haulage use in developing countries.This study will inform the safe deployment of DCT technologies needed for combatting pandemics in low-income countries. ETHICS AND DISSEMINATION: This work has received ethics approval from the School of Public Health Higher Degrees, Research and Ethics Committee at Makerere University and The Uganda National Council for Science and Technology. This work will be disseminated through peer-reviewed publications, our websites https://project-thea.org/ and Github for the open source code https://github.com/project-thea/.

Prioritising Informed Health Choices Key Concepts for those impacted by cancer: a protocol.

Background: Few areas of health have been as insidiously influenced by misinformation as cancer. Thus, interventions that can help people impacted by cancer reduce the extent to which they are victims of misinformation are necessary. The Informed Health Choices (IHC) initiative has developed Key Concepts that can be used in the development of interventions for evaluating the trustworthiness of claims about the effects of health treatments. We are developing an online education programme called Informed Health Choices-Cancer (IHC-C) based on the IHC Key Concepts. We will provide those impacted by cancer with the knowledge and skills necessary to think critically about the reliability of health information and claims and make informed choices. Methods: We will establish a steering group (SG) of 12 key stakeholders, including oncology specialists and academics. In addition, we will establish a patient and public involvement (PPI) panel of 20 people impacted by cancer. After training the members on the Key Concepts and the prioritisation process, we will conduct a two-round prioritisation process. In the first round, 12 SG members and four PPI panel members will prioritise Key Concepts for inclusion. In the second round, the remaining 16 PPI members will undertake the prioritisation based on the prioritised Key Concepts from the first round. Participants in both rounds will use a structured judgement form to rate the importance of the Key Concepts for inclusion in the online IHC-C programme. A consensus meeting will be held, where members will reach a consensus on the Key Concepts to be included and rank the order in which the prioritised Key Concepts will be addressed in the IHC-C programme. Conclusions: At the end of this process, we will identify which Key Concepts should be included and the order in which they should be addressed in the IHC-C programme.

Contextualizing critical thinking about health using digital technology in secondary schools in Kenya: a qualitative analysis.

BACKGROUND: Good health decisions depend on one's ability to think critically about health claims and make informed health choices. Young people can learn these skills through school-based interventions, but learning resources need to be low-cost and built around lessons that can fit into existing curricula. As a first step to developing and evaluating digital learning resources that are feasible to use in Kenyan secondary schools, we conducted a context analysis to explore interest in critical thinking for health, map where critical thinking about health best fits in the curriculum, explore conditions for introducing new learning resources, and describe the information and communication technology (ICT) infrastructure available for teaching and learning. METHODS: We employed a qualitative descriptive approach. We interviewed 15 key informants, carried out two focus group discussions, observed ICT conditions in five secondary schools, reviewed seven documents, and conducted an online catalog of ICT infrastructure in all schools (n=250) in Kisumu County. Participants included national curriculum developers, national ICT officers, teachers, and national examiners. We used a framework analysis approach to analyze data and report findings. FINDINGS: Although critical thinking is a core competence in the curriculum, critical thinking about health is not currently taught in Kenyan secondary schools. Teachers, health officials, and curriculum developers recognized the importance of teaching critical thinking about health in secondary schools. Stakeholders agreed that Informed Health Choices learning resources could be embedded in nine subjects. The National Institute of Curriculum Development regulates resources for learning; the development of new resources requires collaboration and approval from this body. Most schools do not use ICT for teaching, and for those few that do, the use is limited. Implementation of Kenya's ICT policy framework for schools faces several challenges which include inadequate ICT infrastructure, poor internet connectivity, and teachers' lack of training and experience. CONCLUSION: Teaching critical thinking about health is possible within the current Kenyan lower secondary school curriculum, but the learning resources will need to be designed for inclusion in and across existing subjects. The National ICT Plan and Vision for 2030 provides an opportunity for scale-up and integration of technology in teaching and learning environments, which can enable future use of digital resources in schools. However, given the current ICT condition in schools in the country, digital learning resources should be designed to function with limited ICT infrastructure, unstable Internet access, and for use by teachers with low levels of experience using digital technology.

Learning to think critically about health using digital technology in Ugandan lower secondary schools: A contextual analysis.

INTRODUCTION: The world is awash with claims about the effects of health interventions. Many of these claims are untrustworthy because the bases are unreliable. Acting on unreliable claims can lead to waste of resources and poor health outcomes. Yet, most people lack the necessary skills to appraise the reliability of health claims. The Informed Health Choices (IHC) project aims to equip young people in Ugandan lower secondary schools with skills to think critically about health claims and to make good health choices by developing and evaluating digital learning resources. To ensure that we create resources that are suitable for use in Uganda's secondary schools and can be scaled up if found effective, we conducted a context analysis. We aimed to better understand opportunities and barriers related to demand for the resources, how the learning content overlaps with existing curriculum and conditions in secondary schools for accessing and using digital resources, in order to inform resource development. METHODS: We used a mixed methods approach and collected both qualitative and quantitative data. We conducted document analyses, key informant interviews, focus group discussions, school visits, and a telephone survey regarding information communication and technology (ICT). We used a nominal group technique to obtain consensus on the appropriate number and length of IHC lessons that should be planned in a school term. We developed and used a framework from the objectives to code the transcripts and generated summaries of query reports in Atlas.ti version 7. FINDINGS: Critical thinking is a key competency in the lower secondary school curriculum. However, the curriculum does not explicitly make provision to teach critical thinking about health, despite a need acknowledged by curriculum developers, teachers and students. Exam oriented teaching and a lack of learning resources are additional important barriers to teaching critical thinking about health. School closures and the subsequent introduction of online learning during the COVID-19 pandemic has accelerated teachers' use of digital equipment and learning resources for teaching. Although the government is committed to improving access to ICT in schools and teachers are open to using ICT, access to digital equipment, unreliable power and internet connections remain important hinderances to use of digital learning resources. CONCLUSIONS: There is a recognized need for learning resources to teach critical thinking about health in Ugandan lower secondary schools. Digital learning resources should be designed to be usable even in schools with limited access and equipment. Teacher training on use of ICT for teaching is needed.

Teaching critical thinking about health using digital technology in lower secondary schools in Rwanda: A qualitative context analysis.

INTRODUCTION: Adolescents encounter misleading claims about health interventions that can affect their health. Young people need to develop critical thinking skills to enable them to verify health claims and make informed choices. Schools could teach these important life skills, but educators need access to suitable learning resources that are aligned with their curriculum. The overall objective of this context analysis was to explore conditions for teaching critical thinking about health interventions using digital technology to lower secondary school students in Rwanda. METHODS: We undertook a qualitative descriptive study using four methods: document review, key informant interviews, focus group discussions, and observations. We reviewed 29 documents related to the national curriculum and ICT conditions in secondary schools. We conducted 8 interviews and 5 focus group discussions with students, teachers, and policy makers. We observed ICT conditions and use in five schools. We analysed the data using a framework analysis approach. RESULTS: Two major themes found. The first was demand for teaching critical thinking about health. The current curriculum explicitly aims to develop critical thinking competences in students. Critical thinking and health topics are taught across subjects. But understanding and teaching of critical thinking varies among teachers, and critical thinking about health is not being taught. The second theme was the current and expected ICT conditions. Most public schools have computers, projectors, and internet connectivity. However, use of ICT in teaching is limited, due in part to low computer to student ratios. CONCLUSIONS: There is a need for learning resources to develop critical thinking skills generally and critical thinking about health specifically. Such skills could be taught within the existing curriculum using available ICT technologies. Digital resources for teaching critical thinking about health should be designed so that they can be used flexibly across subjects and easily by teachers and students.

Effects of the Informed Health Choices primary school intervention on the ability of children in Uganda to assess the reliability of claims about treatment effects, 1-year follow-up: a cluster-randomised trial.

INTRODUCTION: We evaluated an intervention designed to teach 10- to 12-year-old primary school children to assess claims about the effects of treatments (any action intended to maintain or improve health). We report outcomes measured 1 year after the intervention. METHODS: In this cluster-randomised trial, we included primary schools in the central region of Uganda that taught year 5 children (aged 10 to 12 years). We randomly allocated a representative sample of eligible schools to either an intervention or control group. Intervention schools received the Informed Health Choices primary school resources (textbooks, exercise books and a teachers' guide). The primary outcomes, measured at the end of the school term and again after 1 year, were the mean score on a test with two multiple-choice questions for each of the 12 concepts and the proportion of children with passing scores. RESULTS: We assessed 2960 schools for eligibility; 2029 were eligible, and a random sample of 170 were invited to recruitment meetings. After recruitment meetings, 120 eligible schools consented and were randomly assigned to either the intervention group (n = 60 schools; 76 teachers and 6383 children) or the control group (n = 60 schools; 67 teachers and 4430 children). After 1 year, the mean score in the multiple-choice test for the intervention schools was 68.7% compared with 53.0% for the control schools (adjusted mean difference 16.7%; 95% CI, 13.9 to 19.5; P < 0.00001). In the intervention schools, 3160 (80.1%) of 3943 children who completed the test after 1 year achieved a predetermined passing score (≥ 13 of 24 correct answers) compared with 1464 (51.5%) of 2844 children in the control schools (adjusted difference, 39.5%; 95% CI, 29.9 to 47.5). CONCLUSION: Use of the learning resources led to a large improvement in the ability of children to assess claims, which was sustained for at least 1 year. TRIAL REGISTRATION: Pan African Clinical Trial Registry (www.pactr.org), PACTR201606001679337. Registered on 13 June 2016.

Development of the informed health choices resources in four countries to teach primary school children to assess claims about treatment effects: a qualitative study employing a user-centred approach.

BACKGROUND: People of all ages are flooded with health claims about treatment effects (benefits and harms of treatments). Many of these are not reliable, and many people lack skills to assess their reliability. Primary school is the ideal time to begin to teach these skills, to lay a foundation for continued learning and enable children to make well-informed health choices, as they grow older. However, these skills are rarely being taught and yet there are no rigorously developed and evaluated resources for teaching these skills. OBJECTIVES: To develop the Informed Health Choices (IHC) resources (for learning and teaching people to assess claims about the effects of treatments) for primary school children and teachers. METHODS: We prototyped, piloted, and user-tested resources in four settings that included Uganda, Kenya, Rwanda, and Norway. We employed a user-centred approach to designing IHC resources which entailed multiple iterative cycles of development (determining content scope, generating ideas, prototyping, testing, analysing and refining) based on continuous close collaboration with teachers and children. RESULTS: We identified 24 Key Concepts that are important for children to learn. We developed a comic book and a separate exercise book to introduce and explain the Key Concepts to the children, combining lessons with exercises and classroom activities. We developed a teachers' guide to supplement the resources for children. CONCLUSION: By employing a user-centred approach to designing resources to teach primary children to think critically about treatment claims and choices, we developed learning resources that end users experienced as useful, easy to use and well-suited to use in diverse classroom settings.

Protocol for assessing stakeholder engagement in the development and evaluation of the Informed Health Choices resources teaching secondary school students to think critically about health claims and choices.

BACKGROUND: As part of a five year plan (2019-2023), the Informed Health Choices Project, is developing and evaluating resources for helping secondary school students learn to think critically about health claims and choices. We will bring together key stakeholders; such as secondary school teachers and students, our main target for the IHC secondary school resources, school administrators, policy makers, curriculum development specialists and parents, to enable us gain insight about the context. OBJECTIVES: To ensure that stakeholders are effectively and appropriately engaged in the design, evaluation and dissemination of the learning resources.To evaluate the extent to which stakeholders were successfully engaged. METHODS: Using a multi-stage stratified sampling method, we will identify a representative sample of secondary schools with varied characteristics that might modify the effects of the learning resources such as, the school location (rural, semi-urban or urban), ownership (private, public) and ICT facilities (under resourced, highly resourced). A sample of schools will be randomly selected from the schools in each stratum. We will aim to recruit a diverse sample of students and secondary school teachers from those schools. Other stakeholders will be purposively selected to ensure a diverse range of experience and expertise. RESULTS: Together with the teacher and student networks and the advisory panels, we will establish measurable success criteria that reflect the objectives of engaging stakeholders at the start of the project and evaluate the extent to which those criteria were met at the end of the project. CONCLUSION: We aim for an increase in research uptake, improve quality and appropriateness of research results, accountability and social justice.

Effects of the Informed Health Choices podcast on the ability of parents of primary school children in Uganda to assess the trustworthiness of claims about treatment effects: one-year follow up of a randomised trial.

INTRODUCTION: Earlier, we designed and evaluated an educational mass media intervention for improving people's ability to think more critically and to assess the trustworthiness of claims (assertions) about the benefits and harms (effects) of treatments. The overall aims of this follow-up study were to evaluate the impact of our intervention 1 year after it was administered, and to assess retention of learning and behaviour regarding claims about treatments. METHODS: We randomly allocated consenting parents to listen to either the Informed Health Choices podcast (intervention) or typical public service announcements about health issues (control) over 7-10 weeks. Each intervention episode explained how the trustworthiness of treatment claims can be assessed by using relevant key concepts of evidence-informed decision-making. Participants listened to two episodes per week, delivered by research assistants. We evaluated outcomes immediately, and a year after the intervention. Primary outcomes were mean score and the proportion with a score indicating a basic ability to apply the key concepts (> 11 out of 18 correct answers) on a tool measuring people's ability to critically appraise the trustworthiness of treatment claims. Skills decay/retention was estimated by calculating the relative difference between the follow-up and initial results in the intervention group, adjusting for chance. Statistical analyses were performed using R (R Core Team, Vienna, Austria; version 3.4.3). RESULTS: After 1 year, the mean score for parents in the intervention group was 58.9% correct answers, compared to 52.6% in the control (adjusted mean difference of 6.7% (95% CI 3.3% to 10.1%)). In the intervention group, 47.2% of 267 parents had a score indicating a basic ability to assess treatment claims compared to 39.5% of 256 parents in the control (adjusted difference of 9.8% more parents (95% CI 0.9% to 18.9%). These represent relative reductions of 29% in the mean scores and 33% in the proportion of parents with a score indicating a basic ability to assess the trustworthiness of claims about treatment effects. CONCLUSIONS: Although listening to the Informed Health Choices podcast initially led to a large improvement in the ability of parents to assess claims about the effects of treatments, our findings show that these skills decreased substantially over 1 year. More active practice could address the substantial skills decay observed over 1 year. TRIAL REGISTRATION: Pan African Clinical Trial Registry (www.pactr.org), PACTR201606001676150. Registered on 12 June 2016.