Natural experiments for the evaluation of place-based public health interventions: a methodology scoping review.

Introduction: Place-based public health evaluations are increasingly making use of natural experiments. This scoping review aimed to provide an overview of the design and use of natural experiment evaluations (NEEs), and an assessment of the plausibility of the as-if randomization assumption. Methods: A systematic search of three bibliographic databases (Pubmed, Web of Science and Ovid-Medline) was conducted in January 2020 to capture publications that reported a natural experiment of a place-based public health intervention or outcome. For each, study design elements were extracted. An additional evaluation of as-if randomization was conducted by 12 of this paper's authors who evaluated the same set of 20 randomly selected studies and assessed 'as-if ' randomization for each. Results: 366 NEE studies of place-based public health interventions were identified. The most commonly used NEE approach was a Difference-in-Differences study design (25%), followed by before-after studies (23%) and regression analysis studies. 42% of NEEs had likely or probable as-if randomization of exposure (the intervention), while for 25% this was implausible. An inter-rater agreement exercise indicated poor reliability of as-if randomization assignment. Only about half of NEEs reported some form of sensitivity or falsification analysis to support inferences. Conclusion: NEEs are conducted using many different designs and statistical methods and encompass various definitions of a natural experiment, while it is questionable whether all evaluations reported as natural experiments should be considered as such. The likelihood of as-if randomization should be specifically reported, and primary analyses should be supported by sensitivity analyses and/or falsification tests. Transparent reporting of NEE designs and evaluation methods will contribute to the optimum use of place-based NEEs.

Conducting school-based health surveys with secondary schools in England: advice and recommendations from school staff, local authority professionals, and wider key stakeholders, a qualitative study.

BACKGROUND: Improving the health and well-being of young people is a public health priority. Schools present an ideal setting to implement strategies to improve young people's health and well-being. A key strategy involves conducting surveys to assess student health needs, inform interventions, and monitor health over time. Conducting research in schools is, however, challenging. Schools can find it difficult to participate and adhere to research processes, even when they are keen to be involved in research, because of competing priorities (e.g., attendance and educational achievement), as well as time and resource constraints. There is a lack of literature on the perspectives of school staff and other key stakeholders working in young people's health on how best to work with schools to conduct health research, and in particular, health surveys. METHODS: Participants (n = 26) included members of staff from 11 secondary schools (covering students aged 11-16 years), 5 local authority professionals, and 10 wider key stakeholders in young people's health and well-being (e.g., a school governor, a national government member), based in South West England. Participants took part in semi-structured interviews that were conducted either over the phone or via an online platform. Data were analysed using the Framework Method. RESULTS: Three main themes were identified: Recruitment and Retention, Practicalities of Data Collection in Schools, and Collaboration from Design to Dissemination. It is important to acknowledge the role of local authorities and academy trusts in the English education system, and work closely with these when conducting school-based health surveys. School staff prefer to be contacted about research via email and in the summer term, following exams. Researchers should contact a member of staff involved in student health/well-being, as well as senior leadership, during recruitment. Data collection during the start and end of the school year is undesirable. Research should be collaborative with school staff and young people, consistent with school priorities and values, and flexible and tailored to school timetables and resources. CONCLUSIONS: Overall the findings demonstrate that survey-based research methods should be school-led and tailored to each school.

Implementing a regional school health research network in england to improve adolescent health and well-being, a qualitative process evaluation.

BACKGROUND: There is an increased need for prevention and early intervention surrounding young people's health and well-being. Schools offer a pivotal setting for this with evidence suggesting that focusing on health within schools improves educational attainment. One promising approach is the creation of School Health Research Networks which exist in Wales and Scotland, but are yet to be developed and evaluated in England. METHODS: This qualitative process evaluation aimed to identify the main barriers and facilitators to implementing a pilot School Health Research Network in the South West of England (SW-SHRN). Semi-structured interviews were conducted with school staff, local authority members, and other key stakeholders. Interview data were analysed using the 7-stage framework analysis approach. RESULTS: Four main themes were identified from the data: (1) 'Key barriers to SW-SHRN' (competing priorities of academic attainment and well-being, schools feeling overwhelmed with surveys and lack of school time and resource); (2) 'Key facilitators to SW-SHRN: providing evidence-based support to schools' (improved knowledge to facilitate change, feedback reports and benchmarking and data to inform interventions); (3) 'Effective dissemination of findings' (interpretation and implementation, embedding findings with existing evidence and policy, preferences for an online platform as well personalised communication and the importance of involving young people and families); and (4) 'Longer-term facilitators: ensuring sustainability' (keeping schools engaged, the use of repeat surveys to evaluate impact, informing school inspection frameworks and expanding reach of the network). CONCLUSION: This study identifies several barriers to be addressed and facilitators to be enhanced in order to achieve successful implementation of School Health Research Networks in England which include providing a unique offering to schools that is not too burdensome, supporting schools to take meaningful action with their data and to work closely with existing organisations, services and providers to become meaningfully embedded in the system.

Using systems thinking to understand how the South West - School Health Research Network can improve adolescent health and well-being: A qualitative process evaluation.

Schools offer a valuable setting to promote good health and mental well-being amongst young people. Schools are complex systems and therefore systems interventions are needed to improve pupil health and well-being. This paper presents a qualitative process evaluation of the South West- School Health Research Network, a systems level intervention. The evaluation is based on interviews with school staff, local authorities and wider stakeholders. Given the complexity of England's educational system there is a need to intervene and monitor health at multiple levels and to ensure close partnership working to effectively improve adolescent health through schools.

Study protocol for First Dental Steps Intervention: feasibility study of a health visitor led infant oral health improvement programme.

BACKGROUND: Dental caries in childhood is a burden on the daily lives of children and their families, and associated with poor oral health in adulthood. In England, dental caries is the most common reason for young children to be admitted to hospital. It is believed that most tooth extractions (due to decay) for children aged 10 years and under, could be avoided with improved prevention and early management. National public health policy recommendations in England include specific oral health initiatives to tackle tooth decay. One of these initiatives is delivered as part of the Healthy Child Programme and includes providing workforce training in oral health, integrating oral health advice into home visits, and the timely provision of fluoride toothpaste. This protocol seeks to assess the delivery of the First Dental Steps intervention and uncertainties related to the acceptability, recruitment, and retention of participants. METHODS: This study seeks to explore the feasibility and acceptability of the First Dental Steps intervention and research methods. First Dental Steps intervention will be delivered in local authority areas in South West England and includes oral health training for health visitors (or community nursery nurses) working with 0-5-year-olds and their families. Further, for vulnerable families, integrating oral health advice and the provision of an oral health pack (including a free flow cup, an age appropriate toothbrush, and 1450 ppm fluoride toothpaste) during a mandated check by a health visitor. In this study five local authority areas will receive the intervention. Interviews with parents receiving the intervention and health visitors delivering the intervention will be undertaken, along with a range of additional interviews with stakeholders from both intervention and comparison sites (four additional local authority areas). DISCUSSION: This protocol was written after the start of the COVID-19 pandemic, as a result, some of the original methods were adjusted specifically to account for disruptions caused by the pandemic. Results of this study will primarily provide evidence on the acceptability and feasibility of both the First Dental Steps intervention and the research methods from the perspective of both families and stakeholders.

Health visiting teams and children's oral health: a scoping review.

BACKGROUND: Recent policies have recommended early-life interventions to prevent caries. The four nations of the UK each have a national universal children's health programme, through which health visitors and their wider team (HVTs) promote health in the early years. HVT visits offer an opportunity to support parents to improve their child's oral health. A scoping review was conducted to provide a descriptive synthesis of the current literature related to the role of HVTs in improving the oral health of children 0-5 years old and to identify significant gaps for future research. This review informed the feasibility study of the First Dental Steps Intervention, a targeted health visitor-led infant oral health intervention in England. METHODS: Electronic database searches for peer-reviewed literature were performed using Medline via Ovid and Web of Science (1946-2021). The quality of included intervention studies was assessed using the Effective Public Health Practice Project tool. Additionally, a grey literature search was conducted (key organisations, bibliographic and thesis databases, forwards and backwards citation, Google). RESULTS: Thirty-nine publications, published between 1980 and 2021, were included. The majority of included papers were from the UK. The quality of intervention studies (n = 7) ranged from weak to strong. Thematic analysis identified the following themes: (1) professional knowledge, education, and training; (2) involvement of HVs in the delivery of oral health interventions; (3) effectiveness of interventions; (4) perspectives of HVs providing oral health advice and acceptability; and (5) barriers and facilitators to promoting oral health. The grey literature search identified 125 sources. HVT involvement was reported in a variety of source types: reports, guidance documents, evaluations, reviews, and training resources. HVTs were involved in oral health by providing oral health packs, brushing and oral health advice, registration and attendance, oral health training, risk assessment, and referral to dental services. CONCLUSION: The current literature suggests that HVTs are well placed to improve children's oral health. Facilitators and barriers are encountered by HVTs in promoting oral health which should be considered by commissioners. There is a need for future high-quality studies that address the inadequacies found and provide further evidence of the effectiveness of HVT's oral health interventions.

Creation of a Pilot School Health Research Network in an English Education Infrastructure to Improve Adolescent Health and Well-Being: A Study Protocol.

Schools play a significant role in promoting health and well-being and the reciprocal links between health and educational attainment are well-evidenced. Despite recognition of the beneficial impact of school-based health improvement programmes, significant barriers to improving health and well-being within schools remain. This study pilots a School Health Research Network in the South West of England (SW-SHRN), a systems-based health intervention bringing together schools, academic health researchers and public health and/or education teams in local authorities to share knowledge and expertise to improve the health and well-being of young people. A maximum of 20 secondary schools will be recruited to the pilot SW-SHRN. All students in Years 8 (age 12-13) and 10 (age 14-15) will be invited to complete a health and well-being questionnaire, generating a cohort of approximately 5000 adolescents. School environment questionnaires will also be completed with each school to build a regional picture of existing school health policies and programmes. Each school will be provided with a report summarising data for their students benchmarked against data for all schools in the network. Quantitative analysis will model associations between health risk behaviours and mental health outcomes and a qualitative process evaluation will explore the feasibility and sustainability of the network. This study will create adolescent health data to help provide schools and local authorities with timely and robust information on the health and well-being of their students and help them to identify areas in which public health interventions may be required. SW-SHRN will also help public health professionals focus their resources in the areas most at need.

What is the impact of structural and cultural factors and interventions within educational settings on promoting positive mental health and preventing poor mental health: a systematic review.

Mental health (MH) difficulties are on the increase among children and young people (CYP). Evidence has shown that educational settings contain both risk and protective factors for MH. This review investigated which structural and cultural factors and interventions within educational settings promote positive MH and prevent poor MH in 4-18 year olds. Searches were conducted in PsychINFO, Embase, ERIC, ASSIA and British Education Index, and reference lists from key studies and relevant systematic reviews were hand-searched. Intervention, cohort, and qualitative studies were included. Of the 62 included papers, 36 examined cultural factors (30 social/relational and six value-related) while 12 studies examined structural factors (eight organisational and four physical) and 14 studies examined multiple factors. There was strong evidence for the impact of positive classroom management techniques, access to physical activity, and peer mentoring on student MH. Studies examining the impact of positive school culture, teacher training in MH and parent involvement in school MH activities also found predominantly positive results for student MH, albeit the evidence was of lower quality or from a low number of studies. Few studies explicitly examined the impact of interventions on MH inequalities; those that did indicated limited if any reduction to inequalities. A very small number of studies suggested that interventions targeting those at risk of poor MH due to socioeconomic factors could successfully improve wellbeing and reduce depression, anxiety and behavioural problems. Studies exploring the effect of management and leadership strategies within schools, policies, and aspects of the physical environment other than green space were scarce or absent in the literature. This review highlights the need to consider the ways in which educational settings are organised, the culture that is created and the physical space in order to improve the MH of CYP.

Exploring the potential of a school-based online health and wellbeing screening tool: professional stakeholders' perspectives and experiences.

BACKGROUND: Supporting children and young people's (CYP) mental and physical health is a global policy priority but detecting need and facilitating access to health services and support is challenging. This paper explores professional stakeholders' perspectives of the acceptability, utility and effectiveness of a school-based online health and wellbeing screening tool, the Digital Health Contact (DHC). The DHC, delivered by Public Health School Nurses (PHSN), aims to identify, and put in place strategies to support, unmet health needs among CYP. METHODS: We employed a qualitative study design, using semi-structured interviews. Fourteen key stakeholders involved in the design and implementation of the DHC (commissioners, providers, PHSN and healthcare staff, school leaders) were purposively sampled. Data were analysed thematically. RESULTS: Our analysis generated two key themes: the perceived benefits of the DHC; and challenges in delivering the DHC. Stakeholders perceived the universal application of the DHC with linked follow-up intervention as an effective means of identifying and supporting CYP with unmet needs, and an efficient way to target limited service resources. There were barriers around enabling school engagement in the DHC, typically in terms of logistics, school infrastructure, and perspectives of fit with schools. These barriers were seen as being negated through developing effective working relationships between schools and PHSN. Effective relationships could highlight the potential benefits of participation. Overall, the DHC was seen as a valuable and effective use of resources, with a low burden on school staff. CONCLUSIONS: The DHC, as a universal school-based health and wellbeing screening tool with linked follow-up intervention, has great potential in identifying and supporting unmet health needs among CYP. The perspectives and experiences of those involved in delivering the DHC highlight important considerations which may enable effective implementation and delivery of school screening programmes across other areas.

Effect of A Sun Protection Intervention on the Immune Response to Measles Booster Vaccination in Infants in Rural South Africa.

The incidence of many serious childhood infections can be reduced by vaccination. High sun exposure at the time of vaccination has been associated with a reduced antigen-specific immune response. We hypothesized that providing sun protection advice and equipment to mothers of children who were waiting to be vaccinated would result in a more robust immunization response. We conducted a pilot study in 2015/2016 (data analyzed in 2017-2018) among 98 Black African children (~18 months of age) receiving the booster measles vaccination at two clinics in South Africa. Clinics were randomized to receive (or not) sun protection advice and equipment. We recorded demographic information on children and mothers and data on the child's usual sun exposure. At approximately 4 weeks' postmeasles vaccination, we measured measles immunoglobulin G levels in children. All children with blood results (n = 87, 89%) across both groups had antibody titers higher than 200 mIU mL-1 which was considered the protective antibody concentration. There was no statistically significant difference in titers between groups: geometric difference in mean titers 1.13 mIU mL-1 (95% CI 0.85, 1.51; P = 0.39) and 1.38 mIU mL-1 (95% CI 0.90, 2.11, P = 0.14) for unadjusted and adjusted analyses, respectively. This study demonstrated that a sun protection intervention study could be performed in a developing-world pediatric vaccination setting. Although the sun protection intervention around the time of vaccination was not associated with a higher antibody level, given the potential importance of such an effect, a larger study should be considered.

'My child did not like using sun protection': practices and perceptions of child sun protection among rural black African mothers.

BACKGROUND: Photodamage is partially mitigated by darker skin pigmentation, but immune suppression, photoaging and cataracts occur among individuals with all skin types. METHODS: To assess practices and acceptability to Black African mothers of sun protection equipment for their children living in a rural area, participants were recruited at the time of their child's 18-month vaccinations. Mothers completed a baseline questionnaire on usual sun behaviours and sun protection practices. They were then provided with sun protection equipment and advice. A follow-up questionnaire was administered two weeks later. RESULTS: Mothers reported that during the week prior to the baseline questionnaire, children spent on average less than 1 hour of time outdoors (most often spent in the shade). Most mothers (97%) liked the sun protection equipment. However, many (78 of 86) reported that their child did not like any of the sun protection equipment and two-thirds stated that the sun protection equipment was not easy to use. CONCLUSIONS: Among Black Africans in rural northern South Africa, we found a mismatch between parental preferences and child acceptance for using sun protection when outdoors. A better understanding of the health risks of incidental excess sun exposure and potential benefits of sun protection is required among Black Africans.

Indoor Temperatures in Patient Waiting Rooms in Eight Rural Primary Health Care Centers in Northern South Africa and the Related Potential Risks to Human Health and Wellbeing.

Increased temperatures affect human health and vulnerable groups including infants, children, the elderly and people with pre-existing diseases. In the southern African region climate models predict increases in ambient temperature twice that of the global average temperature increase. Poor ventilation and lack of air conditioning in primary health care clinics, where duration of waiting time may be as long as several hours, pose a possible threat to patients seeking primary health care. Drawing on information measured by temperature loggers installed in eight clinics in Giyani, Limpopo Province of South Africa, we were able to determine indoor temperatures of waiting rooms in eight rural primary health care facilities. Mean monthly temperature measurements inside the clinics were warmer during the summer months of December, January and February, and cooler during the autumn months of March, April and May. The highest mean monthly temperature of 31.4 ± 2.7 °C was recorded in one clinic during February 2016. Maximum daily indoor clinic temperatures exceeded 38 °C in some clinics. Indoor temperatures were compared to ambient (outdoor) temperatures and the mean difference between the two showed clinic waiting room temperatures were higher by 2-4 °C on average. Apparent temperature (AT) incorporating relative humidity readings made in the clinics showed 'realfeel' temperatures were >4 °C higher than measured indoor temperature, suggesting a feeling of 'stuffiness' and discomfort may have been experienced in the waiting room areas. During typical clinic operational hours of 8h00 to 16h00, mean ATs fell into temperature ranges associated with heat-health impact warning categories of 'caution' and 'extreme caution'.

Sun protection to improve vaccine effectiveness in children in a high ambient ultraviolet radiation and rural environment: an intervention study.

BACKGROUND: Vaccination is a mainstay of preventive healthcare, reducing the incidence of serious childhood infections. Ecological studies have demonstrated an inverse association between markers of high ambient ultraviolet (UV) radiation exposure (e.g., sunny season, low latitude of residence) and reduction in the vaccination-associated immune response. Higher sun exposure on the day prior to and spanning the day of vaccination has been associated with a reduced antigen-specific immune response independent of skin pigmentation. The South African Department of Health's Expanded Programme on Immunisation provides free vaccinations in government primary health care clinics. In some areas, these clinics may have only a small waiting room and patients wait outside in full sun conditions. In rural areas, patients may walk several kilometres to and from the clinic. We hypothesised that providing sun protection advice and equipment to mothers of children (from 18 months) who were waiting to be vaccinated would result in a more robust immune response for those vaccinated. METHODS: We conducted an intervention study among 100 children receiving the booster measles vaccination. We randomised clinics to receive (or not) sun protection advice and equipment. At each clinic we recorded basic demographic data on the child and mother/carer participants, their sun exposure patterns, and the acceptability and uptake of the provided sun protection. At 3-4 weeks post-vaccination, we measured measles IgG levels in all children. DISCUSSION: This is the first intervention study to assess the effect of sun protection measures on vaccine effectiveness in a rural, real-world setting. The novel design and rural setting of the study can contribute much needed evidence to better understand sun exposure and protection, as well as factors determining vaccine effectiveness in rural Africa, and inform the design of immunisation programmes. (TRN PACTCR201611001881114, 24 November 2016, retrospective registration).

Diffuse Reflectance Spectroscopy Versus Mexameter(®) MX18 Measurements of Melanin and Erythema in an African Population.

Melanin provides protection against excess exposure to solar ultraviolet radiation (UVR) and related adverse health effects. Diffuse reflectance spectroscopy (DRS) can be used to calculate cutaneous melanin and erythema, but this is complex and has been mostly used for light-to-medium pigmented skin. Handheld reflectance spectrophotometers, such as the Mexameter(®) MX18, can also be used. We compared DRS-calculated melanin and erythema values with Mexameter melanin and erythema index values to understand how these techniques/measurements correlate in an African population of predominantly deeply pigmented skin. Five hundred and three participants comprised 68.5% self-identified Black African, 9.9% Indian/Asian, 18.4% White and 2.9% Colored. The majority of Black African (45%), Indian/Asian (34%) and Colored (53%) participants self-identified their skin as being "brown." Measured melanin levels increased with darker self-reported skin color. DRS-calculated and Mexameter melanin values demonstrated a positive correlation (Spearman rho = 0.87, P < 0.001). The results from both instruments showed erythema values were strongly correlated with their own melanin values. This finding is considered spurious and may result from the complexity of separating brown and red pigment when using narrowband reflectance techniques. Further work is needed to understand melanin, erythema and color in Black skin given sun-related health risks in vulnerable groups in Africa.

Students' Perceived Heat-Health Symptoms Increased with Warmer Classroom Temperatures.

Temperatures in Africa are expected to increase by the end of the century. Heat-related health impacts and perceived health symptoms are potentially a problem, especially in public schools with limited resources. Students (n = 252) aged ~14-18 years from eight high schools completed an hourly heat-health symptom log over 5 days. Data loggers measured indoor classroom temperatures. A high proportion of students felt tired (97.2%), had low concentration (96.8%) and felt sleepy (94.1%) during at least one hour on any day. There were statistically significant correlations, when controlling for school cluster effect and time of day, between indoor temperatures ≥32 °C and students who felt tired and found it hard to breathe. Consistently higher indoor classroom temperatures were observed in classrooms constructed of prefabricated asbestos sheeting with corrugated iron roof and converted shipping container compared to brick classrooms. Longitudinal studies in multiple seasons and different classroom building types are needed.

Knowledge and practice of sun protection in schools in South Africa where no national sun protection programme exists.

Interventions in primary schools that increase sun-protective behaviours and decrease ultraviolet radiation exposure, sunburn incidence and skin cancer risk can be effective. SunSmart School Accreditation Programmes (SSAP) are recommended. Prior to SSAP implementation in South Africa, we explored the feasibility of obtaining national baseline information and investigated possible associations between strategies regarding sun protection in schools and students' responses to a questionnaire. Principals from randomly selected urban government schools in all nine South African provinces completed a questionnaire and 679 students were surveyed. The mean sun-related knowledge and behaviour scores of students were 4 (range: 1-7) and 3 (range-0-8) out of 9, respectively. The mean school sun protection effort score was 4 out of 14. There were no statistically significant correlations between students' knowledge or behaviour scores and their school score. The World Health Organization recommends an SSAP to address policy, practice and curriculum changes to support sun protection of students. This cross-sectional study demonstrates the feasibility of, and need for, a larger baseline study with longitudinal, multi-variable follow-up which includes other influential factors, such as parent support. Such research could quantify the impact of the SSAP and identify which key factors influence the sun-related knowledge and behaviours of students.

Self-reported sun-related knowledge, attitudes and behaviours among schoolchildren attending South African primary schools.

BACKGROUND: Skin cancer and other adverse health effects result from excess solar ultraviolet radiation exposure. Sun protective practices are important interventions for skin cancer prevention, particularly when implemented early in life. Several international studies have assessed children's sun-related knowledge, attitudes and behaviours in school settings but never before in Southern Africa, where multiethnic populations exist. PURPOSE: The purpose of this study is to describe the sun-related knowledge, attitudes and behaviours as self-reported by South African primary schoolchildren and consider the roles of sex and skin type. METHODS: A randomly selected sample of 707 schoolchildren from 24 government, urban schools in all nine provinces of South Africa were surveyed regarding their sun-related knowledge, attitudes and behaviours. RESULTS: Approximately 56% of students reported experience of sunburn last summer and 59% stated that they had got a suntan. Many students (64.5%) believed that one could protect oneself from getting skin cancer by avoiding getting sunburnt. Other means reported to do so by the students were to use sunscreen (65.4%), stay out of the summer sun (48.0%), cover up with clothing (45.5%) and eat the right foods (38.0%). Only about a quarter of the students (22.4%) wrongly agreed that it is safe to get sunburnt once or twice a year. Few students (8.7%) agreed that they like to have a suntan because they feel healthier and agreed that they think a suntan makes them feel more attractive to others (17.3%). Few also agreed that most of their friends (16.1%) and family (14.2%) think that a suntan is a good thing. Children reporting to have white/light brown skin (69.4%) were more likely to agree that they used sunscreen to protect themselves from getting sunburnt compared with children having brown/dark brown/black skin (54.8%) (P = 0.0005). CONCLUSION: South African schoolchildren at urban government schools do have some knowledge about sun protection, and they do have some positive sun behaviours; however, the reported occurrence of sunburn, a risk factor for skin cancer, was relatively high. There were few differences in responses by sex and some differences by skin type. These findings are important for the development of appropriate sun protection programmes aimed at schoolchildren in South Africa and other countries with similar multi-ethnic populations.