The feasibility and acceptability of an app-based intervention with brief behavioural support (APPROACH) to promote brisk walking in people diagnosed with breast, prostate and colorectal cancer in the UK.

INTRODUCTION: Increased moderate to vigorous physical activity (MVPA) can improve clinical and psychosocial outcomes for people living with and beyond cancer (LWBC). This study aimed to assess the feasibility and acceptability of trial procedures in a pilot randomised controlled trial (RCT) of a theory-driven app-based intervention with behavioural support focused on promoting brisk walking (a form of MVPA) in people LWBC (APPROACH). METHODS: Participants diagnosed with breast, prostate or colorectal cancer were recruited from a single UK hospital site. Assessments at baseline and 3 months included online questionnaires, device-measured brisk walking (activPAL accelerometer) and self-reported weight and height. Participants were randomised to intervention or control (care as usual). The intervention comprised a non-cancer-specific app to promote brisk walking (National Health Service 'Active 10') augmented with print information about habit formation, a walking planner and two behavioural support telephone calls. Feasibility and acceptability of trial procedures were explored. Initial estimates for physical activity informed a power calculation for a phase III RCT. A preliminary health economics analysis was conducted. RESULTS: Of those medically eligible, 369/577 (64%) were willing to answer further eligibility questions and 90/148 (61%) of those eligible were enrolled. Feasibility outcomes, including retention (97%), assessment completion rates (>86%) and app download rates in the intervention group (96%), suggest that the trial procedures are acceptable and that the intervention is feasible. The phase III RCT will require 472 participants to be randomised. As expected, the preliminary health economic analyses indicate a high level of uncertainty around the cost-effectiveness of the intervention. CONCLUSIONS: This pilot study demonstrates that a large trial of the brisk walking intervention with behavioural support is both feasible and acceptable to people LWBC. The results support progression onto a confirmatory phase III trial to determine the efficacy and cost-effectiveness of the intervention.

Factors associated with wearing a facemask in shops in England following removal of a legal requirement to do so during the COVID-19 pandemic.

OBJECTIVES: We aimed to identify psychological factors associated with the use of facemasks in shops in England following removal of legal requirements to do so, and to compare associations with and without legal restrictions. DESIGN: Repeated cross-sectional online surveys (n ≈ 2000 adults) between August 2020 and April 2022 (68,716 responses from 45,682 participants) using quota sampling. METHODS: The outcome measure was whether those who had visited a shop for essentials in the previous seven days reported always having worn a facemask versus sometimes or not at all. Psychological predictor variables included worry, perceived risk and severity of COVID-19 and the perceived effectiveness of facemasks. Socio-demographic variables and measures of clinical vulnerability were also measured. For the period following removal of legal restrictions, multivariable regression was used to assess associations between the primary outcome variable and predictors adjusting for socio-demographic and clinical vulnerability measures. The analysis was repeated including interactions between psychological predictors and presence versus absence of legal restrictions. RESULTS: Worry about COVID-19, beliefs about risks and severity of COVID-19 and effectiveness of facemasks were substantially and independently associated with the use of facemasks. Removal of legal obligations to wear facemasks was associated with a 25% decrease in wearing facemasks and stronger associations between psychological predictors and wearing facemasks. CONCLUSIONS: Legal obligations increase rates of wearing a facemask. Psychological factors associated with wearing a facemask could be targets for interventions aiming to alter rates of wearing a facemask. These interventions may be more effective when there are no legal obligations to wear a face covering in place.

The relationship between age and sex partner counts during the mpox outbreak in the UK, 2022.

BACKGROUND: Understanding the dynamics of an infectious disease outbreak linked to sexual activity requires valid expectations of likely counts of unique sex partners during the infectious period. Typically, age is the key demographic trait linked to expected partner count, with many transmission models removing adults from the sexually active pool abruptly at a pre-specified age threshold. Modelling the rate of decline in partner counts with age would benefit from a better description of empirical evidence. METHODS: During the 2022 mpox epidemic in the UK, we asked individuals about their partner counts in the preceding three weeks, which is about the same as usual infectious period for persons with active mpox. We used negative binomial regression (all responses) and Weibull regression (non-zero responses) to analyse the relationship between age and partner counts, adjusted for other demographic data (such as education level and occupation), sub-dividing by three types of respondent: men who have sex with men (MSM), men who have sex with women, and women who have sex with men. RESULTS: Most respondents had zero or one recent partner, all distributions were skewed. There was a relatively linear declining relationship between age and partner counts for heterosexual partnership groups, but a peak in partner counts and concurrency for MSMs in middle age years (age 35-54), especially for MSM who seemed to be in a highly sexually active subgroup. CONCLUSION: Useful data were collected that can be used to describe sex partner counts during the British mpox epidemic and that show distinctive partner count relationships with age, dependent on partnership type.

How Notifications Affect Engagement With a Behavior Change App: Results From a Micro-Randomized Trial.

BACKGROUND: Drink Less is a behavior change app to help higher-risk drinkers in the United Kingdom reduce their alcohol consumption. The app includes a daily notification asking users to "Please complete your drinks and mood diary," yet we did not understand the causal effect of the notification on engagement nor how to improve this component of Drink Less. We developed a new bank of 30 new messages to increase users' reflective motivation to engage with Drink Less. This study aimed to determine how standard and new notifications affect engagement. OBJECTIVE: Our objective was to estimate the causal effect of the notification on near-term engagement, to explore whether this effect changed over time, and to create an evidence base to further inform the optimization of the notification policy. METHODS: We conducted a micro-randomized trial (MRT) with 2 additional parallel arms. Inclusion criteria were Drink Less users who consented to participate in the trial, self-reported a baseline Alcohol Use Disorders Identification Test score of ≥8, resided in the United Kingdom, were aged ≥18 years, and reported interest in drinking less alcohol. Our MRT randomized 350 new users to test whether receiving a notification, compared with receiving no notification, increased the probability of opening the app in the subsequent hour, over the first 30 days since downloading Drink Less. Each day at 8 PM, users were randomized with a 30% probability of receiving the standard message, a 30% probability of receiving a new message, or a 40% probability of receiving no message. We additionally explored time to disengagement, with the allocation of 60% of eligible users randomized to the MRT (n=350) and 40% of eligible users randomized in equal number to the 2 parallel arms, either receiving the no notification policy (n=98) or the standard notification policy (n=121). Ancillary analyses explored effect moderation by recent states of habituation and engagement. RESULTS: Receiving a notification, compared with not receiving a notification, increased the probability of opening the app in the next hour by 3.5-fold (95% CI 2.91-4.25). Both types of messages were similarly effective. The effect of the notification did not change significantly over time. A user being in a state of already engaged lowered the new notification effect by 0.80 (95% CI 0.55-1.16), although not significantly. Across the 3 arms, time to disengagement was not significantly different. CONCLUSIONS: We found a strong near-term effect of engagement on the notification, but no overall difference in time to disengagement between users receiving the standard fixed notification, no notification at all, or the random sequence of notifications within the MRT. The strong near-term effect of the notification presents an opportunity to target notifications to increase "in-the-moment" engagement. Further optimization is required to improve the long-term engagement. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/18690.

Knowledge of Self-Isolation Rules in the UK for Those Who Have Symptoms of COVID-19: A Repeated Cross-Sectional Survey Study.

OBJECTIVES: To investigate knowledge of self-isolation rules and factors associated with knowledge. METHODS: Repeated cross-sectional online surveys (n ≈ 2000 UK adults) between 9 November 2020 and 16 February 2022 (78,573 responses from 51,881 participants). We computed a composite measure of knowledge of self-isolation rules and investigated associations between knowledge and survey wave, socio-demographic characteristics (age, gender, UK nation, index of multiple deprivation), trust in government, and participants' belief that they had received enough information about self-isolation. RESULTS: In total, 87.9% (95% CI 87.7% to 88.1%, n = 67,288/76,562) of participants knew that if they had symptoms of COVID-19 they should 'self-isolate'. However, only 62.8% (n = 48,058/76,562, 95% CI 62.4% to 63.1%) knew the main rules regarding what that meant. Younger people had less knowledge than older people, and men had less knowledge than women. Knowledge was lower in people living in England versus in Scotland, Wales, and Northern Ireland. The pattern of association between knowledge and trust in government was unclear. Knowledge was lower in people living in a more deprived area and those who did not believe they had enough information about self-isolation. Knowledge was lower in December 2020 to January 2021, compared with before and after this period. CONCLUSIONS: Approximately 63% of UK adults between November 2020 and February 2022 appeared to know the main rules regarding self-isolation if symptomatic with COVID-19. Knowledge was lower in younger than older people, men than women, those living in England compared with Scotland, Wales or Northern Ireland, and those living in more deprived areas.

Frameworks for Implementation, Uptake, and Use of Cardiometabolic Disease-Related Digital Health Interventions in Ethnic Minority Populations: Scoping Review.

BACKGROUND: Digital health interventions have become increasingly common across health care, both before and during the COVID-19 pandemic. Health inequalities, particularly with respect to ethnicity, may not be considered in frameworks that address the implementation of digital health interventions. We considered frameworks to include any models, theories, or taxonomies that describe or predict implementation, uptake, and use of digital health interventions. OBJECTIVE: We aimed to assess how health inequalities are addressed in frameworks relevant to the implementation, uptake, and use of digital health interventions; health and ethnic inequalities; and interventions for cardiometabolic disease. METHODS: SCOPUS, PubMed, EMBASE, Google Scholar, and gray literature were searched to identify papers on frameworks relevant to the implementation, uptake, and use of digital health interventions; ethnically or culturally diverse populations and health inequalities; and interventions for cardiometabolic disease. We assessed the extent to which frameworks address health inequalities, specifically ethnic inequalities; explored how they were addressed; and developed recommendations for good practice. RESULTS: Of 58 relevant papers, 22 (38%) included frameworks that referred to health inequalities. Inequalities were conceptualized as society-level, system-level, intervention-level, and individual. Only 5 frameworks considered all levels. Three frameworks considered how digital health interventions might interact with or exacerbate existing health inequalities, and 3 considered the process of health technology implementation, uptake, and use and suggested opportunities to improve equity in digital health. When ethnicity was considered, it was often within the broader concepts of social determinants of health. Only 3 frameworks explicitly addressed ethnicity: one focused on culturally tailoring digital health interventions, and 2 were applied to management of cardiometabolic disease. CONCLUSIONS: Existing frameworks evaluate implementation, uptake, and use of digital health interventions, but to consider factors related to ethnicity, it is necessary to look across frameworks. We have developed a visual guide of the key constructs across the 4 potential levels of action for digital health inequalities, which can be used to support future research and inform digital health policies.

Psychological wellbeing in the English population during the COVID-19 pandemic: A series of cross-sectional surveys.

Psychological distress has been elevated during the COVID-19 pandemic. However, few studies published to date have investigated distress after the first wave of infections (Spring - Summer 2020). We investigated distress and wellbeing between April 2020 and April 2022 in England through a series of cross-sectional online surveys. People aged 16 years or over living in the UK were eligible for the surveys; for this study we selected only those living in England due to differences in restrictions between UK nations. Distress was measured using the PHQ4 (n = 60,921 responses), while wellbeing was measured using the Short Warwick-Edinburgh Mental Wellbeing Scale (n = 61,152 responses). Throughout, approximately 50%-60% of women and 40%-50% of men reported distress, higher than the 25%-30% of women, and 20%-25% of men reported in normative data. Wellbeing was also worse than population norms, with women reporting lower wellbeing than men. Rates of distress in the English population have been consistently high throughout the pandemic. Patterns of distress have broadly mirrored the pattern of restrictions and case numbers, but there are notable exceptions which indicate that other factors may play a part in population mental health.

Patterns of social mixing in England changed in line with restrictions during the COVID-19 pandemic (September 2020 to April 2022).

Social mixing contributes to the transmission of SARS-CoV-2. We developed a composite measure for risky social mixing, investigating changes during the pandemic and factors associated with risky mixing. Forty-five waves of online cross-sectional surveys were used (n = 78,917 responses; 14 September 2020 to 13 April 2022). We investigated socio-demographic, contextual and psychological factors associated with engaging in highest risk social mixing in England at seven timepoints. Patterns of social mixing varied over time, broadly in line with changes in restrictions. Engaging in highest risk social mixing was associated with being younger, less worried about COVID-19, perceiving a lower risk of COVID-19, perceiving COVID-19 to be a less severe illness, thinking the risks of COVID-19 were being exaggerated, not agreeing that one's personal behaviour had an impact on how COVID-19 spreads, and not agreeing that information from the UK Government about COVID-19 can be trusted. Our composite measure for risky social mixing varied in line with restrictions in place at the time of data collection, providing some validation of the measure. While messages targeting psychological factors may reduce higher risk social mixing, achieving a large change in risky social mixing in a short space of time may necessitate a reimposition of restrictions.

The mental health of staff working on intensive care units over the COVID-19 winter surge of 2020 in England: a cross sectional survey.

BACKGROUND: The COVID-19 pandemic generated a surge of critically ill patients greater than the capacity of the UK National Health Service (NHS). There have been multiple well-documented impacts associated with the national COVID-19 pandemic surge on ICU staff, including an increased prevalence of mental health disorders on a scale potentially sufficient to impair high-quality care delivery. We investigated the prevalence of five mental health outcomes; explored demographic and professional predictors of poor mental health outcomes; and describe the prevalence of functional impairment; and explore demographic and professional predictors of functional impairment in ICU staff over the 2020/2021 winter COVID-19 surge in England. METHODS: English ICU staff were surveyed before, during, and after the winter 2020/2021 surge using a survey which comprised validated measures of mental health. RESULTS: A total of 6080 surveys were completed, by ICU nurses (57.5%), doctors (27.9%), and other healthcare staff (14.5%). Reporting probable mental health disorders increased from 51% (before) to 64% (during), and then decreased to 46% (after). Younger, less experienced nursing staff were most likely to report probable mental health disorders. During and after the winter, >50% of participants met threshold criteria for functional impairment. Staff who reported probable post-traumatic stress disorder, anxiety, or depression were more likely to meet threshold criteria for functional impairment. CONCLUSIONS: The winter of 2020/2021 was associated with an increase in poor mental health outcomes and functional impairment amongst ICU staff during a period of peak caseload. These effects are likely to impact on patient care outcomes and the longer-term resilience of the healthcare workforce.

Engagement with protective behaviours in the UK during the COVID-19 pandemic: a series of cross-sectional surveys (the COVID-19 rapid survey of adherence to interventions and responses [CORSAIR] study).

BACKGROUND: Behaviour is key to suppressing the COVID-19 pandemic. Maintaining behaviour change can be difficult. We investigated engagement with hand cleaning, reducing the number of outings, and wearing a face covering over the course of the pandemic. METHODS: We used a series of 64 cross-sectional surveys between 10 February 2020 and 20 January 2022 (n ≈ 2000 per wave). Surveys investigated uptake of hand cleaning behaviours, out of home activity (England only, n ≈ 1700 per wave) and wearing a face covering (England only, restricted to those who reported going out shopping in the last week, n ≈ 1400 per wave). RESULTS: Reported hand cleaning has been high throughout the pandemic period (85 to 90% of participants consistently reporting washing their hands thoroughly and regularly with soap and water frequently or very frequently). Out of home activity has mirrored the easing and re-introduction of restrictive measures. Total number of outings were higher in the second national lockdown than in the first and third lockdowns. Wearing a face covering increased steadily between April to August 2020, plateauing until the end of measurement in May 2021, with approximately 80% of those who had been out shopping in the previous week reporting wearing a face covering frequently or very frequently. CONCLUSIONS: Engagement with protective behaviours increased at the start of the pandemic and has remained high since. The greatest variations in behaviour reflected changes to Government rules. Despite the duration of restrictions, people have continued to adopt personal protective behaviours that were intended to prevent the spread of COVID-19.

Worry and behaviour at the start of the COVID-19 outbreak: Results from three UK surveys (the COVID-19 rapid survey of Adherence to Interventions and responses [CORSAIR] study).

We aimed to describe worry and uptake of behaviours that prevent the spread of infection (respiratory and hand hygiene, distancing) in the UK at the start of the COVID-19 outbreak (January and February 2020) and to investigate factors associated with worry and adopting protective behaviours. Three cross-sectional online surveys of UK adults (28 to 30 January, n = 2016; 3 to 6 February, n = 2002; 10 to 13 February 2020, n = 2006) were conducted. We used logistic regressions to investigate associations between outcome measures (worry, respiratory and hand hygiene behaviour, distancing behaviour) and explanatory variables. 19.8% of participants (95% CI 18.8% to 20.8%) were very or extremely worried about COVID-19. People from minoritized ethnic groups were particularly likely to feel worried. 39.9% of participants (95% CI 37.7% to 42.0%) had completed one or more hand or respiratory hygiene behaviour more than usual in the last seven days. Uptake was associated with greater worry, perceived effectiveness of individual behaviours, self-efficacy for engaging in them, and having heard more information about COVID-19. 13.7% (95% CI 12.2% to 15.2%) had reduced the number of people they had met. This was associated with greater worry, perceived effectiveness, and self-efficacy. At the start of novel infectious disease outbreaks, communications should emphasise perceived effectiveness of behaviours and the ease with which they can be carried out.

Intention to adhere to test, trace, and isolate during the COVID-19 pandemic (the COVID-19 Rapid Survey of Adherence to Interventions and Responses study).

OBJECTIVES: (1) To investigate factors associated with intention to self-isolate, request a test, and share details of close contacts when required. (2) To determine whether associations were stronger during periods when less stringent national COVID-19 restrictions were in place. DESIGN: Series of cross-sectional nationally representative surveys. We selected survey waves where different national restrictions were in place in England (first lockdown, summer release, second lockdown, third lockdown). METHODS: We investigated whether psychological factors and increased out-of-home activity in the last week were associated with intention to self-isolate and request a test if you were to develop COVID-19 symptoms, and intention to share details of contacts if you were to test positive. We also investigated whether the strength of associations differed by timepoint in the pandemic. RESULTS: Intention to self-isolate, request a test and share details of contacts were associated with greater perceived risk of COVID-19 to people in the United Kingdom, knowing that COVID-19 transmission can be asymptomatic, and agreeing that personal behaviour has an impact on COVID-19 transmission. There were few differences in strength of associations by timepoint suggesting these effects are broadly stable over time. CONCLUSIONS: Psychological factors were associated with intention to adhere to key components of the contact tracing system; there was no evidence for an association with increased out-of-home activity. Messages that increase knowledge that COVID-19 can be transmitted even if someone does not have symptoms and that an individual's actions can contribute to the spread of the virus may promote engagement with the test, trace, and isolate system.

Holding a stigmatizing attitude at the start of the COVID-19 outbreak: A cross-sectional survey.

OBJECTIVES: To identify the prevalence of a stigmatizing attitude towards people of Chinese origin at the start of the COVID-19 outbreak in the UK population and investigate factors associated with holding the stigmatizing attitude. DESIGN: Online cross-sectional survey conducted 10-13 February 2020 (n = 2006, people aged 16 years or over and living in the UK). METHODS: We asked participants to what extent they agreed it was best to avoid areas heavily populated by Chinese people because of the COVID-19 outbreak. Survey materials also asked about: worry, perceived risk, knowledge, information receipt, perception of government response to COVID-19, and personal characteristics. We ran binary logistic regressions to investigate associations between holding a stigmatizing attitude, personal characteristics, and psychological and contextual factors. RESULTS: 26.1% people (95% CI 24.2-28.0%, n = 524/2006) agreed it was best to avoid areas heavily populated by Chinese people. Holding a stigmatizing attitude was associated with greater worry about COVID-19, greater perceived risk of COVID-19, and poorer knowledge about COVID-19. CONCLUSIONS: At the start of the COVID-19 pandemic, a large percentage of the UK public endorsed avoiding areas in the UK heavily populated by people of Chinese origin. This attitude was associated with greater worry about, and perceived risk of, the COVID-19 outbreak as well as poorer knowledge about COVID-19. At the start of future novel infectious disease outbreaks, proactive communications from official sources should provide context and facts to reduce uncertainty and challenge stigmatizing attitudes, to minimize harms to affected communities.

Benefits realization management in the context of a national digital transformation initiative in English provider organizations.

BACKGROUND: The Global Digital Exemplar (GDE) Programme is a national initiative to promote digitally enabled transformation in English provider organizations. The Programme applied benefits realization management techniques to promote and demonstrate transformative outcomes. This work was part of an independent national evaluation of the GDE Programme. AIMS: We explored how benefits realization management was approached and conceptualized in the GDE Programme. METHODS: We conducted a series of 36 longitudinal case studies of provider organizations participating in the GDE Programme, 12 of which were in depth. Data collection included a combination of 628 interviews (with implementation staff in provider organizations, national programme management staff, and suppliers), 499 documents (of national and local implementation plans and lessons learned), and 190 nonparticipant observations (of national and local programme management meetings to develop insights into the broader context of benefits realization activities, tensions arising, and how these were negotiated). Data were coded drawing on a sociotechnical framework developed in related work and thematically analyzed, initially within and then across cases, with the help of NVivo 11 software. RESULTS: Most stakeholders broadly agreed with the rationale of benefits realization in the GDE Programme to show due diligence that public money was appropriately spent, and to develop an evidence base supporting the value of digitally enabled transformation. Differing national and local reporting purposes, however, created tensions. Central requirements, for progress reporting and tracking high-level benefits, had limited perceived local value and were seen to impose an unnecessary burden on provider organizations. This was accentuated by the lack of harmonization of reporting requirements to different stakeholders (which differed in content and timing). There were tensions between the desire for early evidence of outcomes and the slow processes of infrastructural change (which created problems of attribution of benefits to causes as benefits emerged gradually and over long timeframes), and also between reporting immediately visible local changes and showing how these flowed through to high level organization wide benefits (eg, in terms of health outcomes or cost savings/return on investment). The attempt to fulfill these diverging agendas and informational needs within a single reporting tool had limited success. These difficulties were mitigated by efforts to simplify reporting requirements and to support targeted collection of key national outcome measures. Although progress was hampered by an initial lack of benefits realization expertise in provider organizations, some providers subsequently retained these skills for their own change management purposes. CONCLUSIONS: There is a need to recognize the limitations and cost of benefits realization management practices in the context of healthcare digitalization where benefits may materialize over long timeframes and in unanticipated ways. Although diverse stakeholder information needs may create tensions, prior agreement about rationales for collecting information and a targeted approach to tracking local and high-level benefits may enhance local relevance, reduce perceived reporting burdens, and improve acceptance/effectiveness. A single integrated reporting mechanism is unlikely to fulfill both national and local requirements.

Running App "Zombies, Run!" Users' Engagement with Physical Activity: A Qualitative Study.

Introduction: Sufficient physical activity (PA) is important for all aspects of health. Smartphone apps and the use of gamification, such as narrative-based augmented reality (AR), have a great potential to engage a variety of people in more PA. Zombies, Run! (ZR) is the world's most popular running exergame app and therefore a suitable model to understand what users find engaging. Objective: To understand people's motivation and experience of using a narrative-based AR exergame app ZR for PA. Materials and Methods: ZR users were randomly selected for interview from a quantitative ZR user's survey. Interviews which were guided by a semistructured topic guide were audio-recorded, transcribed, and analyzed using inductive and deductive thematic analysis. Results: Participants were 15 males and 15 females aged 16-53 years (mean = 36, SD = 10), from 13 countries, with the largest proportions from the United States (30%) and United Kingdom (23%). The majority (73%) used ZR while running, followed by cycling and walking. Four overarching themes that emerged were: "Reasons for starting and staying with ZR," "Preferred features," "Perceived effects of ZR," and "Pros and cons of the app." Sixteen subthemes included the attraction of gamification and narrative appeal, desire to add something fun to PA, or to distract from the negative physiological effects of PA. Users' favorite features were the feelings of immersion and presence through narrative, story line, and characters. The narrative motivated participants to engage in PA for longer sessions and encouraged long-term use. Conclusions: This study identified a number of factors that users found attractive in an AR running exergame, particularly narrative. Our findings suggest that ZR may engage people in exercise by modifying their perception of PA through a story line or narrative, dissociating the players from the effort of exertion. AR narrative-based apps may be an effective way of engaging people with health-related behaviors or habit-forming activities.

An Evaluation Service for Digital Public Health Interventions: User-Centered Design Approach.

BACKGROUND: Digital health interventions (DHIs) have the potential to improve public health by combining effective interventions and population reach. However, what biomedical researchers and digital developers consider an effective intervention differs, thereby creating an ongoing challenge to integrating their respective approaches when evaluating DHIs. OBJECTIVE: This study aims to report on the Public Health England (PHE) initiative set out to operationalize an evaluation framework that combines biomedical and digital approaches and demonstrates the impact, cost-effectiveness, and benefit of DHIs on public health. METHODS: We comprised a multidisciplinary project team including service designers, academics, and public health professionals and used user-centered design methods, such as qualitative research, engagement with end users and stakeholders, and iterative learning. The iterative approach enabled the team to sequentially define the problem, understand user needs, identify opportunity areas, develop concepts, test prototypes, and plan service implementation. Stakeholders, senior leaders from PHE, and a working group critiqued the outputs. RESULTS: We identified 26 themes and 82 user needs from semistructured interviews (N=15), expressed as 46 Jobs To Be Done, which were then validated across the journey of evaluation design for a DHI. We identified seven essential concepts for evaluating DHIs: evaluation thinking, evaluation canvas, contract assistant, testing toolkit, development history, data hub, and publish health outcomes. Of these, three concepts were prioritized for further testing and development, and subsequently refined into the proposed PHE Evaluation Service for public health DHIs. Testing with PHE's Couch-to-5K app digital team confirmed the viability, desirability, and feasibility of both the evaluation approach and the Evaluation Service. CONCLUSIONS: An iterative, user-centered design approach enabled PHE to combine the strengths of academic and biomedical disciplines with the expertise of nonacademic and digital developers for evaluating DHIs. Design-led methodologies can add value to public health settings. The subsequent service, now known as Evaluating Digital Health Products, is currently in use by health bodies in the United Kingdom and is available to others for tackling the problem of evaluating DHIs pragmatically and responsively.

Promoting inter-organisational knowledge sharing: A qualitative evaluation of England's Global Digital Exemplar and Fast Follower Programme.

BACKGROUND: The Global Digital Exemplar (GDE) Programme was designed to promote the digitisation of hospital services in England. Selected provider organisations that were reasonably digitally-mature were funded with the expectation that they would achieve internationally recognised levels of excellence and act as exemplars ('GDE sites') and share their learning with somewhat less digitally-mature Fast Follower (FF) sites. AIMS: This paper explores how partnerships between GDE and FF sites have promoted knowledge sharing and learning between organisations. METHODS: We conducted an independent qualitative longitudinal evaluation of the GDE Programme, collecting data across 36 provider organisations (including acute, mental health and speciality), 12 of which we studied as in-depth ethnographic case studies. We used a combination of semi-structured interviews with programme leads, vendors and national policy leads, non-participant observations of meetings and workshops, and analysed national and local documents. This allowed us to explore both how inter-organisational learning and knowledge sharing was planned, and how it played out in practice. Thematic qualitative analysis, combining findings from diverse data sources, was facilitated by NVivo 11 and drew on sociotechnical systems theory. RESULTS: Formally established GDE and FF partnerships were perceived to enhance learning and accelerate adoption of technologies in most pairings. They were seen to be most successful where they had encouraged, and were supported by, informal knowledge networking, driven by the mutual benefits of information sharing. Informal networking was enhanced where the benefits were maximised (for example where paired sites had implemented the same technological system) and networking costs minimised (for example by geographical proximity, prior links and institutional alignment). Although the intervention anticipated uni-directional learning between exemplar sites and 'followers', in most cases we observed a two-way flow of information, with GDEs also learning from FFs, through informal networking which also extended to other health service providers outside the Programme. The efforts of the GDE Programme to establish a learning ecosystem has enhanced the profile of shared learning within the NHS. CONCLUSIONS: Inter-organisational partnerships have produced significant gains for both follower (FF) and exemplar (GDE) sites. Formal linkages were most effective where they had facilitated, and were supported by, informal networking. Informal networking was driven by the mutual benefits of information sharing and was optimised where sites were well aligned in terms of technology, geography and culture. Misalignments that created barriers to networking between organisations in a few cases were attributed to inappropriate choice of partners. Policy makers seeking to promote learning through centrally directed mechanisms need to create a framework that enables networking and informal knowledge transfer, allowing local organisations to develop bottom-up collaboration and exchanges, where they are productive, in an organic manner.

Adherence to the test, trace, and isolate system in the UK: results from 37 nationally representative surveys.

OBJECTIVE: To investigate rates of adherence to the UK's test, trace, and isolate system over the initial 11 months of the covid-19 pandemic. DESIGN: Series of cross sectional online surveys. SETTING: 37 nationally representative surveys in the UK, 2 March 2020 to 27 January 2021. PARTICIPANTS: 74 697 responses from 53 880 people living in the UK, aged 16 years or older (37 survey waves, about 2000 participants in each wave). MAIN OUTCOME MEASURES: Identification of the main symptoms of covid-19 (cough, high temperature or fever, and loss of sense of smell or taste), self-reported adherence to self-isolation if symptoms were present and intention to self-isolate if symptoms were to develop, requesting a test for covid-19 if symptoms were present and intention to request a test if symptoms were to develop, and intention to share details of close contacts. RESULTS: Only 51.5% of participants (95% confidence interval 51.0% to 51.9%, n=26 030/50 570) identified the main symptoms of covid-19; the corresponding values in the most recent wave of data collection (25-27 January 2021) were 50.8% (48.6% to 53.0%, n=1019/2007). Across all waves, duration adjusted adherence to full self-isolation was 42.5% (95% confidence interval 39.7% to 45.2%, n=515/1213); in the most recent wave of data collection (25-27 January 2021), it was 51.8% (40.8% to 62.8%, n=43/83). Across all waves, requesting a test for covid-19 was 18.0% (95% confidence interval 16.6% to 19.3%, n=552/3068), increasing to 22.2% (14.6% to 29.9%, n=26/117) from 25 to 27 January. Across all waves, intention to share details of close contacts was 79.1% (95% confidence interval 78.8% to 79.5%, n=36 145/45 680), increasing to 81.9% (80.1% to 83.6%, n=1547/1890) from 25 to 27 January. Non-adherence was associated with being male, younger age, having a dependent child in the household, lower socioeconomic grade, greater financial hardship during the pandemic, and working in a key sector. CONCLUSIONS: Levels of adherence to test, trace, and isolate are low, although some improvement has occurred over time. Practical support and financial reimbursement are likely to improve adherence. Targeting messaging and policies to men, younger age groups, and key workers might also be necessary.

Using Blueprints to promote interorganizational knowledge transfer in digital health initiatives-a qualitative exploration of a national change program in English hospitals.

OBJECTIVE: The Global Digital Exemplar (GDE) Program is a national attempt to accelerate digital maturity in healthcare providers through promoting knowledge transfer across the English National Health Service (NHS). "Blueprints"-documents capturing implementation experience-were intended to facilitate this knowledge transfer. Here we explore how Blueprints have been conceptualized, produced, and used to promote interorganizational knowledge transfer across the NHS. MATERIALS AND METHODS: We undertook an independent national qualitative evaluation of the GDE Program. This involved collecting data using semistructured interviews with implementation staff and clinical leaders in provider organizations, nonparticipant observation of meetings, and key documents. We also attended a range of national meetings and conferences, interviewed national program managers, and analyzed a range of policy documents. Our analysis drew on sociotechnical principles, combining deductive and inductive methods. RESULTS: Data comprised 508 interviews, 163 observed meetings, and analysis of 325 documents. We found little evidence of Blueprints being adopted in the manner originally conceived by national program managers. However, they proved effective in different ways to those planned. As well as providing a helpful initial guide to a topic, we found that Blueprints served as a method of identifying relevant expertise that paved the way for subsequent discussions and richer knowledge transfers amongst provider organizations. The primary value of Blueprinting, therefore, seemed to be its role as a networking tool. Members of different organizations came together in developing, applying, and sustaining Blueprints through bilateral conversations-in some circumstances also fostering informal communities of practice. CONCLUSIONS: Blueprints may be effective in facilitating knowledge transfer among healthcare organizations, but need to be accompanied by other evolving methods, such as site visits and other networking activities, to iteratively transfer knowledge and experience.