Sankey diagrams can clarify 'evidence attrition': A systematic review and meta-analysis of the effectiveness of rapid diagnostic tests for antimicrobial resistance.

OBJECTIVES: To demonstrate, using the example of a new systematic review of rapid diagnostic tests, how Sankey diagrams, alongside the PRISMA guidelines, can (i) facilitate reporting of the quality of the evidence base and (ii) help assess evidence syntheses when studies use heterogeneous outcomes. METHODS: Systematic review and meta-analysis of experimental and observational studies which included at least one prescribing or clinical outcome of RDTs in hospital in-patients. Sub-group analysis was used to assess heterogeneity in summary effect estimates. A Sankey diagram was then used to show the pattern and quality of evidence on RDT outcomes. RESULTS: 57 studies from 14 countries were included. The introduction of RDTs did not significantly reduce in-hospital mortality (RR 0.83, 95% CI 0.60 - 1.15) or length of stay (weighted mean difference = -0.36, 95% CI -1.67 to 0.96). There was high heterogeneity in outcomes. CONCLUSION: There is no clear evidence that the routine use of RDTs for bacterial identification and antibiotic susceptibility testing improves clinical outcomes in hospital in-patients. Sankey diagrams may be a useful further way succinctly to present the pattern and quality of evidence in systematic reviews, especially when it is heterogeneous and not easily amenable to meta-analysis.

Quality and Utility of Information Captured by Surveillance Systems Relevant to Antimicrobial Resistance (AMR): A Systematic Review.

Health surveillance systems are considered vital for combatting antimicrobial resistance (AMR); however, the evidence-base on the effectiveness of these systems in providing information that can be used by healthcare professionals, or the acceptability of these systems by users, has not been reviewed. A systematic review was conducted of a number of databases to synthesise the evidence. The review identified 43 studies that met the inclusion criteria, conducted in 18 countries and used 11 attributes in their assessment of surveillance systems. The majority of systems evaluated were for monitoring the incidence of tuberculosis. The studies found that most surveillance systems were underperforming in key attributes that relate to both effectiveness and acceptability. We identified that two features of systems (ease of use and users' awareness of systems) were associated with greater acceptability and completeness of systems. We recommend prioritising these for the improvement of existing systems, as well as ensuring consistency in the definition of attributes studied, to allow a more consistent approach in evaluations of surveillance systems, and to facilitate the identification of the attributes that have the greatest impact on the utility of data produced.

The case for developing a cohesive systems approach to research across unhealthy commodity industries.

OBJECTIVES: Most non-communicable diseases are preventable and largely driven by the consumption of harmful products, such as tobacco, alcohol, gambling and ultra-processed food and drink products, collectively termed unhealthy commodities. This paper explores the links between unhealthy commodity industries (UCIs), analyses the extent of alignment across their corporate political strategies, and proposes a cohesive systems approach to research across UCIs. METHODS: We held an expert consultation on analysing the involvement of UCIs in public health policy, conducted an analysis of business links across UCIs, and employed taxonomies of corporate political activity to collate, compare and illustrate strategies employed by the alcohol, ultra-processed food and drink products, tobacco and gambling industries. RESULTS: There are clear commonalities across UCIs' strategies in shaping evidence, employing narratives and framing techniques, constituency building and policy substitution. There is also consistent evidence of business links between UCIs, as well as complex relationships with government agencies, often allowing UCIs to engage in policy-making forums. This knowledge indicates that the role of all UCIs in public health policy would benefit from a common approach to analysis. This enables the development of a theoretical framework for understanding how UCIs influence the policy process. It highlights the need for a deeper and broader understanding of conflicts of interests and how to avoid them; and a broader conception of what constitutes strong evidence generated by a wider range of research types. CONCLUSION: UCIs employ shared strategies to shape public health policy, protecting business interests, and thereby contributing to the perpetuation of non-communicable diseases. A cohesive systems approach to research across UCIs is required to deepen shared understanding of this complex and interconnected area and also to inform a more effective and coherent response.

Non-market strategy as a framework for exploring commercial involvement in health policy: A primer.

This paper outlines the role of non-market strategy and its relevance to public health. Three broad categories of non-market activity are described: corporate political activity, Corporate Social Responsibility (CSR) and legal activity, with examples relevant to public health. The importance to public health researchers of considering business activity through a non-market lens has been outlined. Using a non-market strategy perspective can assist with understanding the commercial determinants of health and analysing the writing of the 'rules of the game'.

Views of health care professionals and policy-makers on the use of surveillance data to combat antimicrobial resistance.

BACKGROUND: Providing healthcare professionals with health surveillance data aims to support professional and organisational behaviour change. The UK Five Year Antimicrobial Resistance (AMR) Strategy 2013 to 2018 identified better access to and use of surveillance data as a key component. Our aim was to determine the extent to which data on antimicrobial use and resistance met the perceived needs of health care professionals and policy-makers at national, regional and local levels, and how provision could be improved. METHODS: We conducted 41 semi-structured interviews with national policy makers in the four Devolved Administrations and 71 interviews with health care professionals in six locations across the United Kingdom selected to achieve maximum variation in terms of population and health system characteristics. Transcripts were analysed thematically using a mix of a priori reasoning guided by the main topics in the interview guide together with themes emerging inductively from the data. Views were considered at three levels - primary care, secondary care and national - and in terms of availability of data, current uses, benefits, gaps and potential improvements. RESULTS: Respondents described a range of uses for prescribing and resistance data. The principal gaps identified were prescribing in private practice, internet prescribing and secondary care (where some hospitals did not have electronic prescribing systems). Some respondents under-estimated the range of data available. There was a perception that the responsibility for collecting and analysing data often rests with a few individuals who may lack sufficient time and appropriate skills. CONCLUSIONS: There is a need to raise awareness of data availability and the potential value of these data, and to ensure that data systems are more accessible. Any skills gap at local level in how to process and use data needs to be addressed. This requires an identification of the best methods to improve support and education relating to AMR data systems.

Overview of Evidence of Antimicrobial Use and Antimicrobial Resistance in the Food Chain.

Antimicrobial resistance (AMR) is a global health problem. Bacteria carrying resistance genes can be transmitted between humans, animals and the environment. There are concerns that the widespread use of antimicrobials in the food chain constitutes an important source of AMR in humans, but the extent of this transmission is not well understood. The aim of this review is to examine published evidence on the links between antimicrobial use (AMU) in the food chain and AMR in people and animals. The evidence showed a link between AMU in animals and the occurrence of resistance in these animals. However, evidence of the benefits of a reduction in AMU in animals on the prevalence of resistant bacteria in humans is scarce. The presence of resistant bacteria is documented in the human food supply chain, which presents a potential exposure route and risk to public health. Microbial genome sequencing has enabled the establishment of some links between the presence of resistant bacteria in humans and animals but, for some antimicrobials, no link could be established. Research and monitoring of AMU and AMR in an integrated manner is essential for a better understanding of the biology and the dynamics of antimicrobial resistance.

The Public Health Responsibility Deal: Using a Systems-Level Analysis to Understand the Lack of Impact on Alcohol, Food, Physical Activity, and Workplace Health Sub-Systems.

The extent to which government should partner with business interests such as the alcohol, food, and other industries in order to improve public health is a subject of ongoing debate. A common approach involves developing voluntary agreements with industry or allowing them to self-regulate. In England, the most recent example of this was the Public Health Responsibility Deal (RD), a public⁻private partnership launched in 2011 under the then Conservative-led coalition government. The RD was organised around a series of voluntary agreements that aim to bring together government, academic experts, and commercial, public sector and voluntary organisations to commit to pledges to undertake actions of public health benefit. This paper brings together the main findings and implications of the evaluation of the RD using a systems approach. We analysed the functioning of the RD exploring the causal pathways involved and how they helped or hindered the RD; the structures and processes; feedback loops and how they might have constrained or potentiated the effects of the RD; and how resilient the wider systems were to change (i.e., the alcohol, food, and other systems interacted with). Both the production and uptake of pledges by RD partners were largely driven by the interests of partners themselves, enabling these wider systems to resist change. This analysis demonstrates how and why the RD did not meet its objectives. The findings have lessons for the development of effective alcohol, food and other policies, for defining the role of unhealthy commodity industries, and for understanding the limits of industry self-regulation as a public health measure.

Systems Thinking as a Framework for Analyzing Commercial Determinants of Health.

Policy Points: Worldwide, more than 70% of all deaths are attributable to noncommunicable diseases (NCDs), nearly half of which are premature and apply to individuals of working age. Although such deaths are largely preventable, effective solutions continue to elude the public health community. One reason is the considerable influence of the "commercial determinants of health": NCDs are the product of a system that includes powerful corporate actors, who are often involved in public health policymaking. This article shows how a complex systems perspective may be used to analyze the commercial determinants of NCDs, and it explains how this can help with (1) conceptualizing the problem of NCDs and (2) developing effective policy interventions. CONTEXT: The high burden of noncommunicable diseases (NCDs) is politically salient and eminently preventable. However, effective solutions largely continue to elude the public health community. Two pressing issues heighten this challenge: the first is the public health community's narrow approach to addressing NCDs, and the second is the involvement of corporate actors in policymaking. While NCDs are often conceptualized in terms of individual-level risk factors, we argue that they should be reframed as products of a complex system. This article explores the value of a systems approach to understanding NCDs as an emergent property of a complex system, with a focus on commercial actors. METHODS: Drawing on Donella Meadows's systems thinking framework, this article examines how a systems perspective may be used to analyze the commercial determinants of NCDs and, specifically, how unhealthy commodity industries influence public health policy. FINDINGS: Unhealthy commodity industries actively design and shape the NCD policy system, intervene at different levels of the system to gain agency over policy and politics, and legitimize their presence in public health policy decisions. CONCLUSIONS: It should be possible to apply the principles of systems thinking to other complex public health issues, not just NCDs. Such an approach should be tested and refined for other complex public health challenges.

The Public Health Responsibility Deal: making the workplace healthier?

Background: The Public Health Responsibility Deal (RD) in England is a public-private partnership which aims to improve public health by addressing issues such as health at work. This paper analyses the RD health at work pledges in terms of their likely effectiveness and added value. Methods: A review of evidence on the effectiveness of the RD 'health at work' pledges to improve health in the workplace; analysis of publically available data on signatory organizations' plans and progress towards achieving the pledges; and assessment of the likelihood that workplace activities pledged by signatories were brought about by participating in the RD. Results: The 'health at work' pledges mostly consist of information sharing activities, and could be more effective if made part of integrated environmental change at the workplace. The evaluation of organizations' plans and progress suggests that very few actions (7%) were motivated by participation in the RD, with most organizations likely (57%) or probably (36%) already engaged in the activities they listed before joining the RD. Conclusions: The RD's 'health at work' pledges are likely to contribute little to improving workplace health as they stand but could contribute more if they were incorporated into broader, coherent workplace health strategies.

Health information on alcoholic beverage containers: has the alcohol industry's pledge in England to improve labelling been met?

AIMS: In the United Kingdom, alcohol warning labels are the subject of a voluntary agreement between industry and government. In 2011, as part of the Public Health Responsibility Deal in England, the industry pledged to ensure that 80% of products would have clear, legible health warning labelling, although an analysis commissioned by Portman found that only 57.1% met best practice. We assessed what proportion of alcohol products now contain the required health warning information, and its clarity and placement. DESIGN: Survey of alcohol labelling data. SETTING: United Kingdom. PARTICIPANTS: Analysis of the United Kingdom's 100 top-selling alcohol brands (n = 156 individual products). MEASUREMENTS: We assessed the product labels in relation to the presence of five labelling elements: information on alcohol units, government consumption guidelines, pregnancy warnings, reference to the Drinkaware website and a responsibility statement. We also assessed the size, colour and placement of text, and the size and colouring of the pregnancy warning logo. FINDINGS: The first three (required) elements were present on 77.6% of products examined. The mean font size of the Chief Medical Officer's (CMO) unit guidelines (usually on the back of the product) was 8.17-point. The mean size of pregnancy logos was 5.95 mm. The pregnancy logo was on average smaller on wine containers. CONCLUSIONS: The UK Public Health Responsibility Deal alcohol labelling pledge has not been fully met. Labelling information frequently falls short of best practice, with font and logos smaller than would be accepted on other products with health effects.

An evaluation of the Public Health Responsibility Deal: Informants' experiences and views of the development, implementation and achievements of a pledge-based, public-private partnership to improve population health in England.

OBJECTIVES: The Coalition Government's Public Health Responsibility Deal (RD) was launched in England in 2011 as a public-private partnership designed to improve public health in the areas of food, alcohol, health at work and physical activity. As part of a larger evaluation, we explored informants' experiences and views about the RD's development, implementation and achievements. METHODS: We conducted 44 semi-structured interviews with 50 interviewees, purposively sampled from: RD partners (businesses, public sector and non-governmental organisations); individuals with formal roles in implementing the RD; and non-partners and former partners. Data were analysed thematically: NVivo (10) software was employed to manage the data. RESULTS: Key motivations underpinning participation were corporate social responsibility and reputational enhancement. Being a partner often involved making pledges related to work already underway or planned before joining the RD, suggesting limited 'added value' from the RD, although some pledge achievements (e.g., food reformulation) were described. Benefits included access to government, while drawbacks included resource implications and the risk of an 'uneven playing field' between partners and non-partners. CONCLUSIONS: To ensure that voluntary agreements like the RD produce gains to public health that would not otherwise have occurred, government needs to: increase participation and compliance through incentives and sanctions, including those affecting organisational reputation; create greater visibility of voluntary agreements; and increase scrutiny and monitoring of partners' pledge activities.

Are the Public Health Responsibility Deal alcohol pledges likely to improve public health? An evidence synthesis.

AIMS: The English Public Health Responsibility Deal (RD) is a public-private partnership involving voluntary pledges between industry, government and other actors in various areas including alcohol, and designed to improve public health. This paper reviews systematically the evidence underpinning four RD alcohol pledges. METHODS: We conducted a systematic review of reviews of the evidence underpinning interventions proposed in four RD alcohol pledges, namely alcohol labelling, tackling underage alcohol sales, advertising and marketing alcohol, and alcohol unit reduction. In addition, we included relevant studies of interventions where these had not been covered by a recent review. RESULTS: We synthesized the evidence from 14 reviews published between 2002 and 2013. Overall, alcohol labelling is likely to be of limited effect on consumption: alcohol unit content labels can help consumers assess the alcohol content of drinks; however, labels promoting drinking guidelines and pregnancy warning labels are unlikely to influence drinking behaviour. Responsible drinking messages are found to be ambiguous, and industry-funded alcohol prevention campaigns can promote drinking instead of dissuading consumption. Removing advertising near schools can contribute to reducing underage drinking; however, community mobilization and law enforcement are most effective. Finally, reducing alcohol consumption is more likely to occur if there are incentives such as making lower-strength alcohol products cheaper. CONCLUSIONS: The most effective evidence-based strategies to reduce alcohol-related harm are not reflected consistently in the RD alcohol pledges. The evidence is clear that an alcohol control strategy should support effective interventions to make alcohol less available and more expensive.

The Public Health Responsibility deal: has a public-private partnership brought about action on alcohol reduction?

BACKGROUND AND AIMS: The Public Health Responsibility Deal (RD) in England is a public-private partnership involving voluntary pledges between industry, government and other organizations, with the aim of improving public health. This paper aims to evaluate what action resulted from the RD alcohol pledges. METHODS: We analysed publically available data on organizations' plans and progress towards achieving key alcohol pledges of the RD. We assessed the extent to which activities pledged by signatories could have been brought about by the RD, as opposed to having happened anyway (the counterfactual), using a validated coding scheme designed for the purpose. RESULTS: Progress reports were submitted by 92% of signatories in 2013 and 75% of signatories in 2014, and provided mainly descriptive feedback rather than quantifiable performance metrics. Approximately 14% of 2014 progress reports were identical to those presented in 2013. Most organizations (65%) signed pledges that involved actions to which they appear to have been committed already, regardless of the RD. A small but influential group of alcohol producers and retailers reported taking measures to reduce alcohol units available for consumption in the market. However, where reported, these measures appear to involve launching and promoting new lower-alcohol products rather than removing units from existing products. CONCLUSIONS: The RD is unlikely to have contributed significantly to reducing alcohol consumption, as most alcohol pledge signatories appear to have committed to actions that they would have undertaken anyway, regardless of the RD. Irrespective of this, there is considerable scope to improve the clarity of progress reports and reduce the variability of metrics provided by RD pledge signatories.

Potential impact of removing general practice boundaries in England: a policy analysis.

In 2015, the UK government plans to widen patient choice of general practitioner (GP) to improve access through the voluntary removal of practice boundaries in the English NHS. This follows a 12-month pilot in four areas where volunteer GP practices accepted patients from outside their boundaries. Using evidence from the pilot evaluation, we discuss the likely impact of this policy change on patient experience, responsiveness and equity of access. Patients reported positive experiences but in a brief pilot in four areas, it was not possible to assess potential demand, the impact on quality of care or health outcomes. In the rollout, policymakers and commissioners will need to balance the access needs of local residents against the demands of those coming into the area. The rollout should include full information for prospective patients; monitoring and understanding patterns of patient movement between practices and impact on practice capacity; and ensuring the timely transfer of clinical information between providers. This policy has the potential to improve choice and convenience for a sub-group of the population at lower marginal costs than new provision. However, there are simpler, less costly, ways of improving convenience, such as extending opening hours or offering alternatives to face-to-face consultation.

The Public Health Responsibility Deal: how should such a complex public health policy be evaluated?

BACKGROUND: The Public Health Responsibility Deal (RD) in England was launched in 2011 as a public-private partnership which aims to 'tap into the potential for businesses and other influential organisations to make a significant contribution to improving public health by helping us to create this environment'. It has come under criticism from public health advocates and others, who have suggested that it will be ineffective or perhaps even harmful. Like many public health policies, there have also been demands to know whether it 'works'. METHODS: We conducted a scoping review and used this, supplemented with interviews with stakeholders, to develop a detailed logic model of the RD (presented here) to help understand its likely outcomes and the pathways by which these may be achieved as a basis for planning an evaluation. CONCLUSIONS: Evaluations of complex interventions require not just assessment of effects (including outcomes), but also a clear conceptualization of the intervention and its processes. The way the RD and the pledges made by participant organizations has been presented makes it difficult at this stage to evaluate whether the RD 'works' in terms of improving health. Instead, any evaluation needs to put together a jigsaw of evidence about processes, mechanisms and potential future health and non-health impacts, in part using the current scientific evidence. This task is ongoing.

Voluntary agreements between government and business - a scoping review of the literature with specific reference to the Public Health Responsibility Deal.

OBJECTIVES: A scoping review was conducted to synthesise the findings of evaluations of voluntary agreements between business and government. It aimed to summarise the types of agreements that exist, how they work in practice, the conditions for their success and how they had been evaluated. METHODS: Voluntary agreements were included if they involved a transparent signing-up process and where businesses agreed to carry out specific actions or to achieve specific outcomes. Studies of any design published in English were included. RESULTS: 47 studies were identified. Voluntary agreements may help to improve relationships between government and business, and can help both parties agree on target-setting and data-sharing. Governments may also use the experience to help develop subsequent legislation. For voluntary agreements to be successful, targets should be ambitious and clearly defined, with robust independent monitoring. Public knowledge of agreements can help encourage participation and ensure compliance. CONCLUSIONS: If properly implemented and monitored, voluntary agreements can be an effective policy approach, though there is little evidence on whether they are more effective than compulsory approaches. Some of the most effective voluntary agreements include substantial disincentives for non-participation and sanctions for non-compliance. Many countries are moving towards these more formal approaches to voluntary agreements.