If Providing Best Care Means Being at the Cutting Edge of Research, Should It Be Implemented System-wide? Comment on "'We're Not Providing the Best Care If We Are Not on the Cutting Edge of Research': A Research Impact Evaluation at a Regional Australian Hospital and Health Service".

The COVID-19 pandemic intensified debates about the desirability of integrating health research systems into healthcare systems. An excellent evaluation undertaken prior to the pandemic examined a purposeful strategy to improve healthcare through an expansion in research capacity in the Townsville Hospital and Health Service (THHS), a regional service in northern Queensland. This comment puts that evaluation into a rapidly developing wider context, drawing on other work showing an association between research engagement in healthcare organisations and their improved healthcare. In most previous studies this impact arose as a by-product of the research activity. The Townsville scheme went further. But while the evaluation identified some progress and impacts, they were patchy, not system-wide. Recent pre-pandemic studies showed that going even further and integrating a health research system across a national healthcare system markedly improved healthcare, despite continuing challenges. The UK's research experiences during COVID-19 are giving additional momentum to this approach globally.

Saving millions of lives but some resources squandered: emerging lessons from health research system pandemic achievements and challenges.

During the SARS-CoV-2 pandemic, astonishingly rapid research averted millions of deaths worldwide through new vaccines and repurposed and new drugs. Evidence use informed life-saving national policies including non-pharmaceutical interventions. Simultaneously, there was unprecedented waste, with many underpowered trials on the same drugs. We identified lessons from COVID-19 research responses by applying WHO's framework for research systems. It has four functions-governance, securing finance, capacity-building, and production and use of research-and nine components. Two linked questions focused the analysis. First, to what extent have achievements in knowledge production and evidence use built on existing structures and capacity in national health research systems? Second, did the features of such systems mitigate waste? We collated evidence on seven countries, Australia, Brazil, Canada, Germany, New Zealand, the United Kingdom and the United States, to identify examples of achievements and challenges.We used the data to develop lessons for each framework component. Research coordination, prioritization and expedited ethics approval contributed to rapid identification of new therapies, including dexamethasone in the United Kingdom and Brazil. Accelerated vaccines depended on extensive funding, especially through the Operation Warp Speed initiative in the United States, and new platforms created through long-term biomedical research capacity in the United Kingdom and, for messenger ribonucleic acid (mRNA) vaccines, in Canada, Germany and the United States. Research capacity embedded in the United Kingdom's healthcare system resulted in trial acceleration and waste avoidance. Faster publication of research saved lives, but raised challenges. Public/private collaborations made major contributions to vastly accelerating new products, available worldwide, though unequally. Effective developments of living (i.e. regularly updated) reviews and guidelines, especially in Australia and Canada, extended existing expertise in meeting users' needs. Despite complexities, effective national policy responses (less evident in Brazil, the United Kingdom and the United States) also saved lives by drawing on health research system features, including collaboration among politicians, civil servants and researchers; good communications; and willingness to use evidence. Comprehensive health research strategies contributed to success in research production in the United Kingdom and in evidence use by political leadership in New Zealand. In addition to waste, challenges included equity issues, public involvement and non-COVID research. We developed recommendations, but advocate studies of further countries.

Research can be integrated into public health policy-making: global lessons for and from Spanish economic evaluations.

WHO promotes the use of research in policy-making to drive improvements in health, including in achieving Sustainable Development Goals such as tobacco control. The European Union's new €95 billion Horizon Europe research framework programme parallels these aims, and also includes commitments to fund economic evaluations. However, researchers often express frustration at the perceived lack of attention to scientific evidence during policy-making. For example, some researchers claim that evidence regarding the return on investment from optimal implementation of evidence-based policies is frequently overlooked. An increasingly large body of literature acknowledges inevitable barriers to research use, but also analyses facilitators encouraging such use. This opinion piece describes how some research is integrated into policy-making. It highlights two recent reviews. One examines impact assessments of 36 multi-project research programmes and identifies three characteristics of projects more likely to influence policy-making. These include a focus on healthcare system needs, engagement of stakeholders, and research conducted for organizations supported by structures to receive and use evidence. The second review suggests that such characteristics are likely to occur as part of a comprehensive national health research system strategy, especially one integrated into the healthcare system. We also describe two policy-informing economic evaluations conducted in Spain. These examined the most cost-effective package of evidence-based tobacco control interventions and the cost-effectiveness of different strategies to increase screening coverage for cervical cancer. Both projects focused on issues of healthcare concern and involved considerable stakeholder engagement. The Spanish examples reinforce some lessons from the global literature and, therefore, could help demonstrate to authorities in Spain the value of developing comprehensive health research systems, possibly following the interfaces and receptor model. The aim of this would be to integrate needs assessment and stakeholder engagement with structures spanning the research and health systems. In such structures, economic evaluation evidence could be collated, analysed by experts in relation to healthcare needs, and fed into both policy-making as appropriate, and future research calls. The increasingly large local and global evidence base on research utilization could inform detailed implementation of this approach once accepted as politically desirable. Given the COVID-19 pandemic, increasing the cost-effectiveness of healthcare systems and return on investment of public health interventions becomes even more important.

A systems approach for optimizing implementation to impact: meeting report and proceedings of the 2019 In the Trenches: Implementation to Impact International Summit.

BACKGROUND: The In the Trenches series of cutting-edge knowledge sharing events on impact for front-line experts and practitioners provides an engagement platform for diverse stakeholders across government, research funding organizations, industry, and academia to share emerging knowledge and practical experiences. The second event of the series In the Trenches: Implementation to Impact International Summit was held in Banff, Alberta, Canada, on June 7-8, 2019. The overarching vision for the Summit was to create an engagement platform for addressing key challenges and finding practical solutions to move from implementation (i.e. putting findings into effect) to impact (i.e. creating benefits to society and the economy). PROCESSES AND PROCEEDINGS: The Summit used diverse approaches to facilitate active engagement and knowledge sharing between 80 delegates across sectors and jurisdictions. Summit sessions mostly consisted of short talks and moderated panels grouped into eight thematic sessions. Each presentation included a summary of Key Messages, along with a summary of the Actionable Insights which concluded each session. The presentations and discussions are analysed, synthesized and described in this proceedings paper using a systems approach. This demonstrates how the Summit focused on each of the necessary functions (and associated components) that should be undertaken, and combined, for effective research and innovation: stewardship and governance, securing finance, creating capacity, and producing and using research. The approach also identifies relevant challenges. CONCLUSIONS: There is increased interest globally in the benefits that can accrue from adopting a systems approach to research and innovation. Various organizations in Canada and internationally have made considerable progress on Implementation to Impact, often as a result of well-planned initiatives. The Summit highlights the value of 1) collaboration between researchers and potential users, and 2) the adoption by funders of approaches involving an increasing range of responsibilities and activities. The Summit website (https://inthetrenchessummit.com/) will be periodically updated with new resources and information about future In the Trenches events.

From COVID-19 research to vaccine application: why might it take 17 months not 17 years and what are the wider lessons?

It is often said that it takes 17 years to move medical research from bench to bedside. In a coronavirus disease (COVID-19) world, such time-lags feel intolerable. In these extraordinary circumstances could years be made into months? If so, could those lessons be used to accelerate medical research when the crisis eases?To measure time-lags in health and biomedical research as well as to identify ways of reducing them, we developed and published (in 2015) a matrix consisting of overlapping tracks (or stages/phases) in the translation from discovery research to developed products, policies and practice. The matrix aids analysis by highlighting the time and actions required to develop research (and its translation) both (1) along each track and (2) from one track to another, e.g. from the discovery track to the research-in-humans track. We noted four main approaches to reducing time-lags, namely increasing resources, working in parallel, starting or working at risk, and improving processes.Examining these approaches alongside the matrix helps interpret the enormous global effort to develop a vaccine for the 2019 novel coronavirus SARS-CoV-2, the causative agent of COVID-19. Rapid progress in the discovery/basic and human research tracks is being made through a combination of large-scale funding, work being conducted in parallel (between different teams globally and through working in overlapping tracks), working at greater (but proportionate) risk to safety than usual, and adopting various new processes. The overlapping work of some of the teams involves continuing animal research whilst entering vaccine candidates into Phase I trials alongside planning their Phase II trials. The additional funding available helps to reduce some of the usual financial risks in moving so quickly. Going forward through the increasingly large human trials for safety, dosage and efficacy, it will be vital to overlap work in parallel in the often challenging public policy and clinical tracks. Thus, regulatory and reimbursement bodies are beginning and preparing rapid action to pull vaccines proving to be safe and effective through to extraordinarily rapid application to the general population. Monitoring the development of a COVID-19 vaccine using the matrix (modified as necessary) could help identify which of the approaches speeding development and deployment could be usefully applied more widely in the future.

How to strengthen a health research system: WHO's review, whose literature and who is providing leadership?

BACKGROUND: Health research is important for the achievement of the Sustainable Development Goals. However, there are many challenges facing health research, including securing sufficient funds, building capacity, producing research findings and using both local and global evidence, and avoiding waste. A WHO initiative addressed these challenges by developing a conceptual framework with four functions to guide the development of national health research systems. Despite some progress, more is needed before health research systems can meet their full potential of improving health systems. The WHO Regional Office for Europe commissioned an evidence synthesis of the systems-level literature. This Opinion piece considers its findings before reflecting on the vast additional literature available on the range of specific health research system functions related to the various challenges. Finally, it considers who should lead research system strengthening. MAIN TEXT: The evidence synthesis identifies two main approaches for strengthening national health research systems, namely implementing comprehensive and coherent strategies and participation in partnerships. The literature describing these approaches at the systems level also provides data on ways to strengthen each of the four functions of governance, securing financing, capacity-building, and production and use of research. Countries effectively implementing strategies include England, Ireland and Rwanda, whereas West Africa experienced effective partnerships. Recommended policy approaches for system strengthening are context specific. The vast literature on each function and the ever-growing evidence-base are illustrated by considering papers in just one key journal, Health Research Policy and Systems, and analysing the contribution of two national studies. A review of the functions of the Iranian system identifies over 200 relevant and mostly national records; an analysis of the creation of the English National Institute for Health Research describes the key leadership role played by the health department. Furthermore, WHO is playing leadership roles in helping coordinate partnerships within and across health research systems that have been attempting to tackle the COVID-19 crisis. CONCLUSIONS: The evidence synthesis provides a firm basis for decision-making by policy-makers and research leaders looking to strengthen national health research systems within their own national context. It identifies five crucial policy approaches - conducting situation analysis, sustaining a comprehensive strategy, engaging stakeholders, evaluating impacts on health systems, and partnership participation. The vast and ever-growing additional literature could provide further perspectives, including on crucial leadership roles for health ministries.

What is the evidence on policies, interventions and tools for establishing and/or strengthening national health research systems and their effectiveness?

High-quality research is important for improving population health and well-being and for achieving the health-related Sustainable Development Goals. The challenges facing individuals, organizations and countries in securing research funding and building research capacity, and then using these resources effectively, have led to renewed interest in adopting a systems approach to national health research systems strengthening. This report found that health research strategies play a key role in combining the diverse interventions to strengthen specific health research system functions into an overall system. Good practices in research systems strengthening were identified as health ministry involvement in and sustained political commitment to the comprehensive research strategy, and, where appropriate, integration of the health research system into the wider health system. Policy considerations include actions to ensure a contextual analysis to inform a comprehensive strategy; stakeholder engagement, including in priority-setting; monitoring and evaluation tools focused on system objectives; and partnerships.

What is the evidence on policies, interventions and tools for establishing and/or strengthening national health research systems and their effectiveness?

High-quality research is important for improving population health and well-being and for achieving the health-related Sustainable Development Goals. The challenges facing individuals, organizations and countries in securing research funding and building research capacity, and then using these resources effectively, have led to renewed interest in adopting a systems approach to national health research systems strengthening. This report found that health research strategies play a key role in combining the diverse interventions to strengthen specific health research system functions into an overall system. Good practices in research systems strengthening were identified as health ministry involvement in and sustained political commitment to the comprehensive research strategy, and, where appropriate, integration of the health research system into the wider health system. Policy considerations include actions to ensure a contextual analysis to inform a comprehensive strategy; stakeholder engagement, including in priority-setting; monitoring and evaluation tools focused on system objectives; and partnerships.

Health research systems in change: the case of 'Push the Pace' in the National Institute for Health Research.

BACKGROUND: Those running well-organised health research systems are likely to be alert for ways in which they might increase the quality of the services they provide and address any problems identified. This is important because the efficiency of the research system can have a major impact on how long it takes for new treatments to be developed and reach patients. This opinion piece reflects on the experience and learning of the United Kingdom-based National Institute for Health Research (NIHR) when it implemented continuous improvement activity to improve its processes. DISCUSSION: This paper describes the structure and work of the NIHR and why, despite is successes as a health research system and ongoing local continuous improvement, it believed in the value of an organisation-wide continuous improvement activity. It did this by implementing an approach called 'Push the Pace'. Initially, the organisation focused on reducing the amount of time it took for research to transition from an early concept to evidence that changes lives. This scrutiny enabled the NIHR to realise further areas of improvement it could make - additional goals were increased transparency, process simplification, and improved customer and stakeholder experience. We discuss our experience of Push the Pace with reference to literature on continuous improvement. CONCLUSION: Continuous improvement is a cycle, an activity that is done constantly and over time, rather than an act or linear activity (such as Push the Pace). We believe that the work of Push the Pace has initiated a strong commitment to a culture of continuous improvement in the NIHR. This is significant because culture change is widely recognised as immensely challenging, particularly in such a large and distributed organisation. However, our biggest challenge will be to enable all staff and stakeholders of the NIHR to participate in the continuous improvement cycle.

How to engage stakeholders in research: design principles to support improvement.

BACKGROUND: Closing the gap between research production and research use is a key challenge for the health research system. Stakeholder engagement is being increasingly promoted across the board by health research funding organisations, and indeed by many researchers themselves, as an important pathway to achieving impact. This opinion piece draws on a study of stakeholder engagement in research and a systematic literature search conducted as part of the study. MAIN BODY: This paper provides a short conceptualisation of stakeholder engagement, followed by 'design principles' that we put forward based on a combination of existing literature and new empirical insights from our recently completed longitudinal study of stakeholder engagement. The design principles for stakeholder engagement are organised into three groups, namely organisational, values and practices. The organisational principles are to clarify the objectives of stakeholder engagement; embed stakeholder engagement in a framework or model of research use; identify the necessary resources for stakeholder engagement; put in place plans for organisational learning and rewarding of effective stakeholder engagement; and to recognise that some stakeholders have the potential to play a key role. The principles relating to values are to foster shared commitment to the values and objectives of stakeholder engagement in the project team; share understanding that stakeholder engagement is often about more than individuals; encourage individual stakeholders and their organisations to value engagement; recognise potential tension between productivity and inclusion; and to generate a shared commitment to sustained and continuous stakeholder engagement. Finally, in terms of practices, the principles suggest that it is important to plan stakeholder engagement activity as part of the research programme of work; build flexibility within the research process to accommodate engagement and the outcomes of engagement; consider how input from stakeholders can be gathered systematically to meet objectives; consider how input from stakeholders can be collated, analysed and used; and to recognise that identification and involvement of stakeholders is an iterative and ongoing process. CONCLUSION: It is anticipated that the principles will be useful in planning stakeholder engagement activity within research programmes and in monitoring and evaluating stakeholder engagement. A next step will be to address the remaining gap in the stakeholder engagement literature concerned with how we assess the impact of stakeholder engagement on research use.

Estimating the returns to United Kingdom publicly funded musculoskeletal disease research in terms of net value of improved health outcomes.

BACKGROUND: Building on an approach applied to cardiovascular and cancer research, we estimated the economic returns from United Kingdom public- and charitable-funded musculoskeletal disease (MSD) research that arise from the net value of the improved health outcomes in the United Kingdom. METHODS: To calculate the economic returns from MSD-related research in the United Kingdom, we estimated (1) the public and charitable expenditure on MSD-related research in the United Kingdom between 1970 and 2013; (2) the net monetary benefit (NMB), derived from the health benefit in quality adjusted life years (QALYs) valued in monetary terms (using a base-case value of a QALY of £25,000) minus the cost of delivering that benefit, for a prioritised list of interventions from 1994 to 2013; (3) the proportion of NMB attributable to United Kingdom research; and (4) the elapsed time between research funding and health gain. The data collected from these four key elements were used to estimate the internal rate of return (IRR) from MSD-related research investments on health benefits. We analysed the uncertainties in the IRR estimate using a one-way sensitivity analysis. RESULTS: Expressed in 2013 prices, total expenditure on MSD-related research from 1970 to 2013 was £3.5 billion, and for the period used to estimate the rate of return, 1978-1997, was £1.4 billion. Over the period 1994-2013 the key interventions analysed produced 871,000 QALYs with a NMB of £16 billion, allowing for the net NHS costs resulting from them and valuing a QALY at £25,000. The proportion of benefit attributable to United Kingdom research was 30% and the elapsed time between funding and impact of MSD treatments was 16 years. Our best estimate of the IRR from MSD-related research was 7%, which is similar to the 9% for CVD and 10% for cancer research. CONCLUSIONS: Our estimate of the IRR from the net health gain to public and charitable funding of MSD-related research in the United Kingdom is substantial, and justifies the research investments made between 1978 and 1997. We also demonstrated the applicability of the approach previously used in assessing the returns from cardiovascular and cancer research. Inevitably, with a study of this kind, there are a number of important assumptions and caveats that we highlight, and these can inform future research.

'Knowledge for better health' revisited - the increasing significance of health research systems: a review by departing Editors-in-Chief.

How can nations organise research investments to obtain the best bundle of knowledge and the maximum level of improved health, spread as equitably as possible? This question was the central focus of a major initiative from WHO led by Prof Tikki Pang, which resulted in a range of developments, including the publication of a conceptual framework for national health research systems - Knowledge for better health - in 2003, and in the founding of the journal Health Research Policy and Systems (HARPS). As Editors-in-Chief of the journal since 2006, we mark our retirement by tracking both the progress of the journal and the development of national health research systems. HARPS has maintained its focus on a range of central themes that are key components of a national health research system in any country. These include building capacity to conduct and use health research, identifying appropriate priorities, securing funds and allocating them accountably, producing scientifically valid research outputs, promoting the use of research in polices and practice in order to improve health, and monitoring and evaluating the health research system. Some of the themes covered in HARPS are now receiving increased attention and, for example, with the assessment of research impact and development of knowledge translation platforms, the journal has covered their progress throughout that expansion of interest. In addition, there is increasing recognition of new imperatives, including the importance of promoting gender equality in health research if benefits are to be maximised. In this Editorial, we outline some of the diverse and developing perspectives considered within each theme, as well as considering how they are held together by the growing desire to build effective health research systems in all countries.From 2003 until mid-June 2017, HARPS published 590 articles on the above and related themes, with authors being located in 76 countries. We present quantitative data tracing the journal's growth and the increasing external recognition of its role. We thank the many colleagues who have kindly contributed to the journal's success, and finish on an exciting note by welcoming the new Editors-in-Chief who will take HARPS forward.

Building health research systems: WHO is generating global perspectives, and who's celebrating national successes?

In 2016, England's National Institute for Health Research (NIHR) celebrated its tenth anniversary as an innovative national health research system with a focus on meeting patients' needs. This provides a good opportunity to reflect on how the creation of the NIHR has greatly enhanced important work, started in 1991, to develop a health research system in England that is embedded in the National Health Service.In 2004, WHO identified a range of functions that a national health research system should undertake to improve the health of populations. Health Research Policy and Systems (HRPS) has taken particular interest in the pioneering developments in the English health research system, where the comprehensive approach has covered most, if not all, of the functions identified by WHO. Furthermore, several significant recent developments in thinking about health research are relevant for the NIHR and have informed accounts of its achievements. These include recognition of the need to combat waste in health research, which had been identified as a global problem in successive papers in the Lancet, and an increasing emphasis on demonstrating impact. Here, pioneering evaluation of United Kingdom research, conducted through the impact case studies of the Research Excellence Framework, is particularly important. Analyses informed by these and other approaches identified many aspects of NIHR's progress in combating waste, building and sustaining research capacity, creating centres of research excellence linked to leading healthcare institutions, developing research networks, involving patients and others in identifying research needs, and producing and adopting research findings that are improving health outcomes.The NIHR's overall success, and an analysis of the remaining problems, might have lessons for other systems, notwithstanding important advances in many countries, as described in papers in HRPS and elsewhere. WHO's recently established Global Observatory for Health Research and Development provides an opportunity to promote some of these lessons. To inform its work, the Observatory is sponsoring a thematic series of papers in HRPS focusing on health research issues such as funding flows, priority setting, capacity building, utilisation and equity. While important papers on these have been published, this series is still open to new submissions.

Does the engagement of clinicians and organisations in research improve healthcare performance: a three-stage review.

OBJECTIVE: There is a widely held assumption that engagement by clinicians and healthcare organisations in research improves healthcare performance at various levels, but little direct empirical evidence has previously been collated. The objective of this study was to address the question: Does research engagement (by clinicians and organisations) improve healthcare performance? METHODS: An hourglass-shaped review was developed, consisting of three stages: (1) a planning and mapping stage; (2) a focused review concentrating on the core question of whether or not research engagement improves healthcare performance; and (3) a wider (but less systematic) review of papers identified during the two earlier stages, focusing on mechanisms. RESULTS: Of the 33 papers included in the focused review, 28 identified improvements in health services performance. Seven out of these papers reported some improvement in health outcomes, with others reporting improved processes of care. The wider review demonstrated that mechanisms such as collaborative and action research can encourage some progress along the pathway from research engagement towards improved healthcare performance. Organisations that have deliberately integrated the research function into organisational structures demonstrate how research engagement can, among other factors, contribute to improved healthcare performance. CONCLUSIONS: Current evidence suggests that there is an association between the engagement of individuals and healthcare organisations in research and improvements in healthcare performance. The mechanisms through which research engagement might improve healthcare performance overlap and rarely act in isolation, and their effectiveness often depends on the context in which they operate.

Health research improves healthcare: now we have the evidence and the chance to help the WHO spread such benefits globally.

There has been a dramatic increase in the body of evidence demonstrating the benefits that come from health research. In 2014, the funding bodies for higher education in the UK conducted an assessment of research using an approach termed the Research Excellence Framework (REF). As one element of the REF, universities and medical schools in the UK submitted 1,621 case studies claiming to show the impact of their health and other life sciences research conducted over the last 20 years. The recently published results show many case studies were judged positively as providing examples of the wide range and extensive nature of the benefits from such research, including the development of new treatments and screening programmes that resulted in considerable reductions in mortality and morbidity.Analysis of specific case studies yet again illustrates the international dimension of progress in health research; however, as has also long been argued, not all populations fully share the benefits. In recognition of this, in May 2013 the World Health Assembly requested the World Health Organization (WHO) to establish a Global Observatory on Health Research and Development (R&D) as part of a strategic work-plan to promote innovation, build capacity, improve access, and mobilise resources to address diseases that disproportionately affect the world's poorest countries.As editors of Health Research Policy and Systems (HARPS), we are delighted that our journal has been invited to help inform the establishment of the WHO Global Observatory through a Call for Papers covering a range of topics relevant to the Observatory, including topics on which HARPS has published articles over the last few months, such as approaches to assessing research results, measuring expenditure data with a focus on R&D, and landscape analyses of platforms for implementing R&D. Topics related to research capacity building may also be considered. The task of establishing a Global Observatory on Health R&D to achieve the specified objectives will not be easy; nevertheless, this Call for Papers is well timed - it comes just at the point where the evidence of the benefits from health research has been considerably strengthened.

How long does biomedical research take? Studying the time taken between biomedical and health research and its translation into products, policy, and practice.

BACKGROUND: The time taken, or 'time lags', between biomedical/health research and its translation into health improvements is receiving growing attention. Reducing time lags should increase rates of return to such research. However, ways to measure time lags are under-developed, with little attention on where time lags arise within overall timelines. The process marker model has been proposed as a better way forward than the current focus on an increasingly complex series of translation 'gaps'. Starting from that model, we aimed to develop better methods to measure and understand time lags and develop ways to identify policy options and produce recommendations for future studies. METHODS: Following reviews of the literature on time lags and of relevant policy documents, we developed a new approach to conduct case studies of time lags. We built on the process marker model, including developing a matrix with a series of overlapping tracks to allow us to present and measure elements within any overall time lag. We identified a reduced number of key markers or calibration points and tested our new approach in seven case studies of research leading to interventions in cardiovascular disease and mental health. Finally, we analysed the data to address our study's key aims. RESULTS: The literature review illustrated the lack of agreement on starting points for measuring time lags. We mapped points from policy documents onto our matrix and thus highlighted key areas of concern, for example around delays before new therapies become widely available. Our seven completed case studies demonstrate we have made considerable progress in developing methods to measure and understand time lags. The matrix of overlapping tracks of activity in the research and implementation processes facilitated analysis of time lags along each track, and at the cross-over points where the next track started. We identified some factors that speed up translation through the actions of companies, researchers, funders, policymakers, and regulators. Recommendations for further work are built on progress made, limitations identified and revised terminology. CONCLUSIONS: Our advances identify complexities, provide a firm basis for further methodological work along and between tracks, and begin to indicate potential ways of reducing lags.

Four centuries on from Bacon: progress in building health research systems to improve health systems?

In 1627, Francis Bacon's New Atlantis described a utopian society in which an embryonic research system contributed to meeting the needs of the society. In this editorial, we use some of the aspirations described in New Atlantis to provide a context within which to consider recent progress in building health research systems to improve health systems and population health. In particular, we reflect on efforts to build research capacity, link research to policy, identify the wider impacts made by the science, and generally build fully functioning research systems to address the needs identified. In 2014, Health Research Policy and Systems has continued to publish one-off papers and article collections covering a range of these issues in both high income countries and low- and middle-income countries. Analysis of these contributions, in the context of some earlier ones, is brought together to identify achievements, challenges and possible ways forward. We show how 2014 is likely to be a pivotal year in the development of ways to assess the impact of health research on policies, practice, health systems, population health, and economic benefits.We demonstrate how the increasing focus on health research systems will contribute to realising the hopes expressed in the World Health Report, 2013, namely that all nations would take a systematic approach to evaluating the outputs and applications resulting from their research investment.

Estimating the returns to UK publicly funded cancer-related research in terms of the net value of improved health outcomes.

BACKGROUND: Building on an approach developed to assess the economic returns to cardiovascular research, we estimated the economic returns from UK public and charitable funded cancer-related research that arise from the net value of the improved health outcomes. METHODS: To assess these economic returns from cancer-related research in the UK we estimated: 1) public and charitable expenditure on cancer-related research in the UK from 1970 to 2009; 2) net monetary benefit (NMB), that is, the health benefit measured in quality adjusted life years (QALYs) valued in monetary terms (using a base-case value of a QALY of GB£25,000) minus the cost of delivering that benefit, for a prioritised list of interventions from 1991 to 2010; 3) the proportion of NMB attributable to UK research; 4) the elapsed time between research funding and health gain; and 5) the internal rate of return (IRR) from cancer-related research investments on health benefits. We analysed the uncertainties in the IRR estimate using sensitivity analyses to illustrate the effect of some key parameters. RESULTS: In 2011/12 prices, total expenditure on cancer-related research from 1970 to 2009 was £15 billion. The NMB of the 5.9 million QALYs gained from the prioritised interventions from 1991 to 2010 was £124 billion. Calculation of the IRR incorporated an estimated elapsed time of 15 years. We related 17% of the annual NMB estimated to be attributable to UK research (for each of the 20 years 1991 to 2010) to 20 years of research investment 15 years earlier (that is, for 1976 to 1995). This produced a best-estimate IRR of 10%, compared with 9% previously estimated for cardiovascular disease research. The sensitivity analysis demonstrated the importance of smoking reduction as a major source of improved cancer-related health outcomes. CONCLUSIONS: We have demonstrated a substantive IRR from net health gain to public and charitable funding of cancer-related research in the UK, and further validated the approach that we originally used in assessing the returns from cardiovascular research. In doing so, we have highlighted a number of weaknesses and key assumptions that need strengthening in further investigations. Nevertheless, these cautious estimates demonstrate that the returns from past cancer research have been substantial, and justify the investments made during the period 1976 to 1995.