Connections between health research systems and decision-making spaces: lessons from the COVID-19 pandemic in the province of Québec, Canada.

The coronavirus 2019 (COVID-19) pandemic allowed for exceptional decision-making power to be placed in the hands of public health departments. Data and information were widely disseminated in the media and on websites. While the improvement of pandemic management is still a learning curve, the ecosystem perspective - that is, the interconnection of academic health research systems and decision-making spaces - has received little attention. In this commentary, we look at the mechanisms in place, or not, in Canada for ensuring decision-making spheres can "speak" to academic research systems. We look at the thick walls that are still in place between health research systems and decision-making spaces. More precisely, we discuss three organizational flaws that we identified in the evidence-informed decision-making ecosystem of Québec and, more broadly, Canada. We introduce some inspiring measures that other countries have implemented to better link evidence and public health decision-making during health crises. The observed flaws and options are related to the vitality of early information sharing relays, the cross-sectional capacity to issue opinions, and the collection and integration of hard and soft data.

Inter-individual relationships within a Canadian SPOR research network: a social network study.

BACKGROUND: Efforts have been made by health research granting agencies to bring research closer to patients' concerns. In Canada, such efforts were formalized in 2011 with the funding of the Strategy for Patient-Oriented Research (SPOR)'s research networks to address research priorities identified by patients and accelerate the translation of research findings into patient care and health care policy. Among these networks, SPOR Diabetes Action Canada (DAC) has created patient-partner circles to facilitate their integration within the network. The nature of the relationships within this atypical patient-oriented research network is systematically explored in this paper. METHODS: A cross-sectional social network study was conducted among the SPOR DAC's network members to examine inter-individual interactions, and the topics discussed the most between members. Descriptive data analyses were conducted to explore which discussion topics were discussed most among members whose primary roles were research, administration, governance, and patient representation. RESULTS: The response rate was 51.9%, providing data on 76.5% of the maximum number of connections in the network. The survey captured 2763 inter-individual relationships. Responses to a sub-question inserted in the survey show that 482 of these relationships (17,4%) existed before joining the network in collaboration on a research project. Most ties captured in the survey were yearly or quarterly, while few relationships were monthly, weekly, or daily. In measured relationships, members discussed several topics, the most frequent being scientific research, patient engagement, network coordination and governance, and operations and management. The topics associated with the most significant proportion of relationships captured in the survey were scientific research (45.4%) and patient engagement (40.7%). Management & operations and governance & coordination follow, corresponding to 24.3 and 23.9% of the captured relationships. All discussion topic subnetworks were either somewhat or highly centralized, meaning that relationships were not equally distributed among members involved in these discussions. Of the 1256 relationships involving exchanges about scientific research, 647 (51.5%) involved a researcher, 419 (33.3%) an administrator, 182 (14.5%) a patient partner, and 82 (6.5%) a member whose primary role is network governance. CONCLUSIONS: Scientific research and patient engagement were the most common topics discussed, consistent with the patient-centered research at the heart of the SPOR Diabetes Action Canada network. The study identified several relationships where a patient partner has discussed scientific research with a researcher. However, relationships involving research discussions were three times more common between a researcher and an administrator than between a researcher and a patient partner, although twice as many patient partners as administrators participated in the survey. The institutionalization of patient-partner involvement in large research networks is an evolving practice for which optimal engagement methods are still being explored.

Impacts of online and group perinatal education: a mixed methods study protocol for the optimization of perinatal health services.

BACKGROUND: Prenatal education is a core component of perinatal care and services provided by health institutions. Whereas group prenatal education is the most common educational model, some health institutions have opted to implement online prenatal education to address accessibility issues as well as the evolving needs of future parents. Various studies have shown that prenatal education can be effective in acquisition of knowledge on labour and delivery, reducing psychological distress and maximising father's involvement. However, these results may depend on educational material, organization, format and content. Furthermore, the effectiveness of online prenatal education compared to group prenatal education remains unclear in the literature. This project aims to evaluate the impacts of group prenatal education and online prenatal education on health determinants and users' health status, as well as on networks of perinatal educational services maintained with community-based partners. METHODS: This multipronged mixed methods study uses a collaborative research approach to integrate and mobilize knowledge throughout the process. It consists of: 1) a prospective cohort study with quantitative data collection and qualitative interviews with future and new parents; and 2) a multiple case study integrating documentary sources and interviews with stakeholders involved in the implementation of perinatal information service networks and collaborations with community partners. Perinatal health indicators and determinants will be compared between prenatal education groups (group prenatal education and online prenatal education) and standard care without these prenatal education services (control group). DISCUSSION: This study will provide knowledge about the impact of online prenatal education as a new technological service delivery model compared to traditional group prenatal education. Indicators related to the complementarity of these interventions and those available in community settings will refine our understanding of regional perinatal services networks. Results will assist decision-making regarding service organization and delivery models of prenatal education services. PROTOCOL VERSION: Version 1 (February 9 2018).

Portrait of rural emergency departments in Québec and utilization of the provincial emergency department management Guide: cross sectional survey.

BACKGROUND: Rural emergency departments (EDs) constitute crucial safety nets for the 20% of Canadians who live in rural areas. Pilot data suggests that the province of Québec appears to provide more comprehensive access to services than do other provinces. A difference that may be attributable to provincial policy/guidelines "the provincial ED management Guide". The aim of this study was to provide a detailed description of rural EDs in Québec and utilization of the provincial ED management Guide. METHODS: We selected EDs offering 24/7 medical coverage, with hospitalization beds, located in rural or small towns. We collected data via telephone, paper, and online surveys with rural ED/hospital staff. Data were also collected from Québec's Ministry of Health databases and from Statistics Canada. We computed descriptive statistics, ANOVA and t-tests were used to examine the relationship between ED census, services and inter-facility transfer requirements. RESULTS: A total of 23 of Québec's 26 rural EDs (88%) consented to participate in the study. The mean annual ED visits was 18 813 (Standard Deviation = 6 151). Thirty one percent of ED physicians were recent graduates with fewer than 5 years of experience. Only 6 % had residency training or certification in emergency medicine. Teams have good local access (24/7) to diagnostic equipment such as CT scanner (74%), intensive unit care (78%) and general surgical services (78%), but limited access to other consultants. Sixty one percent of participants have reported good knowledge of the provincial ED management Guide, but only 23% of them have used the guidelines. Furthermore, more than 40% of EDs were more than 300 km from levels 1 to 2 trauma centers, and only 30% had air transport access. CONCLUSIONS: Rural EDs in Québec are staffed by relatively new graduates working as solo physicians in well-resourced and moderately busy (by rural standards) EDs. The provincial ED management Guide may have contributed to this model of service attribution. However, the majority of rural ED staff report limited knowledge or use of the provincial ED management Guide and increased efforts at disseminating this Guide are warranted.

A process evaluation accompanying an attempted randomized controlled trial of an evidence service for health system policymakers.

BACKGROUND: We developed an evidence service that draws inputs from Health Systems Evidence (HSE), which is a comprehensive database of research evidence about governance, financial and delivery arrangements within health systems and about implementation strategies relevant to health systems. Our goal was to evaluate whether, how and why a 'full-serve' evidence service increases the use of synthesized research evidence by policy analysts and advisors in the Ontario Ministry of Health and Long-Term Care as compared to a 'self-serve' evidence service. METHODS: We attempted to conduct a two-arm, 10-month randomized controlled trial (RCT), along with a follow-up qualitative process evaluation, but we terminated the RCT when we failed to reach our recruitment target. For the qualitative process evaluation we modified the original interview guide to allow us to explore the (1) factors influencing participation in the trial; (2) usage of HSE, factors explaining usage patterns, and strategies to increase usage; (3) participation in training workshops and use of other supports; and (4) views about and experiences with key HSE features. RESULTS: We terminated the RCT given our 15% recruitment rate. Six factors were identified by those who had agreed to participate in the trial as encouraging their participation: relevance of the study to participants' own work; familiarity with the researchers; personal view of the importance of using research evidence in policymaking; academic background; support from supervisors; and participation of colleagues. Most reported that they never, infrequently or inconsistently used HSE and suggested strategies to increase its use, including regular email reminders and employee training. However, only two participants indicated that employee training, in the form of a workshop about finding and using research evidence, had influenced their use of HSE. Most participants found HSE features to be intuitive and helpful, although registration/sign-in and some page formats (particularly the advanced search page and detailed search results page) discouraged their use or did not optimize the user experience. CONCLUSIONS: The qualitative findings informed a re-design of HSE, which allows users to more efficiently find and use research evidence about how to strengthen or reform health systems or in how to get cost-effective programs, services and drugs to those who need them. Our experience with RCT recruitment suggests the need to consider changing the unit of allocation to divisions instead of individuals within divisions, among other lessons. TRIAL REGISTRATION: This protocol for this study is published in Implementation Science and registered with ClinicalTrials.gov ( HHS/FHS REB 10-267 ).

Electronic health record acceptance by physicians: testing an integrated theoretical model.

OBJECTIVE: Several countries are in the process of implementing an Electronic Health Record (EHR), but limited physicians' acceptance of this technology presents a serious threat to its successful implementation. The aim of this study was to identify the main determinants of physician acceptance of EHR in a sample of general practitioners and specialists of the Province of Quebec (Canada). METHODS: We sent an electronic questionnaire to physician members of the Quebec Medical Association. We tested four theoretical models (Technology acceptance model (TAM), Extended TAM, Psychosocial Model, and Integrated Model) using path analysis and multiple linear regression analysis in order to identify the main determinants of physicians' intention to use the EHR. We evaluated the modifying effect of sociodemographic characteristics using multi-group analysis of structural weights invariance. RESULTS: A total of 157 questionnaires were returned. The four models performed well and explained between 44% and 55% of the variance in physicians' intention to use the EHR. The Integrated model performed the best and showed that perceived ease of use, professional norm, social norm, and demonstrability of the results are the strongest predictors of physicians' intention to use the EHR. Age, gender, previous experience and specialty modified the association between those determinants and intention. CONCLUSIONS: The proposed integrated theoretical model is useful in identifying which factors could motivate physicians from different backgrounds to use the EHR. Physicians who perceive the EHR to be easy to use, coherent with their professional norms, supported by their peers and patients, and able to demonstrate tangible results are more likely to accept this technology. Age, gender, specialty and experience should also be taken into account when developing EHR implementation strategies targeting physicians.

Organizational readiness for knowledge translation in chronic care: a Delphi study.

BACKGROUND: Health-care organizations need to be ready prior to implement evidence-based interventions. In this study, we sought to achieve consensus on a framework to assess the readiness of health-care organizations to implement evidence-based interventions in the context of chronic care. METHODS: We conducted a web-based modified Delphi study between March and May 2013. We contacted 76 potentially eligible international experts working in the fields of organizational readiness (OR), knowledge translation (KT), and chronic care to comment upon the 76 elements resulting from our proposed conceptual map. This conceptual map was based on a systematic review of the existing frameworks of Organizational Readiness for Change (ORC) in health-care. We developed a conceptual map that proposed a set of core concepts and their associated 17 dimensions and 59 sub-dimensions. Experts rated their agreement concerning the applicability and importance of ORC elements on a 5-point Likert scale, where 1 indicates total disagreement and 5 indicates total agreement. Two rounds were needed to get a consensus from the experts. Consensus was a priori defined as strong (≥75%) or moderate (60-74%). Simple descriptive statistics was used. RESULTS: In total, 14 participants completed the first round and 10 completed the two rounds. Panel members reached consensus on the applicability and importance of 6 out of 17 dimensions and 28 out of 59 sub-dimensions to assess OR for KT in the context of chronic care. A strong level of consensus (≥75%) was attained on the Organizational contextual factors, Leadership/participation, Organizational support, and Motivation dimensions. The Organizational climate for change and Change content dimensions reached a moderate consensus (60-74%). Experts also reached consensus on 28 out of 59 sub-dimensions to assess OR for KT. Twenty-one sub-dimensions reached a strong consensus (≥75%) and seven a moderate consensus (60-74%). CONCLUSION: This study results provided the most important and applicable dimensions and sub-dimensions for assessing OR-KT in the context of chronic care. They can be used to guide the design of an assessment tool to improve knowledge translation in the field of chronic care.

Describing the state of a research network: A mixed methods approach to network evaluation.

Diabetes Action Canada Strategy for Patient-Oriented Research (SPOR) Network in Chronic Disease was formed in 2016 and is funded primarily through the Canadian Institutes of Health Research (CIHR). We propose a novel mixed-methods approach to a network evaluation integrating the State of Network Evaluation framework and the Canadian Academy of Health Sciences (CAHS) preferred framework and indicators. We measure key network themes of connectivity, health and results, and impact and return on investment associated with health research networks. Our methods consist of a longitudinal cross-sectional network survey of members and social network analysis to examine Network Connectivity and assess the frequency of interactions, the topics discussed during them, and how networking effectively facilitates interactions and collaboration among members. Network Health will be evaluated through semistructured interviews, a membership survey inquiring about satisfaction and experience with the Network, and a review of documentary sources related to funding and infrastructure to evaluate Network Sustainability. Finally, we will examine Network Results and Impact using the CAHS preferred framework and indicators to measure returns on investment in health research across the five domains of the CAHS framework, which include: advancing knowledge, capacity building, informing decision making, health impact, and economic and social impact. Indicators will be assessed with various methods, including bibliometric analyses, review of relevant documentary sources (annual reports), member activities informing health and research policy, and Patient Partner involvement. The Network Evaluation will provide members and stakeholders with information for planning, improvements, and funding future Network endeavors.

The Impact of Information Presentation and Cognitive Dissonance on Processing Systematic Review Summaries: A Randomized Controlled Trial on Bicycle Helmet Legislation.

Background: Summaries of systematic reviews are a reference method for the dissemination of research evidence on the effectiveness of public health interventions beyond the scientific community. Motivated reasoning and cognitive dissonance may interfere with readers' ability to process the information included in such summaries. Methods: We conducted a web experiment on a panel of university-educated North Americans (N = 259) using a systematic review of the effectiveness of bicycle helmet legislation as a test case. The outcome variables were the perceived tentativeness of review findings and attitude toward bicycle helmet legislation. We manipulated two types of uncertainty: (i) deficient uncertainty (inclusion vs. non-inclusion of information on limitations of the studies included in the review) and (ii) consensus uncertainty (consensual findings showing legislation effectiveness vs. no evidence of effectiveness). We also examined whether reported expertise in helmet legislation and the frequency of wearing a helmet while cycling interact with the experimental factors. Results: None of the experimental manipulations had a main effect on the perceived tentativeness. The presentation of consensual efficacy findings had a positive main effect on the attitude toward the legislation. Self-reported expertise had a significant main effect on the perceived tentativeness, and exposing participants with reported expertise to results showing a lack of evidence of efficacy increased their favorable attitude toward the legislation. Participants' helmet use was positively associated with their attitude toward the legislation (but not with perceived tentativeness). Helmet use did not interact with the experimental manipulations. Conclusions: Motivated reasoning and cognitive dissonance influence a reader's ability to process information contained in a systematic review summary.

Supporting the use of health technology assessments in policy making about health systems.

OBJECTIVES: The objective of this study is to profile the health technology assessments (HTAs) produced in Canada and other selected countries and assess their potential to inform policy making about health systems in jurisdictions other than the ones for which they were produced, and to develop and pilot test prototypes for packaging and assessing the relevance of HTAs for health system managers and policy makers. METHODS: We compiled an inventory of all HTAs that were produced by nine HTA agencies between September 2003 and August 2006; coded the title and abstract of each HTA according to the technologies assessed, methods used, and whether or not context-specific actionable messages were provided; developed a prototype for a structured, decision-relevant HTA summary and for a relevance-assessment form; and pilot-tested the prototypes using semistructured telephone interviews with a purposive sample of Canadian healthcare managers and policy makers. RESULTS: Our review of the 223 HTAs identified that: (i) 44 HTAs addressed health system arrangements (20 percent); (ii) 205 incorporated a systematic review (92 percent), whereas only 12 incorporated a sociopolitical assessment using explicit methods (5 percent); and (iii) 50 contained context-specific actionable messages (22 percent). Our interviews identified significant support for both the general idea of an HTA summary and the prototype's specific elements, but mixed views about using peer assessments of relevance. CONCLUSIONS: Those involved in supporting the use of HTAs in policy making about health systems may wish to produce structured decision-relevant summaries for their systematic review-containing HTAs to increase the prospects for their HTAs being used outside the jurisdiction for which they were produced.

A scoping review of knowledge syntheses in the field of evaluation across four decades of practice.

This scoping review of 62 knowledge syntheses published in evaluation-focused journals between 1979 and May 2018 provides a portrait of synthesis practices and their evolution in the mainstream of the field of evaluation. Concerns surrounding the production of knowledge syntheses to answer policy questions are not new in the field of evaluation. However, during this last decade, knowledge synthesis methods have expanded as a means to go beyond the limits and constraints of singular evaluations. This scoping review reveals and discusses two key issues with regards to the expansion of knowledge synthesis practices within the field of evaluation: the diversity-and muddling- of methodological practices and synthesis designs, and the frequent omission of quality appraisals.

The Quebec emergency department guide: A cross-sectional study to evaluate its use, perceived usefulness, and implementation in rural emergency departments.

OBJECTIVES: The Quebec Emergency Department Management Guide (QEDMG) is a unique document with 78 recommendations designed to improve the organization of emergency departments (EDs) in the province of Quebec. However, no study has examined how this guide is perceived or used by rural health care management. METHODS: We invited all directors of professional services (DPS), directors of nursing services (DNS), head nurses (HN), and emergency department directors (EDD) working in Quebec's rural hospitals to complete an online survey (144 questions). Simple frequency analyses (percentage [%] and 95% confidence interval) were conducted to establish general familiarity and use of the QEDMG, as well as perceived usefulness and implementation of its recommendations. RESULTS: Seventy-three percent (19/26) of Quebec's rural EDs participated in the study. A total of 82% (62/76) of the targeted stakeholders participated. Sixty-one percent of respondents reported being "moderately or a lot" familiar with the QEDMG, whereas 77% reported "almost never or sometimes" refer to this guide. Physician management (DPS, EDD) were more likely than nursing management (DNS and especially HN) to report "not at all" or "little" familiarity on use of the guide. Finally, 98% of the QEDMG recommendations were considered useful. CONCLUSIONS: Although the QEDMG is considered a useful guide for rural EDs, it is not optimally known or used in rural EDs, especially by physician management. Stakeholders should consider these findings before implementing the revised versions of the QEDMG.

Profile of trauma mortality and trauma care resources at rural emergency departments and urban trauma centres in Quebec: a population-based, retrospective cohort study.

OBJECTIVES: As Canada's second largest province, the geography of Quebec poses unique challenges for trauma management. Our primary objective was to compare mortality rates between trauma patients treated at rural emergency departments (EDs) and urban trauma centres in Quebec. As a secondary objective, we compared the availability of trauma care resources and services between these two settings. DESIGN: Retrospective cohort study. SETTING: 26 rural EDs and 33 level 1 and 2 urban trauma centres in Quebec, Canada. PARTICIPANTS: 79 957 trauma cases collected from Quebec's trauma registry. PRIMARY AND SECONDARY OUTCOME MEASURES: Our primary outcome measure was mortality (prehospital, ED, in-hospital). Secondary outcome measures were the availability of trauma-related services and staff specialties at rural and urban facilities. Multivariable generalised linear mixed models were used to determine the relationship between the primary facility and mortality. RESULTS: Overall, 7215 (9.0%) trauma patients were treated in a rural ED and 72 742 (91.0%) received treatment at an urban centre. Mortality rates were higher in rural EDs compared with urban trauma centres (13.3% vs 7.9%, p<0.001). After controlling for available potential confounders, the odds of prehospital or ED mortality were over three times greater for patients treated in a rural ED (OR 3.44, 95% CI 1.88 to 6.28). Trauma care setting (rural vs urban) was not associated with in-hospital mortality. Nearly all of the specialised services evaluated were more present at urban trauma centres. CONCLUSIONS: Trauma patients treated in rural EDs had a higher mortality rate and were more likely to die prehospital or in the ED compared with patients treated at an urban trauma centre. Our results were limited by a lack of accurate prehospital times in the trauma registry.

Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT.

BACKGROUND: Implementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services. METHODS: Based on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts - the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) - where 30 experts assessed the face validity of the three versions of OR4KT. RESULTS: We selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended. CONCLUSION: The OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare.

Enhancing the uptake of systematic reviews of effects: what is the best format for health care managers and policy-makers? A mixed-methods study.

BACKGROUND: Systematic reviews are infrequently used by health care managers (HCMs) and policy-makers (PMs) in decision-making. HCMs and PMs co-developed and tested novel systematic review of effects formats to increase their use. METHODS: A three-phased approach was used to evaluate the determinants to uptake of systematic reviews of effects and the usability of an innovative and a traditional systematic review of effects format. In phase 1, survey and interviews were conducted with HCMs and PMs in four Canadian provinces to determine perceptions of a traditional systematic review format. In phase 2, systematic review format prototypes were created by HCMs and PMs via Conceptboard©. In phase 3, prototypes underwent usability testing by HCMs and PMs. RESULTS: Two hundred two participants (80 HCMs, 122 PMs) completed the phase 1 survey. Respondents reported that inadequate format (Mdn = 4; IQR = 4; range = 1-7) and content (Mdn = 4; IQR = 3; range = 1-7) influenced their use of systematic reviews. Most respondents (76%; n = 136/180) reported they would be more likely to use systematic reviews if the format was modified. Findings from 11 interviews (5 HCMs, 6 PMs) revealed that participants preferred systematic reviews of effects that were easy to access and read and provided more information on intervention effectiveness and less information on review methodology. The mean System Usability Scale (SUS) score was 55.7 (standard deviation [SD] 17.2) for the traditional format; a SUS score < 68 is below average usability. In phase 2, 14 HCMs and 20 PMs co-created prototypes, one for HCMs and one for PMs. HCMs preferred a traditional information order (i.e., methods, study flow diagram, forest plots) whereas PMs preferred an alternative order (i.e., background and key messages on one page; methods and limitations on another). In phase 3, the prototypes underwent usability testing with 5 HCMs and 7 PMs, 11 out of 12 participants co-created the prototypes (mean SUS score 86 [SD 9.3]). CONCLUSIONS: HCMs and PMs co-created prototypes for systematic review of effects formats based on their needs. The prototypes will be compared to a traditional format in a randomized trial.

Health technology assessments conducted in health care facilities: A strategic practice? Findings from a content analysis of HTA reports.

In this paper, we test the hypothesis that health technology assessment units located in hospitals tend to be more optimistic toward technologies that are currently in use in their organization than technologies that are not. The data include 108 health technologies assessed in 87 full-scale health technology assessment reports produced by the four main local health technology assessment units in Quebec (Canada) on behalf of decision makers from the same facility. We found that 58 (53.7 percent) of the 108 technologies were currently in use within the hospital during their assessment. Based on the assessors' interpretation of the scientific evidence regarding the efficacy of the technologies, 67.3 percent of the technologies that were in use in the hospital during the evaluation were effective (56 percent for those that were not currently being used), but the difference is not statistically significant (chi-square 1.38; p = 0.24). Controlling for the efficacy judgment, the type of technologies (i.e. preventive, diagnostic, therapeutic or organizational), the number of technologies assessed in the report and the assessment unit, we found that the technologies that were currently in use in the facility during the evaluation were 62 percent more likely to be recommended favorably by the assessment unit than the technologies that were not currently being used (RR = 1.62; 95 percent CI = 1.06-1.88). This suggests that the local health technology units that were examined in the study tended to be more optimistic toward technologies that were currently in use in their hospital at the time of the evaluation.

Rural emergency care 360°: mobilising healthcare professionals, decision-makers, patients and citizens to improve rural emergency care in the province of Quebec, Canada: a qualitative study protocol.

INTRODUCTION: Emergency departments (EDs) are an important safety net for rural populations. Results of our earlier studies suggest that rural Canadian hospitals have limited access to advanced imaging services and intensive care units and that patients are transferred over large distances. They also revealed significant geographical variations in rural services. In the absence of national standards, our studies raise questions about inequities in rural access to emergency services and the risks for citizens. Our goal is to build recommendations for improving services by mobilising stakeholders interested in rural emergency care. With help and full engagement of stakeholders, we will (1) identify solutions for improving quality and performance in rural EDs; (2) formulate and prioritise recommendations; (3) transfer knowledge of the recommendations to rural EDs and support operationalisation and (4) assess knowledge transfer and explore further impacts of this participatory action research project. METHODOLOGY: We will use a participatory action research approach. We will plan for a governance structure that includes all stakeholders’ representatives, so throughout this project, stakeholders are fully engaged at every step. Our sample will be 26 EDs in rural Quebec. We will conduct semistructured individual and focus group interviews with relevant and representative participants, including patients and citizens (estimated n=200). Interviews will be thematically analysed to extract potential solutions and other qualitative information.An expert panel (±15) will use an analysis grid to develop consensus recommendations from solutions suggested and will evaluate feasibility, impacts, costs, conditions for implementation and establish monitoring indicators. Recommendations will be transferred to stakeholders using tailored knowledge translation strategies (web platform, meetings and so on). DISCUSSION AND EXPECTED RESULTS: This study will result in a comprehensive consensus list of feasible and high-priority recommendations enabling decision-makers in emergency care to implement improvements in rural emergency care in Quebec. ETHICS AND DISSEMINATION: This protocol has been approved by the CSSS Alphonse-Desjardins research ethics committee (Project number: MP 2017-009). The qualitative material will be kept confidential and the data will be presented in a way that respects confidentiality. The dissemination plan for the study includes publications in scientific and professional journals. We will also use social media to disseminate our findings and activities such as communications in public conferences.

What factors induce health care decision-makers to use clinical guidelines? Evidence from provincial health ministries, regional health authorities and hospitals in Canada.

This paper addresses three questions: What is the extent of clinical guideline utilization by decision-makers in provincial health ministries, regional health authorities and hospitals in Canada? Are there differences between these work settings in regard to the extent of clinical guideline utilization? What are the determinants of clinical guidelines utilization in health ministries, regional health authorities and hospitals? Based on a survey of 899 decision-makers from Canadian provincial health ministries, regional health authorities and hospitals, the results indicate that there are large differences between work settings in regard to clinical guideline utilization. Not surprisingly, work settings like hospitals rely more intensively on clinical guidelines than the other work settings (health ministries or agencies and regional health authorities). The results of the regression models indicate that cognitive factors, social factors, technological factors, organizational factors and individual attributes significantly predict the utilization of clinical practice guidelines by decision-makers. However, the results of the regression models also indicate that some factors that predict clinical guideline utilization by decision-makers in hospitals do not predict clinical guidelines utilization by decision-makers working in ministries or in regional health authorities. Therefore, these results suggest that customized interventions would be appropriate in order to efficiently increase the utilization of clinical practice guidelines in different work settings. The paper concludes with suggestions for future research.

Persistent misunderstandings about evidence-based (sorry: informed!) policy-making.

BACKGROUND: The field of research on knowledge mobilization and evidence-informed policy-making has seen enduring debates related to various fundamental assumptions such as the definition of 'evidence', the relative validity of various research methods, the actual role of evidence to inform policy-making, etc. In many cases, these discussions serve a useful purpose, but they also stem from serious disagreement on methodological and epistemological issues. DISCUSSION: This essay reviews the rationale for evidence-informed policy-making by examining some of the common claims made about the aims and practices of this perspective on public policy. Supplementing the existing justifications for evidence-based policy making, we argue in favor of a greater inclusion of research evidence in the policy process but in a structured fashion, based on methodological considerations. In this respect, we present an overview of the intricate relation between policy questions and appropriate research designs. SUMMARY: By closely examining the relation between research questions and research designs, we claim that the usual points of disagreement are mitigated. For instance, when focusing on the variety of research designs that can answer a range of policy questions, the common critical claim about 'RCT-based policy-making' seems to lose some, if not all of its grip.

Portrait of trauma care in Quebec's rural emergency departments and identification of priority intervention needs to improve the quality of care: a study protocol.

INTRODUCTION: Trauma remains the primary cause of death in individuals under 40 years of age in Canada. In Quebec, the Trauma Care Continuum (TCC) has been demonstrated to be effective in decreasing the mortality rate among trauma victims. Although rural citizens are at greater risk for trauma and trauma death, no empirical data concerning the effectiveness of the TCC for the rural population in Quebec are available. The emergency departments (EDs) are important safety nets for rural citizens. However, our data indicate that access to diagnostic support services, such as intensive care units and CT is limited in rural areas. The objectives are to (1) draw a portrait of trauma services in rural EDs; (2) explore geographical variations in trauma care in Quebec; (3) identify adaptable factors that could reduce variation; and (4) establish consensus solutions for improving the quality of care. METHODS AND ANALYSIS: The study will take place from November 2015 to November 2018. A mixed methodology (qualitative and quantitative) will be used. We will include data (2009-2013) from all trauma victims treated in the 26 rural EDs and tertiary/secondary care centres in Quebec. To meet objectives 1 and 2, data will be gathered from the Ministry's Database of the Quebec Trauma Registry Information System. For objectives 3 and 4, the project will use the Delphi method to develop consensus solutions for improving the quality of trauma care in rural areas. Data will be analysed using a Poisson regression to compare mortality rate during hospital stay or death on ED arrival (objectives 1 and 2). Average scores and 95% CI will be calculated for the Delphi questionnaire (objectives 3 and 4). ETHICS AND DISSEMINATION: This protocol has been approved by CSSS Alphonse-Desjardins research ethics committee (Project MP-HDL-2016-003). The results will be published in peer-reviewed journals.