The Quebec emergency department guide: A cross-sectional study to evaluate its use, perceived usefulness, and implementation in rural emergency departments.

OBJECTIVES: The Quebec Emergency Department Management Guide (QEDMG) is a unique document with 78 recommendations designed to improve the organization of emergency departments (EDs) in the province of Quebec. However, no study has examined how this guide is perceived or used by rural health care management. METHODS: We invited all directors of professional services (DPS), directors of nursing services (DNS), head nurses (HN), and emergency department directors (EDD) working in Quebec's rural hospitals to complete an online survey (144 questions). Simple frequency analyses (percentage [%] and 95% confidence interval) were conducted to establish general familiarity and use of the QEDMG, as well as perceived usefulness and implementation of its recommendations. RESULTS: Seventy-three percent (19/26) of Quebec's rural EDs participated in the study. A total of 82% (62/76) of the targeted stakeholders participated. Sixty-one percent of respondents reported being "moderately or a lot" familiar with the QEDMG, whereas 77% reported "almost never or sometimes" refer to this guide. Physician management (DPS, EDD) were more likely than nursing management (DNS and especially HN) to report "not at all" or "little" familiarity on use of the guide. Finally, 98% of the QEDMG recommendations were considered useful. CONCLUSIONS: Although the QEDMG is considered a useful guide for rural EDs, it is not optimally known or used in rural EDs, especially by physician management. Stakeholders should consider these findings before implementing the revised versions of the QEDMG.

Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT.

BACKGROUND: Implementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services. METHODS: Based on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts - the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) - where 30 experts assessed the face validity of the three versions of OR4KT. RESULTS: We selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended. CONCLUSION: The OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare.

Health technology assessments conducted in health care facilities: A strategic practice? Findings from a content analysis of HTA reports.

In this paper, we test the hypothesis that health technology assessment units located in hospitals tend to be more optimistic toward technologies that are currently in use in their organization than technologies that are not. The data include 108 health technologies assessed in 87 full-scale health technology assessment reports produced by the four main local health technology assessment units in Quebec (Canada) on behalf of decision makers from the same facility. We found that 58 (53.7 percent) of the 108 technologies were currently in use within the hospital during their assessment. Based on the assessors' interpretation of the scientific evidence regarding the efficacy of the technologies, 67.3 percent of the technologies that were in use in the hospital during the evaluation were effective (56 percent for those that were not currently being used), but the difference is not statistically significant (chi-square 1.38; p = 0.24). Controlling for the efficacy judgment, the type of technologies (i.e. preventive, diagnostic, therapeutic or organizational), the number of technologies assessed in the report and the assessment unit, we found that the technologies that were currently in use in the facility during the evaluation were 62 percent more likely to be recommended favorably by the assessment unit than the technologies that were not currently being used (RR = 1.62; 95 percent CI = 1.06-1.88). This suggests that the local health technology units that were examined in the study tended to be more optimistic toward technologies that were currently in use in their hospital at the time of the evaluation.

Rural emergency care 360°: mobilising healthcare professionals, decision-makers, patients and citizens to improve rural emergency care in the province of Quebec, Canada: a qualitative study protocol.

INTRODUCTION: Emergency departments (EDs) are an important safety net for rural populations. Results of our earlier studies suggest that rural Canadian hospitals have limited access to advanced imaging services and intensive care units and that patients are transferred over large distances. They also revealed significant geographical variations in rural services. In the absence of national standards, our studies raise questions about inequities in rural access to emergency services and the risks for citizens. Our goal is to build recommendations for improving services by mobilising stakeholders interested in rural emergency care. With help and full engagement of stakeholders, we will (1) identify solutions for improving quality and performance in rural EDs; (2) formulate and prioritise recommendations; (3) transfer knowledge of the recommendations to rural EDs and support operationalisation and (4) assess knowledge transfer and explore further impacts of this participatory action research project. METHODOLOGY: We will use a participatory action research approach. We will plan for a governance structure that includes all stakeholders’ representatives, so throughout this project, stakeholders are fully engaged at every step. Our sample will be 26 EDs in rural Quebec. We will conduct semistructured individual and focus group interviews with relevant and representative participants, including patients and citizens (estimated n=200). Interviews will be thematically analysed to extract potential solutions and other qualitative information.An expert panel (±15) will use an analysis grid to develop consensus recommendations from solutions suggested and will evaluate feasibility, impacts, costs, conditions for implementation and establish monitoring indicators. Recommendations will be transferred to stakeholders using tailored knowledge translation strategies (web platform, meetings and so on). DISCUSSION AND EXPECTED RESULTS: This study will result in a comprehensive consensus list of feasible and high-priority recommendations enabling decision-makers in emergency care to implement improvements in rural emergency care in Quebec. ETHICS AND DISSEMINATION: This protocol has been approved by the CSSS Alphonse-Desjardins research ethics committee (Project number: MP 2017-009). The qualitative material will be kept confidential and the data will be presented in a way that respects confidentiality. The dissemination plan for the study includes publications in scientific and professional journals. We will also use social media to disseminate our findings and activities such as communications in public conferences.

Portrait of trauma care in Quebec's rural emergency departments and identification of priority intervention needs to improve the quality of care: a study protocol.

INTRODUCTION: Trauma remains the primary cause of death in individuals under 40 years of age in Canada. In Quebec, the Trauma Care Continuum (TCC) has been demonstrated to be effective in decreasing the mortality rate among trauma victims. Although rural citizens are at greater risk for trauma and trauma death, no empirical data concerning the effectiveness of the TCC for the rural population in Quebec are available. The emergency departments (EDs) are important safety nets for rural citizens. However, our data indicate that access to diagnostic support services, such as intensive care units and CT is limited in rural areas. The objectives are to (1) draw a portrait of trauma services in rural EDs; (2) explore geographical variations in trauma care in Quebec; (3) identify adaptable factors that could reduce variation; and (4) establish consensus solutions for improving the quality of care. METHODS AND ANALYSIS: The study will take place from November 2015 to November 2018. A mixed methodology (qualitative and quantitative) will be used. We will include data (2009-2013) from all trauma victims treated in the 26 rural EDs and tertiary/secondary care centres in Quebec. To meet objectives 1 and 2, data will be gathered from the Ministry's Database of the Quebec Trauma Registry Information System. For objectives 3 and 4, the project will use the Delphi method to develop consensus solutions for improving the quality of trauma care in rural areas. Data will be analysed using a Poisson regression to compare mortality rate during hospital stay or death on ED arrival (objectives 1 and 2). Average scores and 95% CI will be calculated for the Delphi questionnaire (objectives 3 and 4). ETHICS AND DISSEMINATION: This protocol has been approved by CSSS Alphonse-Desjardins research ethics committee (Project MP-HDL-2016-003). The results will be published in peer-reviewed journals.

Barriers and facilitators to uptake of systematic reviews by policy makers and health care managers: a scoping review.

BACKGROUND: We completed a scoping review on the barriers and facilitators to use of systematic reviews by health care managers and policy makers, including consideration of format and content, to develop recommendations for systematic review authors and to inform research efforts to develop and test formats for systematic reviews that may optimise their uptake. METHODS: We used the Arksey and O'Malley approach for our scoping review. Electronic databases (e.g., MEDLINE, EMBASE, PsycInfo) were searched from inception until September 2014. Any study that identified barriers or facilitators (including format and content features) to uptake of systematic reviews by health care managers and policy makers/analysts was eligible for inclusion. Two reviewers independently screened the literature results and abstracted data from the relevant studies. The identified barriers and facilitators were charted using a barriers and facilitators taxonomy for implementing clinical practice guidelines by clinicians. RESULTS: We identified useful information for authors of systematic reviews to inform their preparation of reviews including providing one-page summaries with key messages, tailored to the relevant audience. Moreover, partnerships between researchers and policy makers/managers to facilitate the conduct and use of systematic reviews should be considered to enhance relevance of reviews and thereby influence uptake. CONCLUSIONS: Systematic review authors can consider our results when publishing their systematic reviews. These strategies should be rigorously evaluated to determine impact on use of reviews in decision-making.

A process evaluation accompanying an attempted randomized controlled trial of an evidence service for health system policymakers.

BACKGROUND: We developed an evidence service that draws inputs from Health Systems Evidence (HSE), which is a comprehensive database of research evidence about governance, financial and delivery arrangements within health systems and about implementation strategies relevant to health systems. Our goal was to evaluate whether, how and why a 'full-serve' evidence service increases the use of synthesized research evidence by policy analysts and advisors in the Ontario Ministry of Health and Long-Term Care as compared to a 'self-serve' evidence service. METHODS: We attempted to conduct a two-arm, 10-month randomized controlled trial (RCT), along with a follow-up qualitative process evaluation, but we terminated the RCT when we failed to reach our recruitment target. For the qualitative process evaluation we modified the original interview guide to allow us to explore the (1) factors influencing participation in the trial; (2) usage of HSE, factors explaining usage patterns, and strategies to increase usage; (3) participation in training workshops and use of other supports; and (4) views about and experiences with key HSE features. RESULTS: We terminated the RCT given our 15% recruitment rate. Six factors were identified by those who had agreed to participate in the trial as encouraging their participation: relevance of the study to participants' own work; familiarity with the researchers; personal view of the importance of using research evidence in policymaking; academic background; support from supervisors; and participation of colleagues. Most reported that they never, infrequently or inconsistently used HSE and suggested strategies to increase its use, including regular email reminders and employee training. However, only two participants indicated that employee training, in the form of a workshop about finding and using research evidence, had influenced their use of HSE. Most participants found HSE features to be intuitive and helpful, although registration/sign-in and some page formats (particularly the advanced search page and detailed search results page) discouraged their use or did not optimize the user experience. CONCLUSIONS: The qualitative findings informed a re-design of HSE, which allows users to more efficiently find and use research evidence about how to strengthen or reform health systems or in how to get cost-effective programs, services and drugs to those who need them. Our experience with RCT recruitment suggests the need to consider changing the unit of allocation to divisions instead of individuals within divisions, among other lessons. TRIAL REGISTRATION: This protocol for this study is published in Implementation Science and registered with ClinicalTrials.gov ( HHS/FHS REB 10-267 ).

Portrait of rural emergency departments in Québec and utilization of the provincial emergency department management Guide: cross sectional survey.

BACKGROUND: Rural emergency departments (EDs) constitute crucial safety nets for the 20% of Canadians who live in rural areas. Pilot data suggests that the province of Québec appears to provide more comprehensive access to services than do other provinces. A difference that may be attributable to provincial policy/guidelines "the provincial ED management Guide". The aim of this study was to provide a detailed description of rural EDs in Québec and utilization of the provincial ED management Guide. METHODS: We selected EDs offering 24/7 medical coverage, with hospitalization beds, located in rural or small towns. We collected data via telephone, paper, and online surveys with rural ED/hospital staff. Data were also collected from Québec's Ministry of Health databases and from Statistics Canada. We computed descriptive statistics, ANOVA and t-tests were used to examine the relationship between ED census, services and inter-facility transfer requirements. RESULTS: A total of 23 of Québec's 26 rural EDs (88%) consented to participate in the study. The mean annual ED visits was 18 813 (Standard Deviation = 6 151). Thirty one percent of ED physicians were recent graduates with fewer than 5 years of experience. Only 6 % had residency training or certification in emergency medicine. Teams have good local access (24/7) to diagnostic equipment such as CT scanner (74%), intensive unit care (78%) and general surgical services (78%), but limited access to other consultants. Sixty one percent of participants have reported good knowledge of the provincial ED management Guide, but only 23% of them have used the guidelines. Furthermore, more than 40% of EDs were more than 300 km from levels 1 to 2 trauma centers, and only 30% had air transport access. CONCLUSIONS: Rural EDs in Québec are staffed by relatively new graduates working as solo physicians in well-resourced and moderately busy (by rural standards) EDs. The provincial ED management Guide may have contributed to this model of service attribution. However, the majority of rural ED staff report limited knowledge or use of the provincial ED management Guide and increased efforts at disseminating this Guide are warranted.

What supports do health system organizations have in place to facilitate evidence-informed decision-making? A qualitative study.

BACKGROUND: Decisions regarding health systems are sometimes made without the input of timely and reliable evidence, leading to less than optimal health outcomes. Healthcare organizations can implement tools and infrastructures to support the use of research evidence to inform decision-making. OBJECTIVES: The purpose of this study was to profile the supports and instruments (i.e., programs, interventions, instruments or tools) that healthcare organizations currently have in place and which ones were perceived to facilitate evidence-informed decision-making. METHODS: In-depth semi-structured telephone interviews were conducted with individuals in three different types of positions (i.e., a senior management team member, a library manager, and a 'knowledge broker') in three types of healthcare organizations (i.e., regional health authorities, hospitals and primary care practices) in two Canadian provinces (i.e., Ontario and Quebec). The interviews were taped, transcribed, and then analyzed thematically using NVivo 9 qualitative data analysis software. RESULTS: A total of 57 interviews were conducted in 25 organizations in Ontario and Quebec. The main findings suggest that, for the healthcare organizations that participated in this study, the following supports facilitate evidence-informed decision-making: facilitating roles that actively promote research use within the organization; establishing ties to researchers and opinion leaders outside the organization; a technical infrastructure that provides access to research evidence, such as databases; and provision and participation in training programs to enhance staff's capacity building. CONCLUSIONS: This study identified the need for having a receptive climate, which laid the foundation for the implementation of other tangible initiatives and supported the use of research in decision-making. This study adds to the literature on organizational efforts that can increase the use of research evidence in decision-making. Some of the identified supports may increase the use of research evidence by decision-makers, which may then lead to more informed decisions, and hopefully to a strengthened health system and improved health.

Some but not all dyadic measures in shared decision making research have satisfactory psychometric properties.

OBJECTIVE: To assess the psychometric properties of dyadic measures for shared decision making (SDM) research. STUDY DESIGN AND SETTING: We conducted an observational cross-sectional study in 17 primary care clinics with physician-patient dyads. We used seven subscales to measure six elements of SDM: (1) defining the problem, presenting options, and discussing pros and cons; (2) clarifying the patient's values and preferences; (3) discussing the patient's self-efficacy; (4) drawing on the doctor's knowledge; (5) verifying the patient's understanding; and (6) assessing the patient's uncertainty. We assessed the reliability and invariance of the factorial structure and considered a measure to be dyadic if the factorial structure of the patient version was similar to that of the physician version and if there was equality of loading (no significant chi-square). RESULTS: We analyzed data for 264 physicians and 269 patients. All measures except one showed adequate reliability (Cronbach alpha, 0.70-0.93) and factorial validity (root mean square error of approximation, 0.000-0.06). However, we found only four measures to be dyadic (P>0.05): the values clarification subscale, perceived behavioral subscale, information-verifying subscale, and uncertainty subscale. CONCLUSION: The subscales for values clarification, perceived behavioral control, information verifying, and uncertainty are appropriate dyadic measures for SDM research and can be used to derive dyadic indices.

Measuring organizational readiness for knowledge translation in chronic care.

BACKGROUND: Knowledge translation (KT) is an imperative in order to implement research-based and contextualized practices that can answer the numerous challenges of complex health problems. The Chronic Care Model (CCM) provides a conceptual framework to guide the implementation process in chronic care. Yet, organizations aiming to improve chronic care require an adequate level of organizational readiness (OR) for KT. Available instruments on organizational readiness for change (ORC) have shown limited validity, and are not tailored or adapted to specific phases of the knowledge-to-action (KTA) process. We aim to develop an evidence-based, comprehensive, and valid instrument to measure OR for KT in healthcare. The OR for KT instrument will be based on core concepts retrieved from existing literature and validated by a Delphi study. We will specifically test the instrument in chronic care that is of an increasing importance for the health system. METHODS: Phase one: We will conduct a systematic review of the theories and instruments assessing ORC in healthcare. The retained theoretical information will be synthesized in a conceptual map. A bibliography and database of ORC instruments will be prepared after appraisal of their psychometric properties according to the standards for educational and psychological testing. An online Delphi study will be carried out among decision makers and knowledge users across Canada to assess the importance of these concepts and measures at different steps in the KTA process in chronic care.Phase two: A final OR for KT instrument will be developed and validated both in French and in English and tested in chronic disease management to measure OR for KT regarding the adoption of comprehensive, patient-centered, and system-based CCMs. DISCUSSION: This study provides a comprehensive synthesis of current knowledge on explanatory models and instruments assessing OR for KT. Moreover, this project aims to create more consensus on the theoretical underpinnings and the instrumentation of OR for KT in chronic care. The final product--a comprehensive and valid OR for KT instrument--will provide the chronic care settings with an instrument to assess their readiness to implement evidence-based chronic care.

Determining research knowledge infrastructure for healthcare systems: a qualitative study.

BACKGROUND: This study examines research knowledge infrastructures (RKIs) found in health systems. An RKI is defined as any instrument (i.e., programs, interventions, tools) implemented in order to facilitate access, dissemination, exchange, and/or use of evidence in healthcare organisations. Based on an environmental scan (17 key informant interviews) and scoping review (26 studies), we found support for a framework that we developed that outlines components that a health system can have in its RKI. The broad domains are climate for research use, research production, activities used to link research to action, and evaluation.The objective of the current study is to profile the RKI of three types of health system organisations--regional health authorities, primary care practices, and hospitals--in two Canadian provinces to determine the current mix of components these organisations have in their RKI, their experience with these components, and their views about future RKI initiatives. METHODS: This study will include semistructured telephone interviews with a purposive sample region of a senior management team member, library/resource centre manager, and a 'knowledge broker' in three regional health authorities, five or six purposively sampled hospitals, and five or six primary care practices in Ontario and Quebec, for a maximum of 71 interviewees. The interviews will explore (a) which RKI components have proven helpful, (b) barriers and facilitators in implementing RKI components, and (c) views about next steps in further development of RKIs. DISCUSSION: This is the first qualitative examination of potential RKI efforts that can increase the use of research evidence in health system decision making. We anticipate being able to identify broadly applicable insights about important next steps in building effective RKIs. Some of the identified RKI components may increase the use of research evidence by decision makers, which may then lead to more informed decisions.

Supporting the use of health technology assessments in policy making about health systems.

OBJECTIVES: The objective of this study is to profile the health technology assessments (HTAs) produced in Canada and other selected countries and assess their potential to inform policy making about health systems in jurisdictions other than the ones for which they were produced, and to develop and pilot test prototypes for packaging and assessing the relevance of HTAs for health system managers and policy makers. METHODS: We compiled an inventory of all HTAs that were produced by nine HTA agencies between September 2003 and August 2006; coded the title and abstract of each HTA according to the technologies assessed, methods used, and whether or not context-specific actionable messages were provided; developed a prototype for a structured, decision-relevant HTA summary and for a relevance-assessment form; and pilot-tested the prototypes using semistructured telephone interviews with a purposive sample of Canadian healthcare managers and policy makers. RESULTS: Our review of the 223 HTAs identified that: (i) 44 HTAs addressed health system arrangements (20 percent); (ii) 205 incorporated a systematic review (92 percent), whereas only 12 incorporated a sociopolitical assessment using explicit methods (5 percent); and (iii) 50 contained context-specific actionable messages (22 percent). Our interviews identified significant support for both the general idea of an HTA summary and the prototype's specific elements, but mixed views about using peer assessments of relevance. CONCLUSIONS: Those involved in supporting the use of HTAs in policy making about health systems may wish to produce structured decision-relevant summaries for their systematic review-containing HTAs to increase the prospects for their HTAs being used outside the jurisdiction for which they were produced.

What factors induce health care decision-makers to use clinical guidelines? Evidence from provincial health ministries, regional health authorities and hospitals in Canada.

This paper addresses three questions: What is the extent of clinical guideline utilization by decision-makers in provincial health ministries, regional health authorities and hospitals in Canada? Are there differences between these work settings in regard to the extent of clinical guideline utilization? What are the determinants of clinical guidelines utilization in health ministries, regional health authorities and hospitals? Based on a survey of 899 decision-makers from Canadian provincial health ministries, regional health authorities and hospitals, the results indicate that there are large differences between work settings in regard to clinical guideline utilization. Not surprisingly, work settings like hospitals rely more intensively on clinical guidelines than the other work settings (health ministries or agencies and regional health authorities). The results of the regression models indicate that cognitive factors, social factors, technological factors, organizational factors and individual attributes significantly predict the utilization of clinical practice guidelines by decision-makers. However, the results of the regression models also indicate that some factors that predict clinical guideline utilization by decision-makers in hospitals do not predict clinical guidelines utilization by decision-makers working in ministries or in regional health authorities. Therefore, these results suggest that customized interventions would be appropriate in order to efficiently increase the utilization of clinical practice guidelines in different work settings. The paper concludes with suggestions for future research.