Organizational impact of evidence-informed decision making training initiatives: a case study comparison of two approaches.

BACKGROUND: The impact of efforts by healthcare organizations to enhance the use of evidence to improve organizational processes through training programs has seldom been assessed. We therefore endeavored to assess whether and how the training of mid- and senior-level healthcare managers could lead to organizational change. METHODS: We conducted a theory-driven evaluation of the organizational impact of healthcare leaders' participation in two training programs using a logic model based on Nonaka's theory of knowledge conversion. We analyzed six case studies nested within the two programs using three embedded units of analysis (individual, group and organization). Interviews were conducted during intensive one-week data collection site visits. A total of 84 people were interviewed. RESULTS: We found that the impact of training could primarily be felt in trainees' immediate work environments. The conversion of attitudes was found to be easier to achieve than the conversion of skills. Our results show that, although socialization and externalization were common in all cases, a lack of combination impeded the conversion of skills. We also identified several individual, organizational and program design factors that facilitated and/or impeded the dissemination of the attitudes and skills gained by trainees to other organizational members. CONCLUSIONS: Our theory-driven evaluation showed that factors before, during and after training can influence the extent of skills and knowledge transfer. Our evaluation went further than previous research by revealing the influence--both positive and negative--of specific organizational factors on extending the impact of training programs.

What, why, and how care protocols are implemented in Ontario nursing homes.

The aim of this study was to better understand care protocol implementation, including the influence of organizational-contextual factors on implementation approaches, in long-term care homes operating in Ontario. We surveyed directors of care employed in all 547 Ontario LTC homes, and combined survey data with secondary organizational data on rural/urban location, nursing home size, chain membership, type of ownership, and accreditation status. Motivations for the use/selection of care protocols in nursing homes primarily derived from beliefs in continuous improvement and in evidence-based care. Protocol selection was largely participative, involving management and staff. External information sources were important for protocol implementation, and in-service education was the chief means of training and educating staff. Significant differences in approaches to implementation were evident in association with differences in ownership. Three key success factors for implementation were identified: contextualizing the practice change, adequately resourcing for implementation, and demonstrating connections between practice change and outcomes.

Secondary health conditions and spinal cord injury: an uphill battle in the journey of care.

PURPOSE: To understand the journey of care in the prevention and management of secondary health conditions (SHCs) following spinal cord injury (SCI). METHOD: This was a case study design with 'Ontario' as the case. The Network Episode Model was used as the conceptual framework. Data sources included in depth interviews with persons with SCI, care providers, and policy and decision makers. Document analysis was also conducted on relevant materials and policies. Key informants were selected by purposeful sampling as well as snowball sampling to provide maximum variation. Data analysis was an iterative process and involved descriptive and interpretive analyses. A coding structure was developed based on the conceptual framework which allowed for free nodes when emerging ideas or themes were identified. RESULTS: Twenty-eight individuals were interviewed (14 persons with SCI and 14 persons representing care providers, community advocacy organization representatives, system service delivery administrators and policy-makers). A major over-arching domain that emerged from the data was the concept of 'fighting'. Eleven themes were identified: at the micro-individual level: (i) social isolation and system abandonment, (ii) funding and equitable care, (iii) bounded freedom and self-management; at the meso care provider level: (iv) gender and caregiving strain, (v) help versus disempowerment, (vi) holistic care-thinking outside the box, (vii) poor communication and coordination of care; and at the macro health system level: (viii) fight for access and availability, (ix) models of care tensions, (x) private versus public tensions and (xi) rigid rules and policies. CONCLUSIONS: Findings suggest that the journey is challenging and a persistent uphill struggle for persons with SCI, care providers, and community-based advocates. If we are to make significant gains in minimizing the incidence and severity of SHCs, we need to tailor efforts at the health system level. IMPLICATIONS FOR REHABILITATION: • Secondary health conditions are problematic for individuals with a spinal cord injury (SCI). • This study aimed to understand the journey of care in the prevention and management of secondary health conditions (SHCs) following SCI. • Findings suggest that the journey is challenging and a persistent uphill struggle for persons with SCI, care providers, and community-based advocates. • All stakeholders involved recognized the disparities in access to care and resources that exist within the system. We recommend that if we are to make significant gains in minimizing the incidence and severity of SHCs, we need to tailor efforts at the health system level.

User Manuals for a Primary Care Electronic Medical Record System: A Mixed Methods Study of User- and Vendor-Generated Documents.

RESEARCH PROBLEM: Tutorials and user manuals are important forms of impersonal support for using software applications including electronic medical records (EMRs). Differences between user- and vendor documentation may indicate support needs, which are not sufficiently addressed by the official documentation, and reveal new elements that may inform the design of tutorials and user manuals. RESEARCH QUESTION: What are the differences between user-generated tutorials and manuals for an EMR and the official user manual from the software vendor? LITERATURE REVIEW: Effective design of tutorials and user manuals requires careful packaging of information, balance between declarative and procedural texts, an action and task-oriented approach, support for error recognition and recovery, and effective use of visual elements. No previous research compared these elements between formal and informal documents. METHODOLOGY: We conducted an mixed methods study. Seven tutorials and two manuals for an EMR were collected from three family health teams and compared with the official user manual from the software vendor. Documents were qualitatively analyzed using a framework analysis approach in relation to the principles of technical documentation described above. Subsets of the data were quantitatively analyzed using cross-tabulation to compare the types of error information and visual cues in screen captures between user- and vendor-generated manuals. RESULTS AND DISCUSSION: The user-developed tutorials and manuals differed from the vendor-developed manual in that they contained mostly procedural and not declarative information; were customized to the specific workflow, user roles, and patient characteristics; contained more error information related to work processes than to software usage; and used explicit visual cues on screen captures to help users identify window elements. These findings imply that to support EMR implementation, tutorials and manuals need to be customized and adapted to specific organizational contexts and workflows. The main limitation of the study is its generalizability. Future research should address this limitation and may explore alternative approaches to software documentation, such as modular manuals or participatory design.

End-user support for primary care electronic medical records: a qualitative case study of users' needs, expectations and realities.

Support is considered an important factor for realizing the benefits of health information technology (HIT) but there is a dearth of research on the topic of support, especially in primary care. We conducted a qualitative multiple case study of 4 family health teams (FHTs) and one family health organization (FHO) in Ontario, Canada in an attempt to gain insight into users' expectations and needs, and the realities of end-user support for primary care electronic medical records (EMRs). Data were collected by semi-structured interviews, documents review, and observation of training sessions. The analysis highlights the important role of on-site information technology (IT) staff and super-users in liaising with various stakeholders to solve technical problems and providing hardware and functional ('how to') support; the local development of data support practices to ensure consistent documentation; and the gaps that exist in users' and support personnel's understanding of each other's work processes.

Social networks and secondary health conditions: the critical secondary team for individuals with spinal cord injury.

OBJECTIVES: To describe the structure of informal networks for individuals with spinal cord injury (SCI) living in the community, to understand the quality of relationship of informal networks, and to understand the role of informal networks in the prevention and management of secondary health conditions (SHCs). DESIGN: Mixed-method descriptive study. SETTING: Ontario, Canada Participants: Community-dwelling adults with an SCI living in Ontario Interventions/methods: The Arizona Social Support Interview Survey was used to measure social networks. Participants were asked the following open-ended questions: (1) What have been your experiences with your health care in the community? (2) What have been your experiences with care related to prevention and/or management of SHCs?, (3)What has been the role of your informal social networks (friends/family) related to SHCs? RESULTS: Fourteen key informant interviews were conducted (6 men, 8 women). The overall median for available informal networks was 11.0 persons (range 3-19). The informal network engaged in the following roles: (1) advice/validating concerns; (2) knowledge brokers; (3) advocacy; (4) preventing SHCs; (5) assisting with finances; and (6) managing SHCs. Participants described their informal networks as a "secondary team"; a critical and essential force in dealing with SHCs. CONCLUSIONS: While networks are smaller for persons with SCI compared with the general population, these ties seems to be strong, which is essential when the roles involve a level of trust, certainty, tacit knowledge, and flexibility. These informal networks serve as essential key players in filling the gaps that exist within the formal health care system.

The importance of employment status in determining exit rates from nursing.

To mitigate nurse shortages, health care decision makers tend to employ retention strategies that assume nurses employed in full-time, part-time, or casual positions and working in different sectors have similar preferences for work. However, this assumption has not been validated in the literature. The relationship between a nurse's propensity to exit the nurse profession in Ontario and employment status was explored by building an extended Cox Proportional Hazards Regression Model using a counting process technique. The differential exit patterns between part-time and casual nurses suggest that the common practice of treating part-time and casual nurses as equivalent is misleading. Health care decision makers should consider nurse retention strategies specifically targeting casual nurses because this segment of the profession is at the greatest risk of leaving. Nurse executives and nurse managers should investigate the different work preferences of part-time and casual nurses to devise tailored rather than "one-size fits all" nurse retention strategies to retain casual nurses.

Retaining nurses: the impact of Ontario's "70% full-time commitment".

OBJECTIVES: To evaluate the effectiveness of a nurse retention strategy, the "70% Full-Time Commitment", in retaining part-time and casual nurses in Ontario's nurse profession. METHODS: Using the College of Nurses of Ontario database, a longitudinal dataset for all nurses registered with the college from 1993 to 2006 was created (N=216,353). One-year transition probabilities of nurse employment status (full-time, part-time and casual) were conducted (1993-2009) to generate trends of nurses' likelihood to stay in, switch or leave their full-time, part-time or casual position in Ontario's nurse profession. RESULTS: After the 70% Full-Time Commitment (2004-2009) was initiated, most full-time (89.7%), part-time (76.6%) and casual (62.5%) nurses stayed in their employment position. A slightly larger proportion of part-time nurses (13.6%) switched to full-time compared to casual nurses (8.6%). However, a similar proportion of young part-time (24.5%) and casual (23.3%) nurses switched to full-time. A smaller proportion of part-time (3.2%) and casual (7.1%) nurses left the profession. CONCLUSION: Part-time and casual nurses have different employment switching patterns. The "70% Full-Time Commitment" was not an effective mechanism in retaining part-time and casual nurses. It might be more effective as a recruitment initiative for young nurses.

Application of the Andersen's health care utilization framework to secondary complications of spinal cord injury: a scoping review.

PURPOSE: The purpose of this scoping review was to identify research priority areas related to secondary complications and associated health care use for individuals with spinal cord injury (SCI). DATA SOURCES: Peer-reviewed journals were identified using CINAHL, MEDLINE, PubMed, Embase, Social Sciences Abstracts, Social Works Abstract and PsycInfo search engines. Key references were hand searched. STUDY SELECTION: A total of 289 abstracts were identified from the initial search strategy. We removed studies that did not measure health care and those that did not involve analytical investigation. DATA EXTRACTION: The selected 31 studies were reviewed in detail using a coding template based on the domains and sub-components of the Andersen model (i.e. environmental, population characteristics, health behavior and outcome). RESULTS: Most studies measured predisposing characteristics (e.g., age, gender) and need characteristics (e.g., level of injury). There was a notable absence of environmental characteristics (e.g., health system, neighborhood variables), enabling characteristics and health behaviors (beyond diet and nutrition). CONCLUSIONS: We identified a gap in the SCI literature. Future research should focus on longitudinal study designs with more representation of non-traumatic spinal cord injury, as well as utilizing more advanced statistical analyses (i.e., multivariate level) to adjust for confounding variables.

End-user support for a primary care electronic medical record: a qualitative case study of a vendor's perspective.

BACKGROUND: In primary care settings, users often rely on vendors to provide support for health information technology (HIT). Yet, little is known about the vendors' perspectives on the support they provide, how support personnel perceive their roles, the challenges they face and the ways they deal with them. OBJECTIVE: To provide in-depth insight into an electronic medical record (EMR) vendor's perspective on end-user support. METHODS: As part of a larger case study research, we conducted nine semi-structured interviews with help desk staff, trainers and service managers of an EMR vendor, and observed two training sessions of a new client. RESULTS: With a growing client base, the vendor faced challenges of support staff shortage and high variance in users' technical knowledge. Additionally, users sometimes needed assistance with infrastructure, and not just software problems. These challenges sometimes hindered the provision of timely support and required supporters to possess good interpersonal skills and adapt to diverse client population. CONCLUSION: This study highlights the complexity of providing end-user support for HIT. With increased adoption, other vendors are likely to face similar challenges. To deal with these issues, supporters need not only strong technical knowledge of the systems, but also good interpersonal communication skills. Some responsibilities may be delegated to super-users. Users may find it useful to hire local IT staff, at least on an on-call basis, to provide assistance with infrastructure problems, which are not supported by the software vendor. Vendors may consider expanding their service packages to cover these elements.

How can we improve guideline use? A conceptual framework of implementability.

BACKGROUND: Guidelines continue to be underutilized, and a variety of strategies to improve their use have been suboptimal. Modifying guideline features represents an alternative, but untested way to promote their use. The purpose of this study was to identify and define features that facilitate guideline use, and examine whether and how they are included in current guidelines. METHODS: A guideline implementability framework was developed by reviewing the implementation science literature. We then examined whether guidelines included these, or additional implementability elements. Data were extracted from publicly available high quality guidelines reflecting primary and institutional care, reviewed independently by two individuals, who through discussion resolved conflicts, then by the research team. RESULTS: The final implementability framework included 22 elements organized in the domains of adaptability, usability, validity, applicability, communicability, accommodation, implementation, and evaluation. Data were extracted from 20 guidelines on the management of diabetes, hypertension, leg ulcer, and heart failure. Most contained a large volume of graded, narrative evidence, and tables featuring complementary clinical information. Few contained additional features that could improve guideline use. These included alternate versions for different users and purposes, summaries of evidence and recommendations, information to facilitate interaction with and involvement of patients, details of resource implications, and instructions on how to locally promote and monitor guideline use. There were no consistent trends by guideline topic. CONCLUSIONS: Numerous opportunities were identified by which guidelines could be modified to support various types of decision making by different users. New governance structures may be required to accommodate development of guidelines with these features. Further research is needed to validate the proposed framework of guideline implementability, develop methods for preparing this information, and evaluate how inclusion of this information influences guideline use.

Understanding end-user support for health information technology: a theoretical framework.

BACKGROUND: Support is often considered an important factor for successful implementation and realising the benefits of health information technology (HIT); however, there is a dearth of research on support and theoretical frameworks to characterise it. OBJECTIVE: To develop and present a comprehensive, holistic, framework for characterising enduser support that can be applied to various settings and types of information systems. METHOD: Scoping review of the medical informatics and information systems literature. RESULTS: A theoretical framework of end-user support is presented. It includes the following facets: support source, location of support, support activities, and perceived characteristics of support and support personnel. CONCLUSION: The proposed framework may be a useful tool for describing and characterising enduser support for HIT. it may also be used by decision makers and implementation leaders for planning purposes.

Accelerating the workplace health agenda.

Lowe and Chan's proposal for the development of common work environment metrics is long overdue. The authors' healthy work environment (HWE) framework is evidence based and illustrates the relationships between HWEs and organizational-level outcomes in a succinct yet comprehensive manner. The challenges we face in implementing their framework are related not so much to a fear of change but to a willingness to engage with multiple stakeholders and levels of government in coordinating our efforts. To date, we have lacked, at the policy level, a belief that HWEs can reduce operating costs, improve human resource utilization and, ultimately, lead to higher-quality patient care. We need a framework that will allow us to compare organizational performance in the area of health human resources in the same manner as we compare organizational outcomes in other areas. Such comparisons would allow us to further our understanding of the relationships among care providers, workplaces and organizational outcomes.

Does accreditation stimulate change? A study of the impact of the accreditation process on Canadian healthcare organizations.

BACKGROUND: One way to improve quality and safety in healthcare organizations (HCOs) is through accreditation. Accreditation is a rigorous external evaluation process that comprises self-assessment against a given set of standards, an on-site survey followed by a report with or without recommendations, and the award or refusal of accreditation status. This study evaluates how the accreditation process helps introduce organizational changes that enhance the quality and safety of care. METHODS: We used an embedded multiple case study design to explore organizational characteristics and identify changes linked to the accreditation process. We employed a theoretical framework to analyze various elements and for each case, we interviewed top managers, conducted focus groups with staff directly involved in the accreditation process, and analyzed self-assessment reports, accreditation reports and other case-related documents. RESULTS: The context in which accreditation took place, including the organizational context, influenced the type of change dynamics that occurred in HCOs. Furthermore, while accreditation itself was not necessarily the element that initiated change, the accreditation process was a highly effective tool for (i) accelerating integration and stimulating a spirit of cooperation in newly merged HCOs; (ii) helping to introduce continuous quality improvement programs to newly accredited or not-yet-accredited organizations; (iii) creating new leadership for quality improvement initiatives; (iv) increasing social capital by giving staff the opportunity to develop relationships; and (v) fostering links between HCOs and other stakeholders. The study also found that HCOs' motivation to introduce accreditation-related changes dwindled over time. CONCLUSIONS: We conclude that the accreditation process is an effective leitmotiv for the introduction of change but is nonetheless subject to a learning cycle and a learning curve. Institutions invest greatly to conform to the first accreditation visit and reap the greatest benefits in the next three accreditation cycles (3 to 10 years after initial accreditation). After 10 years, however, institutions begin to find accreditation less challenging. To maximize the benefits of the accreditation process, HCOs and accrediting bodies must seek ways to take full advantage of each stage of the accreditation process over time.

Spanning the know-do gap: understanding knowledge application and capacity in long-term care homes.

Using a multiple case study design, this article explores the translation process that emerges within Ontario long-term care (LTC) homes with the adoption and implementation of evidence-based clinical practice guidelines (CPGs). Within-organization knowledge translation is referred to as knowledge application. We conducted 28 semi-structured interviews with a range of administrative and care staff within 7 homes differentiated by size, profit status, chain membership, and rural/urban location. We further undertook 7 focus groups at 5 locations, involving a total of 35 senior clinical staff representing 15 homes not involved in earlier structured interviews. The knowledge application process that emerges across our participant organizations is highly complex, iterative, and reliant upon a facility's knowledge application capacity, or absorptive capacity to effect change through learning. Knowledge application capacity underpins the emergence of the application process and the advancement of knowledge through it. We find that different elements of capacity are important to different stages of the knowledge application process. Capacity can pre-exist, or can be acquired. The majority of the capacity elements required for successful knowledge application in the LTC contexts we studied were organizational. It is essential for managers and practitioners therefore to conceptualize and orchestrate knowledge application initiatives at the organization level; organizational leaders (including clinical leaders) have a vital role to play in the success of knowledge application processes.

Novice nurse information needs in paper and hybrid electronic-paper environments: a qualitative analysis.

A within group, laboratory, experimental study of nurse information seeking was conducted. As a part of the study, 35 novice nurses assessed and planned the care of two patients in two simulation environments: a paper (PR) environment and a hybrid (HY) environment [i.e., part of the environment was made available in electronic form via an electronic patient record (EPR) and part of it was paper-based]. Subjects were asked to "think aloud" in each environment and participated in a cued recall session following participation in the simulations. Subjects' verbalizations and actions were audio and video recorded and then transcribed. In the first phase of the study audio and video data were qualitatively coded using Model Based Coding with concepts from Newcomer Information Seeking Theory (NIST). This paper presents the qualitative results of this study with a focus upon the types of information used by novice nurses during the assessment and planning of patient care. Qualitative findings revealed novice nurses used referent, relational and appraisal information (as predicted by NIST theory and research) including information composed of more than one type of information (e.g., referent-relational). Two new types of information emerged from the qualitative data - situational task and situational organization information.

An exploration of how guideline developer capacity and guideline implementability influence implementation and adoption: study protocol.

BACKGROUND: Practice guidelines can improve health care delivery and outcomes but several issues challenge guideline adoption, including their intrinsic attributes, and whether and how they are implemented. It appears that guideline format may influence accessibility and ease of use, which may overcome attitudinal barriers of guideline adoption, and appear to be important to all stakeholders. Guideline content may facilitate various forms of decision making about guideline adoption relevant to different stakeholders. Knowledge and attitudes about, and incentives and capacity for implementation on the part of guideline sponsors may influence whether and how they develop guidelines containing these features, and undertake implementation. Examination of these issues may yield opportunities to improve guideline adoption. METHODS: The attributes hypothesized to facilitate adoption will be expanded by thematic analysis, and quantitative and qualitative summary of the content of international guidelines for two primary care (diabetes, hypertension) and institutional care (chronic ulcer, chronic heart failure) topics. Factors that influence whether and how guidelines are implemented will be explored by qualitative analysis of interviews with individuals affiliated with guideline sponsoring agencies. DISCUSSION: Previous research examined guideline implementation by measuring rates of compliance with recommendations or associated outcomes, but this produced little insight on how the products themselves, or their implementation, could be improved. This research will establish a theoretical basis upon which to conduct experimental studies to compare the cost-effectiveness of interventions that enhance guideline development and implementation capacity. Such studies could first examine short-term outcomes predictive of guideline utilization, such as recall, attitude toward, confidence in, and adoption intention. If successful, then long-term objective outcomes reflecting the adoption of processes and associated patient care outcomes could be evaluated.

Sustaining change: once evidence-based practices are transferred, what then?

Healthcare has undergone many transformations over the past several decades including increased diagnostic sophistication, shorter in-hospital stays and day surgeries as well as greater home-based treatments such as intravenous therapy, dialysis and palliation. Despite their rigorous evidence-based underpinnings and the demonstrated benefits of these advances, the sustainability of new clinical practices in healthcare organizations continues to present a challenge to practitioners and researchers alike.

The efficiency and effectiveness of utilizing diagrams in interviews: an assessment of participatory diagramming and graphic elicitation.

BACKGROUND: This paper focuses on measuring the efficiency and effectiveness of two diagramming methods employed in key informant interviews with clinicians and health care administrators. The two methods are 'participatory diagramming', where the respondent creates a diagram that assists in their communication of answers, and 'graphic elicitation', where a researcher-prepared diagram is used to stimulate data collection. METHODS: These two diagramming methods were applied in key informant interviews and their value in efficiently and effectively gathering data was assessed based on quantitative measures and qualitative observations. RESULTS: Assessment of the two diagramming methods suggests that participatory diagramming is an efficient method for collecting data in graphic form, but may not generate the depth of verbal response that many qualitative researchers seek. In contrast, graphic elicitation was more intuitive, better understood and preferred by most respondents, and often provided more contemplative verbal responses, however this was achieved at the expense of more interview time. CONCLUSION: Diagramming methods are important for eliciting interview data that are often difficult to obtain through traditional verbal exchanges. Subject to the methodological limitations of the study, our findings suggest that while participatory diagramming and graphic elicitation have specific strengths and weaknesses, their combined use can provide complementary information that would not likely occur with the application of only one diagramming method. The methodological insights gained by examining the efficiency and effectiveness of these diagramming methods in our study should be helpful to other researchers considering their incorporation into qualitative research designs.