Influences of post-implementation factors on the sustainability, sustainment, and intra-organizational spread of complex interventions.

BACKGROUND: Complex interventions are increasingly applied to healthcare problems. Understanding of post-implementation sustainment, sustainability, and spread of interventions is limited. We examine these phenomena for a complex quality improvement initiative led by care aides in 7 care homes (long-term care homes) in Manitoba, Canada. We report on factors influencing these phenomena two years after implementation. METHODS: Data were collected in 2019 via small group interviews with unit- and care home-level managers (n = 11) from 6 of the 7 homes using the intervention. Interview participants discussed post-implementation factors that influenced continuing or abandoning core intervention elements (processes, behaviors) and key intervention benefits (outcomes, impact). Interviews were audio-recorded, transcribed verbatim, and analyzed with thematic analysis. RESULTS: Sustainment of core elements and sustainability of key benefits were observed in 5 of the 6 participating care homes. Intra-unit intervention spread occurred in 3 of 6 homes. Factors influencing sustainment, sustainability, and spread related to intervention teams, unit and care home, and the long-term care system. CONCLUSIONS: Our findings contribute understanding on the importance of micro-, meso-, and macro-level factors to sustainability of key benefits and sustainment of some core processes. Inter-unit spread relates exclusively to meso-level factors of observability and practice change institutionalization. Interventions should be developed with post-implementation sustainability in mind and measures taken to protect against influences such as workforce instability and competing internal and external demands. Design should anticipate need to adapt interventions to strengthen post-implementation traction.

Acute care nurses' perceptions of leadership, teamwork, turnover intention and patient safety - a mixed methods study.

BACKGROUND: This study contributes to a small but growing body of literature on how context influences perceptions of patient safety in healthcare settings. We examine the impact of senior leadership support for safety, supervisory leadership support for safety, teamwork, and turnover intention on overall patient safety grade. Interaction effects of predictors on perceptions of patient safety are also examined. METHODS: In this mixed methods study, cross-sectional survey data (N = 185) were collected from nurses and non-physician healthcare professionals. Semi-structured interview data (N = 15) were collected from nurses. The study participants worked in intensive care, general medicine, mental health, or the emergency department of a large community hospital in Southern Ontario. RESULTS: Hierarchical regression analyses showed that staff perceptions of senior leadership (p < 0.001), teamwork (p < 0.01), and turnover intention (p < 0.01) were significantly associated with overall patient safety grade. The interactive effect of teamwork and turnover intention on overall patient safety grade was also found to be significant (p < 0.05). The qualitative findings corroborated the survey results but also helped expand the characteristics of the study's key concepts (e.g., teamwork within and across professional boundaries) and why certain statistical relationships were found to be non-significant (e.g., nurse interviewees perceived the safety specific responsibilities of frontline supervisors much more broadly compared to the narrower conceptualization of the construct in the survey). CONCLUSIONS: The results of the current study suggest that senior leadership, teamwork, and turnover intention significantly impact nursing staff perceptions of patient safety. Leadership is a modifiable contextual factor and resources should be dedicated to strengthen relational competencies of healthcare leaders. Healthcare organizations must also proactively foster inter and intra-professional collaboration by providing teamwork educational workshops or other on-site learning opportunities (e.g., simulation training). Healthcare organizations would benefit by considering the interactive effect of contextual factors as another lever for patient safety improvement, e.g., lowering staff turnover intentions would maximize the positive impact of teamwork improvement initiatives on patient safety.

Turnover intention of hospital staff in Ontario, Canada: exploring the role of frontline supervisors, teamwork, and mindful organizing.

BACKGROUND: This study contributes to a small but growing body of literature on how context influences employee turnover intention. We examine the impact of staff perceptions of supervisory leadership support for safety, teamwork, and mindful organizing on turnover intention. Interaction effects of safety-specific constructs on turnover intention are also examined. METHODS: Cross-sectional survey data were collected from nurses, allied health professionals, and unit clerks working in intensive care, general medicine, mental health, or the emergency department of a large community hospital in Southern Ontario. RESULTS: Hierarchical regression analyses showed that staff perceptions of teamwork were significantly associated with turnover intention (p < 0.001). Direct associations of supervisory leadership support for safety and mindful organizing with turnover intention were non-significant; however, when staff perceived lower levels of mindful organizing at the frontlines, the positive effect of supervisory leadership on turnover intention was significant (p < 0.01). CONCLUSIONS: Our results suggest that, in addition to teamwork perceptions positively affecting turnover intentions, safety-conscious supportive supervisors can help alleviate the negative impact of poor mindful organizing on frontline staff turnover intention. Healthcare organizations should recruit and retain individuals in supervisory roles who prioritize safety and possess adequate relational competencies. They should further dedicate resources to build and strengthen the relational capacities of their supervisory leadership. Moreover, it is important to provide on-site workshops on topics (e.g., conflict management) that can improve the quality of teamwork and consequently reduce employees' intention to leave their unit/organization.

Relationships between work outcomes, work attitudes and work environments of health support workers in Ontario long-term care and home and community care settings.

BACKGROUND: Our overarching study objective is to further our understanding of the work psychology of Health Support Workers (HSWs) in long-term care and home and community care settings in Ontario, Canada. Specifically, we seek novel insights about the relationships among aspects of these workers' work environments, their work attitudes, and work outcomes in the interests of informing the development of human resource programs to enhance elder care. METHODS: We conducted a path analysis of data collected via a survey administered to a convenience sample of Ontario HSWs engaged in the delivery of elder care over July-August 2015. RESULTS: HSWs' work outcomes, including intent to stay, organizational citizenship behaviors, and performance, are directly and significantly related to their work attitudes, including job satisfaction, work engagement, and affective organizational commitment. These in turn are related to how HSWs perceive their work environments including their quality of work life (QWL), their perceptions of supervisor support, and their perceptions of workplace safety. CONCLUSIONS: HSWs' work environments are within the power of managers to modify. Our analysis suggests that QWL, perceptions of supervisor support, and perceptions of workplace safety present particularly promising means by which to influence HSWs' work attitudes and work outcomes. Furthermore, even modest changes to some aspects of the work environment stand to precipitate a cascade of positive effects on work outcomes through work attitudes.

Implementing Frontline Worker-Led Quality Improvement in Nursing Homes: Getting to "How".

BACKGROUND: Despite emerging frameworks for quality improvement (QI) implementation, little is known about how the implementation process works, particularly in nursing home settings. A study was conducted to describe "how"' a complex frontline worker-led QI program was implemented in nursing homes. METHODS: Six focus groups were conducted in February 2017 with participants of a year-long, multicomponent, unit-level QI intervention in seven nursing homes in the Canadian province of Manitoba. Constant comparative analysis was used to examine perspectives of different groups of QI program participants-35 health care aides, health professionals, and managers. RESULTS: Five themes important to the implementation process were identified: (1) "supportive elements of the QI program structure," (2) "navigating the workplace," (3) "negotiating relationships," (4) "developing individual skills," and (5) "observable program impact." Data on theme integration suggest that "supportive elements of the QI program structure" (Theme 1), "developing individual skills" (Theme 4), and "observable program impact" (on residents, health care aides, and leaders; Theme 5) operated as part of a reinforcing feedback loop that boosted team members' ability to navigate the workplace, negotiate relationships, and implement the QI program. CONCLUSION: Health care aide-led QI teams are feasible. However, a leadership paradox exists whereby worker-led QI programs also must incorporate concrete mechanisms to promote strong leadership and sponsor support to teams. The findings also point to the underexplored impact of interpersonal relationships between health care aides and professional staff on QI implementation.

Insights into nurses' work: Exploring relationships among work attitudes and work-related behaviors.

BACKGROUND: Work attitudes have been associated with work productivity. In health care, poor work attitudes have been linked to poor performance, decreased patient safety, and quality care. Hence, the importance, ascribed in the literature, of work that clearly identifies the relationships between and among work attitudes and work behaviors linked to performance. PURPOSE: The purpose of this study is to better understand the relationships between work attitudes-perceived organizational justice, perceived organizational support (POS), affective commitment-consistently associated with a key type of performance outcome among nurses' organizational citizenship behaviors (OCBs). METHODOLOGY: A survey was developed and administered to frontline nurses working in the province of Ontario, Canada. Data analysis used path analytic techniques. RESULTS: Direct associations were identified between interpersonal justice and POS, procedural justice and POS, and POS and affective commitment to both one's supervisor and one's co-workers. Affective commitment to patients and career was directly associated with OCBs. Affective commitment to one's co-worker was directly associated with OCBs directed toward individuals, as affective commitment to one's organization was with OCBs directed toward the organization. Finally, OCBIs and OCBs were directly associated. CONCLUSIONS: Examining the relationships of these constructs in a single model is novel and provides new information regarding their complexity. Findings suggest that prior approaches to studying these relationships may have been undernuanced, and conceptualizations may have led to somewhat inaccurate conclusions regarding their associations. PRACTICE IMPLICATIONS: With limited resources, knowledge of nurse work attitudes can inform human resource practices and operational policies involving training programs in employee communication, transparency, interaction, support, and performance evaluation.

The evaluation of a multifaceted intervention to promote "speaking up" and strengthen interprofessional teamwork climate perceptions.

Communication failure is a leading cause of error and is often due to inhibition of individuals to speak up in interprofessional healthcare environments. The present study sought to evaluate the impact of a multifaceted intervention designed to promote speaking up on teamwork climate in one clinical department of a large community hospital based in Canada. The multifaceted intervention included a role-playing simulation workshop, teamwork climate data feedback and facilitated discussion with the interprofessional team (discussion briefings), and other department-led initiatives to promote trust, teamwork, and speaking up among interprofessional team members. A quasi-experiment (pretest-posttest control group design, using two posttests several months apart) was used to evaluate the impact of the complete intervention on individual teamwork climate perceptions. The intervention was implemented with an intact interprofessional team (the Emergency Department-ED) in 2014. The intensive care unit (ICU) was used as the control unit. Survey response rates were the highest at time 1 (83/102 = 81% for the ED and 29/31 = 94% for the ICU) and the lowest at time 3 (38/105 = 36% for the ED and 14/30 = 47% for the ICU). The results obtained from paired and unpaired analyses suggest that this type of multifaceted approach can improve staff perceptions of teamwork climate. The teamwork climate score in the ED was significantly higher at follow-up (Mt2 = 3.42, SD = 0.66) compared to baseline (Mt1 = 3.13, SD = 0.72), (F(1, 34) = 12.2, p = .001, eta2p = .263), while baseline and follow-up scores were not significantly different between baseline and follow-up for the ICU group (Mt1 = 4.12, SD = 0.60; Mt2 = 4.15, SD = 0.56; F(1, 34) = 0.06, p = .806, eta2p = .002). Sustaining high levels of participation in interprofessional initiatives and engaging physicians remain challenging when interventions are used in context. Improving team communication is a broad and challenging area that continues to require attention.

Burden of common mental disorders in a community health centre sample.

OBJECTIVE: To examine the rates of common mental disorders (CMDs) such as depression, anxiety, posttraumatic stress disorder (PTSD), and alcohol use in an urban community health care centre (CHC) serving vulnerable immigrant and ethnoracial communities in order to improve knowledge on the rates of CMDs specific to these groups accessing primary care settings. DESIGN: English or Spanish, self-administered, tablet-based survey known as the Interactive Computer-Assisted Client Assessment Survey (iCCAS). SETTING: Access Alliance Multicultural Health and Community Services CHC in Toronto, Ont. PARTICIPANTS: Adult patients waiting to see a clinician. MAIN OUTCOME MEASURES: The iCCAS screened for depression (using the PHQ-9 [Patient Health Questionnaire]), anxiety (using the GAD-7 [Generalized Anxiety Disorder 7-item scale]), PTSD (using the PC-PTSD [Primary Care PTSD Screen]), and alcohol dependency (using the CAGE questionnaire); those with an existing diagnosis and active treatment for one of these conditions were not asked to complete that condition-specific screening scale. An exit survey measured demographic characteristics and relevant indicators. RESULTS: A response rate of 78.6% was achieved. The iCCAS survey was completed by 75 patients (26 men and 49 women) with a mean age of 36.5 years. Almost all were first-generation immigrants: 32.0% originated from Latin America, 28.0% from South Asia, and 17.3% from Africa or the Middle East. Major depression was found among 44.0% of participants (11 with diagnosis and treatment, 22 with a score of 10 or greater on the PHQ-9). Generalized anxiety disorder was present in 26.7% of participants (7 with diagnosis and treatment, 13 with a score of 10 or greater on the GAD-7 scale). Posttraumatic stress disorder was detected in 37.3% of participants (7 with diagnosis and treatment, 21 with a score of 3 or greater on the PC-PTSD tool). Alcohol dependency was found among 10.7% of participants (1 with diagnosis and treatment, 7 with a score of 2 or greater on the CAGE questionnaire). CONCLUSION: The high rates of probable depression, generalized anxiety, and PTSD that were found in the studied population suggest a need for systematic assessment of CMDs in CHCs, as well as training and resources to increase readiness to handle identified cases.

Understanding nurses' and physicians' fear of repercussions for reporting errors: clinician characteristics, organization demographics, or leadership factors?

BACKGROUND: Identifying and understanding factors influencing fear of repercussions for reporting and discussing medical errors in nurses and physicians remains an important area of inquiry. Work is needed to disentangle the role of clinician characteristics from those of the organization-level and unit-level safety environments in which these clinicians work and learn, as well as probing the differing reporting behaviours of nurses and physicians. This study examines the influence of clinician demographics (age, gender, and tenure), organization demographics (teaching status, location of care, and province) and leadership factors (organization and unit leadership support for safety) on fear of repercussions, and does so for nurses and physicians separately. METHODS: A cross-sectional analysis of 2319 nurse and 386 physician responders from three Canadian provinces to the Modified Stanford patient safety climate survey (MSI-06). Data were analyzed using exploratory factor analysis, multiple linear regression, and hierarchical linear regression. RESULTS: Age, gender, tenure, teaching status, and province were not significantly associated with fear of repercussions for nurses or physicians. Mental health nurses had poorer fear responses than their peers outside of these areas, as did community physicians. Strong organization and unit leadership support for safety explained the most variance in fear for both nurses and physicians. CONCLUSIONS: The absence of associations between several plausible factors including age, tenure and teaching status suggests that fear is a complex construct requiring more study. Substantially differing fear responses across locations of care indicate areas where interventions may be needed. In addition, since factors affecting fear of repercussions appear to be different for nurses and physicians, tailoring patient safety initiatives to each group may, in some instances, be fruitful. Although further investigation is needed to examine these and other factors in detail, supportive safety leadership appears to be central to reducing fear of reporting errors for both nurses and physicians.

Patient safety climate (PSC) perceptions of frontline staff in acute care hospitals: examining the role of ease of reporting, unit norms of openness, and participative leadership.

BACKGROUND: Increased awareness regarding the importance of patient safety issues has led to the proliferation of theoretical conceptualizations, frameworks, and articles that apply safety experiences from high-reliability industries to medical settings. However, empirical research on patient safety and patient safety climate in medical settings still lags far behind the theoretical literature on these topics. PURPOSE: The broader organizational literature suggests that ease of reporting, unit norms of openness, and participative leadership might be important variables for improving patient safety. The aim of this empirical study is to examine in detail how these three variables influence frontline staff perceptions of patient safety climate within health care organizations. METHODOLOGY: A cross-sectional study design was used. Data were collected using a questionnaire composed of previously validated scales. FINDINGS: The results of the study show that ease of reporting, unit norms of openness, and participative leadership are positively related to staff perceptions of patient safety climate. PRACTICE IMPLICATIONS: Health care management needs to involve frontline staff during the development and implementation stages of an error reporting system to ensure staff perceive error reporting to be easy and efficient. Senior and supervisory leaders at health care organizations must be provided with learning opportunities to improve their participative leadership skills so they can better integrate frontline staff ideas and concerns while making safety-related decisions. Finally, health care management must ensure that frontline staff are able to freely communicate safety concerns without fear of being punished or ridiculed by others.

Development and validation of the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI).

BACKGROUND: In many quality improvement (QI) and other complex interventions, assessing the fidelity with which participants 'enact' intervention activities (ie, implement them as intended) is underexplored. Adapting the evaluative approach used in objective structured clinical examinations, we aimed to develop and validate a practical approach to assessing fidelity enactment-the Overall Fidelity Enactment Scale for Complex Interventions (OFES-CI). METHODS: We developed the OFES-CI to evaluate enactment of the SCOPE QI intervention, which teaches nursing home teams to use plan-do-study-act (PDSA) cycles. The OFES-CI was piloted and revised early in SCOPE with good inter-rater reliability, so we proceeded with a single rater. An intraclass correlation coefficient (ICC) was used to assess inter-rater reliability. For 27 SCOPE teams, we used ICC to compare two methods for assessing fidelity enactment: (1) OFES-CI ratings provided by one of five trained experts who observed structured 6 min PDSA progress presentations made at the end of SCOPE, (2) average rating of two coders' deductive content analysis of qualitative process evaluation data collected during the final 3 months of SCOPE (our gold standard). RESULTS: Using Cicchetti's classification, inter-rater reliability between two coders who derived the gold standard enactment score was 'excellent' (ICC=0.93, 95% CI=0.85 to 0.97). Inter-rater reliability between the OFES-CI and the gold standard was good (ICC=0.71, 95% CI=0.46 to 0.86), after removing one team where open-text comments were discrepant with the rating. Rater feedback suggests the OFES-CI has strong face validity and positive implementation qualities (acceptability, easy to use, low training requirements). CONCLUSIONS: The OFES-CI provides a promising novel approach for assessing fidelity enactment in QI and other complex interventions. It demonstrates good reliability against our gold standard assessment approach and addresses the practicality problem in fidelity assessment by virtue of its suitable implementation qualities. Steps for adapting the OFES-CI to other complex interventions are offered.

Building a Program Theory of Implementation Using Process Evaluation of a Complex Quality Improvement Trial in Nursing Homes.

BACKGROUND AND OBJECTIVES: Significant quality problems exist in long-term care (LTC). Interventions to improve care are complex and often have limited success. Implementation remains a black box. We developed a program theory explaining how implementation of a complex intervention occurs in LTC settings-examining mechanisms of impact, effects of context on implementation, and implementation outcomes such as fidelity. RESEARCH DESIGN AND METHODS: Concurrent process evaluation of Safer Care for Older Persons in residential Environments (SCOPE)-a frontline worker (care aide) led improvement trial in 31 Canadian LTC homes. Using a mixed-methods exploratory sequential design, qualitative data were analyzed using grounded theory to develop a conceptual model illustrating how teams implemented the intervention and how it produced change. Quantitative analyses (mixed-effects regression) tested aspects of the program theory. RESULTS: Implementation fidelity was moderate. Implementation is facilitated by (a) care aide engagement with core intervention components; (b) supportive leadership (internal facilitation) to create positive team dynamics and help negotiate competing workplace priorities; (c) shifts in care aide role perceptions and power differentials. Mixed-effects model results suggest intervention acceptability, perceived intervention benefits, and leadership support predict implementation fidelity. When leadership support is high, fidelity is high regardless of intervention acceptability or perceived benefits. DISCUSSION AND IMPLICATIONS: Our program theory addresses important knowledge gaps regarding implementation of complex interventions in nursing homes. Results can guide scaling of complex interventions and future research.

Workforce resilience supporting staff in managing stress: A coherent breathing intervention for the long-term care workforce.

BACKGROUND: Staff in long-term care (LTC) homes have long-standing stressors, such as short staffing and high workloads. These stressors increased during the COVID-19 pandemic; better resources are needed to help staff manage stress and well-being. The purpose of this study was to evaluate the effect of a simple stress management strategy (coherent breathing). METHODS: We conducted a pre-post intervention study to evaluate a self-managed coherent breathing intervention from February to September 2022. The intervention included basic (breathing only) and comprehensive (breathing plus a biofeedback device) groups. Six hundred eighty-six participants were initially recruited (359 and 327 in the comprehensive and basic groups respectively) from 31 LTC homes in Alberta, Canada. Two hundred fifty-four participants completed pre-and post-intervention questionnaires (142 [55.9%] in comprehensive and 112 [44.1%] in basic). Participants were asked to use coherent breathing based on a schedule increasing from 2 to 10 min daily, 5-7 times a week over 8 weeks. Participants completed self-administered online questionnaires pre- and post-intervention to assess outcomes-stress, psychological distress, anxiety, depression, resilience, insomnia, compassion satisfaction, compassion fatigue, and burnout. We used a mixed-effects regression model to test the main effect of time (pre- and post-intervention) and group while testing the interaction between time and group and controlling for covariates. RESULTS: We found statistically significant changes from pre- to post-intervention in stress (b = -2.5, p < 0.001, 95% CI = -3.1, -1.9), anxiety (b = -0.5, p < 0.001, 95% CI = -0.7, -0.3), depression (b = -0.4, p < 0.001, 95% CI = -0.6, -0.2), insomnia (b = -1.5, p < 0.001, 95% CI = -2.1, -0.9), and resilience (b = 0.2, p < 0.001, 95% CI = 0.1, 0.2). We observed no statistically significant differences between the two intervention groups on any outcome. CONCLUSIONS: Our findings suggest that coherent breathing is a promising strategy for improving stress-related outcomes and resilience. This intervention warrants further, more rigorous testing.

Developing a tool to measure enactment of complex quality improvement interventions in healthcare.

Quality improvement (QI) projects are common in healthcare settings and often involve interdisciplinary teams working together towards a common goal. Many interventions and programmes have been introduced through research to convey QI skills and knowledge to healthcare workers, however, a few studies have attempted to differentiate between what individuals 'learn' or 'know' versus their capacity to apply their learnings in complex healthcare settings. Understanding and differentiating between delivery, receipt, and enactment of QI skills and knowledge is important because while enactment alone does not guarantee desired QI outcomes, it might be reasonably assumed that 'better enactment' is likely to lead to better outcomes. This paper describes the development, application and validation of a tool to measure enactment of core QI skills and knowledge of a complex QI intervention in a healthcare setting. Based on the Institute for Healthcare Improvement's Model for Improvement, existing QI assessment tools, literature on enactment fidelity and our research protocols, 10 indicators related to core QI skills and knowledge were determined. Definitions and assessment criteria were tested and refined in five iterative cycles. Qualitative data from four QI teams in long-term care homes were used to test and validate the tool. The final measurement tool contains 10 QI indicators and a five-point scale. Inter-rater reliability ranged from good to excellent. Usability and acceptability among raters were considered high. This measurement tool assists in identifying strengths and weaknesses of a QI team and allows for targeted feedback on core QI components. The indicators developed in our tool and the approach to tool development may be useful in other health related contexts where similar data are collected.

Safer Care for Older Persons in (residential) Environments (SCOPE): a pragmatic controlled trial of a care aide-led quality improvement intervention.

BACKGROUND: The increased complexity of residents and increased needs for care in long-term care (LTC) have not been met with increased staffing. There remains a need to improve the quality of care for residents. Care aides, providers of the bulk of direct care, are well placed to contribute to quality improvement efforts but are often excluded from so doing. This study examined the effect of a facilitation intervention enabling care aides to lead quality improvement efforts and improve the use of evidence-informed best practices. The eventual goal was to improve both the quality of care for older residents in LTC homes and the engagement and empowerment of care aides in leading quality improvement efforts. METHODS: Intervention teams participated in a year-long facilitative intervention which supported care aide-led teams to test changes in care provision to residents using a combination of networking and QI education meetings, and quality advisor and senior leader support. This was a controlled trial with random selection of intervention clinical care units matched 1:1 post hoc with control units. The primary outcome, between group change in conceptual research use (CRU), was supplemented by secondary staff- and resident-level outcome measures. A power calculation based upon pilot data effect sizes resulted in a sample size of 25 intervention sites. RESULTS: The final sample included 32 intervention care units matched to 32 units in the control group. In an adjusted model, there was no statistically significant difference between intervention and control units for CRU or in secondary staff outcomes. Compared to baseline, resident-adjusted pain scores were statistically significantly reduced (less pain) in the intervention group (p=0.02). The level of resident dependency significantly decreased statistically for residents whose teams addressed mobility (p<0.0001) compared to baseline. CONCLUSIONS: The Safer Care for Older Persons in (residential) Environments (SCOPE) intervention resulted in a smaller change in its primary outcome than initially expected resulting in a study underpowered to detect a difference. These findings should inform sample size calculations of future studies of this nature if using similar outcome measures. This study highlights the problem with measures drawn from current LTC databases to capture change in this population. Importantly, findings from the trial's concurrent process evaluation provide important insights into interpretation of main trial data, highlight the need for such evaluations of complex trials, and suggest the need to consider more broadly what constitutes "success" in complex interventions. TRIAL REGISTRATION: ClinicalTrials.gov , NCT03426072, registered August 02, 2018, first participant site April, 05, 2018.

Perspectives on patient safety among undergraduate nursing students.

Incorporating patient safety principles in academic and clinical education for health science professionals is necessary to support widespread adoption of safety practices. It is vital to understand nursing students' perspectives on patient safety and the extent to which patient safety is addressed in the classroom and clinical settings. In this cross-sectional study, students in all 4 years of an undergraduate program were asked to complete the Health Professional Education in Patient Safety Survey. Eighty-one percent (238 of 293) of students completed the questionnaire. Responses were favorable, with students reporting confidence in learning about a variety of patient safety competencies. Of note, there were decreasing levels of confidence in the third-year and fourth-year students and low-to-moderate correlation between classroom and clinical responses. These results support the importance of consistently engaging students in safety principles early in and throughout their health care programs.

SCOPE: safer care for older persons (in residential) environments-a pilot study to enhance care aide-led quality improvement in nursing homes.

BACKGROUND: Nursing home residents require daily support. While care aides provide most of this support they are rarely empowered to lead quality improvement (QI) initiatives. Researchers have shown that care aide-led teams can successfully participate in a QI intervention called Safer Care for Older Persons in Residential Care Environments (SCOPE). In preparation for a large-scale study, we conducted a 1-year pilot to evaluate how well coaching strategies helped teams to enact this intervention. Secondarily, we measured if improvements in team cohesion and communication, and resident quality of care, occurred. METHODS: This study was conducted using a prospective single-arm study design, on 7 nursing homes in Winnipeg Manitoba belonging to the Translating Research in Elder Care research program. One QI team was selected per site, led by care aides who partnered with other front-line staff. Each team received facilitated coaching to enact SCOPE during three learning sessions, and additional support from quality advisors between these sessions. Researchers developed a rubric to evaluate how well teams enacted their interventions (i.e., created actionable aim statements, implemented interventions using plan-do-study-act cycles, and used measurement to guide decision-making). Team cohesion and communication were measured using surveys, and changes in unit-level quality indicators were measured using Resident Assessment Instrument-Minimum Data Set data. RESULTS: Most teams successfully enacted their interventions. Five of 7 teams created adequate-to-excellent aim statements. While 6 of 7 teams successfully implemented plan-do-study-act cycles, only 2 reported spreading their change ideas to other residents and staff on their unit. Three of 7 teams explicitly stated how measurement was used to guide intervention decisions. Teams scored high in cohesion and communication at baseline, and hence improved minimally. Indicators of resident quality care improved in 4 nursing home units; teams at 3 of these sites were scored as 'excellent' in two or more enactment areas, versus 1 of the 3 remaining teams. CONCLUSIONS: Our coaching strategies helped most care aide-led teams to enact SCOPE. Coaching modifications are needed to help teams more effectively use measurement. Refinements to our evaluation rubric are also recommended.

Reporting unit context data to stakeholders in long-term care: a practical approach.

BACKGROUND: The importance of reporting research evidence to stakeholders in ways that balance complexity and usability is well-documented. However, guidance for how to accomplish this is less clear. We describe a method of developing and visualising dimension-specific scores for organisational context (context rank method). We explore perspectives of leaders in long-term care nursing homes (NHs) on two methods for reporting organisational context data: context rank method and our traditionally presented binary method-more/less favourable context. METHODS: We used a multimethod design. First, we used survey data from 4065 healthcare aides on 290 care units from 91 NHs to calculate quartiles for each of the 10 Alberta Context Tool (ACT) dimension scores, aggregated at the care unit level based on the overall sample distribution of these scores. This ordinal variable was then summed across ACT scores. Context rank scores were assessed for associations with outcomes for NH staff and for quality of care (healthcare aides' instrumental and conceptual research use, job satisfaction, rushed care, care left undone) using regression analyses. Second, we used a qualitative descriptive approach to elicit NH leaders' perspectives on whether the methods were understandable, meaningful, relevant, and useful. With 16 leaders, we conducted focus groups between December 2017 and June 2018: one in Nova Scotia, one in Prince Edward Island, and one in Ontario, Canada. Data were analysed using content analysis. RESULTS: Composite scores generated using the context rank method had positive associations with healthcare aides' instrumental research use (p < .0067) and conceptual research use and job satisfaction (p < .0001). Associations were negative between context rank summary scores and rushed care and care left undone (p < .0001). Overall, leaders indicated that data presented by both methods had value. They liked the binary method as a starting point but appreciated the greater level of detail in the context rank method. CONCLUSIONS: We recommend careful selection of either the binary or context rank method based on purpose and audience. If a simple, high-level overview is the goal, the binary method has value. If improvement is the goal, the context rank method will give leaders more actionable details.

Staff, space, and time as dimensions of organizational slack: a psychometric assessment.

BACKGROUND: : In the theoretical and research literature, organizational slack has been largely described in terms of financial resources and its impact on organizational outcomes. However, empirical research is limited by unclear definitions and lack of standardized measures. PURPOSE: : The aim of this study was to assess the psychometric properties of a new organizational slack measure in health care settings. METHODS: : A total of 752 nurses and 197 allied health care professionals (AHCPs) employed in seven pediatric Canadian hospitals completed the Alberta Context Tool, an instrument measuring organizational context, which includes the newly developed organizational slack measure. The nine-item, 5-point Likert organizational slack measure includes items assessing staff perceptions of available human resources (staffing), time, and space. We report psychometric assessments, bivariate analyses, and data aggregation indices for the measure. FINDINGS: : The findings indicate that the measure has three subscales (staff, space, and time) with acceptable internal consistency reliability (alphas for staff, space, and time, respectively:.83,.63, and.74 for nurses;.81,.52, and.76 for AHCPs), links theory and hypotheses (construct validity), and is related to other relevant variables. Within-group reliability measures indicate stronger agreement among nurses than AHCPs, more reliable aggregation results in all three subscales at the unit versus facility level, and higher explained variance and validity of aggregated scores at the unit level. PRACTICE IMPLICATIONS: : The proposed organizational slack measure assesses modifiable organizational factors in hospitals and has the potential to explain variance in important health care system outcomes. Further assessments of the psychometric properties of the organizational slack measure in acute and long-term care facilities are underway.

Fidelity is not easy! Challenges and guidelines for assessing fidelity in complex interventions.

BACKGROUND: Fidelity in complex behavioural interventions is underexplored and few comprehensive or detailed fidelity studies report on specific procedures for monitoring fidelity. Using Bellg's popular Treatment Fidelity model, this paper aims to increase understanding of how to practically and comprehensively assess fidelity in complex, group-level, interventions. APPROACH AND LESSONS LEARNED: Drawing on our experience using a mixed methods approach to assess fidelity in the INFORM study (Improving Nursing home care through Feedback On perfoRMance data-INFORM), we report on challenges and adaptations experienced with our fidelity assessment approach and lessons learned. Six fidelity assessment challenges were identified: (1) the need to develop succinct tools to measure fidelity given tools tend to be intervention specific, (2) determining which components of fidelity (delivery, receipt, enactment) to emphasize, (3) unit of analysis considerations in group-level interventions, (4) missing data problems, (5) how to respond to and treat fidelity 'failures' and 'deviations' and lack of an overall fidelity assessment scheme, and (6) ensuring fidelity assessment doesn't threaten internal validity. RECOMMENDATIONS AND CONCLUSIONS: Six guidelines, primarily applicable to group-level studies of complex interventions, are described to help address conceptual, methodological, and practical challenges with fidelity assessment in pragmatic trials. The current study offers guidance to researchers regarding key practical, methodological, and conceptual challenges associated with assessing fidelity in pragmatic trials. Greater attention to fidelity assessment and publication of fidelity results through detailed studies such as this one is critical for improving the quality of fidelity studies and, ultimately, the utility of published trials. TRIAL REGISTRATION: ClinicalTrials.gov NCT02695836. Registered on February 24, 2016.