Mechanisms of change in external implementation support: A conceptual model and case examples to guide research and practice.

Background: External implementation support (EIS) is a well-recognized feature of implementation science and practice, often under related terms such as technical assistance and implementation facilitation. Existing models of EIS have gaps related to addressing practice outcomes at both individual and organizational levels, connecting practice activities to intended outcomes, or grounding in well-established theories of behavior and organization change. Moreover, there have been calls to clarify the mechanisms of change through which EIS influences related outcomes. Method: In this article, we theorize about mechanisms of change within EIS. Our theorizing process aligns with the approach advocated by Kislov et al. We aim to consolidate prior EIS literature, combining related constructs from previous empirical and conceptual work while drawing on our extensive EIS experience to develop a higher-order, midrange theory of change. Results: Our theory of change is empirically and practically informed, conceptually situated within an established grand theory of change, and guided by eight practice principles and social cognitive theory. The theory of change proposes 10 core practice components as mechanisms of change within EIS. When used according to underlying theory and principles, they are believed to contribute to favorable practice outcomes at individual, team, organizational, and system levels. The model offers flexibility by recognizing the need for sequential support processes and the demand to practice in dynamic and responsive ways. Case examples are presented to illustrate major themes and patterns of the model in action. Conclusions: The proposed model is intended to support prospective EIS studies by conceptualizing discernable practice components with hypothesized relationships to proximal and distal practice outcomes. The model can be behaviorally operationalized to compliment and extend competency-based approaches to implementation support practitioner (ISP) training and coaching. Over time, the model should be refined based on new empirical findings and contributions from ISPs across the field.

There are few models that help us understand how external support providers work with organizational, system, and community partners to improve their efforts to implement innovative programs and practices. Existing models typically describe characteristics and features of the process but lack grounding in well-established theories of behavior and organizational change. In this paper, we theorize about mechanisms of change within the support process, which we label core practice components, and explain how their use might improve implementation efforts through shorter- and longer-term practice outcomes. We believe that our model holds promise for informing future advancements in both research and practice. Foremost, the core practice components lend themselves to behavioral definitions and thus being observed and reported in action. In research, this will allow the relationships we propose in our model to be tested and refined over time, resulting in an incremental accumulation of knowledge. In practice, a greater understanding of core practice components and their relationships to key practice outcomes offers ways to enhance training and coaching activities for external support providers. The model may also aid support providers to more effectively navigate the support process and plan more timely and effective support strategies.

The Implementation Playbook: study protocol for the development and feasibility evaluation of a digital tool for effective implementation of evidence-based innovations.

BACKGROUND: Evidence-based innovations can improve health outcomes, but only if successfully implemented. Implementation can be complex, highly susceptible to failure, costly and resource intensive. Internationally, there is an urgent need to improve the implementation of effective innovations. Successful implementation is best guided by implementation science, but organizations lack implementation know-how and have difficulty applying it. Implementation support is typically shared in static, non-interactive, overly academic guides and is rarely evaluated. In-person implementation facilitation is often soft-funded, costly, and scarce. This study seeks to improve effective implementation by (1) developing a first-in-kind digital tool to guide pragmatic, empirically based and self-directed implementation planning in real-time; and (2) exploring the tool's feasibility in six health organizations implementing different innovations. METHODS: Ideation emerged from a paper-based resource, The Implementation Game©, and a revision called The Implementation Roadmap©; both integrate core implementation components from evidence, models and frameworks to guide structured, explicit, and pragmatic planning. Prior funding also generated user personas and high-level product requirements. This study will design, develop, and evaluate the feasibility of a digital tool called The Implementation Playbook©. In Phase 1, user-centred design and usability testing will inform tool content, visual interface, and functions to produce a minimum viable product. Phase 2 will explore the Playbook's feasibility in six purposefully selected health organizations sampled for maximum variation. Organizations will use the Playbook for up to 24 months to implement an innovation of their choosing. Mixed methods will gather: (i) field notes from implementation team check-in meetings; (ii) interviews with implementation teams about their experience using the tool; (iii) user free-form content entered into the tool as teams work through implementation planning; (iv) Organizational Readiness for Implementing Change questionnaire; (v) System Usability Scale; and (vi) tool metrics on how users progressed through activities and the time required to do so. DISCUSSION: Effective implementation of evidence-based innovations is essential for optimal health. We seek to develop a prototype digital tool and demonstrate its feasibility and usefulness across organizations implementing different innovations. This technology could fill a significant need globally, be highly scalable, and potentially valid for diverse organizations implementing various innovations.

The Triple P Implementation Framework: the Role of Purveyors in the Implementation and Sustainability of Evidence-Based Programs.

Evidence-based programs are considered critical in the human services field if major social and health problems are to be addressed. Despite the large number of programs that have been developed and implemented, there is much to learn about how to effectively implement these programs in community settings. One perspective that is rarely represented in the literature is that of the purveyor organization (an organization that actively works to disseminate and support the implementation of a program or practice). This paper introduces the Triple P Implementation Framework, developed by the program's purveyor organization, and discusses principles underlying the design and implementation of the Framework. The Framework incorporates two key underlying principles of the Triple P system: minimal sufficiency and self-regulation. Lessons learned from the application of these principles and the implementation process are discussed, along with directions for future research.

The current utility of ultrasound in the diagnosis of acute appendicitis.

The purpose of this study is to evaluate the current performance of ultrasound in the diagnosis of acute appendicitis. Retrospectively, patients who presented to a single institution between 2011 and 2012 were included. Diagnostic accuracy was calculated, with surgery considered gold-standard. Our data demonstrates that US relative to surgery-confirmed appendicitis has a sensitivity and specificity of 48.4% and 97.9%, respectively. The diagnostic accuracy was further increased when there was a low pre-test probability, with a NPV of up to 96.6%. Ultrasound has a strong PPV in the diagnosis of acute appendicitis, and in equivocal cases, the NPV is reliable.

The application of implementation science for pressure ulcer prevention best practices in an inpatient spinal cord injury rehabilitation program.

OBJECTIVES: To implement pressure ulcer (PU) prevention best practices in spinal cord injury (SCI) rehabilitation using implementation science frameworks. DESIGN: Quality improvement. SETTING: SCI Rehabilitation Center. PARTICIPANTS: Inpatients admitted January 2012 to July 2013. INTERVENTIONS: Implementation of two PU best practices were targeted: (1) completing a comprehensive PU risk assessment and individualized interprofessional PU prevention plan (PUPP); and (2) providing patient education for PU prevention; as part of the pan-Canadian SCI Knowledge Mobilization Network. At our center, the SCI Pressure Ulcer Scale replaced the Braden risk assessment scale and an interprofessional PUPP form was implemented. Comprehensive educational programing existed, so efforts focused on improving documentation. Implementation science frameworks provided structure for a systematic approach to best practice implementation (BPI): (1) site implementation team, (2) implementation drivers, (3) stages of implementation, and (4) improvement cycles. Strategies were developed to address key implementation drivers (staff competency, organizational supports, and leadership) through the four stages of implementation: exploration, installation, initial implementation, and full implementation. Improvement cycles were used to address BPI challenges. OUTCOME MEASURES: Implementation processes (e.g. staff training) and BPI outcomes (completion rates). RESULTS: Following BPI, risk assessment completion rates improved from 29 to 82%. The PUPP completion rate was 89%. PU education was documented for 45% of patients (vs. 21% pre-implementation). CONCLUSION: Implementation science provided a framework and effective tools for successful pressure ulcer BPI in SCI rehabilitation. Ongoing improvement cycles will target timeliness of tool completion and documentation of patient education.

Does training and experience influence the accuracy of computed tomography colonography interpretation?

AIM: To evaluate the effect of experience on the accuracy rate of computed tomography colonography (CTC) interpretation and patient preferences/satisfaction for CTC and colonoscopy. METHODS: A prospective, non-randomized, observational study performed in a single, tertiary care center involving 90 adults who underwent CTC followed by colonoscopy on the same day. CTC was interpreted by an abdominal imaging radiologist and then a colonoscopy was performed utilizing segmental un-blinding and re-examination as required. A radiology resident and two gastroenterology (GI) fellows blinded to the results also interpreted the CTC datasets independently. Accuracy rates and trend changes were determined for each reader to assess for a learning curve. RESULTS: Among 90 patients (57% male) aged 55 ± 8.9 years, 39 polyps ≥ 6 mm were detected in 20 patients and 13 polyps > 9 mm in 10 patients. Accuracy rates were 88.9% (≥ 6 mm) and 93.3% (> 9 mm) for the GI Radiologist, 89.8% (≥ 6 mm) and 98.9% (> 9 mm) for the Radiology Resident and 86.7% and 95.6% (≥ 6 mm) and 87.8% and 94.4% (> 9 mm) for each of the GI fellows respectively. The reader's accuracy rate did not change significantly with the percentage change rate ranging between -1.7 to 0.9 (P = 0.12 to 0.56). Patients considered colonoscopy more satisfactory than CTC (30% vs 4%, P < 0.0001), they felt less anxiety during colonoscopy (36% vs 7%, P < 0.0001), they experienced less pain or discomfort during colonoscopy compared to CTC (69% vs 4%, P < 0.0001) and colonoscopy was preferred by 77% of the participants as a repeat screening test for the future. CONCLUSION: No statistically significant learning curve was identified in CTC interpretation suggesting that further study is required to identify the necessary training to adequately interpret CTC scans.

Significance of various pulmonary and extrapulmonary abnormalities on HRCT of the chest in scleroderma lung.

Patients with systemic sclerosis (SSc) are routinely investigated with high-resolution computed tomography (HRCT) chest for early detection and accurate characterization of complicating interstitial lung diseases. Though the primary aim of HRCT is to delineate the burden of pulmonary involvement and to characterize the nature of fibrosis to potentially help guide management, it provides an opportunity to evaluate extrapulmonary manifestations, particularly the dilated pulmonary artery, esophageal dilatation, and pericardial abnormalities which have their own clinical significance. The aim of this article is to discuss the significance of various pulmonary and extrapulmonary abnormalities that may be identified on HRCT chest of SSc patients.

Oesophageal dilatation on high-resolution CT chest in systemic sclerosis: what does it signify?

OBJECTIVE: To evaluate the significance of oesophageal dilatation on high-resolution CT (HRCT) chest in patients with systemic sclerosis. METHODS: We retrospectively retrieved the database of patients with systemic sclerosis seen at our hospital between January 2008 and January 2009. A total of 50 patients (46 women and four men) who had HRCT chest, pulmonary function testing and echocardiography within 1 month were included in the study. Peak pulmonary artery (PA) pressures and pulmonary function testing were charted. The HRCT chest was interpreted by a chest radiologist. Oesophageal dilatation was defined as a luminal coronal diameter of ≥9 mm in infra-aortic oesophagus. Extent of ground glass, reticulation and honeycombing was objectively scored. RESULTS: Statistical analysis using independent t-test showed that diffusion capacity of carbon monoxide was significantly lower (P = 0.042) and peak PA pressures were significantly higher (P = 0.045) in patients with oesophageal dilatation (n = 29) as compared with those without oesophageal dilatation (n = 21). The two cohorts had no significant difference in their total lung capacity and HRCT determined extent of interstitial lung disease. CONCLUSION: Patients with oesophageal dilatation on HRCT chest had significantly lower diffusion capacity of carbon monoxide and higher peak PA pressures, which suggest that these patients tend to have more severe pulmonary vascular disease.

Predictors of pulmonary hypertension on high-resolution computed tomography of the chest in systemic sclerosis: a retrospective analysis.

PURPOSE: To evaluate the imaging features on high-resolution computed tomography (HRCT) of the chest and the clinical parameters that are associated with pulmonary hypertension in systemic sclerosis. We specifically investigated whether main pulmonary artery (MPA) diameter and burden of lung fibrosis are predictors of pulmonary hypertension in these patients. METHODS: We retrospectively retrieved the database information of patients with systemic sclerosis seen at our hospital between January 2007 and December 2008. A total of 75 patients had HRCT of the chest, pulmonary function testing (PFT), and echocardiography within 6 months of each other. The echocardiography images were reviewed by a level-3 echocardiographer, and 29 cases were excluded because of suboptimal evaluation of pulmonary artery (PA) pressure. Peak PA pressures and PFT of the remaining 46 cases (43 women and 3 men) were charted. The PFT included total lung capacity (TLC), diffusion capacity of lung for carbon monooxide (DLCO) and the ratio of forced expiratory volume in one second and forced vital capacity (FEV1/FVC). The HRCT of the chest of each patient was read by a chest radiologist. The extent of ground glass, reticulation, and honeycombing was objectively scored. The maximum diameter of the main pulmonary artery (MPAD) and ascending aorta were measured. The ratio of main pulmonary artery diameter and ascending aortic diameter (MPAD/AD) and ratio of main pulmonary artery diameter and body surface area (MPAD/BSA) were also calculated. RESULTS: Statistical analysis done by using a multivariate model showed that the calculated fibrotic score strongly correlated with peak PA pressures (P < .001). MPAD (P = .0175), and the ratio MPAD/AD (P = .0102) also showed a statistically significant correlation with peak PA pressures. By using stepwise regression analysis, the fibrotic score was found to be the most reliable independent predictor of pulmonary hypertension. CONCLUSION: HRCT-determined severity and extent of pulmonary fibrosis may be helpful in screening for pulmonary hypertension in patients with systemic sclerosis.