Bridges and Mechanisms: Integrating Systems Science Thinking into Implementation Research.

We present a detailed argument for how to integrate, or bridge, systems science thinking and methods with implementation science. We start by showing how fundamental systems science principles of structure, dynamics, information, and utility are relevant for implementation science. Then we examine the need for implementation science to develop and apply richer theories of complex systems. This can be accomplished by emphasizing a causal mechanisms approach. Identifying causal mechanisms focuses on the "cogs and gears" of public health, clinical, and organizational interventions. A mechanisms approach focuses on how a specific strategy will produce the implementation outcome. We show how connecting systems science to implementation science opens new opportunities for examining and addressing social determinants of health and conducting equitable and ethical implementation research. Finally, we present case studies illustrating successful applications of systems science within implementation science in community health policy, tobacco control, health care access, and breast cancer screening.

Designing for Dissemination and Sustainability to Promote Equitable Impacts on Health.

Designing for dissemination and sustainability (D4DS) refers to principles and methods for enhancing the fit between a health program, policy, or practice and the context in which it is intended to be adopted. In this article we first summarize the historical context of D4DS and justify the need to shift traditional health research and dissemination practices. We present a diverse literature according to a D4DS organizing schema and describe a variety of dissemination products, design processes and outcomes, and approaches to messaging, packaging, and distribution. D4DS design processes include stakeholder engagement, participatory codesign, and context and situation analysis, and leverage methods and frameworks from dissemination and implementation science, marketing and business, communications and visualarts, and systems science. Finally, we present eight recommendations to adopt a D4DS paradigm, reflecting shifts in ways of thinking, skills and approaches, and infrastructure and systems for training and evaluation.

Patterns and correlates of mis-implementation in state chronic disease public health practice in the United States.

BACKGROUND: Much of the disease burden in the United States is preventable through application of existing knowledge. State-level public health practitioners are in ideal positions to affect programs and policies related to chronic disease, but the extent to which mis-implementation occurring with these programs is largely unknown. Mis-implementation refers to ending effective programs and policies prematurely or continuing ineffective ones. METHODS: A 2018 comprehensive survey assessing the extent of mis-implementation and multi-level influences on mis-implementation was reported by state health departments (SHDs). Questions were developed from previous literature. Surveys were emailed to randomly selected SHD employees across the Unites States. Spearman's correlation and multinomial logistic regression were used to assess factors in mis-implementation. RESULTS: Half (50.7%) of respondents were chronic disease program managers or unit directors. Forty nine percent reported that programs their SHD oversees sometimes, often or always continued ineffective programs. Over 50% also reported that their SHD sometimes or often ended effective programs. The data suggest the strongest correlates and predictors of mis-implementation were at the organizational level. For example, the number of organizational layers impeded decision-making was significant for both continuing ineffective programs (OR=4.70; 95% CI=2.20, 10.04) and ending effective programs (OR=3.23; 95% CI=1.61, 7.40). CONCLUSION: The data suggest that changing certain agency practices may help in minimizing the occurrence of mis-implementation. Further research should focus on adding context to these issues and helping agencies engage in appropriate decision-making. Greater attention to mis-implementation should lead to greater use of effective interventions and more efficient expenditure of resources, ultimately to improve health outcomes.

Modelling the impact of menthol sales restrictions and retailer density reduction policies: insights from tobacco town Minnesota.

INTRODUCTION: Tobacco control policies focused on the retail environment have the potential to reduce tobacco use and tobacco-related health disparities through increasing direct and indirect costs. Recently, national and subnational governments have begun to restrict the sale of menthol products and reduce tobacco retailer density. METHODS: We developed an agent-based model to project the impact of menthol cigarette sales restrictions and retailer density reduction policies for six types of communities and three priority populations. During each simulated day, agents smoke cigarettes, travel in the community and make purchase decisions-whether, where and which product type to purchase-based on a combination of their own properties and the current retail environment. RESULTS: Of the policies tested, restricting all cigarette sales or menthol cigarette sales to tobacco specialty shops may have the largest effect on the total (direct and indirect) costs of purchasing cigarettes. Coupling one of these policies with one that establishes a minimum distance between tobacco retailers may enhance the impact. Combining these policies could also make the costs of acquiring cigarettes more equal across communities and populations. DISCUSSION: Our simulations revealed the importance of context, for example, lower income communities in urban areas begin with higher retailer density and may need stronger policies to show impact, as well as the need to focus on differential effects for priority populations, for example, combinations of policies may equalise the average distance travelled to purchase. Adapting and combining policies could enhance the sustainability of policy effects and reduce tobacco use.

Tobacco Town: Computational Modeling of Policy Options to Reduce Tobacco Retailer Density.

OBJECTIVES: To identify the behavioral mechanisms and effects of tobacco control policies designed to reduce tobacco retailer density. METHODS: We developed the Tobacco Town agent-based simulation model to examine 4 types of retailer reduction policies: (1) random retailer reduction, (2) restriction by type of retailer, (3) limiting proximity of retailers to schools, and (4) limiting proximity of retailers to each other. The model examined the effects of these policies alone and in combination across 4 different types of towns, defined by 2 levels of population density (urban vs suburban) and 2 levels of income (higher vs lower). RESULTS: Model results indicated that reduction of retailer density has the potential to decrease accessibility of tobacco products by driving up search and purchase costs. Policy effects varied by town type: proximity policies worked better in dense, urban towns whereas retailer type and random retailer reduction worked better in less-dense, suburban settings. CONCLUSIONS: Comprehensive retailer density reduction policies have excellent potential to reduce the public health burden of tobacco use in communities.

Disparities in tobacco marketing and product availability at the point of sale: Results of a national study.

OBJECTIVE: Neighborhood socioeconomic and racial/ethnic disparities exist in the amount and type of tobacco marketing at retail, but most studies are limited to a single city or state, and few have examined flavored little cigars. Our purpose is to describe tobacco product availability, marketing, and promotions in a national sample of retail stores and to examine associations with neighborhood characteristics. METHODS: At a national sample of 2230 tobacco retailers in the contiguous US, we collected in-person store audit data on: Availability of products (e.g., flavored cigars), quantity of interior and exterior tobacco marketing, presence of price promotions, and marketing with youth appeal. Observational data were matched to census tract demographics. RESULTS: Over 95% of stores displayed tobacco marketing; the average store featured 29.5 marketing materials. 75.1% of stores displayed at least one tobacco product price promotion, including 87.2% of gas/convenience stores and 85.5% of pharmacies. 16.8% of stores featured marketing below three feet, and 81.3% of stores sold flavored cigars, both of which appeal to youth. Stores in neighborhoods with the highest (vs. lowest) concentration of African-American residents had more than two times greater odds of displaying a price promotion (OR=2.1) and selling flavored cigars (OR=2.6). Price promotions were also more common in stores located in neighborhoods with more residents under age 18. CONCLUSIONS AND RELEVANCE: Tobacco companies use retail marketing extensively to promote their products to current customers and youth, with disproportionate targeting of African Americans. Local, state, and federal policies are needed to counteract this unhealthy retail environment.

Reducing Disparities in Tobacco Retailer Density by Banning Tobacco Product Sales Near Schools.

INTRODUCTION: This study examined whether a policy of banning tobacco product retailers from operating within 1000 feet of schools could reduce existing socioeconomic and racial/ethnic disparities in tobacco retailer density. METHODS: We geocoded all tobacco retailers in Missouri (n = 4730) and New York (n = 17 672) and linked them with Census tract characteristics. We then tested the potential impact of a proximity policy that would ban retailers from selling tobacco products within 1000 feet of schools. RESULTS: Our results confirmed socioeconomic and racial/ethnic disparities in tobacco retailer density, with more retailers found in areas with lower income and greater proportions of African American residents. A high proportion of retailers located in these areas were in urban areas, which also have stores located in closer proximity to schools. If a ban on tobacco product sales within 1000 feet of schools were implemented in New York, the number of tobacco retailers per 1000 people would go from 1.28 to 0.36 in the lowest income quintile, and from 0.84 to 0.45 in the highest income quintile. In New York and Missouri, a ban on tobacco product sales near schools would either reduce or eliminate existing disparities in tobacco retailer density by income level and by proportion of African American. CONCLUSIONS: Proximity-based point of sale (POS) policies banning tobacco product sales near schools appear to be more effective in reducing retailer density in lower income and racially diverse neighborhoods than in higher income and white neighborhoods, and hold great promise for reducing tobacco-related disparities at the POS. IMPLICATIONS: Given the disparities-reducing potential of policies banning tobacco product sales near schools, jurisdictions with tobacco retailer licensing should consider adding this provision to their licensing requirements. Since relatively few jurisdictions currently ban tobacco sales near schools, future research should examine ways to increase and monitor the uptake of this policy, and assess whether it has an impact upon reducing exposure to tobacco marketing and on tobacco product availability and use.

Reduced Social Network Drinking is Associated with Improved Response Inhibition in Women During Early Recovery from Alcohol Use Disorders: A Pilot Study.

BACKGROUND: Social support for recovery from alcohol use disorders (AUDs) is associated with improvements in self-reported impulsive behavior in individuals treated for AUDs. We build on these findings using a behavioral task-based measure of response inhibition, a well-defined component of impulsivity, to examine the association of disinhibition with alcohol-specific social network characteristics during early recovery. METHODS: Women (n = 28) were recruited from treatment for AUD within 3 to 4 weeks of their last drink and were assessed at baseline and again 3 months later. Outcome measures were level of disinhibition at baseline and change in disinhibition from baseline to follow-up, measured using a computer-based continuous performance test. The primary independent variables were level of drinking in the social network at baseline and change in network drinking from baseline to follow-up. RESULTS: The sample [50% black, age M (SD) = 42.3 (9.5)] reported high rates of physical and sexual abuse before age 13 (43%), psychiatric disorder (71%), drug use disorder (78%), and previous treatment (71%). More drinking in participants' social networks was associated with greater disinhibition at baseline (ß = 12.5, 95% CI = 6.3, 18.7). A reduction in network drinking from baseline to follow-up was associated with reduced disinhibition (ß = -6.0, 95% CI = -11.3, -0.78) independent of IQ, recent alcohol consumption, and self-reported negative urgency. CONCLUSIONS: This study extends previous findings of an association between social networks and self-reported impulsivity to a neurobehavioral phenotype, response inhibition, suggesting that abstinence-supporting social networks may play a role in cognitive change during early recovery from AUDs.

Success in the city: the road to implementation of Tobacco 21 and Sensible Tobacco Enforcement in New York City.

New York City, a leader in municipal tobacco control in the USA, furthered its goal of reducing the community's burden of tobacco use in 2014 by implementing Sensible Tobacco Enforcement and Tobacco 21. These policies are intended to restrict youth access and eliminate sources of cheap tobacco. Strong partnerships, substantial local data and support from the public and elected officials were key in overcoming many challenges and ensuring these policies were signed into law.

Comparing projected impacts of cigarette floor price and excise tax policies on socioeconomic disparities in smoking.

BACKGROUND: About half of all US states have cigarette minimum price laws (MPLs) that require a per cent mark-up on prices, but research suggests they may not be very effective in raising prices. An alternative type of MPL sets a floor price below which packs cannot be sold, and may be more promising. This new type of MPL policy has only been implemented in 1 city, therefore its benefits relative to excise taxes is difficult to assess. METHODS: We constructed a set of possible state floor price MPL options, and matched them to possible state excise tax hikes designed to produce similar average price increases. Using self-reported price and cigarette consumption data from 23 521 participants in the 2010-2011 Tobacco Use Supplement of the Current Population Survey, we projected changes in pack prices and cigarette consumption following implementation of each paired MPL and tax option, for lower and higher income groups. RESULTS: We project that state MPLs set at the average reported pack price would raise prices by $0.33 and reduce cigarette consumption by about 4%; a tax with a similar average price effect would reduce consumption by 2.3%. MPLs and taxes that raise average prices by more than $2.00 would reduce consumption by 15.9% and 13.5%, respectively. In all models, we project that MPLs will reduce income-based smoking disparities more than their comparable excise taxes. CONCLUSIONS: Floor price cigarette MPLs set at or above what consumers currently report paying could reduce both tobacco use and socioeconomic disparities in smoking.

Tobacco retail policy landscape: a longitudinal survey of US states.

BACKGROUND: There are ∼380 000 tobacco retailers in the USA, where the largest tobacco companies spend almost $9 billion a year to promote their products. No systematic survey has been conducted of state-level activities to regulate the retail environment, thus little is known about what policies are being planned, proposed or implemented. METHODS: This longitudinal study is the first US survey of state tobacco control programmes (TCPs) about retail policy activities. Surveyed in 2012 and 2014, programme managers (n=46) reported activities in multiple domains: e-cigarettes, retailer density and licensing, non-tax price increases, product placement, advertising and promotion, health warnings and other approaches. Policy activities were reported in one of five levels: no formal activity, planning or advocating, policy was proposed, policy was enacted or policy was implemented. Overall and domain-specific activity scores were calculated for each state. RESULTS: The average retail policy activity almost doubled between 2012 and 2014. States with the largest increase in scores included: Minnesota, which established a fee-based tobacco retail licensing system and banned self-service for e-cigarettes and all other tobacco products (OTP); Oregon, Kansas and Maine, all of which banned self-service for OTP; and West Virginia, which banned some types of flavoured OTP. CONCLUSIONS: Retail policy activities in US states increased dramatically in a short time. Given what is known about the impact of the retail environment on tobacco use by youth and adults, state and local TCPs may want diversify policy priorities by implementing retail policies alongside tax and smoke-free air laws.

Accuracy of Wearable Cameras to Track Social Interactions in Stroke Survivors.

BACKGROUND: Social isolation after a stroke is related to poor outcomes. However, a full study of social networks on stroke outcomes is limited by the current metrics available. Typical measures of social networks rely on self-report, which is vulnerable to response bias and measurement error. We aimed to test the accuracy of an objective measure-wearable cameras-to capture face-to-face social interactions in stroke survivors. If accurate and usable in real-world settings, this technology would allow improved examination of social factors on stroke outcomes. METHODS: In this prospective study, 10 stroke survivors each wore 2 wearable cameras: Autographer (OMG Life Limited, Oxford, United Kingdom) and Narrative Clip (Narrative, Linköping, Sweden). Each camera automatically took a picture every 20-30 seconds. Patients mingled with healthy controls for 5 minutes of 1-on-1 interactions followed by 5 minutes of no interaction for 2 hours. After the event, 2 blinded judges assessed whether photograph sequences identified interactions or noninteractions. Diagnostic accuracy statistics were calculated. RESULTS: A total of 8776 photographs were taken and adjudicated. In distinguishing interactions, the Autographer's sensitivity was 1.00 and specificity was .98. The Narrative Clip's sensitivity was .58 and specificity was 1.00. The receiver operating characteristic curves of the 2 devices were statistically different (Z = 8.26, P < .001). CONCLUSIONS: Wearable cameras can accurately detect social interactions of stroke survivors. Likely because of its large field of view, the Autographer was more sensitive than the Narrative Clip for this purpose.

Differential effects of cigarette price changes on adult smoking behaviours.

BACKGROUND: Raising cigarette prices through taxation is an important policy approach to reduce smoking. Yet, cigarette price increases may not be equally effective in all subpopulations of smokers. PURPOSE: To examine differing effects of state cigarette price changes with individual changes in smoking among smokers of different intensity levels. METHODS: Data were derived from the National Epidemiologic Survey on Alcohol and Related Conditions, a nationally representative sample of US adults originally interviewed in 2001-2002 (Wave 1) and re-interviewed in 2004-2005 (Wave 2): 34 653 were re-interviewed in Wave 2, and 7068 smokers defined at Wave 1 were included in our study. Mixed effects linear regression models were used to assess whether the effects of changes in state cigarette prices on changes in daily smoking behaviour differed by level of daily smoking. RESULTS: In the multivariable model, there was a significant interaction between change in price per pack of cigarettes from Wave 1 to Wave 2 and the number of cigarettes smoked per day (p=0.044). The more cigarettes smoked per day at baseline, the more responsive the smokers were to increases in price per pack of cigarettes (ie, number of cigarettes smoked per day was reduced in response to price increases). CONCLUSIONS: Our findings that heavier smokers successfully and substantially reduced their cigarette smoking behaviours in response to state cigarette price increases provide fresh insight to the evidence on the effectiveness of higher cigarette prices in reducing smoking.

Using the Program Sustainability Assessment Tool to assess and plan for sustainability.

Implementing and growing a public health program that benefits society takes considerable time and effort. To ensure that positive outcomes are maintained over time, program managers and stakeholders should plan and implement activities to build sustainability capacity within their programs. We describe a 3-part sustainability planning process that programs can follow to build their sustainability capacity. First, program staff and stakeholders take the Program Sustainability Assessment Tool to measure their program's sustainability across 8 domains. Next, managers and stakeholders use results from the assessment to inform and prioritize sustainability action planning. Lastly, staff members implement the plan and keep track of progress toward their sustainability goals. Through this process, staff can more holistically address the internal and external challenges and pressures associated with sustaining a program. We include a case example of a chronic disease program that completed the Program Sustainability Assessment Tool and engaged in program sustainability planning.

The Program Sustainability Assessment Tool: a new instrument for public health programs.

INTRODUCTION: Public health programs can deliver benefits only if they are able to sustain programs, policies, and activities over time. Although numerous sustainability frameworks and models have been developed, there are almost no assessment tools that have demonstrated reliability or validity or have been widely disseminated. We present the Program Sustainability Assessment Tool (PSAT), a new and reliable instrument for assessing the capacity for program sustainability of various public health and other programs. METHODS: A measurement development study was conducted to assess the reliability of the PSAT. Program managers and staff (n = 592) representing 252 public health programs used the PSAT to rate the sustainability of their program. State and community-level programs participated, representing 4 types of chronic disease programs: tobacco control, diabetes, obesity prevention, and oral health. RESULTS: The final version of the PSAT contains 40 items, spread across 8 sustainability domains, with 5 items per domain. Confirmatory factor analysis shows good fit of the data with the 8 sustainability domains. The subscales have excellent internal consistency; the average Cronbach's α is 0.88, ranging from 0.79 to 0.92. Preliminary validation analyses suggest that PSAT scores are related to important program and organizational characteristics. CONCLUSION: The PSAT is a new and reliable assessment instrument that can be used to measure a public health program's capacity for sustainability. The tool is designed to be used by researchers, evaluators, program managers, and staff for large and small public health programs.

Action planning for building public health program sustainability: results from a group-randomized trial.

BACKGROUND: Public health programs are charged with implementing evidence-based interventions to support public health improvement; however, to achieve long-term population-based benefits, these interventions must be sustained. Empirical evidence suggests that program sustainability can be improved through training and technical assistance, but few resources are available to support public health programs in building capacity for sustainability. METHODS: This study sought to build capacity for sustainability among state tobacco control programs through a multiyear, group-randomized trial that developed, tested, and evaluated a novel Program Sustainability Action Planning Model and Training Curricula. Using Kolb's experiential learning theory, we developed this action-oriented training model to address the program-related domains proven to impact capacity for sustainability as outlined in the Program Sustainability Framework. We evaluated the intervention using a longitudinal mixed-effects model using Program Sustainability Assessment (PSAT) scores from three time points. The main predictors in our model included group (control vs intervention) and type of dosage (active and passive). Covariates included state-level American Lung Association Score (proxy for tobacco control policy environment) and percent of CDC-recommended funding (proxy for program resources). RESULTS: Twenty-three of the 24 state tobacco control programs were included in the analyses: 11 received the training intervention and 12 were control. Results of the longitudinal mixed-effects linear regression model, where the annual PSAT score was the outcome, showed that states in the intervention condition reported significantly higher PSAT scores. The effects of CDC-recommended funding and American Lung Association smoke-free scores (proxy for policy environment) were small but statistically significant. CONCLUSION: This study found that the Program Sustainability Action Planning Model and Training Curricula was effective in building capacity for sustainability. The training was most beneficial for programs that had made less policy progress than others, implying that tailored training may be most appropriate for programs possibly struggling to make progress. Finally, while funding had a small, statistically significant effect on our model, it virtually made no difference for the average program in our study. This suggests that other factors may be more or equally important as the level of funding a program receives. CLINICALTRIALS: gov, NCT03598114. Registered on July 26, 2018.

Study protocol for transforming health equity research in integrated primary care: Antiracism as a disruptive innovation.

Among the consequences of systemic racism in health care are significant health disparities among Black/African American individuals with comorbid physical and mental health conditions. Despite decades of studies acknowledging health disparities based on race, significant change has not occurred. There are shockingly few evidence-based antiracism interventions. New paradigms are needed to intervene on, and not just document, racism in health care systems. We are developing a transformative paradigm for new antiracism interventions for primary care settings that integrate mental and physical health care. The paradigm is the first of its kind to integrate community-based participatory research and systems science, within an established model of early phase translation to rigorously define new antiracism interventions. This protocol will use a novel application of systems sciences by combining the qualitative systems sciences methods (group model building; GMB) with quantitative methods (simulation modeling) to develop a comprehensive and community-engaged view of both the drivers of racism and the potential impact of antiracism interventions. Community participants from two integrated primary health care systems will engage in group GMB workshops with researchers to 1) Describe and map the complex dynamic systems driving racism in health care practices, 2) Identify leverage points for disruptive antiracism interventions, policies and practices, and 3) Review and prioritize a list of possible intervention strategies. Advisory committees will provide feedback on the design of GMB procedures, screen potential intervention components for impact, feasibility, and acceptability, and identify gaps for further exploration. Simulation models will be generated based on contextual factors and provider/patient characteristics. Using Item Response Theory, we will initiate the process of developing core measures for assessing the effectiveness of interventions at the organizational-systems and provider levels to be tested under a variety of conditions. While we focus on Black/African Americans, we hope that the resulting transformative paradigm can be applied to improve health equity among other marginalized groups.

Supporting Teams with Designing for Dissemination and Sustainability: the Design, Development, and Usability of a Digital Interactive Platform.

Background: The use of Designing for Dissemination and Sustainability (D4DS) principles and methods can support the development of research products (interventions, tools, findings) to match well with the needs and context of the intended audience and setting. D4DS principles and methods are not well-known or used during clinical and public health research; research teams would benefit from applying D4DS. This paper presents the development of a new digital platform for teams to learn and apply a D4DS process to their work. Methods: A user-centered design (UCD) approach engaged users (n=14) and an expert panel (n=6) in an iterative design process from discovery to prototyping and testing. We led five design sessions using Zoom and Figma software over a 5-month period. Users (71% academics; 29% practitioners) participated in at least 2 sessions. Following design sessions, feedback from users were summarized and discussed to generate design decisions. A prototype was then built and heuristically tested with 11 users who were asked to complete multiple tasks within the platform while verbalizing their decision-making using the 'think aloud' procedure. The System Usability Scale (SUS) was administered at the end of each testing session. After refinements to the platform were made, usability was reassessed with 7 of 11 same users to examine changes. Results: The interactive digital platform (the D4DS Planner) has two main components: 1) the Education Hub (e.g., searchable platform with literature, videos, websites) and 2) the Action Planner. The Action Planner includes 7 interactive steps that walk users through a set of activities to generate a downloadable D4DS action plan for their project. Participants reported that the prototype tool was moderately usable (SUS=66) but improved following refinements (SUS=71). Conclusions: This is a first of its kind tool that supports research teams in learning about and explicitly applying D4DS to their work. The use of this publicly available tool may increase the adoption, impact, and sustainment of a wide range of research products. The use of UCD yielded a tool that is easy to use. The future use and impact of this tool will be evaluated, and the tool will continue to be refined and improved.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America.

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.