Bridges and Mechanisms: Integrating Systems Science Thinking into Implementation Research.

We present a detailed argument for how to integrate, or bridge, systems science thinking and methods with implementation science. We start by showing how fundamental systems science principles of structure, dynamics, information, and utility are relevant for implementation science. Then we examine the need for implementation science to develop and apply richer theories of complex systems. This can be accomplished by emphasizing a causal mechanisms approach. Identifying causal mechanisms focuses on the "cogs and gears" of public health, clinical, and organizational interventions. A mechanisms approach focuses on how a specific strategy will produce the implementation outcome. We show how connecting systems science to implementation science opens new opportunities for examining and addressing social determinants of health and conducting equitable and ethical implementation research. Finally, we present case studies illustrating successful applications of systems science within implementation science in community health policy, tobacco control, health care access, and breast cancer screening.

Designing for Dissemination and Sustainability to Promote Equitable Impacts on Health.

Designing for dissemination and sustainability (D4DS) refers to principles and methods for enhancing the fit between a health program, policy, or practice and the context in which it is intended to be adopted. In this article we first summarize the historical context of D4DS and justify the need to shift traditional health research and dissemination practices. We present a diverse literature according to a D4DS organizing schema and describe a variety of dissemination products, design processes and outcomes, and approaches to messaging, packaging, and distribution. D4DS design processes include stakeholder engagement, participatory codesign, and context and situation analysis, and leverage methods and frameworks from dissemination and implementation science, marketing and business, communications and visualarts, and systems science. Finally, we present eight recommendations to adopt a D4DS paradigm, reflecting shifts in ways of thinking, skills and approaches, and infrastructure and systems for training and evaluation.

Patterns and correlates of mis-implementation in state chronic disease public health practice in the United States.

BACKGROUND: Much of the disease burden in the United States is preventable through application of existing knowledge. State-level public health practitioners are in ideal positions to affect programs and policies related to chronic disease, but the extent to which mis-implementation occurring with these programs is largely unknown. Mis-implementation refers to ending effective programs and policies prematurely or continuing ineffective ones. METHODS: A 2018 comprehensive survey assessing the extent of mis-implementation and multi-level influences on mis-implementation was reported by state health departments (SHDs). Questions were developed from previous literature. Surveys were emailed to randomly selected SHD employees across the Unites States. Spearman's correlation and multinomial logistic regression were used to assess factors in mis-implementation. RESULTS: Half (50.7%) of respondents were chronic disease program managers or unit directors. Forty nine percent reported that programs their SHD oversees sometimes, often or always continued ineffective programs. Over 50% also reported that their SHD sometimes or often ended effective programs. The data suggest the strongest correlates and predictors of mis-implementation were at the organizational level. For example, the number of organizational layers impeded decision-making was significant for both continuing ineffective programs (OR=4.70; 95% CI=2.20, 10.04) and ending effective programs (OR=3.23; 95% CI=1.61, 7.40). CONCLUSION: The data suggest that changing certain agency practices may help in minimizing the occurrence of mis-implementation. Further research should focus on adding context to these issues and helping agencies engage in appropriate decision-making. Greater attention to mis-implementation should lead to greater use of effective interventions and more efficient expenditure of resources, ultimately to improve health outcomes.

Tobacco Town: Computational Modeling of Policy Options to Reduce Tobacco Retailer Density.

OBJECTIVES: To identify the behavioral mechanisms and effects of tobacco control policies designed to reduce tobacco retailer density. METHODS: We developed the Tobacco Town agent-based simulation model to examine 4 types of retailer reduction policies: (1) random retailer reduction, (2) restriction by type of retailer, (3) limiting proximity of retailers to schools, and (4) limiting proximity of retailers to each other. The model examined the effects of these policies alone and in combination across 4 different types of towns, defined by 2 levels of population density (urban vs suburban) and 2 levels of income (higher vs lower). RESULTS: Model results indicated that reduction of retailer density has the potential to decrease accessibility of tobacco products by driving up search and purchase costs. Policy effects varied by town type: proximity policies worked better in dense, urban towns whereas retailer type and random retailer reduction worked better in less-dense, suburban settings. CONCLUSIONS: Comprehensive retailer density reduction policies have excellent potential to reduce the public health burden of tobacco use in communities.

Disparities in tobacco marketing and product availability at the point of sale: Results of a national study.

OBJECTIVE: Neighborhood socioeconomic and racial/ethnic disparities exist in the amount and type of tobacco marketing at retail, but most studies are limited to a single city or state, and few have examined flavored little cigars. Our purpose is to describe tobacco product availability, marketing, and promotions in a national sample of retail stores and to examine associations with neighborhood characteristics. METHODS: At a national sample of 2230 tobacco retailers in the contiguous US, we collected in-person store audit data on: Availability of products (e.g., flavored cigars), quantity of interior and exterior tobacco marketing, presence of price promotions, and marketing with youth appeal. Observational data were matched to census tract demographics. RESULTS: Over 95% of stores displayed tobacco marketing; the average store featured 29.5 marketing materials. 75.1% of stores displayed at least one tobacco product price promotion, including 87.2% of gas/convenience stores and 85.5% of pharmacies. 16.8% of stores featured marketing below three feet, and 81.3% of stores sold flavored cigars, both of which appeal to youth. Stores in neighborhoods with the highest (vs. lowest) concentration of African-American residents had more than two times greater odds of displaying a price promotion (OR=2.1) and selling flavored cigars (OR=2.6). Price promotions were also more common in stores located in neighborhoods with more residents under age 18. CONCLUSIONS AND RELEVANCE: Tobacco companies use retail marketing extensively to promote their products to current customers and youth, with disproportionate targeting of African Americans. Local, state, and federal policies are needed to counteract this unhealthy retail environment.

Reducing Disparities in Tobacco Retailer Density by Banning Tobacco Product Sales Near Schools.

INTRODUCTION: This study examined whether a policy of banning tobacco product retailers from operating within 1000 feet of schools could reduce existing socioeconomic and racial/ethnic disparities in tobacco retailer density. METHODS: We geocoded all tobacco retailers in Missouri (n = 4730) and New York (n = 17 672) and linked them with Census tract characteristics. We then tested the potential impact of a proximity policy that would ban retailers from selling tobacco products within 1000 feet of schools. RESULTS: Our results confirmed socioeconomic and racial/ethnic disparities in tobacco retailer density, with more retailers found in areas with lower income and greater proportions of African American residents. A high proportion of retailers located in these areas were in urban areas, which also have stores located in closer proximity to schools. If a ban on tobacco product sales within 1000 feet of schools were implemented in New York, the number of tobacco retailers per 1000 people would go from 1.28 to 0.36 in the lowest income quintile, and from 0.84 to 0.45 in the highest income quintile. In New York and Missouri, a ban on tobacco product sales near schools would either reduce or eliminate existing disparities in tobacco retailer density by income level and by proportion of African American. CONCLUSIONS: Proximity-based point of sale (POS) policies banning tobacco product sales near schools appear to be more effective in reducing retailer density in lower income and racially diverse neighborhoods than in higher income and white neighborhoods, and hold great promise for reducing tobacco-related disparities at the POS. IMPLICATIONS: Given the disparities-reducing potential of policies banning tobacco product sales near schools, jurisdictions with tobacco retailer licensing should consider adding this provision to their licensing requirements. Since relatively few jurisdictions currently ban tobacco sales near schools, future research should examine ways to increase and monitor the uptake of this policy, and assess whether it has an impact upon reducing exposure to tobacco marketing and on tobacco product availability and use.

Reduced Social Network Drinking is Associated with Improved Response Inhibition in Women During Early Recovery from Alcohol Use Disorders: A Pilot Study.

BACKGROUND: Social support for recovery from alcohol use disorders (AUDs) is associated with improvements in self-reported impulsive behavior in individuals treated for AUDs. We build on these findings using a behavioral task-based measure of response inhibition, a well-defined component of impulsivity, to examine the association of disinhibition with alcohol-specific social network characteristics during early recovery. METHODS: Women (n = 28) were recruited from treatment for AUD within 3 to 4 weeks of their last drink and were assessed at baseline and again 3 months later. Outcome measures were level of disinhibition at baseline and change in disinhibition from baseline to follow-up, measured using a computer-based continuous performance test. The primary independent variables were level of drinking in the social network at baseline and change in network drinking from baseline to follow-up. RESULTS: The sample [50% black, age M (SD) = 42.3 (9.5)] reported high rates of physical and sexual abuse before age 13 (43%), psychiatric disorder (71%), drug use disorder (78%), and previous treatment (71%). More drinking in participants' social networks was associated with greater disinhibition at baseline (ß = 12.5, 95% CI = 6.3, 18.7). A reduction in network drinking from baseline to follow-up was associated with reduced disinhibition (ß = -6.0, 95% CI = -11.3, -0.78) independent of IQ, recent alcohol consumption, and self-reported negative urgency. CONCLUSIONS: This study extends previous findings of an association between social networks and self-reported impulsivity to a neurobehavioral phenotype, response inhibition, suggesting that abstinence-supporting social networks may play a role in cognitive change during early recovery from AUDs.

Comparing projected impacts of cigarette floor price and excise tax policies on socioeconomic disparities in smoking.

BACKGROUND: About half of all US states have cigarette minimum price laws (MPLs) that require a per cent mark-up on prices, but research suggests they may not be very effective in raising prices. An alternative type of MPL sets a floor price below which packs cannot be sold, and may be more promising. This new type of MPL policy has only been implemented in 1 city, therefore its benefits relative to excise taxes is difficult to assess. METHODS: We constructed a set of possible state floor price MPL options, and matched them to possible state excise tax hikes designed to produce similar average price increases. Using self-reported price and cigarette consumption data from 23 521 participants in the 2010-2011 Tobacco Use Supplement of the Current Population Survey, we projected changes in pack prices and cigarette consumption following implementation of each paired MPL and tax option, for lower and higher income groups. RESULTS: We project that state MPLs set at the average reported pack price would raise prices by $0.33 and reduce cigarette consumption by about 4%; a tax with a similar average price effect would reduce consumption by 2.3%. MPLs and taxes that raise average prices by more than $2.00 would reduce consumption by 15.9% and 13.5%, respectively. In all models, we project that MPLs will reduce income-based smoking disparities more than their comparable excise taxes. CONCLUSIONS: Floor price cigarette MPLs set at or above what consumers currently report paying could reduce both tobacco use and socioeconomic disparities in smoking.

Tobacco retail policy landscape: a longitudinal survey of US states.

BACKGROUND: There are ∼380 000 tobacco retailers in the USA, where the largest tobacco companies spend almost $9 billion a year to promote their products. No systematic survey has been conducted of state-level activities to regulate the retail environment, thus little is known about what policies are being planned, proposed or implemented. METHODS: This longitudinal study is the first US survey of state tobacco control programmes (TCPs) about retail policy activities. Surveyed in 2012 and 2014, programme managers (n=46) reported activities in multiple domains: e-cigarettes, retailer density and licensing, non-tax price increases, product placement, advertising and promotion, health warnings and other approaches. Policy activities were reported in one of five levels: no formal activity, planning or advocating, policy was proposed, policy was enacted or policy was implemented. Overall and domain-specific activity scores were calculated for each state. RESULTS: The average retail policy activity almost doubled between 2012 and 2014. States with the largest increase in scores included: Minnesota, which established a fee-based tobacco retail licensing system and banned self-service for e-cigarettes and all other tobacco products (OTP); Oregon, Kansas and Maine, all of which banned self-service for OTP; and West Virginia, which banned some types of flavoured OTP. CONCLUSIONS: Retail policy activities in US states increased dramatically in a short time. Given what is known about the impact of the retail environment on tobacco use by youth and adults, state and local TCPs may want diversify policy priorities by implementing retail policies alongside tax and smoke-free air laws.

Accuracy of Wearable Cameras to Track Social Interactions in Stroke Survivors.

BACKGROUND: Social isolation after a stroke is related to poor outcomes. However, a full study of social networks on stroke outcomes is limited by the current metrics available. Typical measures of social networks rely on self-report, which is vulnerable to response bias and measurement error. We aimed to test the accuracy of an objective measure-wearable cameras-to capture face-to-face social interactions in stroke survivors. If accurate and usable in real-world settings, this technology would allow improved examination of social factors on stroke outcomes. METHODS: In this prospective study, 10 stroke survivors each wore 2 wearable cameras: Autographer (OMG Life Limited, Oxford, United Kingdom) and Narrative Clip (Narrative, Linköping, Sweden). Each camera automatically took a picture every 20-30 seconds. Patients mingled with healthy controls for 5 minutes of 1-on-1 interactions followed by 5 minutes of no interaction for 2 hours. After the event, 2 blinded judges assessed whether photograph sequences identified interactions or noninteractions. Diagnostic accuracy statistics were calculated. RESULTS: A total of 8776 photographs were taken and adjudicated. In distinguishing interactions, the Autographer's sensitivity was 1.00 and specificity was .98. The Narrative Clip's sensitivity was .58 and specificity was 1.00. The receiver operating characteristic curves of the 2 devices were statistically different (Z = 8.26, P < .001). CONCLUSIONS: Wearable cameras can accurately detect social interactions of stroke survivors. Likely because of its large field of view, the Autographer was more sensitive than the Narrative Clip for this purpose.

Differential effects of cigarette price changes on adult smoking behaviours.

BACKGROUND: Raising cigarette prices through taxation is an important policy approach to reduce smoking. Yet, cigarette price increases may not be equally effective in all subpopulations of smokers. PURPOSE: To examine differing effects of state cigarette price changes with individual changes in smoking among smokers of different intensity levels. METHODS: Data were derived from the National Epidemiologic Survey on Alcohol and Related Conditions, a nationally representative sample of US adults originally interviewed in 2001-2002 (Wave 1) and re-interviewed in 2004-2005 (Wave 2): 34 653 were re-interviewed in Wave 2, and 7068 smokers defined at Wave 1 were included in our study. Mixed effects linear regression models were used to assess whether the effects of changes in state cigarette prices on changes in daily smoking behaviour differed by level of daily smoking. RESULTS: In the multivariable model, there was a significant interaction between change in price per pack of cigarettes from Wave 1 to Wave 2 and the number of cigarettes smoked per day (p=0.044). The more cigarettes smoked per day at baseline, the more responsive the smokers were to increases in price per pack of cigarettes (ie, number of cigarettes smoked per day was reduced in response to price increases). CONCLUSIONS: Our findings that heavier smokers successfully and substantially reduced their cigarette smoking behaviours in response to state cigarette price increases provide fresh insight to the evidence on the effectiveness of higher cigarette prices in reducing smoking.

Using the Program Sustainability Assessment Tool to assess and plan for sustainability.

Implementing and growing a public health program that benefits society takes considerable time and effort. To ensure that positive outcomes are maintained over time, program managers and stakeholders should plan and implement activities to build sustainability capacity within their programs. We describe a 3-part sustainability planning process that programs can follow to build their sustainability capacity. First, program staff and stakeholders take the Program Sustainability Assessment Tool to measure their program's sustainability across 8 domains. Next, managers and stakeholders use results from the assessment to inform and prioritize sustainability action planning. Lastly, staff members implement the plan and keep track of progress toward their sustainability goals. Through this process, staff can more holistically address the internal and external challenges and pressures associated with sustaining a program. We include a case example of a chronic disease program that completed the Program Sustainability Assessment Tool and engaged in program sustainability planning.

The Program Sustainability Assessment Tool: a new instrument for public health programs.

INTRODUCTION: Public health programs can deliver benefits only if they are able to sustain programs, policies, and activities over time. Although numerous sustainability frameworks and models have been developed, there are almost no assessment tools that have demonstrated reliability or validity or have been widely disseminated. We present the Program Sustainability Assessment Tool (PSAT), a new and reliable instrument for assessing the capacity for program sustainability of various public health and other programs. METHODS: A measurement development study was conducted to assess the reliability of the PSAT. Program managers and staff (n = 592) representing 252 public health programs used the PSAT to rate the sustainability of their program. State and community-level programs participated, representing 4 types of chronic disease programs: tobacco control, diabetes, obesity prevention, and oral health. RESULTS: The final version of the PSAT contains 40 items, spread across 8 sustainability domains, with 5 items per domain. Confirmatory factor analysis shows good fit of the data with the 8 sustainability domains. The subscales have excellent internal consistency; the average Cronbach's α is 0.88, ranging from 0.79 to 0.92. Preliminary validation analyses suggest that PSAT scores are related to important program and organizational characteristics. CONCLUSION: The PSAT is a new and reliable assessment instrument that can be used to measure a public health program's capacity for sustainability. The tool is designed to be used by researchers, evaluators, program managers, and staff for large and small public health programs.

Lowering the burden: Shorter versions of the Program Sustainability Assessment Tool (PSAT) and Clinical Sustainability Assessment Tool (CSAT).

BACKGROUND: Although significant advances have been made in the conceptualization of sustainability, having pragmatic, psychometrically valid tools remains a need within the field. Our previous work has developed frameworks and tools to assess both program sustainability and clinical sustainability capacity. This work presents new, psychometrically tested short versions of the Program Sustainability Assessment Tool (PSAT) and the Clinical Sustainability Assessment Tool (CSAT). METHODS: These methods were conducted in identical, parallel processes for the CSAT and PSAT. Previously collected data for these instruments was obtained across a variety of settings, contexts, and participants. We first conducted testing to determine cronbach's alpha of shortened domains (3 items each) and then conducted Confirmatory Factor Analysis to ensure that the domains were still appropriate for the tool. After, the team met to review the results and determine the final versions of the short PSAT and short CSAT. RESULTS: The short PSAT retained cronbach's alpha's of 0.82 - 0.91 for each domain of the tool, with which maintains excellent reliability for the tool. Confirmatory factor analysis highlights that the short PSAT retains conceptual distinction across the 8 domains, with CFI scores greater than 0.90, RMSEA scores below 0.6, and SRMR scores less than 0.08. The short CSAT had cronbach's alpha of 0.84 - 0.92 for each of the domains of the tool, also suggesting excellent reliability of the domains within the measure after dropping two items/domain. Confirmatory factor analysis of the short CSAT meets the same specifications as above, again highlighting conceptual distinction across the domains. CONCLUSION: Each tool was able to be shortened to three items per domain while maintaining strong psychometric properties. This results in a tool that takes less time to complete, meeting one of the key calls for pragmatic measures within implementation science. This advances our abilities to measure and test sustainability within implementation science.

Assessment of the quality of interdisciplinary communication (CritCom): evaluation and refinement of a center summary report.

Communication failures among clinicians in the ICU (intensive care unit) often lead to worse patient outcomes. CritCom is a bilingual (English and Spanish) tool to evaluate the quality of interdisciplinary communication around patient deterioration for pediatric oncology patients. The use of reports, such as the CritCom report, as dissemination methods lead to quicker knowledge translation and implementation of research findings into policy. Nurses and physicians at participating centers who care for patients at risk of deterioration completed the CritCom survey and center-specific reports were generated to communicate CritCom results. Focus groups were conducted with clinicians receiving CritCom reports in both English and Spanish to evaluate report clarity and usability. Participants found the reports to be useful and described the writing and design as clear and specific. Participants provided feedback to improve report design and requested actionable steps to improve communication at their center. Feedback illustrated that the report was easy to interpret and a useful way to disseminate information. Participants noted the utility of the report, illustrating that the use of reports can be a useful method to disseminate research findings back to participants in a way that is applicable to the local context. Communicating research findings through reports can minimize the significant time lag in knowledge translation and provide participants with actionable steps to implement in their setting.

Documenting adaptations to an evidence-based intervention in 58 resource-variable pediatric oncology hospitals across implementation phases.

BACKGROUND: Adaptation of evidence-based interventions (EBIs) often occurs when implemented in new local contexts and settings. It is unclear, however, during which phase of implementation adaptations are most frequently made and how these changes may impact the fidelity, effectiveness, and sustainability of the EBI. Pediatric Early Warning Systems (PEWS) are EBIs for early identification of deterioration in hospitalized children with cancer. This study evaluates adaptations of PEWS made among resource-variable pediatric oncology hospitals in Latin America implementing and sustaining PEWS. METHODS: We conducted a cross-sectional survey among pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), a collaborative to implement PEWS. Adaptations to PEWS were assessed via 3 multiple choice and 1 free text question administered as part of a larger study of PEWS sustainability. Descriptive statistics quantitatively described what, when, and why adaptations were made. Qualitative analysis of free text responses applied the Framework for Reporting Adaptations and Modifications Expanded (FRAME) to describe respondent perspectives on PEWS adaptations. RESULTS: We analyzed 2,094 responses from 58 pediatric oncology centers across 19 countries in Latin America. Participants were predominantly female (82.5%), consisting of nurses (57.4%) and physicians (38.2%) who were PEWS implementation leaders (22.1%) or clinical staff (69.1%). Respondents described multiple PEWS adaptations across all implementation phases, with most occurring during the planning and piloting of EBIs. Adaptations included changes to PEWS content (algorithm, scoring tool, terminology, and use frequency) and context (personnel delivering or population). Respondents felt adaptations streamlined monitoring, enhanced effectiveness, improved workflow, increased comprehension, and addressed local resource limitations. Qualitative analysis indicated that most adaptations were categorized as fidelity consistent and planned; fidelity inconsistent adaptations were unplanned responses to unanticipated challenges. CONCLUSION: Adaptations made to PEWS across implementation phases demonstrate how EBIs are adapted to fit dynamic, real-world clinical settings. This research advances implementation science by highlighting EBI adaptation as a potential strategy to promote widespread implementation and sustainability in hospitals of all resource levels.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America.

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Introducing SoNHR-Reporting guidelines for Social Networks In Health Research.

OBJECTIVE: The overall goal of this work is to produce a set of recommendations (SoNHR-Social Networks in Health Research) that will improve the reporting and dissemination of social network concepts, methods, data, and analytic results within health sciences research. METHODS: This study used a modified-Delphi approach for recommendation development consistent with best practices suggested by the EQUATOR health sciences reporting guidelines network. An initial set of 28 reporting recommendations was developed by the author team. A group of 67 (of 147 surveyed) experienced network and health scientists participated in an online feedback survey. They rated the clarity and importance of the individual recommendations, and provided qualitative feedback on the coverage, usability, and dissemination opportunities of the full set of recommendations. After examining the feedback, a final set of 18 recommendations was produced. RESULTS: The final SoNHR reporting guidelines are comprised of 18 recommendations organized within five domains: conceptualization (how study research questions are linked to network conceptions or theories), operationalization (how network science portions of the study are defined and operationalized), data collection & management (how network data are collected and managed), analyses & results (how network results are analyzed, visualized, and reported), and ethics & equity (how network-specific human subjects, equity, and social justice concerns are reported). We also present a set of exemplar published network studies which can be helpful for seeing how to apply the SoNHR recommendations in research papers. Finally, we discuss how different audiences can use these reporting guidelines. CONCLUSIONS: These are the first set of formal reporting recommendations of network methods in the health sciences. Consistent with EQUATOR goals, these network reporting recommendations may in time improve the quality, consistency, and replicability of network science across a wide variety of important health research areas.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol.

BACKGROUND: More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment. METHODS: We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies. DISCUSSION: This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.