Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers.

BACKGROUND: Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice. METHODS: At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites. RESULTS: Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff. CONCLUSION: This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals.

Background: Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation. Methods: This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time. Results: In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges. Conclusions: Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

The COVID-19 Pandemic's impact on sustainability and expansion of a Pediatric Early Warning System in resource-limited hospitals.

BACKGROUND: The COVID-19 pandemic impacted healthcare delivery worldwide, including pediatric cancer care, with a disproportionate effect in resource-limited settings. This study evaluates its impact on existing quality improvement (QI) programs. METHODS: We conducted 71 semi-structured interviews of key stakeholders at five resource-limited pediatric oncology centers participating in a collaborative to implement Pediatric Early Warning System (PEWS). Interviews were conducted virtually using a structured interview guide, recorded, transcribed, and translated into English. Two coders developed a codebook of a priori and inductive codes and independently coded all transcripts, achieving a kappa of 0.8-0.9. Thematic analysis explored the impact of the pandemic on PEWS. RESULTS: All hospitals reported limitations in material resources, reduction in staffing, and impacts on patient care due to the pandemic. However, the impact on PEWS varied across centers. Identified factors that promoted or limited ongoing PEWS use included the availability of material resources needed for PEWS, staff turnover, PEWS training for staff, and the willingness of staff and hospital leaders to prioritize PEWS. Consequently, some hospitals were able to sustain PEWS; others halted or reduced PEWS use to prioritize other work. Similarly, the pandemic delayed plans at all hospitals to expand PEWS to other units. Several participants were hopeful for future expansion of PEWS post-pandemic. CONCLUSION: The COVID-19 pandemic created challenges for sustainability and scale of PEWS, an ongoing QI program, in these resource-limited pediatric oncology centers. Several factors mitigated these challenges and promoted ongoing PEWS use. These results can guide strategies to sustain effective QI interventions during future health crises.

Multilevel impacts of a pediatric early warning system in resource-limited pediatric oncology hospitals.

Background: Pediatric Early Warning Systems (PEWS) reduce clinical deterioration, improve interdisciplinary communication, and provide cost savings; however, little is known about how these impacts are achieved or related. This study evaluates the multi-level impacts of PEWS in resource-limited pediatric oncology centers. Methods: We conducted 71 semi-structured interviews including physicians (45%), nurses (45%), and administrators (10%) from 5 resource-limited pediatric oncology centers in 4 Latin American countries. Interviews were conducted in Spanish, transcribed, and translated into English. A code book was developed using a priori and inductively derived codes. Transcripts were independently coded by 2 coders, achieving a kappa of 0.8-0.9. Thematic content analysis explored perceived impacts of PEWS at the level of the patient, clinician, healthcare team, and institution. Results: PEWS improved the quality of attention for patients, reducing morbidity and mortality. Clinicians felt more knowledgeable, confident, and empowered providing patient care, resulting in greater job satisfaction. PEWS affected team dynamics by improving interdisciplinary (ward and intensive care unit) and interprofessional (physicians and nurses) relationships and communication. This ultimately led to institutional culture change with emphasis on patient safety, collaboration with other centers, and receipt of institutional awards. Together, these impacts led to hospital-wide support of ongoing PEWS use. Conclusions: In resource-limited hospitals, PEWS use results in multi-level positive impacts on patients, clinicians, teams, and institutions, creating a feedback loop that further supports ongoing PEWS use. These findings can guide advocacy for PEWS to various stakeholders, improve PEWS effectiveness, and inform assessment of other interventions to improve childhood cancer outcomes.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America.

BACKGROUND: Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America. METHODS: Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact. RESULTS: From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care. CONCLUSIONS: Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes. LAY SUMMARY: Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Assessment of Barriers and Enablers to Implementation of a Pediatric Early Warning System in Resource-Limited Settings.

Importance: Pediatric early warning systems (PEWS) aid with early identification of clinical deterioration and improve outcomes in children with cancer hospitalized in resource-limited settings; however, there may be barriers to implementation. Objective: To evaluate stakeholder-reported barriers and enablers to PEWS implementation in resource-limited hospitals. Design, Setting, and Participants: In this qualitative study, semistructured stakeholder interviews were conducted at 5 resource-limited pediatric oncology centers in 4 countries in Latin America. Hospitals participating in a multicenter collaborative to implement PEWS were purposefully sampled based on time required for implementation (fast vs slow), and stakeholders interviewed included physicians, nurses, and administrators, involved in PEWS implementation. An interview guide was developed using the Consolidated Framework for Implementation Research (CFIR). Interviews were conducted virtually in Spanish, audiorecorded, and professionally transcribed and translated into English. A codebook was developed a priori using the CFIR and supplemented with codes inductively derived from transcript review. Two coders independently analyzed all transcripts, achieving a κ of 0.8 to 0.9. The study was conducted from June 1 to August 31, 2020. Main Outcomes and Measures: Thematic analysis was conducted based on CFIR domains (inner setting, characteristics of individuals, outer setting, intervention characteristics, and implementation process) to identify barriers and enablers to PEWS implementation. Results: Seventy-one staff involved in PEWS implementation were interviewed, including 32 physicians (45%), 32 nurses (45%), and 7 administrators (10%). Of these, 50 were women (70%). Components of the 5 CFIR domains were mentioned by participants as barriers and enablers to PEWS implementation at both fast- and slow-implementing centers. Participants emphasized barriers at the level of the clinical staff, hospital, external factors, and PEWS intervention. These barriers included staff resistance to change, inadequate resources, components of health systems, and the perceived origin and complexity of PEWS. At all centers, most barriers were successfully converted to enablers during the implementation process through targeted strategies, such as early stakeholder engagement and adaptation, including adapting PEWS to better fit the local context and changing the hospital setting to support ongoing use of PEWS. Conclusions and Relevance: To date, this is the first multicenter, multinational study describing barriers and enablers to PEWS implementation in resource-limited settings. Findings suggest that many barriers are not immutable and can be converted to enablers during the implementation process. This work can serve as a guide for clinicians looking to implement evidence-based interventions to reduce global disparities in patient outcomes.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America.

Background: Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS). Methods: We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability. Results: We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability. Conclusion: This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.

Clinical and organizational risk factors for mortality during deterioration events among pediatric oncology patients in Latin America: A multicenter prospective cohort.

BACKGROUND: Hospitalized pediatric hematology-oncology (PHO) patients have frequent clinical deterioration events (CDE) requiring intensive care unit (ICU) admission, particularly in resource-limited settings. The objective of this study was to describe CDEs in hospitalized PHO patients in Latin America and to identify event-level and center-level risk factors for mortality. METHODS: In 2017, the authors implemented a prospective registry of CDEs, defined as unplanned transfers to a higher level of care, use of ICU-level interventions on the floor, or nonpalliative floor deaths, in 16 PHO centers in 10 countries. PHO hospital admissions and hospital inpatient days were also reported. This study analyzes the first year of registry data (June 2017 to May 2018). RESULTS: Among 16 centers, 553 CDEs were reported in PHO patients during 11,536 admissions and 119,414 inpatient days (4.63 per 1000 inpatient days). Event mortality was 29% (1.33 per 1000 inpatient days) but ranged widely across centers (11%-79% or 0.36-5.80 per 1000 inpatient days). Significant risk factors for event mortality included requiring any ICU-level intervention on the floor and not being transferred to a higher level of care. Events with organ dysfunction, a higher severity of illness, and a requirement for ICU intervention had higher mortality. In center-level analysis, hospitals with a higher volume of PHO patients, less floor use of ICU intervention, lower severity of illness on transfer, and lower rates of floor cardiopulmonary arrest had lower event mortality. CONCLUSIONS: Hospitalized PHO patients who experience CDEs in resource-limited settings frequently require floor-based ICU interventions and have high mortality. Modifiable hospital practices around the escalation of care for these high-risk patients may contribute to poor outcomes. Earlier recognition of critical illness and timely ICU transfer may improve survival in hospitalized children with cancer.

Measuring development assistance for health systems strengthening and health security: an analysis using the Creditor Reporting System database.

Background: Health systems strengthening (HSS) and health security are two pillars of universal health coverage (UHC). Investments in these areas are essential for meeting the Sustainable Development Goals and are of heightened relevance given the emergence of the 2019 novel coronavirus disease (COVID-19). This study aims to generate information on development assistance for health (DAH) for these areas, including how to track it and how funding levels align with country needs. Methods: We developed a framework to analyze the amount of DAH disbursed in 2015 for the six building blocks of the health system ('system-wide HSS') plus health security (emergency preparedness, risk management, and response) at both the global (transnational) and country level. We reviewed 2,427 of 32,801 DAH activities in the Creditor Reporting System (CRS) database (80% of the total value of disbursements in 2015) and additional public information sources. Additional aid activities were identified through a keyword search. Results: In 2015, we estimated that US$3.1 billion (13.4%) of the US$22.9 billion of DAH captured in the CRS database was for system-wide HSS and health security: US$2.5 billion (10.9%) for system-wide HSS, mostly for infrastructure, and US$0.6 billion (2.5%) for system-wide health security. US$567.1 million (2.4%) was invested in supporting these activities at the global level. If responses to individual health emergencies are included, 7.5% of total DAH (US$1.7B) was for health security. We found a correlation between DAH for HSS and maternal mortality rates, and we interpret this as evidence that HSS aid generally flowed to countries with greater need. Conclusions : Achieving UHC by 2030 will require greater investments in system-wide HSS and proactive health emergency preparedness. It may be appropriate for donors to more prominently consider country needs and global functions when investing in health security and HSS.