Improving quality of pediatric onco-critical care: A 2-year experience using PROACTIVE at a cancer center in Jordan.

PROACTIVE (PediatRic Oncology cApaCity Assessment Tool for IntensiVe CarE) is a consensus-derived tool that evaluates pediatric onco-critical care (POCC) services and identifies gaps amenable to improvement. King Hussein Cancer Center (KHCC), an oncology hospital in Jordan, completed PROACTIVE in 2021 and 2022. We evaluated PROACTIVE's ability to identify gaps and improve POCC services at KHCC by analyzing score changes and interviewing site leaders to understand mechanisms of improvement. Results identified three types of outcomes: direct (e.g., improved multidisciplinary communication), indirect (e.g., guidelines implementation), and other outcomes unrelated to PROACTIVE (e.g., funding mechanisms). PROACTIVE can assist institutions strengthen and monitor POCC services over time.

Model for regional collaboration: Successful strategy to implement a pediatric early warning system in 36 pediatric oncology centers in Latin America.

BACKGROUND: Pediatric early warning systems (PEWS) aid in the early identification of deterioration in hospitalized children with cancer; however, they are under-used in resource-limited settings. The authors use the knowledge-to-action framework to describe the implementation strategy for Proyecto Escala de Valoracion de Alerta Temprana (EVAT), a multicenter quality-improvement collaborative, to scale-up PEWS in pediatric oncology centers in Latin America. METHODS: Proyecto EVAT mentored participating centers through an adaptable implementation strategy to: (1) monitor clinical deterioration in children with cancer, (2) contextually adapt PEWS, (3) assess barriers to using PEWS, (4) pilot and implement PEWS, (5) monitor the use of PEWS, (6) evaluate outcomes, and (7) sustain PEWS. The implementation outcomes assessed included the quality of PEWS use, the time required for implementation, and global program impact. RESULTS: From April 2017 to October 2021, 36 diverse Proyecto EVAT hospitals from 13 countries in Latin America collectively managing more than 4100 annual new pediatric cancer diagnoses successfully implemented PEWS. The time to complete all program phases varied among centers, averaging 7 months (range, 3-13 months) from PEWS pilot to implementation completion. All centers ultimately implemented PEWS and maintained high-quality PEWS use for up to 18 months after implementation. Across the 36 centers, more than 11,100 clinicians were trained in PEWS, and more than 41,000 pediatric hospital admissions had PEWS used in their care. CONCLUSIONS: Evidence-based interventions like PEWS can be successfully scaled-up regionally basis using a systematic approach that includes a collaborative network, an adaptable implementation strategy, and regional mentorship. Lessons learned can guide future programs to promote the widespread adoption of effective interventions and reduce global disparities in childhood cancer outcomes. LAY SUMMARY: Pediatric early warning systems (PEWS) are clinical tools used to identify deterioration in hospitalized children with cancer; however, implementation challenges limit their use in resource-limited settings. Proyecto EVAT is a multicenter quality-improvement collaborative to implement PEWS in 36 pediatric oncology centers in Latin America. This is the first multicenter, multinational study reporting a successful implementation strategy (Proyecto EVAT) to regionally scale-up PEWS. The lessons learned from Proyecto EVAT can inform future programs to promote the adoption of clinical interventions to globally improve childhood cancer outcomes.

Assessment of the quality of interdisciplinary communication (CritCom): evaluation and refinement of a center summary report.

Communication failures among clinicians in the ICU (intensive care unit) often lead to worse patient outcomes. CritCom is a bilingual (English and Spanish) tool to evaluate the quality of interdisciplinary communication around patient deterioration for pediatric oncology patients. The use of reports, such as the CritCom report, as dissemination methods lead to quicker knowledge translation and implementation of research findings into policy. Nurses and physicians at participating centers who care for patients at risk of deterioration completed the CritCom survey and center-specific reports were generated to communicate CritCom results. Focus groups were conducted with clinicians receiving CritCom reports in both English and Spanish to evaluate report clarity and usability. Participants found the reports to be useful and described the writing and design as clear and specific. Participants provided feedback to improve report design and requested actionable steps to improve communication at their center. Feedback illustrated that the report was easy to interpret and a useful way to disseminate information. Participants noted the utility of the report, illustrating that the use of reports can be a useful method to disseminate research findings back to participants in a way that is applicable to the local context. Communicating research findings through reports can minimize the significant time lag in knowledge translation and provide participants with actionable steps to implement in their setting.

The burden of pediatric critical illness among pediatric oncology patients in low- and middle-income countries: A systematic review and meta-analysis.

BACKGROUND: Pediatric oncology patients have increased risk for critical illness; outcomes are well described in high-income countries (HICs); however, data is limited for low- and middle-income countries (LMICs). METHODS: We systematically searched PubMed, EMBASE, Web of Science, CINAHL and Global Health databases for articles in 6 languages describing mortality in children with cancer admitted to intensive care units (ICUs) in LMICs. Two investigators independently assessed eligibility, data quality, and extracted data. We pooled ICU mortality estimates using random effect models. RESULTS: Of 3641 studies identified, 22 studies were included, covering 4803 ICU admissions. Overall pooled mortality was 30.3 % [95 % Confidence-interval (CI) 21.7-40.6 %]. Mechanical ventilation [odds ratio (OR) 12.2, 95 %CI:6.2-24.0, p-value<0.001] and vasoactive infusions [OR 6.3 95 %CI:3.3-11.9, p-value<0.001] were associated with ICU mortality. CONCLUSIONS: ICU mortality among pediatric oncology patients in LMICs is similar to that in HICs, however, this review likely underestimates true mortality due to underrepresentation of studies from low-income countries.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America.

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol.

BACKGROUND: More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment. METHODS: We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies. DISCUSSION: This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

The COVID-19 Pandemic's impact on sustainability and expansion of a Pediatric Early Warning System in resource-limited hospitals.

BACKGROUND: The COVID-19 pandemic impacted healthcare delivery worldwide, including pediatric cancer care, with a disproportionate effect in resource-limited settings. This study evaluates its impact on existing quality improvement (QI) programs. METHODS: We conducted 71 semi-structured interviews of key stakeholders at five resource-limited pediatric oncology centers participating in a collaborative to implement Pediatric Early Warning System (PEWS). Interviews were conducted virtually using a structured interview guide, recorded, transcribed, and translated into English. Two coders developed a codebook of a priori and inductive codes and independently coded all transcripts, achieving a kappa of 0.8-0.9. Thematic analysis explored the impact of the pandemic on PEWS. RESULTS: All hospitals reported limitations in material resources, reduction in staffing, and impacts on patient care due to the pandemic. However, the impact on PEWS varied across centers. Identified factors that promoted or limited ongoing PEWS use included the availability of material resources needed for PEWS, staff turnover, PEWS training for staff, and the willingness of staff and hospital leaders to prioritize PEWS. Consequently, some hospitals were able to sustain PEWS; others halted or reduced PEWS use to prioritize other work. Similarly, the pandemic delayed plans at all hospitals to expand PEWS to other units. Several participants were hopeful for future expansion of PEWS post-pandemic. CONCLUSION: The COVID-19 pandemic created challenges for sustainability and scale of PEWS, an ongoing QI program, in these resource-limited pediatric oncology centers. Several factors mitigated these challenges and promoted ongoing PEWS use. These results can guide strategies to sustain effective QI interventions during future health crises.

Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers.

BACKGROUND: Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice. METHODS: At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites. RESULTS: Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff. CONCLUSION: This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

CritCom: assessment of quality of interdisciplinary communication around deterioration in pediatric oncologic patients.

Background: High-quality clinical care requires excellent interdisciplinary communication, especially during emergencies, and no tools exist to evaluate communication in critical care. We describe the development of a pragmatic tool focusing on interdisciplinary communication during patient deterioration (CritCom). Methods: The preliminary CritCom tool was developed after a literature review and consultation with a multidisciplinary panel of global experts in communication, pediatric oncology, and critical care to review the domains and establish content validity iteratively. Face and linguistic validity were established through cognitive interviews, translation, and linguistic synthesis. We conducted a pilot study among an international group of clinicians to establish reliability and usability. Results: After reviewing 105 potential survey items, we identified 52 items across seven domains. These were refined through cognitive interviews with 36 clinicians from 15 countries. CritCom was piloted with 433 clinicians (58% nurses, 36% physicians, and 6% other) from 42 hospitals in 22 countries. Psychometric testing guided the refinement of the items for the final tool. CritCom comprised six domains with five items each (30 total). The final tool has excellent reliability (Cronbach's alpha 0.81-0.86), usability (93% agree or strongly agree that the tool is easy to use), and similar performance between English and Spanish tools. Confirmatory factor analysis was used to establish the final 6-domain structure. Conclusions: CritCom is a reliable and pragmatic bilingual tool to assess the quality of interdisciplinary communication around patient deterioration for children in diverse resource levels globally. Critcom results can be used to design and evaluate interventions to improve team communication.

Development and pilot testing of PROACTIVE: A pediatric onco-critical care capacity and quality assessment tool for resource-limited settings.

BACKGROUND: Nearly 90% children with cancer reside in low- and middle-income countries, which face multiple challenges delivering high-quality pediatric onco-critical care (POCC). We recently identified POCC quality and capacity indicators for PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), a tool that evaluates strengths and limitations in POCC services. This study describes pilot testing of PROACTIVE, development of center-specific reports, and identification of common POCC challenges. METHODS: The original 119 consensus-derived PROACTIVE indicators were converted into 182 questions divided between 2 electronic surveys for intensivists and oncologists managing critically ill pediatric cancer patients. Alpha-testing was conducted to confirm face-validity with four pediatric intensivists. Eleven centers representing diverse geographic regions, income levels, and POCC services conducted beta-testing to evaluate usability, feasibility, and applicability of PROACTIVE. Centers' responses were scored and indicators with mean scores ≤75% in availability/performance were classified as common POCC challenges. RESULTS: Alpha-testing ensured face-validity and beta-testing demonstrated feasibility and usability of PROACTIVE (October 2020-June 2021). Twenty-two surveys (response rate 99.4%) were used to develop center-specific reports. Adjustments to PROACTIVE were made based on focus group feedback and surveys, resulting in 200 questions. Aggregated data across centers identified common POCC challenges: (1) lack of pediatric intensivists, (2) absence of abstinence and withdrawal symptoms monitoring, (3) shortage of supportive care resources, and (4) limited POCC training for physicians and nurses. CONCLUSIONS: PROACTIVE is a feasible and contextually appropriate tool to help clinicians and organizations identify challenges in POCC services across a wide range of resource-levels. Widespread use of PROACTIVE can help prioritize and develop tailored interventions to strengthen POCC services and outcomes globally.