RESUMEN
PURPOSE: In the absence of a standardized tool to assess the quality of pediatric hematology/oncology training programs, the Education Program Assessment Tool (EPAT) was conceptualized as a user-friendly and adaptable tool to evaluate and identify areas of opportunity, pinpoint needed modifications, and monitor progress for training programs around the world. METHODS: The development of EPAT consisted of three main phases: operationalization, consensus, and piloting. After each phase, the tool was iteratively modified based on feedback to improve its relevance, usability, and clarity. RESULTS: The operationalization process led to the development of 10 domains with associated assessment questions. The two-step consensus phase included an internal consensus phase to validate the domains and a subsequent external consensus phase to refine the domains and overall function of the tool. EPAT domains for programmatic evaluation are hospital infrastructure, patient care, education infrastructure, program basics, clinical exposure, theory, research, evaluation, educational culture, and graduate impact. EPAT was piloted in five training programs in five countries, representing diverse medical training and patient care contexts for proper validation of the tool. Face validity was confirmed by a correlation between the perceived and calculated scores for each domain (r = 0.78, p < .0001). CONCLUSIONS: EPAT was developed following a systematic approach, ultimately leading to a relevant tool to evaluate the different core elements of pediatric hematology/oncology training programs across the world. With EPAT, programs will have a tool to quantitatively evaluate their training, allowing for benchmarking with centers at the local, regional, and international level.
RESUMEN
BACKGROUND: Nearly 90% children with cancer reside in low- and middle-income countries, which face multiple challenges delivering high-quality pediatric onco-critical care (POCC). We recently identified POCC quality and capacity indicators for PROACTIVE (PediatRic Oncology cApaCity assessment Tool for IntensiVe carE), a tool that evaluates strengths and limitations in POCC services. This study describes pilot testing of PROACTIVE, development of center-specific reports, and identification of common POCC challenges. METHODS: The original 119 consensus-derived PROACTIVE indicators were converted into 182 questions divided between 2 electronic surveys for intensivists and oncologists managing critically ill pediatric cancer patients. Alpha-testing was conducted to confirm face-validity with four pediatric intensivists. Eleven centers representing diverse geographic regions, income levels, and POCC services conducted beta-testing to evaluate usability, feasibility, and applicability of PROACTIVE. Centers' responses were scored and indicators with mean scores ≤75% in availability/performance were classified as common POCC challenges. RESULTS: Alpha-testing ensured face-validity and beta-testing demonstrated feasibility and usability of PROACTIVE (October 2020-June 2021). Twenty-two surveys (response rate 99.4%) were used to develop center-specific reports. Adjustments to PROACTIVE were made based on focus group feedback and surveys, resulting in 200 questions. Aggregated data across centers identified common POCC challenges: (1) lack of pediatric intensivists, (2) absence of abstinence and withdrawal symptoms monitoring, (3) shortage of supportive care resources, and (4) limited POCC training for physicians and nurses. CONCLUSIONS: PROACTIVE is a feasible and contextually appropriate tool to help clinicians and organizations identify challenges in POCC services across a wide range of resource-levels. Widespread use of PROACTIVE can help prioritize and develop tailored interventions to strengthen POCC services and outcomes globally.