Consistency and quality in written accreditation protocols for pediatrician training programs: a mixed-methods analysis of a global sample, and directions for improvement.

BACKGROUND: The World Federation for Medical Education (WFME) defines accreditation as 'certification of the suitability of medical education programs, and of…competence…in the delivery of medical education.' Accreditation bodies function at national, regional and global levels. In 2015, WFME published quality standards for accreditation of postgraduate medical education (PGME). We compared accreditation of pediatric PGME programs to these standards to understand variability in accreditation and areas for improvement. METHODS: We examined 19 accreditation protocols representing all country income levels and world regions. For each, two raters assessed 36 WFME-defined accreditation sub-areas as present, partially present, or absent. When rating "partially present" or "absent", raters noted the rationale for the rating. Using an inductive approach, authors qualitatively analyzed notes, generating themes in reasons for divergence from the benchmark. RESULTS: A median of 56% (IQR 43-77%) of WFME sub-areas were present in individual protocols; 22% (IQR 15-39%) were partially present; and 8.3% (IQR 5.5-21%) were absent. Inter-rater agreement was 74% (SD 11%). Sub-areas least addressed included number of trainees, educational expertise, and performance of qualified doctors. Qualitative themes of divergence included (1) variation in protocols related to heterogeneity in program structure; (2) limited engagement with stakeholders, especially regarding educational outcomes and community/health system needs; (3) a trainee-centered approach, including equity considerations, was not universal; and (4) less emphasis on quality of education, particularly faculty development in teaching. CONCLUSIONS: Heterogeneity in accreditation can be appropriate, considering cultural or regulatory context. However, we identified broadly applicable areas for improvement: ensuring equitable access to training, taking a trainee-centered approach, emphasizing quality of teaching, and ensuring diverse stakeholder feedback.

Feasibility of Family-Assisted Severity of Illness Monitoring for Hospitalized Children in Low-Income Settings.

OBJECTIVES: To determine the feasibility of having caregivers assist in recognition of clinical deterioration in children hospitalized with febrile illness in a resource-limited setting. DESIGN: Single-center, prospective, interventional pilot study. SETTING: General pediatric wards at Kenyatta National Hospital, Nairobi, Kenya's largest public tertiary-care hospital. PATIENTS: Children hospitalized with acute febrile illness, accompanied by caregivers available at the bedside for 24 hours soon after hospital admission. INTERVENTIONS: Caregivers were trained to recognize signs of critical illness using the Family-Assisted Severe Febrile Illness Therapy tool, which quantifies patients' work of breathing, mental status, and perfusion, producing color-coded flags to signal illness severity. Caregivers' Family-Assisted Severe Febrile Illness Therapy assessments were compared with healthcare professional assessments and to established Pediatric Early Warning Scores (PEWS). An initial study stage was followed by refinement of training and a larger second stage with intervention/control arms. MEASUREMENTS AND MAIN RESULTS: A total of 107 patient/caregiver pairs were enrolled in the interventional arm; 106 caregivers underwent Family-Assisted Severe Febrile Illness Therapy training and were included in the analysis. Patient characteristics included median age 1.1 years (0.2-10 yr), 55 (52%) female, and diagnoses: pneumonia (64 [60%]), meningitis (38 [36%]), gastroenteritis (24 [23%]), and malaria (21 [20%]). Most caregivers had primary (34 [32%]) or secondary (53 [50%]) school education. Fourteen of 106 patients (13%) died during their stay, six within 2 days. Across all severity levels, caregiver Family-Assisted Severe Febrile Illness Therapy assessments matched professionals in 87% and 94% for stages 1 and 2, respectively. Caregiver Family-Assisted Severe Febrile Illness Therapy assessments had a moderate to strong correlation with coinciding Pediatric Early Warning Scores and were sensitive to life-threatening deterioration: for all six patients who died within 2 days of admission, caregiver assessment reached the highest alert level. CONCLUSIONS: Caregiver involvement in recognition of critical illness in hospitalized children in low-resource settings may be feasible. This may facilitate earlier detection of clinical deterioration where staffing is severely limited by constrained resources. Further validation of the Family-Assisted Severe Febrile Illness Therapy tool is warranted, followed by its application in a larger multisite patient population to assess provider response and associated clinical outcomes.

Family-Assisted Severity of Illness Monitoring for Hospitalized Children in Low-Resource Settings-A Two-Arm Interventional Feasibility Study.

Introduction: Pediatric mortality remains unacceptably high in many low-resource settings, with inpatient deaths often associated with delayed recognition of clinical deterioration. The Family-Assisted Severe Febrile Illness ThERapy (FASTER) tool has been developed for caregivers to assist in monitoring their hospitalized children and alert clinicians. This study evaluates feasibility of implementation by caregivers and clinicians. Methods: Randomized controlled feasibility study at Kenyatta National Hospital, Kenya. Children hospitalized with acute febrile illness with caregivers at the bedside for 24 h were enrolled. Caregivers were trained using the FASTER tool. The primary outcome was the frequency of clinician reassessments between intervention (FASTER) and standard care arms. Poisson regression with random intercept for grouping by patient was used, adjusting for admission pediatric early warning score, age, gender. Secondary outcomes included survey assessments of clinician and caregiver experiences with FASTER. Results: One hundred and fifty patient/caregiver pairs were enrolled, 139 included in the analysis, 74 in the intervention, 65 in the control arm. Patients' median age was 0.9 (range 0.2-10) and 1.1 years (range 0.2-12) in intervention vs. control arms. The most common diagnoses were pneumonia (80[58%]), meningitis (58[38%]) and malaria (34 [24%]). 134 (96%) caregivers were patients' mothers. Clinician visits/hour increased with patients' illness severity in both arms, but without difference in frequency between arms (point estimate for difference -0.9%, p = 0.97). Of the 16 deaths, 8 (four/arm) occurred within 2 days of enrollment. Forty clinicians were surveyed, 33 (82%) reporting that FASTER could improve outcomes of very sick children in low-resource settings; 26 (65%) rating caregivers as able to adequately capture patients' severity of illness. Of 70 caregivers surveyed, 63 (90%) reported that FASTER training was easy to understand; all (100%) agreed that the intervention would improve care of hospitalized children and help identify sick children in their community. Discussion: We observed no difference in recorded frequency of clinician visits with FASTER monitoring. However, the tool was rated positively by caregivers and clinicians., Implementation appears feasible but requires optimization. These feasibility data may inform a larger trial powered to measure morbidity and mortality outcomes to determine the utility of FASTER in detecting and responding to clinical deterioration in low-resource settings. Clinical Trial Registration: ClinicalTrials.gov, identifier: NCT03513861.