Overview of the Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopy: A Joint NASPGHAN/ESPGHAN Guideline.

INTRODUCTION: Pediatric-specific quality standards for endoscopy are needed to define best practices, while measurement of associated indicators is critical to guide quality improvement. The international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) working group was assembled to develop and define quality standards and indicators for pediatric gastrointestinal endoscopic procedures through a rigorous guideline consensus process. METHODS: The Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument guided PEnQuIN members, recruited from 31 centers of various practice types representing 11 countries, in generating and refining proposed quality standards and indicators. Consensus was sought via an iterative online Delphi process, and finalized at an in-person conference. Quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach. RESULTS: Forty-nine quality standards and 47 indicators reached consensus, encompassing pediatric endoscopy facilities, procedures, endoscopists, and the patient experience. The evidence base for PEnQuIN standards and indicators was largely adult-based and observational, and downgraded for indirectness, imprecision, and study limitations to "very low" quality, resulting in "conditional" recommendations for most standards (45/49). CONCLUSIONS: The PEnQuIN guideline development process establishes international agreement on clinically meaningful metrics that can be used to promote safety and quality in endoscopic care for children. Through PEnQuIN, pediatric endoscopists and endoscopy services now have a framework for auditing, providing feedback, and ultimately, benchmarking performance. Expansion of evidence and prospective validation of PEnQuIN standards and indicators as predictors of clinically relevant outcomes and high-quality pediatric endoscopic care is now a research priority.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopy Facilities: A Joint NASPGHAN/ESPGHAN Guideline.

INTRODUCTION: There is increasing international recognition of the impact of variability in endoscopy facilities on procedural quality and outcomes. There is also growing precedent for assessing the quality of endoscopy facilities at regional and national levels by using standardized rating scales to identify opportunities for improvement. METHODS: With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of facilities where endoscopic care is provided to children. Consensus was reached via an iterative online Delphi process and subsequent in-person meeting. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development and Evaluation) approach. RESULTS: The PEnQuIN working group achieved consensus on 27 standards for facilities supporting pediatric endoscopy, as well 10 indicators that can be used to identify high-quality endoscopic care in children. These standards were subcategorized into three subdomains: Quality of Clinical Operations (15 standards, 5 indicators); Patient and Caregiver Experience (9 standards, 5 indicators); and Workforce (3 standards). DISCUSSION: The rigorous PEnQuIN process successfully yielded standards and indicators that can be used to universally guide and measure high-quality facilities for procedures around the world where endoscopy is performed in children. It also underscores the current paucity of evidence for pediatric endoscopic care processes, and the need for research into this clinical area.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopic Procedures: A Joint NASPGHAN/ESPGHAN Guideline.

INTRODUCTION: High-quality pediatric gastrointestinal procedures are performed when clinically indicated and defined by their successful performance by skilled providers in a safe, comfortable, child-oriented, and expeditious manner. The process of pediatric endoscopy begins when a plan to perform the procedure is first made and ends when all appropriate patient follow-up has occurred. Procedure-related standards and indicators developed to date for endoscopy in adults emphasize cancer screening and are thus unsuitable for pediatric medicine. METHODS: With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of endoscopic procedures. Consensus was sought via an iterative online Delphi process and finalized at an in-person conference. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach. RESULTS: The PEnQuIN working group achieved consensus on 14 standards for pediatric endoscopic procedures, as well as 30 indicators that can be used to identify high-quality procedures. These were subcategorized into three subdomains: Preprocedural (3 standards, 7 indicators), Intraprocedural (8 standards, 18 indicators), and Postprocedural (3 standards, 5 indicators). A minimum target for the key indicator, "rate of adequate bowel preparation," was set at ≥80%. DISCUSSION: It is recommended that all facilities and individual providers performing pediatric endoscopy worldwide initiate and engage with the procedure-related standards and indicators developed by PEnQuIN to identify gaps in quality and drive improvement.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopists and Endoscopists in Training: A Joint NASPGHAN/ESPGHAN Guideline.

INTRODUCTION: High-quality pediatric endoscopy requires reliable performance of procedures by competent individual providers who consistently uphold all standards determined to assure optimal patient outcomes. Establishing consensus expectations for ongoing monitoring and assessment of individual pediatric endoscopists is a method for confirming the highest possible quality of care for such procedures worldwide. We aim to provide guidance to define and measure quality of endoscopic care for children. METHODS: With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of endoscopists. Consensus was sought via an iterative online Delphi process and finalized at an in-person conference. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach. RESULTS: The PEnQuIN working group achieved consensus on 6 standards that all providers who perform pediatric endoscopy should uphold and 2 standards for pediatric endoscopists in training, with 7 corresponding indicators that can be used to identify high-quality endoscopists. Additionally, these can inform continuous quality improvement at the provider level. Minimum targets for defining high-quality pediatric ileocolonoscopy were set for 2 key indicators: cecal intubation rate (≥90%) and terminal ileal intubation rate (≥85%). DISCUSSION: It is recommended that all individual providers performing or training to perform pediatric endoscopy initiate and engage with these international endoscopist-related standards and indicators developed by PEnQuIN.

Pediatric Endoscopy Quality Improvement Network Pediatric Endoscopy Reporting Elements: A Joint NASPGHAN/ESPGHAN Guideline.

INTRODUCTION: High-quality procedure reports are a cornerstone of high-quality pediatric endoscopy as they ensure the clear communication of procedural events and outcomes, guide patient care and facilitate continuous quality improvement. The aim of this document is to outline standardized reporting elements that achieved international consensus as requirements for high-quality pediatric endoscopy procedure reports. METHODS: With support from the North American and European Societies of Pediatric Gastroenterology, Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used Delphi methodology to identify key elements that should be found in all pediatric endoscopy reports. Item reduction was attained through iterative rounds of anonymized online voting using a 6-point scale. Responses were analyzed after each round and items were excluded from subsequent rounds if ≤50% of panelists rated them as 5 ("agree moderately") or 6 ("agree strongly"). Reporting elements that ≥70% of panelists rated as "agree moderately" or "agree strongly" were considered to have achieved consensus. RESULTS: Twenty-six PEnQuIN group members from 25 centers internationally rated 63 potential reporting elements that were generated from a systematic literature review and the Delphi panelists. The response rates were 100% for all three survey rounds. Thirty reporting elements reached consensus as essential for inclusion within a pediatric endoscopy report. DISCUSSION: It is recommended that the PEnQuIN Reporting Elements for pediatric endoscopy be universally employed across all endoscopists, procedures and facilities as a foundational means of ensuring high-quality endoscopy services, while facilitating quality improvement activities in pediatric endoscopy.

Online education for gluten-free diet teaching: Development and usability testing of an e-learning module for children with concurrent celiac disease and type 1 diabetes.

BACKGROUND AND OBJECTIVE: Celiac disease (CD), the most common genetically-based food intolerance, affects 3% to 16% of children with type 1 diabetes (T1D). Treatment involves lifelong adherence to a gluten-free diet (GFD). Individualized dietary education is resource-intensive. We, therefore, sought to develop and test the usability of an e-learning module aimed at educating patients and caregivers regarding implementation of the GFD in children with concurrent CD and T1D. METHODS: An interactive e-learning module was developed based on extensive review of CD, T1D, and educational literature. A mixed-methods usability testing approach was used to refine and evaluate the module, using qualitative semi-structured interviews, observations, and satisfaction and knowledge questionnaires in two iterative cycles. The module was refined based on themes identified from each usability cycle. RESULTS: Eighteen patients (8 in cycle 1, 10 in cycle 2) and 15 caregivers (7 in cycle 1, 8 in cycle 2) participated. Patient participants had CD and T1D for a mean (SD) of 6.1 ± 5.1 and 8.3 ± 5.5 years, respectively. Their mean age was 13.5 ± 4.5 years. Thematic analysis of usability interviews showed the module to be appealing and resulted in minor module revisions after each cycle to improve usability. Mean satisfaction scores post-module completion were high (4.67 ± 0.54), indicating participants were "very satisfied" with the education. Knowledge test scores increased significantly from pre- to post-module completion (P = 0.001). CONCLUSION: A multifaceted user-centered usability approach demonstrated that an innovative, interactive e-learning module is effective in knowledge retention and can provide comprehensive and accessible information in the implementation of the GFD teaching in children with CD and T1D.

Codevelopment and usability testing of Patient Engagement 101: a Patient-Oriented Research Curriculum in Child Health e-learning module for health care professionals, researchers and trainees.

BACKGROUND: Patient and family engagement is thought to improve the quality and relevance of child health research. We developed and evaluated the usability of Patient Engagement 101, an e-learning module designed to strengthen the patient-oriented research readiness of health care professionals, researchers, trainees and other stakeholders. METHODS: The development of Patient Engagement 101 was co-led by a parent and a researcher and overseen by a diverse multistake-holder steering committee. The module was refined and evaluated using a mixed-methods usability testing approach with 2 iterative cycles of semistructured interviews, observations and questionnaires. We collected module feedback by way of semistructured interviews, the validated System Usability Scale, and satisfaction, knowledge and confidence questionnaires. Thematic coding of transcripts and field notes, informed by team discussions, guided the module revisions. RESULTS: Thirty end-users completed usability testing (15 per cycle). In each cycle, we modified the module with respect to its content, learner experience, learner-centred design and aesthetic design. Participants were highly satisfied, and System Usability Scale scores indicated the module had the best imaginable usability. Substantial increases in the participants' knowledge test scores and the confidence to engage in patient-oriented research, but not self-rated knowledge, were observed after module completion. INTERPRETATION: Codevelopment with patients and caregivers, and refinement through comprehensive end-user testing, resulted in a training resource with exceptional usability that improved knowledge and confidence to engage in patient-oriented research in child health. Patient Engagement 101 is openly available online, and the methods used to develop and evaluate it may facilitate the creation and evaluation of similar capacity-building resources.

Co-development and Usability Testing of Research 101: A Patient-Oriented Research Curriculum in Child Health (PORCCH) E-Learning Module for Patients and Families.

Background: Engaging patients and families as research partners increases the relevance, quality, and impact of child health research. However, those interested in research engagement may feel underequipped to meaningfully partner. We sought to co-develop an online learning (e-learning) module, "Research 101," to support capacity-development in patient-oriented child health research amongst patients and families. Methods: Module co-development was co-led by a parent and researcher, with guidance from a diverse, multi-stakeholder steering committee. A mixed-methods usability testing approach, with three iterative cycles of semi-structured interviews, observations, and questionnaires, was used to refine and evaluate the e-learning module. Module feedback was collected during testing and a post-module interview, and with the validated System Usability Scale (SUS), and satisfaction, knowledge, and self-efficacy questionnaires. Transcripts and field notes were analyzed through team discussion and thematic coding to inform module revisions. Results: Thirty participants fully tested Research 101, and another 15 completed confirmatory usability testing (32 caregivers, 6 patients, and 7 clinician-researchers). Module modifications pertaining to learner-centered design, content, aesthetic design, and learner experience were made in each cycle. SUS scores indicated the overall usability of the final version was "excellent." Participants' knowledge of patient-oriented research and self-efficacy to engage in research improved significantly after completing Research 101 (p < 0.01). Conclusions: Co-development and usability testing facilitated the creation of an engaging and effective resource to support the scaling up of patient-oriented child health research capacity. The methods and findings of this study may help guide the integration of co-development and usability testing in creating similar resources.