Preliminary Evaluation of a Novel Rigid Bronchoscopy Simulator.

ABSTRACT

PURPOSE: Emergent retrieval of airway foreign bodies (AFBs) in children remains a priority skill set for pediatric surgeons. In the setting of low procedural volume, simulation-based education with deliberate practice is essential to ensure trainees reach expected surgical competency. The purposes of this work were to (1) create a realistic rigid bronchoscopy for AFB retrieval simulation model and (2) to evaluate preliminary validity evidence of a novel simulator for the use of training and assessing pediatric surgical trainees' rigid bronchoscopy skills. METHODS: After institutional review board exemption determination, 18 participants performed AFB retrieval of two different objects on a novel simulator that represented an 18-month-old pediatric tracheobronchial airway. Participants reported their experience and comfort level, and rated the simulator across two domains-Authenticity and their Ability to perform tasks. Authenticity was measured by 23 items across five subdomains (Visual Attributes, Materials' Response, Realism of Experience, Value and Relevance, and Global Value). Participants who had previously performed ≥10 rigid bronchoscopies were categorized as "experienced," while those reporting <10 were considered "novice." Validity evidence relevant to test content and internal structure was evaluated using a many-facet Rasch model. RESULTS: Novice surgeons (n = 12) had previously performed a mean of 2.7 (±2.0) rigid bronchoscopies, compared to 15.4 (±7.7) by experienced surgeons (n = 6). For both models, the Value and Relevance subdomain received the highest ratings (observed average [OA] = 3.9, while Materials' Response received the lowest (OA <3.0). Participants' Global Value rating for this model was consistent with "requires minor improvements before it can be considered for use in rigid bronchoscopy training." CONCLUSIONS: We successfully designed, assembled, and evaluated a novel pediatric rigid bronchoscopy model for AFB retrieval. The model was considered as relevant to educational needs and valuable as a testing and training tool. With recommended improvements, the model could be used for implementation with a Mastery Learning curriculum.