Validation of an Educational Tool for Skin Abscess Incision and Drainage by Delphi and Angoff Methods.

BACKGROUND: Bedside incision and drainage (I&D) of skin abscesses is a common medical procedure performed in a variety of medical settings. Yet, there is a paucity of published validated educational tools to teach and assess competency for this procedure. OBJECTIVE: To validate an educational tool to teach and assess competency for bedside I&D of skin abscesses via the Delphi consensus and Angoff standard setting methods. DESIGN: Expert consensus on the importance of each procedural step in the educational tool was obtained using the Delphi method, consisting of four rounds of iterative revisions based on input from a panel of experts. The passing cut-off score for a proficient provider was determined using the modified dichotomous Angoff method. PARTICIPANTS: All participants met the minimum criteria of active involvement in resident education and performance of at least 20 skin abscess I&D's within the past 5 years. Participant specialties included general surgery, emergency medicine, and internal medicine. MAIN MEASURES: The primary outcome was consensus on procedural steps and errors, defined as an interquartile range ≤ 2 on a 9-point Likert scale. A cut-off score was determined by the average across all respondents for the anticipated number of errors that would be committed by a provider with the level of proficiency defined in the survey. Qualitative input was incorporated into the educational tool. KEY RESULTS: At the end of four rounds of review via the Delphi process, participants achieved consensus on 93% of items on the clinical checklist and 85% of errors on the assessment checklist. Via the modified dichotomous Angoff method, the determined passing cut-off for competency was 6 out of 22 errors. CONCLUSION: An educational and evaluation tool for bedside I&D of skin abscesses was validated via the Delphi and Angoff methods.

Considerations for Clinician-Educators Developing Online Educational Content: A Narrative Review.

In modern medical education, clinician-educators are increasingly called upon to develop online education to complement or replace in-person instruction. Despite a growing need for online curricula, many medical professionals lack training and experience in digital content development, deployment, assessment, and maintenance. Previous studies offer guidance on some aspects of online education development but often overlook key components, such as accessibility, legal considerations, financial implications, and sustainability challenges. This review offers medical professionals a broad overview of these important issues. We discuss various pedagogical considerations, including aligning educational goals and objectives with the digital content, choosing the appropriate online interface, and employing strategies to mitigate cognitive load while maximizing accessibility to create an inclusive online learning environment. We offer practical tips for creating effective, high-quality, and enduring audio-visual content and reflect on initial content deployment, testing, assessment, and revision. We discuss the intricacies of obtaining continuing medical education credits when the target audience includes faculty members. We address several legal issues online educators must consider, such as copyright laws, intellectual property rights, and medical liability. The review concludes with a discussion of sustainability mechanisms and financial considerations to ensure the long-term success of the educational program. Our recommendations aim to equip medical professionals embarking on a digital education journey with practical tools to produce effective, inclusive, and sustainable online content while considering legal implications.

A Quality Improvement Approach to Modification of a Point-of-Care Ultrasound Curriculum.

Background: There is increasing emphasis on resident involvement in quality improvement (QI) efforts, yet resident engagement in QI has remained low for many reasons. Although QI methods are classically applied to clinical processes, there are many opportunities to incorporate QI principles into curricular design and implementation. Objective: Demonstrate the utility of QI methods when applied to curricular design and the implementation of a novel point-of-care ultrasound portfolio development and quality assurance program at a large internal medicine residency program. Methods: We applied foundational QI methods, including process mapping, plan-do-study-act (PDSA) cycles, time-trap identification, run-chart analysis, and qualitative interviews throughout the curricular design and implementation phases to rapidly identify areas for improvement and perform timely tests of change. Results: Fifty-one interns participated in the curriculum, submitting 731 images in the first trimester. Process mapping and submission review revealed that 29% of images were saved to the incorrect digital archive. Resident-reviewer interpretation concordance was present in 80.7% of submissions. In 95.2% of completed quality assurance cards, the same information was provided in the commentary feedback and the evaluator's checklists, representing a time trap. Interventions included restricting access to image archives and removing redundant fields from quality assurance cards. The time to feedback fell from 69.5 to 6.5 days, demonstrating nonrandom variation via run-chart analysis. Conclusion: This pilot study demonstrates the successful application of QI methods to a novel point-of-care ultrasound curriculum. The systematic use of these methodologies in curricular design and implementation allows expeditious curricular improvement. Emphasizing the relevance of QI methods to subject matter beyond clinical processes may increase resident engagement in QI efforts.