A review of the American College of Surgeons accredited education institutes' assessment practices for learners, faculty, and continuous program improvement.

Purpose: Simulation is an instructional modality that offers opportunities for assessment across many domains. The American College of Surgeons created the Accredited Education Institutes (AEIs) to build a community of high-quality simulation centers focused around improving surgical education and training. The goals of this project were to identify assessment methods used by AEIs, discuss how these methods align with established assessment frameworks, identify best practices, and provide guidance on best practice implementation. Methods: The authors analyzed responses regarding learner assessment, faculty assessment, and continuous program improvement from AEI accreditations surveys using deductive qualitative analysis. Results: Data from ninety-six centers were reviewed. Codes for each category were organized into formal and informal themes. For learner assessment, examinations and checklists identified as the most common types of formal assessment used and oral feedback as the most common type of informal assessment. For faculty assessment, written evaluations were the most common formal type and debriefs were the most common informal type. For continuous program improvement, written evaluations were the most common formal type and oral feedback was the most frequent informal type. Discussion: The goal of assessment should be to encourage learning through feedback and to ensure the attainment of educational competencies. The data revealed a variety of assessment modalities used to accomplish this goal with AEIs frequently utilizing some of the most reliable forms of assessment. We discuss how these forms of assessment can be integrated with best practices to develop assessment portfolios for learners and faculty, performance improvement reports for faculty, and assessments of clinical impact. Supplementary Information: The online version contains supplementary material available at 10.1007/s44186-023-00132-6.

Impact of the COVID-19 pandemic on American College of Surgeons-Accredited Education Institutes & American Society of Anesthesiologists-Simulation Education Network: Opportunities for interdisciplinary collaboration.

BACKGROUND: The COVID-19 pandemic presented challenges for simulation programs including American College of Surgeons Accredited Education Institutes and American Society of Anesthesiologists Simulation Education Network. American College of Surgeons Accredited Education Institutes and American Society of Anesthesiologists Simulation Education Network leadership were surveyed to identify opportunities to enhance patient safety through simulation. METHODS: Between January and June 2021, surveys consisting of 3 targeted domains: (I) Changing practice; (II) Contributions and recognition; and (III) Moving ahead were distributed to 100 American College of Surgeons Accredited Education Institutes and 54 American Society of Anesthesiologists Simulation Education Network centers. Responses were combined and percent frequencies reported. RESULTS: Ninety-six respondents, representing 51 (51%) American College of Surgeons Accredited Education Institutes, 17 (31.5%) American Society of Anesthesiologists Simulation Education Network, and 28 dually accredited centers, completed the survey. Change of practice. Although 20.3% of centers stayed fully operational at the COVID-19 onset, 82% of all centers closed: 32% were closed less than 3 months, 28% were closed 3 to 6 months, 8% were closed 7 to 9 months, and 32% remained closed as of June 6, 2021. Most impacted activities were large-group instruction and team training. Sixty-nine percent of programs converted in-person to virtual programs. Contributions. The top reported innovative contributions included policies (80%), curricula (80%), and scholarly work (74%), Moving ahead. The respondents' top concerns were returning to high-quality training to best address learners' deficiencies and re-engagement of re-directed training programs. When asked "How the American College of Surgeons/American Society of Anesthesiologists Programs could best assist your simulation center goals?" the top responses were "facilitate collaboration" and "publish best practices from this work." CONCLUSION: The Pandemic presented multiple challenges and opportunities for simulation centers. Opportunities included collaboration between American College of Surgeons Accredited Education Institutes and the American Society of Anesthesiologists Simulation Education Network to identify best practices and resources needed to enhance patient safety through simulation.

Overarching themes from ACS-AEI accreditation survey best practices 2011-2019.

The American College of Surgeons launched the Accredited Education Institutes (ACS-AEIs) in 2005 to create a network of simulation centers to offer the highest-quality surgical education and training and to pursue cutting-edge scholarship. Specific standards and criteria were developed to accredit simulation centers, and decisions made based on the application, site surveyor visit, and ACS-AEI Accreditation Committee review. In addition to granting accreditation and providing recommendations for improvement, site surveyors and the Accreditation Committee identified best practices defined as areas far exceeding the accreditation standards or novel methods of advancing high-quality, impactful education. Best practices were compiled into a list starting in 2011 for dissemination to all members of the ACS-AEI Consortium through on-line videos, newsletters, and workshops at the Annual ACS Surgical Simulation Summit. Using thematic analysis, the authors classified common themes from the 337 best practices identified during 247 accreditation reviews between June 2011 and June 2019. As best practices were extracted, the authors compiled them into a single database. Eight overarching themes were identified, including approaches to faculty development, scholarly activity, development of curricula, use of resources, delivery of educational content, assessment of learners, and collaboration between centers. The authors discuss themes in the context of their practical relevance and highlight strategies used at different centers, with an emphasis on the importance of each theme in developing a successful simulation program.