ABSTRACT
PURPOSE: This article shares our experience developing an integrated curriculum for the ACES (Acute Critical Event Simulation) program. The purpose of the ACES program is to ensure that health care providers develop proficiency in the early management of critically ill patients. The program includes multiple different types of educational interventions (mostly simulation-based) and targets both specialty and family physicians practicing in tertiary and community hospitals. METHODS: To facilitate integration between different educational interventions, we developed a knowledge repository consisting of cognitive sequence maps that make explicit the flow of cognitive activities carried out by experts facing different situations - the sequence maps then serving as the foundation upon which multimodal simulation scenarios would be built. To encourage participation of experts, we produced this repository as a peer-reviewed ebook. Five national organizations collaborated with the Royal College of Physicians and Surgeons of Canada to identify and recruit expert authors and reviewers. Foundational chapters, centered on goals/interventions, were first developed to comprehensively address most tasks conducted in the early management of a critically ill patient. Tasks from the foundational chapters were then used to complete the curriculum with situations. The curriculum development consisted of two-phases each followed by a peer-review process. In the first phase, focus groups using web-conferencing were conducted to map clinical practice approaches and in the second, authors completed the body of the chapter (e.g., introduction, definition, concepts, etc.) then provided a more detailed description of each task linked to supporting evidence. RESULTS: Sixty-seven authors and thirty-five peer reviewers from various backgrounds (physicians, pharmacists, nurses, respiratory therapists) were recruited. On average, there were 32 tasks and 15 situations per chapter. The average number of focus group meetings needed to develop a map (one map per chapter) was 6.7 (SD ± 3.6). We found that the method greatly facilitated integration between different chapters especially for situations which are not limited to a single goal or intervention. For example, almost half of the tasks of the Hypercapnic Ventilatory Failure chapter map were borrowed from other maps with some modifications, which significantly reduced the authors' workload and enhanced content integration. This chapter was also linked to 6 other chapters. CONCLUSIONS: To facilitate curriculum integration, we have developed a knowledge repository consisting of cognitive maps which organize time-sensitive tasks in the proper sequence; the repository serving as the foundation upon which other educational interventions are then built. While this methodology is demanding, authors welcomed the challenge given the scholarly value of their work, thus creating an interprofessional network of educators across Canada.
ABSTRACT
INTRODUCTION: Evaluation capacity building (ECB) is a topic of great interest to many organizations as they face increasing demands for accountability and evidence-based practices. ECB is about building the knowledge, skills, and attitudes of organizational members, the sustainability of rigorous evaluative practices, and providing the resources and motivations to engage in ongoing evaluative work. There exists a solid foundation of theoretical research on ECB, however, understanding what ECB looks like in practice is relatively thin. Our purpose was to investigate what ECB looks like firsthand within a national medical educational organization. METHODS: The context for this study was the Acute Critical Events Simulation (ACES) organization in Canada, which has successfully evolved into a national educational program, driven by physicians. We conducted an exploratory qualitative study to better understand and describe ECB in practice. In doing so, interviews were conducted with program leaders and instructors so as to gain a richer understanding of evaluative processes and practices. RESULTS: A total of 21 individuals participated in the semistructured interviews. Themes from our qualitative data analysis included the following: evaluation knowledge, skills, and attitudes, use of evaluation findings, shared evaluation beliefs and commitment, evaluation frameworks and processes, and resources dedicated to evaluation. CONCLUSION: The national ACES organization was a useful case study to explore ECB in practice. The ECB literature provided a solid foundation to understand the purpose and nuances of ECB. This study added to the paucity of studies focused on examining ECB in practice. The most important lesson learned was that the organization must have leadership who are intrinsically motivated to employ and use evaluation data to drive ongoing improvements within the organization. Leaders who are intrinsically motivated will employ risk taking when evaluation practices and processes may be somewhat unfamiliar. Creating and maintaining a culture of data use and ongoing inquiry have enabled national ACES to achieve a sustainable evaluation practice.
ABSTRACT
OBJECTIVES: Conceptual clarity on physician volunteer engagement is lacking in the medical literature. The aim of this study was to present a conceptual framework to describe the elements which influence physician volunteer engagement and to explore volunteer engagement within a national educational programme. SETTING: The context for this study was the Acute Critical Events Simulation (ACES) programme in Canada, which has successfully evolved into a national educational programme, driven by physician volunteers. From 2010 to 2014, the programme recruited 73 volunteer healthcare professionals who contributed to the creation of educational materials and/or served as instructors. METHOD: A conceptual framework was constructed based on an extensive literature review and expert consultation. Secondary qualitative analysis was undertaken on 15 semistructured interviews conducted from 2012 to 2013 with programme directors and healthcare professionals across Canada. An additional 15 interviews were conducted in 2015 with physician volunteers to achieve thematic saturation. Data were analysed iteratively and inductive coding techniques applied. RESULTS: From the physician volunteer data, 11 themes emerged. The most prominent themes included volunteer recruitment, retention, exchange, recognition, educator network and quasi-volunteerism. Captured within these interrelated themes were the framework elements, including the synergistic effects of emotional, cognitive and reciprocal engagement. Behavioural engagement was driven by these factors along with a cue to action, which led to contributions to the ACES programme. CONCLUSION: This investigation provides a preliminary framework and supportive evidence towards understanding the complex construct of physician volunteer engagement. The need for this research is particularly important in present day, where growing fiscal constraints create challenges for medical education to do more with less.
