Competencies for proficiency in basic point-of-care ultrasound in anesthesiology: national expert recommendations using Delphi methodology.

PURPOSE: Point-of-care ultrasound (POCUS) allows for rapid bedside assessment and guidance of patient care. Recently, POCUS was included as a mandatory component of Canadian anesthesiology training; however, there is no national consensus regarding the competencies to guide curriculum development. We therefore aimed to define national residency competencies for basic perioperative POCUS proficiency. METHODS: We adopted a Delphi process to delineate relevant POCUS competencies whereby we circulated an online survey to academic anesthesiologists identified as POCUS leads/experts (n = 25) at all 17 Canadian anesthesiology residency programs. After reviewing a list of competencies derived from the Royal College of Physicians and Surgeons of Canada's National Curriculum, we asked participants to accept, refine, delete, or add competencies. Three rounds were completed between 2022 and 2023. We discarded items with < 50% agreement, revised those with 50-79% agreement based upon feedback provided, and maintained unrevised those items with ≥ 80% agreement. RESULTS: We initially identified and circulated (Round 1) 74 competencies across 19 clinical domains (e.g., basics of ultrasound [equipment, nomenclature, clinical governance, physics]; cardiac [left ventricle, right ventricle, valve assessment, pericardial effusion, intravascular volume status] and lung ultrasound anatomy, image acquisition, and image interpretation; and clinical applications [monitoring and serial assessments, persistent hypotension, respiratory distress, cardiac arrest]). After three Delphi rounds (and 100% response rate maintained), panellists ultimately agreed upon 75 competencies. CONCLUSION: Through national expert consensus, this study identified POCUS competencies suitable for curriculum development and assessment in perioperative anesthesiology. Next steps include designing and piloting a POCUS curriculum and assessment tool(s) based upon these nationally defined competencies.

RéSUMé: OBJECTIF: L'échographie ciblée (POCUS) permet une évaluation rapide au chevet des patient·es et l'orientation des soins aux patient·es. Récemment, l'échographie ciblée a été incluse en tant que composante obligatoire de la formation en anesthésiologie au Canada; cependant, il n'y a pas de consensus national sur les compétences qui guideront l'élaboration des programmes d'études. Nous avons donc cherché à définir les compétences à inclure dans les programmes de résidence nationaux pour acquérir des compétences de base en échographie ciblée périopératoire. MéTHODE: Nous avons adopté un processus Delphi pour délimiter les compétences pertinentes en échographie ciblée, processus dans le cadre duquel nous avons fait circuler un sondage en ligne auprès d'anesthésiologistes universitaires identifié·es comme des responsables/expert·es en échographie ciblée (n = 25) dans les 17 programmes canadiens de résidence en anesthésiologie. Après avoir examiné une liste de compétences tirées du programme d'études national du Collège royal des médecins et chirurgiens du Canada, nous avons demandé aux participant·es d'accepter, de peaufiner, de supprimer ou d'ajouter des compétences. Trois rondes ont été complétées entre 2022 et 2023. Nous avons écarté les éléments ayant < 50 % d'accord, révisé ceux avec 50 à 79 % d'accord en fonction des commentaires fournis, et maintenu sans révision les éléments obtenant ≥ 80 % d'accord. RéSULTATS: Nous avons d'abord identifié et diffusé (ronde 1) 74 compétences dans 19 domaines cliniques (p. ex., les bases de l'échographie [équipement, nomenclature, gouvernance clinique, physique]; anatomie échographique cardiaque [ventricule gauche, ventricule droit, évaluation valvulaire, épanchement péricardique, état du volume intravasculaire] et pulmonaire [acquisition et interprétation d'images]; et applications cliniques [surveillance et évaluations en série, hypotension persistante, détresse respiratoire, arrêt cardiaque]). Après trois rondes Delphi (et un taux de réponse de 100 % maintenu), les panélistes se sont finalement mis·es d'accord sur 75 compétences. CONCLUSION: Grâce à un consensus d'expert·es au pays, cette étude a permis d'identifier les compétences en échographie ciblée adaptées à l'élaboration et à l'évaluation de programmes d'études en anesthésiologie périopératoire. Les prochaines étapes comprennent la conception et la mise à l'essai d'un programme d'études et d'outils d'évaluation en échographie ciblée basés sur ces compétences définies à l'échelle nationale.

Competency based medical education implementation at the institutional level: A cross-discipline comparative program evaluation.

INTRODUCTION: As an early adopter of competency-based medical education (CBME) our postgraduate institution was uniquely positioned to analyze implementation experience data across programs, while keeping institutional factors constant. We described participants' experiences related to CBME implementation across programs derived from early program evaluation efforts within our setting. METHODS: This evaluation focused on eight residency programs at a medium-sized academic institution in Canada. Participants (n = 175) included program leaders, faculty, and residents. The study consisted of 3 phases: (1) describing intended implementation; (2) documenting enacted implementation; and (3) comparing intended with enacted implementation to inform adaptations. Each program's findings were summarized in technical reports which were then analyzed thematically. Cross program data were organized by themes. RESULTS: Six themes were identified. All groups emphasized the need for ongoing refinement of CBME resulting from shared tensions such as increased assessment burden. However, there were some disparate CBME-related experiences between programs such as the experience with entrustable professional activities, the interpretation of retrospective entrustment anchors, and quality of feedback. CONCLUSION: We detected several cross-program successes and important challenges related to CBME. Our experience can inform other programs engaging in implementation and evaluation of CBME.

Was it all worth it? A graduating resident perspective on CBME.

BACKGROUND: Our institution simultaneously transitioned all postgraduate specialty training programs to competency-based medical education (CBME) curricula. We explored experiences of CBME-trained residents graduating from five-year programs to inform the continued evolution of CBME in Canada. METHODS: We utilized qualitative description to explore residents' experiences and inform continued CBME improvement. Data were collected from fifteen residents from various specialties through focus groups, interviews, and written responses. The data were analyzed inductively, using conventional content analysis. RESULTS: We identified five overarching themes. Three themes provided insight into residents' experiences with CBME, describing discrepancies between the intentions of CBME and how it was enacted, challenges with implementation, and variation in residents' experiences. Two themes - adaptations and recommendations - could inform meaningful refinements for CBME going forward. CONCLUSIONS: Residents graduating from CBME training programs offered a balanced perspective, including criticism and recognition of the potential value of CBME when implemented as intended. Their experiences provide a better understanding of residents' needs within CBME curricula, including greater balance and flexibility within programs of assessment and curricula. Many challenges that residents faced with CBME could be alleviated by greater accountability at program, institutional, and national levels. We conclude with actionable recommendations for addressing residents' needs in CBME.

Exploring Patient Advisors' Perceptions of Virtual Care Across Canada: Qualitative Phenomenological Study.

BACKGROUND: While virtual care services existed prior to the emergence of COVID-19, the pandemic catalyzed a rapid transition from in-person to virtual care service delivery across the Canadian health care system. Virtual care includes synchronous or asynchronous delivery of health care services through video visits, telephone visits, or secure messaging. Patient advisors are people with patient and caregiving experiences who collaborate within the health care system to share insights and experiences in order to improve health care. OBJECTIVE: This study aimed to understand patient advisors' perceptions related to virtual care and potential impacts on health care quality. METHODS: We adopted a phenomenological approach, whereby we interviewed 20 participants who were patient advisors across Canada using a semistructured interview protocol. The protocol was developed by content experts and medical education researchers. The interviews were audio-recorded, transcribed verbatim, and analyzed thematically. Data collection stopped once thematic saturation was reached. The study was conducted at Queen's University, Kingston, Ontario. We recruited 20 participants from 5 Canadian provinces (17 female participants and 3 male participants). RESULTS: Six themes were identified: (1) characteristics of effective health care, (2) experiences with virtual care, (3) modality preferences, (4) involvement of others, (5) risks associated with virtual care encounters, and (6) vulnerable populations. Participants reported that high-quality health care included building relationships and treating patients holistically. In general, participants described positive experiences with virtual care during the pandemic, including greater efficiency, increased accessibility, and that virtual care was less stressful and more patient centered. Participants comparing virtual care with in-person care reported that time, scheduling, and content of interactions were similar across modalities. However, participants also shared the perception that certain modalities were more appropriate for specific clinical encounters (eg, prescription renewals and follow-up appointments). Perspectives related to the involvement of family members and medical trainees were positive. Potential risks included miscommunication, privacy concerns, and inaccurate patient assessments. All participants agreed that stakeholders should be proactive in applying strategies to support vulnerable patients. Participants also recommended education for patients and providers to improve virtual care delivery. CONCLUSIONS: Participant-reported experiences of virtual care encounters were relatively positive. Future work could focus on delivering training and resources for providers and patients. While initial experiences are positive, there is a need for ongoing stakeholder engagement and evaluation to improve patient and caregiver experiences with virtual care.

Assessment-Seeking Strategies: Navigating the Decision to Initiate Workplace-Based Assessment.

Phenomenon: Competency-based medical education (CBME) relies on workplace-based assessment (WBA) to generate formative feedback (assessment for learning-AfL) and make inferences about competence (assessment of learning-AoL). When approaches to CBME rely on residents to initiate WBA, learners experience tension between seeking WBA for learning and for establishing competence. How learners resolve this tension may lead to unintended consequences for both AfL and AoL. We sought to explore the factors that impact both decisions to seek and not to seek WBA and use the findings to build a model of assessment-seeking strategy used by residents. In building this model we consider how the link between WBA and promotion or progression within a program impacts an individual's assessment-seeking strategy. Approach: We conducted 20 semi-structured interviews with internal medicine residents at Queen's University about the factors that influence their decision to seek or avoid WBA. Using grounded theory methodology, we applied a constant comparative analysis to collect data iteratively and identify themes. A conceptual model was developed to describe the interaction of factors impacting the decision to seek and initiate WBA. Findings: Participants identified two main motivations when deciding to seek assessments: the need to fulfill program requirements and the desire to receive feedback for learning. Analysis suggested that these motivations are often at odds with each other. Participants also described several moderating factors that impact the decision to initiate assessments, irrespective of the primary underlying motivation. These included resident performance, assessor factors, training program expectations, and clinical context. A conceptual framework was developed to describe the factors that lead to strategic assessment-seeking behaviors. Insights: Faced with the dual purpose of WBA in CBME, resident behavior in initiating assessment is guided by specific assessment-seeking strategies. Strategies reflect individual underlying motivations, influenced by four moderating factors. These findings have broad implications for programmatic assessment in a CBME context including validity considerations for assessment data used in summative decision-making including readiness for unsupervised practice.

A Canadian survey of residency applicants' and interviewers' perceptions of the 2021 CaRMS R1 virtual interviews.

BACKGROUND: All Canadian Residency Matching Service (CaRMS) R1 interviews were conducted virtually for the first time in 2021. We explored the facilitators, barriers, and implications of the virtual interview process for the CaRMS R1 match and provide recommendations for improvement. METHODS: We conducted a cross-sectional survey study of CaRMS R1 residency applicants and interviewers across Canada in 2021. Surveys were distributed by email to the interviewers, and by email, social media, or newsletter to the applicants. Inductive thematic analysis was used for open-ended items. Recommendations were provided as frequencies to demonstrate strength. Close-ended items were described and compared across groups using Chi-Square Fisher's Exact tests. RESULTS: A total of 127 applicants and 400 interviewers, including 127 program directors, responded to the survey. 193/380 (50.8%) interviewers and 90/118 (76.3%) applicants preferred virtual over in-person interview formats. Facilitators of the virtual interview format included cost and time savings, ease of scheduling, reduced environmental impact, greater equity, less stress, greater reach and participation, and safety. Barriers of the virtual interview format included reduced informal conversations, limited ability for applicants to explore programs at different locations, limited ability for programs to assess applicants' interest, technological issues, concern for interview integrity, limited non-verbal communication, and reduced networking. The most helpful media for applicants to learn about residency programs were program websites, the CaRMS/AFMC websites, and recruitment videos. Additionally, panel interviews were preferred by applicants for their ability to showcase themselves and build connections with multiple interviewers. Respondents provided recommendations regarding: (1) dissemination of program information, (2) the use of technology, and (3) the virtual interview format. CONCLUSIONS: Perceptions of 2021 CaRMS R1 virtual interviews were favourable among applicants and interviewers. Recommendations from this study can help improve future iterations of virtual interviews.

Lessons learned and new strategies for success: Evaluating the Implementation of Competency-Based Medical Education in Queen's Pediatrics.

Objectives: In 2017, Queen's University launched Competency-Based Medical Education (CBME) across 29 programs simultaneously. Two years post-implementation, we asked key stakeholders (faculty, residents, and program leaders) within the Pediatrics program for their perspectives on and experiences with CBME so far. Methods: Program leadership explicitly described the intended outcomes of implementing CBME. Focus groups and interviews were conducted with all stakeholders to describe the enacted implementation. The intended versus enacted implementations were compared to provide insight into needed adaptations for program improvement. Results: Overall, stakeholders saw value in the concept of CBME. Residents felt they received more specific feedback and monthly Competence Committee (CC) meetings and Academic Advisors were helpful. Conversely, all stakeholders noted the increased expectations had led to a feeling of assessment fatigue. Faculty noted that direct observation and not knowing a resident's previous performance information was challenging. Residents wanted to see faculty initiate assessments and improved transparency around progress and promotion decisions. Discussion: The results provided insight into how well the intended outcomes had been achieved as well as areas for improvement. Proposed adaptations included a need for increased direct observation and exploration of faculty accessing residents' previous performance information. Education was provided on the performance expectations of residents and how progress and promotion decisions are made. As well, "flex blocks" were created to help residents customize their training experience to meet their learning needs. The results of this study can be used to inform and guide implementation and adaptations in other programs and institutions.

Evaluating the effectiveness of let's talk period's high school educational outreach program: A pilot study.

INTRODUCTION: Menorrhagia impacts ~40% of adolescent females, with about half having an underlying bleeding disorder, most commonly von Willebrand Disease (VWD). VWD affects ~1 in 1000 individuals, though many are unaware of their condition. Let's Talk Period (LTP) is an online knowledge translation platform aimed at increasing awareness of bleeding disorders symptoms, with a validated self-administered bleeding assessment tool (Self-BAT). AIM: To evaluate the effectiveness of the LTP high school outreach program in Grade 9 girls' health classes quantitatively, using baseline, post-presentation, and follow-up quiz scores, and qualitatively, with student and teacher feedback forms. METHODS: The 75-minute in-class presentations, developed in alignment with the 2015 Ontario Curriculum for Grade 9 Health and Physical Activity, were led by a haemophilia nurse, clinical research assistant, and undergraduate student from the LTP team. Students completed baseline, post-presentation, and 4-6-week follow-up Kahoot quizzes featuring the same nine questions to evaluate change in knowledge levels and retention. Both student and teacher feedback were collected. RESULTS: There was a significant increase (p < 0.001) from baseline to post-presentation scores, with a significant gain in knowledge, for all questions (p < 0.01). Students found content related to the basics and management of menstruation to be most interesting. Many had constructive feedback on how the presentation method could be improved. On average, the presentations were rated an 8.6 of 10 by students and 8.75 of 10 by teachers. CONCLUSION: The LTP high school outreach program effectively increases student knowledge of menorrhagia and bleeding disorders. It was well-received by students and staff alike.

The Development of Visual Expertise in ECG Interpretation: An Eye-Tracking Augmented Re Situ Interview Approach.

Phenomenon: Visual expertise in medicine involves a complex interplay between expert visual behavior patterns and higher-level cognitive processes. Previous studies of visual expertise in medicine have centered around traditionally visually intensive disciplines such as radiology and pathology. However, there is limited study of visual expertise in electrocardiogram (ECG) interpretation, a common clinical task that is associated with high error rates. This qualitatively driven multi-methods study aimed to describe differences in cognitive approaches to ECG interpretation between medical students, emergency medicine (EM) residents, and EM attending physicians. Approach: Ten medical students, 10 EM residents, and 10 EM attending physicians were recruited from one tertiary academic center to participate in this study. Participants interpreted 10 ECGs with a screen-based eye-tracking device, then underwent a subjective re situ interview augmented by playback of the participants' own gaze scan-paths via eye-tracking. Interviews were transcribed verbatim and an emergent thematic analysis was performed across participant groups. Diagnostic speed, accuracy, and heat maps of fixation distribution were collected to supplement the qualitative findings. Findings: Qualitative analysis demonstrated differences among the cohorts in three major themes: dual-process reasoning, ability to prioritize, and clinical implications. These qualitative findings were aligned with differences in visual behavior demonstrated by heat maps of fixation distribution across each ECG. More experienced participants completed ECG interpretation significantly faster and more accurately than less experienced participants. Insights: The cognitive processes related to ECG interpretation differed between novices and more experienced providers in EM. Understanding the differences in cognitive approaches to ECG interpretation between these groups may help inform best practices in teaching this ubiquitous diagnostic skill.

The Impacts of COVID-19 on Early Childhood Education: Capturing the Unique Challenges Associated with Remote Teaching and Learning in K-2.

Due to the COVID-19 pandemic, schools across North America closed to in person learning in March 2020. Since then, it has becoming increasingly clear that physical distancing will need to be prolonged in the 2020/2021 school year and possibly resumed in the future. In response, education ministries shifted teaching and learning online. Research is urgently needed to mitigate the effects of COVID-19 on teaching and learning, particularly in the foundational early primary years. This research directly responds to this concern by examining the unique challenges associated with remote teaching and learning in early primary contexts. Given that learning in kindergarten and early primary grades is largely play- and inquiry- based, there is a particular need to investigate the impacts of this move for teachers, parents, and children in K-2. As such, the purpose of this research is twofold: (1) to capture the unique challenges and unanticipated successes associated with remote teaching and learning, and (2) to utilize findings to provide recommendations for remote learning as well as strategies for supporting in-person learning in the COVID-19 era (and post COVID-19 era). Data collection included 45-min semi-structured interviews with K-2 teachers (n = 25) and parents (n =11). All participants were from Ontario Canada. Data were collected from April-June 2020. The sample size was chosen to ensure saturation while uncovering a variety of perspectives. Data were analyzed in NVivo using an emergent thematic approach (Patton, 2016). The emergent thematic approach to analysis revealed five themes: equity considerations, synchronous versus asynchronous teaching and learning, social and emotional effects on students, academic impacts, and effects on parents/families.

Exploring How the New Entrustable Professional Activity Assessment Tools Affect the Quality of Feedback Given to Medical Oncology Residents.

The post-graduate medical programs at Queen's University transitioned to a competency-based medical education framework on July 1, 2017. In advance of this transition, the Medical Oncology program participated in a pilot of six Entrustable Professional Activities (EPAs) focused workplace-based assessment (WBA) tools with faculty and residents. The purpose of this sequential explanatory mixed method study was to determine the extent to which these WBAs provided quality feedback for residents. The WBAs were introduced into daily clinical practice and, once completed, were collected by the research team. A resident focus group (n = 4) and faculty interviews (n = 5) were also conducted. Focus group and interview data were analyzed using an emergent thematic analysis. Data from the completed assessment tools were analyzed using both descriptive statistics and a literature-informed framework developed to assess the quality of feedback. Six main findings emerged: Verbal feedback is preferred over written; providing both written and verbal feedback is important; effective feedback was seen as timely, specific, and actionable; the process was conceptualized as coaching rather than high stakes; there were logistical concerns about the WBAs, and additional clarification about the WBA tools is needed. This study provides insight into faculty and resident perceptions of quality feedback and the potential for WBA tools to assist in providing effective feedback to residents as we shift to competency-based medical education in Canada. Our results suggest the need for additional faculty development around the use of the tools, and their intended role, and the elements of quality feedback.

Starting to Think Like an Expert: An Analysis of Resident Cognitive Processes During Simulation-Based Resuscitation Examinations.

STUDY OBJECTIVE: Simulation is commonly used to teach crisis resource management skills and assess them in emergency medicine residents. However, our understanding of the cognitive processes underlying crisis resource management skills is limited because these processes are difficult to assess and describe. The objective of this study is to uncover and characterize the cognitive processes underlying crisis resource management skills and to describe how these processes vary between residents according to performance in a simulation-based examination. METHODS: Twenty-two of 24 eligible emergency medicine trainees from 1 tertiary academic center completed 1 or 2 resuscitation-based examinations in the simulation laboratory. Resident performance was assessed by a blinded expert using an entrustment-based scoring tool. Participants wore eye-tracking glasses that generated first-person video that was used to augment subsequent interviews led by an emergency medicine faculty member. Interviews were audio recorded and then transcribed. An emergent thematic analysis was completed with a codebook that was developed by 4 research assistants, with subsequent analyses conducted by the lead research assistant with input from emergency medicine faculty. Themes from high- and low-performing residents were subsequently qualitatively compared. RESULTS: Higher-performing residents were better able to anticipate, selectively attend to relevant information, and manage cognitive demands, and took a concurrent (as opposed to linear) approach to managing the simulated patient. CONCLUSION: The results provide new insights into residents' cognitive processes while managing simulated patients in an examination environment and how these processes vary with performance. More work is needed to determine how best to apply these findings to improve crisis resource management education.

Getting Inside the Expert's Head: An Analysis of Physician Cognitive Processes During Trauma Resuscitations.

STUDY OBJECTIVE: Crisis resource management skills are integral to leading the resuscitation of a critically ill patient. Despite their importance, crisis resource management skills (and their associated cognitive processes) have traditionally been difficult to study in the real world. The objective of this study was to derive key cognitive processes underpinning expert performance in resuscitation medicine, using a new eye-tracking-based video capture method during clinical cases. METHODS: During an 18-month period, a sample of 10 trauma resuscitations led by 4 expert trauma team leaders was analyzed. The physician team leaders were outfitted with mobile eye-tracking glasses for each case. After each resuscitation, participants were debriefed with a modified cognitive task analysis, based on a cued-recall protocol, augmented by viewing their own first-person perspective eye-tracking video from the clinical encounter. RESULTS: Eye-tracking technology was successfully applied as a tool to aid in the qualitative analysis of expert performance in a clinical setting. All participants stated that using these methods helped uncover previously unconscious aspects of their cognition. Overall, 5 major themes were derived from the interviews: logistic awareness, managing uncertainty, visual fixation behaviors, selective attendance to information, and anticipatory behaviors. CONCLUSION: The novel approach of cognitive task analysis augmented by eye tracking allowed the derivation of 5 unique cognitive processes underpinning expert performance in leading a resuscitation. An understanding of these cognitive processes has the potential to enhance educational methods and to create new assessment modalities of these previously tacit aspects of expertise in this field.

Exploring residents' perceptions of competency-based medical education across Canada: A national survey study.

Background: As competency-based medical education (CBME) is implemented across Canada, little is known about residents' perceptions of this model. This study examined how Canadian residents understand CBME and their lived experiences with implementation. Methods: We administered a survey in 2018 with Likert-type and open-ended questions to 375 residents across Canada, of whom 270 were from traditional programs ("pre-CBME") and 105 were in a CBME program. We used the Mann-Whitney test to examine differences across samples, and analyzed qualitative data thematically. Results: Three themes were identified across both groups: program outcome concerns, changes, and emotional responses. In relation to program concerns, both groups were concerned about the administrative burden, challenges with the assessment process, and feedback quality. Only pre-CBME residents were concerned about faculty engagement and buy-in. In terms of changes, both groups discussed a more formalized assessment process with mixed reactions. Residents in the pre-CBME sample reported greater concerns for faculty time constraints, assessment completion, and quality of learning experiences, whilst those in CBME programs reported being more proactive in their learning and greater selfreflection. Residents expressed strong emotional narrative responses including greater stress and frustration in a CBME environment. Conclusion: Findings demonstrate that residents have mixed feelings and experiences regarding CBME. Their positive experiences align with the aim of developing more self-directed learners. However, the concerns suggest the need to address specific shortcomings to increase buy-in, while the emotional responses associated with CBME may require a cultural shift within residency programs to guard against burnout.

Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency.

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen's University Internal Medicine residency program introduced a facilitated, team-based assessment initiative ("Feedback Fridays") in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program's assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions: The introduction of facilitated team-based assessment in the Queen's Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement.

Objectif: La formation médicale fondée sur les compétences s'appuie sur la rétroaction faite lors de l'évaluation des apprentissages par observation directe dans le milieu de travail. Malheureusement, les évaluations dans le milieu de travail omettent souvent de fournir une rétroaction narrative exhaustive et privilégient les aspects des soins relevant de l'expertise médicale. En se basant sur la recherche ayant étudié les approches d'évaluation interactive, le programme de résidence en médecine interne de l'Université Queen's a introduit en juillet 2017 une initiative d'évaluation facilitée et en équipe (« Les vendredis rétroaction ¼), visant à améliorer l'évaluation holistique du rendement des résidents dans les unités d'enseignement clinique en médecine interne. Dans cette étude, nous visons à explorer comment ces « vendredis rétroaction ¼ ont contribué à l'évaluation formative des résidents en médecine interne dans le cadre de notre modèle actuel de formation axée sur les compétences. Méthode: Au total, 53 résidents ont participé à des séances d'évaluation de groupe facilitées et bi-hebdomadaires au cours de l'année universitaire 2017-2018. Chaque séance consistait en une discussion d'évaluation facilitée de 30 minutes menée avec une équipe de l'unité de soins, qui comprenait des étudiants en médecine, des résidents et le médecin superviseur. Les commentaires issus de la discussion ont été recueillis, résumés et documentés sous forme narrative dans des formulaires électroniques d'observation directe dans le milieu de travail par le responsable de l'évaluation du programme de résidence. À des fins de recherche, les transcriptions verbatim des séances de rétroaction ont été analysées de façon thématique. Résultats: Les chercheurs ont identifié quatre thèmes principaux pour les commentaires : la communication, la conscience intra- et interpersonnelle, le leadership et le travail d'équipe, et les occasions d'apprentissage. Bien que la rétroaction concerne un large éventail d'activités, elle met fortement l'accent sur les compétences liées aux rôles intrinsèques de CanMEDS. De plus, le fait que la rétroaction avait un rôle clairement formatif est une autre constatation importante. Conclusions: L'introduction de l'évaluation en équipe facilitée dans le programme de médecine interne à Queen's a comblé une lacune importante dans l'apprentissage par observation directe dans le milieu de travail en fournissant aux apprenants une rétroaction détaillée sur tous les rôles CanMEDS et en formulant des recommandations constructives sur les domaines à améliorer.

The hidden curriculum across medical disciplines: an examination of scope, impact, and context.

Background: While research suggests that manifestations of the hidden curriculum (HC) phenomenon have the potential to reinforce or undermine the values of an institution, very few studies have comprehensively measured its scope, impact, and the varied clinical teaching and learning contexts within which they occur. We explored the HC and examined the validity of newly developed constructs and determined the influence of context on the HC. Methods: We surveyed medical students (n =182), residents (n =148), and faculty (n = 140) from all disciplines at our institution between 2019 and 2020. Based on prior research and expertise, we measured participants' experience with the HC including perceptions of respect and disrespect for different medical disciplines, settings in which the HC is experienced, impact of the HC, personal actions, efficacy, and their institutional perceptions. We examined the factor structure, reliability, and validity of the HC constructs using exploratory factor analysis Cronbach's alpha, regression analysis and Pearson's correlations. Results: Expert judges (physician faculty and medical learners) confirmed the content validity of the items used and the analysis revealed new HC constructs reflecting negative expressions, positive impacts and expressions, negative impacts, personal actions, and positive institutional perceptions of the HC. Evidence for criterion validity was found for the negative impacts and the personal actions constructs and were significantly associated with the stage of respondents' career and gender. Support for convergent validity was obtained for HC constructs that were significantly correlated with certain contexts within which the HC occurs. Conclusion: More unique dimensions and contexts of the HC exist than have been previously documented. The findings demonstrate that specific clinical contexts can be targeted to improve negative expressions and impacts of the HC.

Contexte: Bien que la recherche suggère que les expressions du curriculum caché (CC) ont le potentiel de renforcer ou de miner les valeurs d'un établissement, très peu d'études ont mesuré de manière exhaustive sa portée, ses effets et les divers contextes d'enseignement et d'apprentissage cliniques dans lesquels elles se produisent. Nous avons exploré le CC, examiné la validité de nouvelles notions et déterminé l'influence du contexte sur le CC. Méthodes: Entre 2019 et 2020, nous avons interrogé des étudiants (n =182), des résidents (n =148) et des membres du corps professoral (n = 140) de notre établissement, toutes disciplines médicales confondues. Sur la base de recherches et d'expertises antérieures, nous avons mesuré l'expérience des participants par rapport au CC, y compris leurs perceptions du respect ou du non-respect des diverses disciplines médicales, les contextes dans lesquels ils ont été confrontés au CC, les effets et l'efficacité du CC, les perceptions de l'établissement et les actions personnelles des participants. Nous avons examiné la structure factorielle, la fiabilité et la validité des notions du CC à l'aide d'une analyse factorielle exploratoire, du coefficient alpha de Cronbach, d'une analyse de régression et des corrélations de Pearson. Résultats: Des juges experts (médecins enseignants et apprenants) ont confirmé la validité du contenu des éléments utilisés et l'analyse a révélé de nouvelles notions du CC reflétant des expressions et des effets négatifs, des expressions et des effets positifs, des actions personnelles et des perceptions positives du CC au sein des établissements. La validité de critère a été démontrée pour les notions d'impacts négatifs et d'actions personnelles et a été associée de manière significative à l'étape de la carrière des répondants et à leur sexe. La validité convergente a été confirmée pour les notions de CC qui étaient significativement corrélées à certains contextes dans lesquels le CC se manifeste. Conclusion: Il existe plus de dimensions et de contextes uniques du CC que ceux qui avaient été documentés par le passé. Nos résultats montrent que des contextes cliniques spécifiques peuvent être ciblés pour améliorer les expressions et les effets négatifs du CC.

Is Competency-Based Medical Education being implemented as intended? Early lessons learned from Physical Medicine and Rehabilitation.

Background: As competency-based medical education (CBME) curricula are introduced in residency programs across Canada, systematic evaluation efforts are needed to ensure fidelity of implementation. This study evaluated early outcomes of CBME implementation in one Canadian Physical Medicine and Rehabilitation program that was an early adopter of CBME, with an aim to inform continuous quality improvement initiatives and CBME implementation nationwide. Methods: Using Rapid Evaluation methodology, informed by the CBME Core Components Framework, the intended outcomes of CBME were compared to actual outcomes. Results: Results suggested that a culture of feedback and coaching already existed in this program prior to CBME implementation, yet faculty felt that CBME added a framework to support feedback. The small program size was valuable in fostering strong relationships and individualized learning. However, participants expressed concerns about CBME fostering a reductionist approach to the development of competence. Challenges existed with direct observation, clear expectations for off-service training experiences, and tracking trainee progress. There was trepidation surrounding national curricular change, yet the institution-wide approach to CBME implementation created shared experiences and a community of practice. Conclusions: Program evaluation can help understand gaps between planned versus enacted implementation of CBME, and foster adaptations to improve the fidelity of implementation.

Contexte: À mesure que les programmes d'approche par compétences (APC) en formation médicale sont introduits dans les programmes de résidence au Canada, des efforts d'évaluation systématiques sont nécessaires pour assurer la fidélité de la mise en œuvre. Cette étude a évalué les premiers résultats de la mise en œuvre de l'APC en formation médicale dans un programme canadien de médecine physique et réadaptation, qui a été un des premiers à adopter l'APC, dans le but d'orienter les initiatives d'amélioration continue de la qualité et de la mise en œuvre de l'APC à l'échelle nationale. Méthodes: En utilisant une méthodologie d'évaluation rapide, fondée sur le cadre des composantes de base de l'APC en formation médicale, les résultats escomptés de l'APC ont été comparés aux résultats réels. Résultats: Les résultats suggèrent qu'une culture de la rétroaction et de l'encadrement existait déjà dans ce programme avant la mise en œuvre de l'APC, mais le corps professoral a estimé que l'APC en formation médicale a ajouté un cadre pour soutenir cette rétroaction. La petite taille du programme a permis de favoriser des relations solides et un apprentissage individualisé. Cependant, les participants ont exprimé des inquiétudes quant au fait que l'APC favorise une approche réductionniste du développement des compétences. L'observation directe, les attentes claires en matière d'expériences de formation hors de l'environnement clinique et le suivi des progrès des résidents posent problème. Le changement de programme national a suscité des inquiétudes, mais l'approche institutionnelle de la mise en œuvre de l'APC a permis de partager des expériences et de créer une communauté de pratique. Conclusions: L'évaluation des programmes peut aider à comprendre les écarts entre la mise en œuvre planifiée et effective de l'APC en formation médicale, et de favoriser les adaptations pour améliorer le respect des conditions de mise en œuvre.

Evaluating the Value of Eye-Tracking Augmented Debriefing in Medical Simulation-A Pilot Randomized Controlled Trial.

INTRODUCTION: Debriefing after simulation facilitates reflective thinking and learning. Eye-tracking augmented debriefing (ETAD) may provide advantages over traditional debriefing (TD) by leveraging video replay with first-person perspective. This multisite randomized controlled trial compared the impact of ETAD with TD (without eye-tracking and without video) after simulation on 4 outcomes: (1) resident metacognitive awareness (the primary outcome), (2) cognitive load (CL) of residents and debriefers, (3) alignment of resident self-assessment and debriefer assessment scores, and (4) resident and debriefer perceptions of the debriefing experience. METHOD: Fifty-four emergency medicine residents from 2 institutions were randomized to the experimental (ETAD) or the control (TD) arm. Residents completed 2 simulation stations followed by debriefing. Before station 1 and after station 2, residents completed a Metacognition Awareness Inventory (MAI). After each station, debriefers and residents rated their CL and completed an assessment of performance. After the stations, residents were interviewed and debriefers participated in a focus group. RESULTS: There were no statistically significant differences in mean MAI change, resident CL, or assessment alignment between residents and debriefers. Debriefer CL was lower in the experimental arm. Interviews identified 4 themes: (1) reflections related to debriefing approach, (2) eye-tracking as a metacognitive sensitizer, (3) translation of metacognition to practice, and (4) ETAD as a strategy to manage CL. Residents reported that eye tracking improved the specificity of feedback. Debriefers relied less on notes, leveraged video timestamps, appreciated the structure of the eye-tracking video, and found the video useful when debriefing poor performers. CONCLUSIONS: There were no significant quantitative differences in MAI or resident CL scores; qualitative findings suggest that residents appreciated the benefits of the eye-tracking video review. Debriefers expended less CL and reported less perceived mental effort with the new technology. Future research should leverage longitudinal experimental designs to further understand the impact of eye-tracking facilitated debriefing.

Development of a Canadian Medical Assistance in Dying Curriculum for Healthcare Providers.

Objectives: Medical Assistance in Dying (MAiD) was legalized in Canada in 2016, necessitating greater education and training in MAiD for physicians and nurse practitioners. To meet this need, the Canadian MAiD Curriculum (CMC) was developed to offer a nationally accredited, comprehensive, bilingual, hybrid (synchronous and asynchronous) educational program to support and enhance the practice of MAiD in Canada. Methods: This work describes the process of developing the CMC, including its guiding principles and framework. The CMC was guided by constructivism and adult learning theory, preliminary literature review, 5 key principles based on a needs assessment survey, as well as consultation with diverse partners. Results: Seven modules were developed: (1) foundations of MAiD in Canada, (2) clinical conversations that includes MAiD, (3) how to do an MAiD assessment, (4) capacity and vulnerability, (5) providing MAiD, (6) navigating complex cases with confidence, and (7) MAiD and mental disorders. An eighth topic on clinician resilience and reflection was woven into each of the 7 modules. Conclusion: This curriculum ensures that consistent information is available to healthcare providers concerning the practice of MAiD in Canada. To ensure sustainability, the CMC will continue to be updated alongside the evolution of MAiD policy and services in Canada.

Catalytic effect of multisource feedback for trauma team captains: a mixed-methods prospective study.

OBJECTIVES: To evaluate the impact and feasibility of multisource feedback compared with traditional feedback for trauma team captains (TTCs). DESIGN: A mixed-methods, non-randomised prospective study. SETTING: A level one trauma centre in Ontario, Canada. PARTICIPANTS: Postgraduate medical residents in emergency medicine and general surgery participating as TTCs. Selection was based on a convenience sampling method. INTERVENTION: Postgraduate medical residents participating as TTCs received either multisource feedback or standard feedback following trauma cases. MAIN OUTCOME MEASURES: TTCs completed questionnaires designed to measure the self-reported intention to change practice (catalytic effect), immediately following a trauma case and 3 weeks later. Secondary outcomes included measures of perceived benefit, acceptability, and feasibility from TTCs and other trauma team members. RESULTS: Data were collected following 24 trauma team activations: TTCs from 12 activations received multisource feedback and 12 received standard feedback. The self-reported intention for practice change was not significantly different between groups initially (4.0 vs 4.0, p=0.57) and at 3 weeks (4.0 vs 3.0, p=0.25). Multisource feedback was perceived to be helpful and superior to the existing feedback process. Feasibility was identified as a challenge. CONCLUSIONS: The self-reported intention for practice change was no different for TTCs who received multisource feedback and those who received standard feedback. Multisource feedback was favourably received by trauma team members, and TTCs perceived multisource feedback as useful for their development.