Competencies for proficiency in basic point-of-care ultrasound in anesthesiology: national expert recommendations using Delphi methodology.

PURPOSE: Point-of-care ultrasound (POCUS) allows for rapid bedside assessment and guidance of patient care. Recently, POCUS was included as a mandatory component of Canadian anesthesiology training; however, there is no national consensus regarding the competencies to guide curriculum development. We therefore aimed to define national residency competencies for basic perioperative POCUS proficiency. METHODS: We adopted a Delphi process to delineate relevant POCUS competencies whereby we circulated an online survey to academic anesthesiologists identified as POCUS leads/experts (n = 25) at all 17 Canadian anesthesiology residency programs. After reviewing a list of competencies derived from the Royal College of Physicians and Surgeons of Canada's National Curriculum, we asked participants to accept, refine, delete, or add competencies. Three rounds were completed between 2022 and 2023. We discarded items with < 50% agreement, revised those with 50-79% agreement based upon feedback provided, and maintained unrevised those items with ≥ 80% agreement. RESULTS: We initially identified and circulated (Round 1) 74 competencies across 19 clinical domains (e.g., basics of ultrasound [equipment, nomenclature, clinical governance, physics]; cardiac [left ventricle, right ventricle, valve assessment, pericardial effusion, intravascular volume status] and lung ultrasound anatomy, image acquisition, and image interpretation; and clinical applications [monitoring and serial assessments, persistent hypotension, respiratory distress, cardiac arrest]). After three Delphi rounds (and 100% response rate maintained), panellists ultimately agreed upon 75 competencies. CONCLUSION: Through national expert consensus, this study identified POCUS competencies suitable for curriculum development and assessment in perioperative anesthesiology. Next steps include designing and piloting a POCUS curriculum and assessment tool(s) based upon these nationally defined competencies.

RéSUMé: OBJECTIF: L'échographie ciblée (POCUS) permet une évaluation rapide au chevet des patient·es et l'orientation des soins aux patient·es. Récemment, l'échographie ciblée a été incluse en tant que composante obligatoire de la formation en anesthésiologie au Canada; cependant, il n'y a pas de consensus national sur les compétences qui guideront l'élaboration des programmes d'études. Nous avons donc cherché à définir les compétences à inclure dans les programmes de résidence nationaux pour acquérir des compétences de base en échographie ciblée périopératoire. MéTHODE: Nous avons adopté un processus Delphi pour délimiter les compétences pertinentes en échographie ciblée, processus dans le cadre duquel nous avons fait circuler un sondage en ligne auprès d'anesthésiologistes universitaires identifié·es comme des responsables/expert·es en échographie ciblée (n = 25) dans les 17 programmes canadiens de résidence en anesthésiologie. Après avoir examiné une liste de compétences tirées du programme d'études national du Collège royal des médecins et chirurgiens du Canada, nous avons demandé aux participant·es d'accepter, de peaufiner, de supprimer ou d'ajouter des compétences. Trois rondes ont été complétées entre 2022 et 2023. Nous avons écarté les éléments ayant < 50 % d'accord, révisé ceux avec 50 à 79 % d'accord en fonction des commentaires fournis, et maintenu sans révision les éléments obtenant ≥ 80 % d'accord. RéSULTATS: Nous avons d'abord identifié et diffusé (ronde 1) 74 compétences dans 19 domaines cliniques (p. ex., les bases de l'échographie [équipement, nomenclature, gouvernance clinique, physique]; anatomie échographique cardiaque [ventricule gauche, ventricule droit, évaluation valvulaire, épanchement péricardique, état du volume intravasculaire] et pulmonaire [acquisition et interprétation d'images]; et applications cliniques [surveillance et évaluations en série, hypotension persistante, détresse respiratoire, arrêt cardiaque]). Après trois rondes Delphi (et un taux de réponse de 100 % maintenu), les panélistes se sont finalement mis·es d'accord sur 75 compétences. CONCLUSION: Grâce à un consensus d'expert·es au pays, cette étude a permis d'identifier les compétences en échographie ciblée adaptées à l'élaboration et à l'évaluation de programmes d'études en anesthésiologie périopératoire. Les prochaines étapes comprennent la conception et la mise à l'essai d'un programme d'études et d'outils d'évaluation en échographie ciblée basés sur ces compétences définies à l'échelle nationale.

Was it all worth it? A graduating resident perspective on CBME.

BACKGROUND: Our institution simultaneously transitioned all postgraduate specialty training programs to competency-based medical education (CBME) curricula. We explored experiences of CBME-trained residents graduating from five-year programs to inform the continued evolution of CBME in Canada. METHODS: We utilized qualitative description to explore residents' experiences and inform continued CBME improvement. Data were collected from fifteen residents from various specialties through focus groups, interviews, and written responses. The data were analyzed inductively, using conventional content analysis. RESULTS: We identified five overarching themes. Three themes provided insight into residents' experiences with CBME, describing discrepancies between the intentions of CBME and how it was enacted, challenges with implementation, and variation in residents' experiences. Two themes - adaptations and recommendations - could inform meaningful refinements for CBME going forward. CONCLUSIONS: Residents graduating from CBME training programs offered a balanced perspective, including criticism and recognition of the potential value of CBME when implemented as intended. Their experiences provide a better understanding of residents' needs within CBME curricula, including greater balance and flexibility within programs of assessment and curricula. Many challenges that residents faced with CBME could be alleviated by greater accountability at program, institutional, and national levels. We conclude with actionable recommendations for addressing residents' needs in CBME.

Exploring Patient Advisors' Perceptions of Virtual Care Across Canada: Qualitative Phenomenological Study.

BACKGROUND: While virtual care services existed prior to the emergence of COVID-19, the pandemic catalyzed a rapid transition from in-person to virtual care service delivery across the Canadian health care system. Virtual care includes synchronous or asynchronous delivery of health care services through video visits, telephone visits, or secure messaging. Patient advisors are people with patient and caregiving experiences who collaborate within the health care system to share insights and experiences in order to improve health care. OBJECTIVE: This study aimed to understand patient advisors' perceptions related to virtual care and potential impacts on health care quality. METHODS: We adopted a phenomenological approach, whereby we interviewed 20 participants who were patient advisors across Canada using a semistructured interview protocol. The protocol was developed by content experts and medical education researchers. The interviews were audio-recorded, transcribed verbatim, and analyzed thematically. Data collection stopped once thematic saturation was reached. The study was conducted at Queen's University, Kingston, Ontario. We recruited 20 participants from 5 Canadian provinces (17 female participants and 3 male participants). RESULTS: Six themes were identified: (1) characteristics of effective health care, (2) experiences with virtual care, (3) modality preferences, (4) involvement of others, (5) risks associated with virtual care encounters, and (6) vulnerable populations. Participants reported that high-quality health care included building relationships and treating patients holistically. In general, participants described positive experiences with virtual care during the pandemic, including greater efficiency, increased accessibility, and that virtual care was less stressful and more patient centered. Participants comparing virtual care with in-person care reported that time, scheduling, and content of interactions were similar across modalities. However, participants also shared the perception that certain modalities were more appropriate for specific clinical encounters (eg, prescription renewals and follow-up appointments). Perspectives related to the involvement of family members and medical trainees were positive. Potential risks included miscommunication, privacy concerns, and inaccurate patient assessments. All participants agreed that stakeholders should be proactive in applying strategies to support vulnerable patients. Participants also recommended education for patients and providers to improve virtual care delivery. CONCLUSIONS: Participant-reported experiences of virtual care encounters were relatively positive. Future work could focus on delivering training and resources for providers and patients. While initial experiences are positive, there is a need for ongoing stakeholder engagement and evaluation to improve patient and caregiver experiences with virtual care.

Assessment-Seeking Strategies: Navigating the Decision to Initiate Workplace-Based Assessment.

Phenomenon: Competency-based medical education (CBME) relies on workplace-based assessment (WBA) to generate formative feedback (assessment for learning-AfL) and make inferences about competence (assessment of learning-AoL). When approaches to CBME rely on residents to initiate WBA, learners experience tension between seeking WBA for learning and for establishing competence. How learners resolve this tension may lead to unintended consequences for both AfL and AoL. We sought to explore the factors that impact both decisions to seek and not to seek WBA and use the findings to build a model of assessment-seeking strategy used by residents. In building this model we consider how the link between WBA and promotion or progression within a program impacts an individual's assessment-seeking strategy. Approach: We conducted 20 semi-structured interviews with internal medicine residents at Queen's University about the factors that influence their decision to seek or avoid WBA. Using grounded theory methodology, we applied a constant comparative analysis to collect data iteratively and identify themes. A conceptual model was developed to describe the interaction of factors impacting the decision to seek and initiate WBA. Findings: Participants identified two main motivations when deciding to seek assessments: the need to fulfill program requirements and the desire to receive feedback for learning. Analysis suggested that these motivations are often at odds with each other. Participants also described several moderating factors that impact the decision to initiate assessments, irrespective of the primary underlying motivation. These included resident performance, assessor factors, training program expectations, and clinical context. A conceptual framework was developed to describe the factors that lead to strategic assessment-seeking behaviors. Insights: Faced with the dual purpose of WBA in CBME, resident behavior in initiating assessment is guided by specific assessment-seeking strategies. Strategies reflect individual underlying motivations, influenced by four moderating factors. These findings have broad implications for programmatic assessment in a CBME context including validity considerations for assessment data used in summative decision-making including readiness for unsupervised practice.

A Canadian survey of residency applicants' and interviewers' perceptions of the 2021 CaRMS R1 virtual interviews.

BACKGROUND: All Canadian Residency Matching Service (CaRMS) R1 interviews were conducted virtually for the first time in 2021. We explored the facilitators, barriers, and implications of the virtual interview process for the CaRMS R1 match and provide recommendations for improvement. METHODS: We conducted a cross-sectional survey study of CaRMS R1 residency applicants and interviewers across Canada in 2021. Surveys were distributed by email to the interviewers, and by email, social media, or newsletter to the applicants. Inductive thematic analysis was used for open-ended items. Recommendations were provided as frequencies to demonstrate strength. Close-ended items were described and compared across groups using Chi-Square Fisher's Exact tests. RESULTS: A total of 127 applicants and 400 interviewers, including 127 program directors, responded to the survey. 193/380 (50.8%) interviewers and 90/118 (76.3%) applicants preferred virtual over in-person interview formats. Facilitators of the virtual interview format included cost and time savings, ease of scheduling, reduced environmental impact, greater equity, less stress, greater reach and participation, and safety. Barriers of the virtual interview format included reduced informal conversations, limited ability for applicants to explore programs at different locations, limited ability for programs to assess applicants' interest, technological issues, concern for interview integrity, limited non-verbal communication, and reduced networking. The most helpful media for applicants to learn about residency programs were program websites, the CaRMS/AFMC websites, and recruitment videos. Additionally, panel interviews were preferred by applicants for their ability to showcase themselves and build connections with multiple interviewers. Respondents provided recommendations regarding: (1) dissemination of program information, (2) the use of technology, and (3) the virtual interview format. CONCLUSIONS: Perceptions of 2021 CaRMS R1 virtual interviews were favourable among applicants and interviewers. Recommendations from this study can help improve future iterations of virtual interviews.

Lessons learned and new strategies for success: Evaluating the Implementation of Competency-Based Medical Education in Queen's Pediatrics.

Objectives: In 2017, Queen's University launched Competency-Based Medical Education (CBME) across 29 programs simultaneously. Two years post-implementation, we asked key stakeholders (faculty, residents, and program leaders) within the Pediatrics program for their perspectives on and experiences with CBME so far. Methods: Program leadership explicitly described the intended outcomes of implementing CBME. Focus groups and interviews were conducted with all stakeholders to describe the enacted implementation. The intended versus enacted implementations were compared to provide insight into needed adaptations for program improvement. Results: Overall, stakeholders saw value in the concept of CBME. Residents felt they received more specific feedback and monthly Competence Committee (CC) meetings and Academic Advisors were helpful. Conversely, all stakeholders noted the increased expectations had led to a feeling of assessment fatigue. Faculty noted that direct observation and not knowing a resident's previous performance information was challenging. Residents wanted to see faculty initiate assessments and improved transparency around progress and promotion decisions. Discussion: The results provided insight into how well the intended outcomes had been achieved as well as areas for improvement. Proposed adaptations included a need for increased direct observation and exploration of faculty accessing residents' previous performance information. Education was provided on the performance expectations of residents and how progress and promotion decisions are made. As well, "flex blocks" were created to help residents customize their training experience to meet their learning needs. The results of this study can be used to inform and guide implementation and adaptations in other programs and institutions.

Evaluating the effectiveness of let's talk period's high school educational outreach program: A pilot study.

INTRODUCTION: Menorrhagia impacts ~40% of adolescent females, with about half having an underlying bleeding disorder, most commonly von Willebrand Disease (VWD). VWD affects ~1 in 1000 individuals, though many are unaware of their condition. Let's Talk Period (LTP) is an online knowledge translation platform aimed at increasing awareness of bleeding disorders symptoms, with a validated self-administered bleeding assessment tool (Self-BAT). AIM: To evaluate the effectiveness of the LTP high school outreach program in Grade 9 girls' health classes quantitatively, using baseline, post-presentation, and follow-up quiz scores, and qualitatively, with student and teacher feedback forms. METHODS: The 75-minute in-class presentations, developed in alignment with the 2015 Ontario Curriculum for Grade 9 Health and Physical Activity, were led by a haemophilia nurse, clinical research assistant, and undergraduate student from the LTP team. Students completed baseline, post-presentation, and 4-6-week follow-up Kahoot quizzes featuring the same nine questions to evaluate change in knowledge levels and retention. Both student and teacher feedback were collected. RESULTS: There was a significant increase (p < 0.001) from baseline to post-presentation scores, with a significant gain in knowledge, for all questions (p < 0.01). Students found content related to the basics and management of menstruation to be most interesting. Many had constructive feedback on how the presentation method could be improved. On average, the presentations were rated an 8.6 of 10 by students and 8.75 of 10 by teachers. CONCLUSION: The LTP high school outreach program effectively increases student knowledge of menorrhagia and bleeding disorders. It was well-received by students and staff alike.

The Development of Visual Expertise in ECG Interpretation: An Eye-Tracking Augmented Re Situ Interview Approach.

Phenomenon: Visual expertise in medicine involves a complex interplay between expert visual behavior patterns and higher-level cognitive processes. Previous studies of visual expertise in medicine have centered around traditionally visually intensive disciplines such as radiology and pathology. However, there is limited study of visual expertise in electrocardiogram (ECG) interpretation, a common clinical task that is associated with high error rates. This qualitatively driven multi-methods study aimed to describe differences in cognitive approaches to ECG interpretation between medical students, emergency medicine (EM) residents, and EM attending physicians. Approach: Ten medical students, 10 EM residents, and 10 EM attending physicians were recruited from one tertiary academic center to participate in this study. Participants interpreted 10 ECGs with a screen-based eye-tracking device, then underwent a subjective re situ interview augmented by playback of the participants' own gaze scan-paths via eye-tracking. Interviews were transcribed verbatim and an emergent thematic analysis was performed across participant groups. Diagnostic speed, accuracy, and heat maps of fixation distribution were collected to supplement the qualitative findings. Findings: Qualitative analysis demonstrated differences among the cohorts in three major themes: dual-process reasoning, ability to prioritize, and clinical implications. These qualitative findings were aligned with differences in visual behavior demonstrated by heat maps of fixation distribution across each ECG. More experienced participants completed ECG interpretation significantly faster and more accurately than less experienced participants. Insights: The cognitive processes related to ECG interpretation differed between novices and more experienced providers in EM. Understanding the differences in cognitive approaches to ECG interpretation between these groups may help inform best practices in teaching this ubiquitous diagnostic skill.

The Impacts of COVID-19 on Early Childhood Education: Capturing the Unique Challenges Associated with Remote Teaching and Learning in K-2.

Due to the COVID-19 pandemic, schools across North America closed to in person learning in March 2020. Since then, it has becoming increasingly clear that physical distancing will need to be prolonged in the 2020/2021 school year and possibly resumed in the future. In response, education ministries shifted teaching and learning online. Research is urgently needed to mitigate the effects of COVID-19 on teaching and learning, particularly in the foundational early primary years. This research directly responds to this concern by examining the unique challenges associated with remote teaching and learning in early primary contexts. Given that learning in kindergarten and early primary grades is largely play- and inquiry- based, there is a particular need to investigate the impacts of this move for teachers, parents, and children in K-2. As such, the purpose of this research is twofold: (1) to capture the unique challenges and unanticipated successes associated with remote teaching and learning, and (2) to utilize findings to provide recommendations for remote learning as well as strategies for supporting in-person learning in the COVID-19 era (and post COVID-19 era). Data collection included 45-min semi-structured interviews with K-2 teachers (n = 25) and parents (n =11). All participants were from Ontario Canada. Data were collected from April-June 2020. The sample size was chosen to ensure saturation while uncovering a variety of perspectives. Data were analyzed in NVivo using an emergent thematic approach (Patton, 2016). The emergent thematic approach to analysis revealed five themes: equity considerations, synchronous versus asynchronous teaching and learning, social and emotional effects on students, academic impacts, and effects on parents/families.

Exploring How the New Entrustable Professional Activity Assessment Tools Affect the Quality of Feedback Given to Medical Oncology Residents.

The post-graduate medical programs at Queen's University transitioned to a competency-based medical education framework on July 1, 2017. In advance of this transition, the Medical Oncology program participated in a pilot of six Entrustable Professional Activities (EPAs) focused workplace-based assessment (WBA) tools with faculty and residents. The purpose of this sequential explanatory mixed method study was to determine the extent to which these WBAs provided quality feedback for residents. The WBAs were introduced into daily clinical practice and, once completed, were collected by the research team. A resident focus group (n = 4) and faculty interviews (n = 5) were also conducted. Focus group and interview data were analyzed using an emergent thematic analysis. Data from the completed assessment tools were analyzed using both descriptive statistics and a literature-informed framework developed to assess the quality of feedback. Six main findings emerged: Verbal feedback is preferred over written; providing both written and verbal feedback is important; effective feedback was seen as timely, specific, and actionable; the process was conceptualized as coaching rather than high stakes; there were logistical concerns about the WBAs, and additional clarification about the WBA tools is needed. This study provides insight into faculty and resident perceptions of quality feedback and the potential for WBA tools to assist in providing effective feedback to residents as we shift to competency-based medical education in Canada. Our results suggest the need for additional faculty development around the use of the tools, and their intended role, and the elements of quality feedback.

Starting to Think Like an Expert: An Analysis of Resident Cognitive Processes During Simulation-Based Resuscitation Examinations.

STUDY OBJECTIVE: Simulation is commonly used to teach crisis resource management skills and assess them in emergency medicine residents. However, our understanding of the cognitive processes underlying crisis resource management skills is limited because these processes are difficult to assess and describe. The objective of this study is to uncover and characterize the cognitive processes underlying crisis resource management skills and to describe how these processes vary between residents according to performance in a simulation-based examination. METHODS: Twenty-two of 24 eligible emergency medicine trainees from 1 tertiary academic center completed 1 or 2 resuscitation-based examinations in the simulation laboratory. Resident performance was assessed by a blinded expert using an entrustment-based scoring tool. Participants wore eye-tracking glasses that generated first-person video that was used to augment subsequent interviews led by an emergency medicine faculty member. Interviews were audio recorded and then transcribed. An emergent thematic analysis was completed with a codebook that was developed by 4 research assistants, with subsequent analyses conducted by the lead research assistant with input from emergency medicine faculty. Themes from high- and low-performing residents were subsequently qualitatively compared. RESULTS: Higher-performing residents were better able to anticipate, selectively attend to relevant information, and manage cognitive demands, and took a concurrent (as opposed to linear) approach to managing the simulated patient. CONCLUSION: The results provide new insights into residents' cognitive processes while managing simulated patients in an examination environment and how these processes vary with performance. More work is needed to determine how best to apply these findings to improve crisis resource management education.

Getting Inside the Expert's Head: An Analysis of Physician Cognitive Processes During Trauma Resuscitations.

STUDY OBJECTIVE: Crisis resource management skills are integral to leading the resuscitation of a critically ill patient. Despite their importance, crisis resource management skills (and their associated cognitive processes) have traditionally been difficult to study in the real world. The objective of this study was to derive key cognitive processes underpinning expert performance in resuscitation medicine, using a new eye-tracking-based video capture method during clinical cases. METHODS: During an 18-month period, a sample of 10 trauma resuscitations led by 4 expert trauma team leaders was analyzed. The physician team leaders were outfitted with mobile eye-tracking glasses for each case. After each resuscitation, participants were debriefed with a modified cognitive task analysis, based on a cued-recall protocol, augmented by viewing their own first-person perspective eye-tracking video from the clinical encounter. RESULTS: Eye-tracking technology was successfully applied as a tool to aid in the qualitative analysis of expert performance in a clinical setting. All participants stated that using these methods helped uncover previously unconscious aspects of their cognition. Overall, 5 major themes were derived from the interviews: logistic awareness, managing uncertainty, visual fixation behaviors, selective attendance to information, and anticipatory behaviors. CONCLUSION: The novel approach of cognitive task analysis augmented by eye tracking allowed the derivation of 5 unique cognitive processes underpinning expert performance in leading a resuscitation. An understanding of these cognitive processes has the potential to enhance educational methods and to create new assessment modalities of these previously tacit aspects of expertise in this field.

Exploring residents' perceptions of competency-based medical education across Canada: A national survey study.

Background: As competency-based medical education (CBME) is implemented across Canada, little is known about residents' perceptions of this model. This study examined how Canadian residents understand CBME and their lived experiences with implementation. Methods: We administered a survey in 2018 with Likert-type and open-ended questions to 375 residents across Canada, of whom 270 were from traditional programs ("pre-CBME") and 105 were in a CBME program. We used the Mann-Whitney test to examine differences across samples, and analyzed qualitative data thematically. Results: Three themes were identified across both groups: program outcome concerns, changes, and emotional responses. In relation to program concerns, both groups were concerned about the administrative burden, challenges with the assessment process, and feedback quality. Only pre-CBME residents were concerned about faculty engagement and buy-in. In terms of changes, both groups discussed a more formalized assessment process with mixed reactions. Residents in the pre-CBME sample reported greater concerns for faculty time constraints, assessment completion, and quality of learning experiences, whilst those in CBME programs reported being more proactive in their learning and greater selfreflection. Residents expressed strong emotional narrative responses including greater stress and frustration in a CBME environment. Conclusion: Findings demonstrate that residents have mixed feelings and experiences regarding CBME. Their positive experiences align with the aim of developing more self-directed learners. However, the concerns suggest the need to address specific shortcomings to increase buy-in, while the emotional responses associated with CBME may require a cultural shift within residency programs to guard against burnout.

Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency.

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen's University Internal Medicine residency program introduced a facilitated, team-based assessment initiative ("Feedback Fridays") in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program's assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions: The introduction of facilitated team-based assessment in the Queen's Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement.

Objectif: La formation médicale fondée sur les compétences s'appuie sur la rétroaction faite lors de l'évaluation des apprentissages par observation directe dans le milieu de travail. Malheureusement, les évaluations dans le milieu de travail omettent souvent de fournir une rétroaction narrative exhaustive et privilégient les aspects des soins relevant de l'expertise médicale. En se basant sur la recherche ayant étudié les approches d'évaluation interactive, le programme de résidence en médecine interne de l'Université Queen's a introduit en juillet 2017 une initiative d'évaluation facilitée et en équipe (« Les vendredis rétroaction ¼), visant à améliorer l'évaluation holistique du rendement des résidents dans les unités d'enseignement clinique en médecine interne. Dans cette étude, nous visons à explorer comment ces « vendredis rétroaction ¼ ont contribué à l'évaluation formative des résidents en médecine interne dans le cadre de notre modèle actuel de formation axée sur les compétences. Méthode: Au total, 53 résidents ont participé à des séances d'évaluation de groupe facilitées et bi-hebdomadaires au cours de l'année universitaire 2017-2018. Chaque séance consistait en une discussion d'évaluation facilitée de 30 minutes menée avec une équipe de l'unité de soins, qui comprenait des étudiants en médecine, des résidents et le médecin superviseur. Les commentaires issus de la discussion ont été recueillis, résumés et documentés sous forme narrative dans des formulaires électroniques d'observation directe dans le milieu de travail par le responsable de l'évaluation du programme de résidence. À des fins de recherche, les transcriptions verbatim des séances de rétroaction ont été analysées de façon thématique. Résultats: Les chercheurs ont identifié quatre thèmes principaux pour les commentaires : la communication, la conscience intra- et interpersonnelle, le leadership et le travail d'équipe, et les occasions d'apprentissage. Bien que la rétroaction concerne un large éventail d'activités, elle met fortement l'accent sur les compétences liées aux rôles intrinsèques de CanMEDS. De plus, le fait que la rétroaction avait un rôle clairement formatif est une autre constatation importante. Conclusions: L'introduction de l'évaluation en équipe facilitée dans le programme de médecine interne à Queen's a comblé une lacune importante dans l'apprentissage par observation directe dans le milieu de travail en fournissant aux apprenants une rétroaction détaillée sur tous les rôles CanMEDS et en formulant des recommandations constructives sur les domaines à améliorer.

The hidden curriculum across medical disciplines: an examination of scope, impact, and context.

Background: While research suggests that manifestations of the hidden curriculum (HC) phenomenon have the potential to reinforce or undermine the values of an institution, very few studies have comprehensively measured its scope, impact, and the varied clinical teaching and learning contexts within which they occur. We explored the HC and examined the validity of newly developed constructs and determined the influence of context on the HC. Methods: We surveyed medical students (n =182), residents (n =148), and faculty (n = 140) from all disciplines at our institution between 2019 and 2020. Based on prior research and expertise, we measured participants' experience with the HC including perceptions of respect and disrespect for different medical disciplines, settings in which the HC is experienced, impact of the HC, personal actions, efficacy, and their institutional perceptions. We examined the factor structure, reliability, and validity of the HC constructs using exploratory factor analysis Cronbach's alpha, regression analysis and Pearson's correlations. Results: Expert judges (physician faculty and medical learners) confirmed the content validity of the items used and the analysis revealed new HC constructs reflecting negative expressions, positive impacts and expressions, negative impacts, personal actions, and positive institutional perceptions of the HC. Evidence for criterion validity was found for the negative impacts and the personal actions constructs and were significantly associated with the stage of respondents' career and gender. Support for convergent validity was obtained for HC constructs that were significantly correlated with certain contexts within which the HC occurs. Conclusion: More unique dimensions and contexts of the HC exist than have been previously documented. The findings demonstrate that specific clinical contexts can be targeted to improve negative expressions and impacts of the HC.

Contexte: Bien que la recherche suggère que les expressions du curriculum caché (CC) ont le potentiel de renforcer ou de miner les valeurs d'un établissement, très peu d'études ont mesuré de manière exhaustive sa portée, ses effets et les divers contextes d'enseignement et d'apprentissage cliniques dans lesquels elles se produisent. Nous avons exploré le CC, examiné la validité de nouvelles notions et déterminé l'influence du contexte sur le CC. Méthodes: Entre 2019 et 2020, nous avons interrogé des étudiants (n =182), des résidents (n =148) et des membres du corps professoral (n = 140) de notre établissement, toutes disciplines médicales confondues. Sur la base de recherches et d'expertises antérieures, nous avons mesuré l'expérience des participants par rapport au CC, y compris leurs perceptions du respect ou du non-respect des diverses disciplines médicales, les contextes dans lesquels ils ont été confrontés au CC, les effets et l'efficacité du CC, les perceptions de l'établissement et les actions personnelles des participants. Nous avons examiné la structure factorielle, la fiabilité et la validité des notions du CC à l'aide d'une analyse factorielle exploratoire, du coefficient alpha de Cronbach, d'une analyse de régression et des corrélations de Pearson. Résultats: Des juges experts (médecins enseignants et apprenants) ont confirmé la validité du contenu des éléments utilisés et l'analyse a révélé de nouvelles notions du CC reflétant des expressions et des effets négatifs, des expressions et des effets positifs, des actions personnelles et des perceptions positives du CC au sein des établissements. La validité de critère a été démontrée pour les notions d'impacts négatifs et d'actions personnelles et a été associée de manière significative à l'étape de la carrière des répondants et à leur sexe. La validité convergente a été confirmée pour les notions de CC qui étaient significativement corrélées à certains contextes dans lesquels le CC se manifeste. Conclusion: Il existe plus de dimensions et de contextes uniques du CC que ceux qui avaient été documentés par le passé. Nos résultats montrent que des contextes cliniques spécifiques peuvent être ciblés pour améliorer les expressions et les effets négatifs du CC.

Catalytic effect of multisource feedback for trauma team captains: a mixed-methods prospective study.

OBJECTIVES: To evaluate the impact and feasibility of multisource feedback compared with traditional feedback for trauma team captains (TTCs). DESIGN: A mixed-methods, non-randomised prospective study. SETTING: A level one trauma centre in Ontario, Canada. PARTICIPANTS: Postgraduate medical residents in emergency medicine and general surgery participating as TTCs. Selection was based on a convenience sampling method. INTERVENTION: Postgraduate medical residents participating as TTCs received either multisource feedback or standard feedback following trauma cases. MAIN OUTCOME MEASURES: TTCs completed questionnaires designed to measure the self-reported intention to change practice (catalytic effect), immediately following a trauma case and 3 weeks later. Secondary outcomes included measures of perceived benefit, acceptability, and feasibility from TTCs and other trauma team members. RESULTS: Data were collected following 24 trauma team activations: TTCs from 12 activations received multisource feedback and 12 received standard feedback. The self-reported intention for practice change was not significantly different between groups initially (4.0 vs 4.0, p=0.57) and at 3 weeks (4.0 vs 3.0, p=0.25). Multisource feedback was perceived to be helpful and superior to the existing feedback process. Feasibility was identified as a challenge. CONCLUSIONS: The self-reported intention for practice change was no different for TTCs who received multisource feedback and those who received standard feedback. Multisource feedback was favourably received by trauma team members, and TTCs perceived multisource feedback as useful for their development.

Exploring virtual care clinical experience from non-physician healthcare providers (VCAPE).

COVID-19 has caused an urgent implementation of virtual care (VC). Most research has focused on patient and physician experience with virtual care. Non-physician healthcare providers have played an active role in transitioning to virtual care, yet little is known about their experiences. This study explored their lived experiences in caring for patients virtually. Forty non-physician healthcare providers from local hospitals, community, and home care settings in Kingston, ON, Canada, participated and included nurse practitioners, occupational therapists, physiotherapists, psychologists, registered dietitians, social workers, and speech-language pathologists. Data were collected using semi-structured interviews between February and July 2021 and were analyzed thematically. The study was guided by organizational change theory. Four themes were identified from the data: 1) Quality of care, 2) Resources and training, 3) Healthcare system efficiency, and 4) Health equity and access for patients. Providers suggested that VC increased patient-centredness and had clear benefits for patients. Participants had little to no training in conducting patient care, virtually stating this as a key challenge. They believed that VC increased the efficiency of the healthcare system and was more proactive. Despite concerns regarding inequities across healthcare, participants reported that VC could improve equity as long as patients had access to technology. The study highlights the urgent need to support all healthcare providers in delivering optimal patient-centred care. We should leverage some of the advantages offered by VC to improve the efficiency of healthcare delivery, reduce provider burnout, and increase capacity across organizational systems.

Using cognitive load theory to develop an emergency airway management curriculum: the Queen's University Mastery Airway Course (QUMAC).

Emergency airway management requires the simultaneous coordination of clinical reasoning and therapeutic interventions in the complex and time-sensitive setting of emergency resuscitation. The cognitive demand associated with these situations is invariably high and must be taken into consideration when designing training programs for this core professional competency. The four-component instructional design model (4C/ID), based on cognitive load theory, was used to develop a 1-year longitudinal airway management curriculum for Emergency Medicine residents. The simulation-based curriculum was designed with the goal of facilitating the construction and automation of schemas by individual residents in preparation for the high cognitive demand associated with emergency airway management in the clinical environment.

RéSUMé: La gestion des voies aériennes en urgence nécessite la coordination simultanée du raisonnement clinique et des interventions thérapeutiques dans le cadre complexe et sensible au temps de la réanimation d'urgence. La demande cognitive associée à ces situations est invariablement élevée et doit être prise en considération lors de la conception des programmes de formation pour cette compétence professionnelle essentielle. Le modèle de conception pédagogique à quatre composantes (4C/ID), fondé sur la théorie de la charge cognitive, a été utilisé pour élaborer un programme longitudinal de gestion des voies aériennes d'un an à l'intention des résidents en médecine d'urgence.

The Assessment Burden in Competency-Based Medical Education: How Programs Are Adapting.

Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME. From June 2019-September 2022, 8 residency programs underwent a standardized Rapid Evaluation guided by the Core Components Framework (CCF). Sixty interviews and 18 focus groups were held with invested partners. Transcripts were analyzed abductively using CCF, and ideal implementation was compared with enacted implementation. These findings were then shared back with program leaders, adaptations were subsequently developed, and technical reports were generated for each program. Researchers reviewed the technical reports to identify themes related to the burden of assessment with a subsequent focus on identifying adaptations across programs. Three themes were identified: (1) disparate mental models of assessment processes in CBME, (2) challenges in workplace-based assessment processes, and (3) challenges in performance review and decision making. Theme 1 included entrustment interpretation and lack of shared mindset for performance standards. Adaptations included revising entrustment scales, faculty development, and formalizing resident membership. Theme 2 involved direct observation, timeliness of assessment completion, and feedback quality. Adaptations included alternative assessment strategies beyond entrustable professional activity forms and proactive assessment planning. Theme 3 related to resident data monitoring and competence committee decision making. Adaptations included adding resident representatives to the competence committee and assessment platform enhancements. These adaptations represent responses to the concerning signal of significant burden of assessment within CBME being experienced broadly. The authors hope other programs may learn from their institution's experience and navigate the CBME-related assessment burden their invested partners may be facing.

Exploring the Quality of Narrative Feedback Provided to Residents During Ambulatory Patient Care in Medicine and Surgery.

OBJECTIVES: The transition to competency-based medical education (CBME) has increased the volume of residents' assessment data; however, the quality of the narrative feedback is yet to be used as feedback-on-feedback for faculty. Our objectives were (1) to explore and compare the quality and content of narrative feedback provided to residents in medicine and surgery during ambulatory patient care and (2) to use the Deliberately Developmental Organization framework to identify strengths, weaknesses, and opportunities to improve quality of feedback within CBME. METHODS: We conducted a mixed convergent methods study with residents from the Departments of Surgery (DoS; n = 7) and Medicine (DoM; n = 9) at Queen's University. We used thematic analysis and the Quality of Assessment for Learning (QuAL) tool to analyze the content and quality of narrative feedback documented in entrustable professional activities (EPAs) assessments for ambulatory care. We also examined the association between the basis of assessment, time to provide feedback, and the quality of narrative feedback. RESULTS: Forty-one EPA assessments were included in the analysis. Three major themes arose from thematic analysis: Communication, Diagnostics/Management, and Next Steps. Quality of the narrative feedback varied; 46% had sufficient evidence about residents' performance; 39% provided a suggestion for improvement; and 11% provided a connection between the suggestion and the evidence. There were significant differences between DoM and DoS in quality of feedback scores for evidence (2.1 [1.3] vs. 1.3 [1.1]; p < 0.01) and connection (0.4 [0.5] vs. 0.1 [0.3]; p = 0.04) domains of the QuAL tool. Feedback quality was not associated with the basis of assessment or time taken to provide feedback. CONCLUSION: The quality of the narrative feedback provided to residents during ambulatory patient care was variable with the greatest gap in providing connections between suggestions and evidence about residents' performance. There is a need for ongoing faculty development to improve the quality of narrative feedback provided to residents.