Competence committees decision-making; an interplay of data, group orientation, and intangible impressions.

BACKGROUND: The implementation of competency-based medical education and utilization of competence committees (CC) represents a paradigm shift in residency education. This qualitative study aimed to explore the methods used by two operational CC and their members to make decisions about progression and competence of their residents. METHODS: An instrumental case study methodology was used to study the CC of two postgraduate training programs. Transcripts from observed CC meetings, member interviews, and guiding documents were analyzed using a constructivist grounded theory approach to reveal themes explaining the decision-making process. RESULTS: Our study found that the CC followed a process that began within a social decision schema model and evolved to a discussion that invoked social influence theory, shared mental models, and social judgment scheme to clarify the points of contention. We identified that the CC decision-making was at risk of bias, primarily influenced by the group composition, the group orientation and individual members' mindset, as well as their personal experiences with the trainees. CONCLUSIONS: Increased awareness of the sources of bias in CC functioning and familiarity with the CC role in competency-based medical education would enable committees to provide valuable feedback to all trainees regardless of their trajectory.

Ready, set, go! Evaluating readiness to implement competency-based medical education.

PURPOSE: Organizational readiness is critical for successful implementation of an innovation. We evaluated program readiness to implement Competence by Design (CBD), a model of Competency-Based Medical Education (CBME), among Canadian postgraduate training programs. METHODS: A survey of program directors was distributed 1 month prior to CBD implementation in 2019. Questions were informed by the R = MC2 framework of organizational readiness and addressed: program motivation, general capacity for change, and innovation-specific capacity. An overall readiness score was calculated. An ANOVA was conducted to compare overall readiness between disciplines. RESULTS: Survey response rate was 42% (n = 79). The mean overall readiness score was 74% (30-98%). There was no difference in scores between disciplines. The majority of respondents agreed that successful implementation of CBD was a priority (74%), and that their leadership (94%) and faculty and residents (87%) were supportive of change. Fewer perceived that CBD was a move in the right direction (58%) and that implementation was a manageable change (53%). Curriculum mapping, competence committees and programmatic assessment activities were completed by >90% of programs, while <50% had engaged off-service disciplines. CONCLUSION: Our study highlights important areas where programs excelled in their preparation for CBD, as well as common challenges that serve as targets for future intervention to improve program readiness for CBD implementation.

The effectiveness of a multifaceted, group-facilitated audit and feedback intervention to increase tranexamic acid use during total joint arthroplasty.

PURPOSE: Intraoperative tranexamic acid (TXA) is used to reduce blood loss and the need for transfusions following total hip arthroplasty (THA) and total knee arthroplasty (TKA). Despite evidence in literature and local practice protocols supporting TXA as a part of standard of care for joint arthroplasty, TXA administration is underutilized. We aimed to use group-facilitated audit and feedback as the foundation of a knowledge translation strategy to increase TXA use for THA and TKA procedures. METHODS: Anesthesiologists consented to receive two data reports summarizing their individual rates of TXA use and postoperative blood transfusions compared with site peers. Variables collected included patient demographics, TXA usage, and the frequency and volume of red blood cell transfusions administered in the 72-hr postoperative period. The facilitated feedback session discussed report findings and focused on factors contributing to local practice patterns and opportunities for change. RESULTS: Tranexamic acid use increased for THA procedures at the intervention site from 66.6 to 74.4% (absolute change, 7.9%; 95% confidence interval [CI], 2.4 to 13.3). Likewise, TXA use for TKA procedures increased from 62.4 to 82.3% (absolute change, 19.9%; 95% CI 15.0 to 25.0). CONCLUSIONS: Physicians and their teams were able to review their practice data on TXA utilization, reflect on differences compared with evidence-based guidelines, discuss findings with peers, and identify opportunities for improvement. The intervention increased the use of TXA for both TKA and THA and shifted the dosage to better align with evidence-based practice guidelines.

RéSUMé: OBJECTIF : L'acide tranexamique (ATX) peropératoire est utilisé pour réduire les pertes sanguines et les besoins transfusionnels après les arthroplasties totales de la hanche (ATH) et du genou (ATG). Malgré les données probantes et les protocoles de pratique locaux appuyant l'utilisation d'ATX dans le cadre de la norme de soins en cas d'arthroplastie, l'administration de cet agent est sous-utilisée. Notre objectif était d'utiliser l'audit et la rétroaction facilités par le groupe comme base d'une stratégie d'application des connaissances afin d'accroître l'utilisation de l'ATX lors des ATH et ATG. MéTHODE: Les anesthésiologistes ont consenti à recevoir deux rapports de données résumant leurs taux individuels d'utilisation d'ATX et de transfusions sanguines postopératoires par rapport à leurs pairs au sein du même établissement. Les variables recueillies comprenaient les données démographiques des patients, l'utilisation d'ATX et la fréquence et le volume des transfusions d'érythrocytes administrées au cours d'une période postopératoire de 72 heures. La séance de rétroaction facilitée a porté sur les conclusions du rapport et s'est concentrée sur les facteurs contribuant aux habitudes de pratique locales et aux possibilités de changement. RéSULTATS: L'utilisation d'acide tranexamique a augmenté pour les procédures d'ATH au site d'intervention, passant de 66,6 % à 74,4 % (variation absolue, 7,9 %; intervalle de confiance [IC] à 95 %, 2,4 à 13,3). De même, l'utilisation d'ATX pour les procédures d'ATG est passée de 62,4 % à 82,3 % (variation absolue, 19,9 %; IC 95 %, 15,0 à 25,0). CONCLUSION: Les médecins et leurs équipes ont pu passer en revue leurs données de pratique sur l'utilisation d'ATX, réfléchir aux différences par rapport aux lignes directrices fondées sur des données probantes, discuter des résultats avec leurs pairs et identifier les possibilités d'amélioration. L'intervention a augmenté l'utilisation d'ATX pour l'ATG et l'ATH et a modifié la posologie pour mieux s'aligner sur les lignes directrices de pratique fondées sur des données probantes.

Implementation of competence committees during the transition to CBME in Canada: A national fidelity-focused evaluation.

PURPOSE: This study evaluated the fidelity of competence committee (CC) implementation in Canadian postgraduate specialist training programs during the transition to competency-based medical education (CBME). METHODS: A national survey of CC chairs was distributed to all CBME training programs in November 2019. Survey questions were derived from guiding documents published by the Royal College of Physicians and Surgeons of Canada reflecting intended processes and design. RESULTS: Response rate was 39% (113/293) with representation from all eligible disciplines. Committee size ranged from 3 to 20 members, 42% of programs included external members, and 20% included a resident representative. Most programs (72%) reported that a primary review and synthesis of resident assessment data occurs prior to the meeting, with some data reviewed collectively during meetings. When determining entrustable professional activity (EPA) achievement, most programs followed the national specialty guidelines closely with some exceptions (53%). Documented concerns about professionalism, EPA narrative comments, and EPA entrustment scores were most highly weighted when determining resident progress decisions. CONCLUSIONS: Heterogeneity in CC implementation likely reflects local adaptations, but may also explain some of the variable challenges faced by programs during the transition to CBME. Our results offer educational leaders important fidelity data that can help inform the larger evaluation and transformation of CBME.

Neurological and Head/Eyes/Ears/Nose/Throat Manifestations of COVID-19: A Systematic Review and Meta-Analysis.

BACKGROUND/OBJECTIVE: Coronavirus disease 2019 (COVID-19) has been associated with various neurological and atypical head/eyes/ears/nose/throat (HEENT) manifestations. We sought to review the evidence for these manifestations. METHODS: In this systematic review and meta-analysis, we compiled studies published until March 31, 2021 that examined non-respiratory HEENT, central, and peripheral nervous system presentations in COVID-19 patients. We included 477 studies for qualitative synthesis and 59 studies for meta-analyses. RESULTS: Anosmia, ageusia, and conjunctivitis may precede typical upper/lower respiratory symptoms. Central nervous system (CNS) manifestations include stroke and encephalopathy, potentially with brainstem or cranial nerve involvement. MRI studies support CNS para-/postinfectious etiologies, but direct neuroinvasion seems very rare, with few cases detecting Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) in the CNS. Peripheral nervous system (PNS) manifestations include muscle damage, Guillain-Barre syndrome (GBS), and its variants. There was moderate-to-high study heterogeneity and risk of bias. In random-effects meta-analyses, anosmia/ageusia was estimated to occur in 56% of COVID-19 patients (95% CI: 0.41-0.71, I2:99.9%), more commonly than in patients without COVID-19 (OR: 14.28, 95% CI: 8.39-24.29, I2: 49.0%). Neurological symptoms were estimated to occur in 36% of hospitalized patients (95% CI: 0.31-0.42, I2: 99.8%); ischemic stroke in 3% (95% CI: 0.03-0.04, I2: 99.2%), and GBS in 0.04% (0.033%-0.047%), more commonly than in patients without COVID-19 (OR[stroke]: 2.53, 95% CI: 1.16-5.50, I2: 76.4%; OR[GBS]: 3.43,1.15-10.25, I2: 89.1%). CONCLUSIONS: Current evidence is mostly from retrospective cohorts or series, largely in hospitalized or critically ill patients, not representative of typical community-dwelling patients. There remains a paucity of systematically gathered prospective data on neurological manifestations. Nevertheless, these findings support a high index of suspicion to identify HEENT/neurological presentations in patients with known COVID-19, and to test for COVID-19 in patients with such presentations at risk of infection.

Capturing outcomes of competency-based medical education: The call and the challenge.

There is an urgent need to capture the outcomes of the ongoing global implementation of competency-based medical education (CBME). However, the measurement of downstream outcomes following educational innovations, such as CBME is fraught with challenges stemming from the complexities of medical training, the breadth and variability of inputs, and the difficulties attributing outcomes to specific educational elements. In this article, we present a logic model for CBME to conceptualize an impact pathway relating to CBME and facilitate outcomes evaluation. We further identify six strategies to mitigate the challenges of outcomes measurement: (1) clearly identify the outcome of interest, (2) distinguish between outputs and outcomes, (3) carefully consider attribution versus contribution, (4) connect outcomes to the fidelity and integrity of implementation, (5) pay attention to unanticipated outcomes, and (6) embrace methodological pluralism. Embracing these challenges, we argue that careful and thoughtful evaluation strategies will move us forward in answering the all-important question: Are the desired outcomes of CBME being achieved?

Outcomes of competency-based medical education: A taxonomy for shared language.

As the global transformation of postgraduate medical training continues, there are persistent calls for program evaluation efforts to understand the impact and outcomes of competency-based medical education (CBME) implementation. The measurement of a complex educational intervention such as CBME is challenging because of the multifaceted nature of activities and outcomes. What is needed, therefore, is an organizational taxonomy to both conceptualize and categorize multiple outcomes. In this manuscript we propose a taxonomy that builds on preceding works to organize CBME outcomes across three domains: focus (educational, clinical), level (micro, meso, macro), and timeline (training, transition to practice, practice). We also provide examples of how to conceptualize outcomes of educational interventions across medical specialties using this taxonomy. By proposing a shared language for outcomes of CBME, we hope that this taxonomy will help organize ongoing evaluation work and catalyze those seeking to engage in the evaluation effort to help understand the impact and outcomes of CBME.

The Calgary Audit and Feedback Framework: a practical, evidence-informed approach for the design and implementation of socially constructed learning interventions using audit and group feedback.

BACKGROUND: Audit and feedback interventions may be strengthened using social interaction. The Calgary office of the Alberta Physician Learning Program (CPLP) developed a process for audit and group feedback for physicians. This paper extends previous work in which we developed a conceptual model of physician responses to audit and group feedback based on a qualitative analysis of six audit and group feedback sessions. The present study explored the mediating factors for successfully engaging physician groups in change planning through audit and group feedback. METHODS: To understand why some groups were more interactive than others, we completed a comparative case analysis of the six audit and group feedback projects from the prior study. We used framework analysis to build the case studies, triangulated our observations across data sources to validate findings, compared the case studies for similarities and differences that influenced social interaction (mediating factors), and thematically categorized mediating factors into an organizing framework. RESULTS: Mediating factors for socially interactive AGFS were a pre-existing relationship between the program team and the physician group, projects addressing important, actionable questions, easily interpretable data visualization in the reports, and facilitation of the groups that included reflective questioning. When these factors were in place (cases 1, 2A, 3), the audit and group feedback sessions were dynamic, with physicians sharing and comparing practices, and raising change cues (such as declaring commitments to de-prescribing, planning educational interventions, and improving documentation). In cases 2C-D, the mediating factors were less well established and in these cases, the sessions showed little physician reflection or change planning. We organized the mediating factors into a framework linking the factors for successful sessions to the conceptual model of physician behaviors which these mediating factors drive. CONCLUSIONS: We propose the Calgary Audit and Feedback Framework as a practical tool to help foster socially constructed learning in audit and group feedback sessions. Ensuring that the four factors, relationship, question choice, data visualization, and facilitation, are considered for design and implementation of audit and group feedback will help physicians move from reactions to their data towards planning for change.

How do physicians behave when they participate in audit and feedback activities in a group with their peers?

BACKGROUND: Audit and feedback interventions may be strengthened using social interaction. With this in mind, the Calgary office of the Alberta Physician Learning Program developed a process for audit and group feedback for physician groups. As a part of a larger project to develop a practical approach to the design and implementation of audit and group feedback projects, we explored patterns of physician behavior during facilitated audit and group feedback sessions. METHODS: Six audit and group feedback sessions were recorded, transcribed, and analyzed thematically to derive a conceptual model of physicians' behaviors during audit and group feedback sessions. RESULTS: A predictable cycle of behaviors emerged from audit and group feedback sessions. This cycle would repeat with discussion of each new data element: reacting to the data, questioning and understanding the data, justifying and contextualizing, sharing and reflecting on the data and relevant guidelines, and planning for change. "Change cues" that emerged within groups reliably pivoted the discussion towards action planning. CONCLUSIONS: In audit and group feedback sessions, physicians display a predictable series of behaviors as they move towards commitment to change. Establishing the meaning and credibility of the data is a necessary precursor to reflection. Group reflection leads to "change cues" triggered by group members, which stimulate action planning.

Screening with Papanicolaou tests in Alberta: Are we Choosing Wisely?

OBJECTIVE: To describe the prevalence and geographic distribution of cervical cancer screening, as well as the age groups of those undergoing screening, in Alberta, and to determine if screening practices conform to current guidelines and follow Choosing Wisely Canada recommendations. DESIGN: Descriptive study using data from the Alberta Ministry of Health Analytics and Performance Reporting Branch. SETTING: Alberta. PARTICIPANTS: Women who had 1 or more Papanicolaou tests between 2011 and 2013. MAIN OUTCOME MEASURES: Number of women aged 15 to 20 and those aged 70 and older who had 1 or more Pap tests in a 3-year period; year-to-year trends in screening rates for women in these 2 age groups; trends in screening rates in various geographic regions (ie, cities and zones) in Alberta; and the discipline of clinicians who ordered the Pap tests. RESULTS: Between 2011 and 2013, 805 632 women in the province of Alberta had 1 or more Pap tests for cervical cancer screening. Overall, 25 511 (17.5%) women aged 15 to 20 and 16 818 (10.3%) aged 70 and older were screened contrary to most existing guidelines. Screening rates varied markedly in different geographic regions of the province. Most Pap tests were ordered by family physicians or general practitioners. CONCLUSION: Within the geographic regions of Alberta, provincial, national, and international guidelines for screening with Pap tests are inconsistently followed. This strongly echoes the need for clinicians and patients to consider the Choosing Wisely Canada recommendations and current guidelines for cervical cancer screening.

Migraine prevalence, treatment and impact: the canadian women and migraine study.

BACKGROUND: The prevalence of migraine headache varies somewhat across geographic regions. The last Canadian population-based study of migraine was in 1994. We report the findings of the Canadian Women and Migraine Survey. In addition to reporting migraine prevalence in Canadian women, the survey identified current consultation and treatment practices of women with migraine, and the psychological burden of migraine. METHODS: The survey was conducted with a population-based sample of 1210 women using standard telephone research methods. Headache diagnoses were based on the International Headache Society (IHS) Classification. RESULTS: Calculated prevalence of migraine headache was 26%. Only 51% of women with migraine had consulted a physician about their headaches. Women with migraines rely on over-the-counter medications and non-specific prescription medications. Less than 10% of women with migraine use triptans/dihydroergotamine for primary treatment. Ninety seven percent of women with migraine reported at least one psychosocial impact resulting from migraines. CONCLUSIONS: The prevalence of migraine in Canadian women appears static, and is again shown to be slightly higher than that reported in the United States. As in other epidemiologic studies, many women with migraine do not seek medical help for their headaches and perhaps as a result, few are using migraine-specific medications to treat their headaches. The impact of migraine on Canadian women is substantial with almost all women with migraine reporting adverse psychosocial effects of migraines on their lives.