Payment and Coverage Parity for Virtual Care and In-Person Care: How Do We Get There?

Background: A steep increase in the use of delivery of virtual care occurred during the COVID-19 public health emergency (PHE) because of easing up of payment and coverage restrictions. With the end of PHE, there is uncertainty regarding continued coverage and payment parity for the virtual care services. Methods: On November 8, 2022, The Mass General Brigham held the Third Annual Virtual Care Symposium: Demystifying Clinical Appropriateness in Virtual Care and What's Ahead for Pay Parity. Results: In one of the panels, experts from Mayo Clinic led by Dr. Bart Demaerschalk discussed key issues related to "Payment and Coverage Parity for Virtual Care and In-Person Care: How Do We Get There?" The discussions centered around current policies around payment and coverage parity for virtual care, including state licensure laws for virtual care delivery and the current evidence base regarding outcomes, costs, and resource utilization associated with virtual care. The panel discussion ended with highlighting next steps targeting policymakers, payers, and industry groups to help strengthen the case for parity. Conclusions: To ensure the continued viability of virtual care delivery, legislators and insurers must address the coverage and payment parity between telehealth and in-person visits. This will require a renewed focus on research on clinical appropriateness, parity, equity and access, and economics of virtual care.

Learner engagement and teaching effectiveness in livestreamed versus in-person CME.

INTRODUCTION: Engaging learners in continuing medical education (CME) is challenging. Recently, CME courses have transitioned to livestreamed CME, with learners viewing live, in-person courses online. The authors aimed to (1) compare learner engagement and teaching effectiveness in livestreamed with in-person CME and (2) determine how livestream engagement and teaching effectiveness is associated with (A) interactivity metrics, (B) presentation characteristics and (C) medical knowledge. METHODS: A 3-year, non-randomised study of in-person and livestream CME was performed. The course was in-person for 2018 but transitioned to livestream for 2020 and 2021. Learners completed the Learner Engagement Inventory and Teaching Effectiveness Instrument after each presentation. Both instruments were supported by content, internal structure and relations to other variables' validity evidence. Interactivity metrics included learner use of audience response, questions asked by learners and presentation views. Presentation characteristics included presentations using audience response, using pre/post-test format, time of day and words per slide. Medical knowledge was assessed by audience response. A repeated measures analysis of variance (anova) was used for comparisons and a mixed model approach for correlations. RESULTS: A total of 159 learners (response rate 27%) completed questionnaires. Engagement did not significantly differ between in-person or livestream CME. (4.56 versus 4.53, p = 0.64, maximum 5 = highly engaged). However, teacher effectiveness scores were higher for in-person compared with livestream (4.77 versus 4.71 p = 0.01, maximum 5 = highly effective). For livestreamed courses, learner engagement was associated with presentation characteristics, including presentation using of audience response (yes = 4.57, no = 4.45, p < .0001), use of a pre/post-test (yes = 4.62, no = 4.54, p < .0001) and time of presentation (morning = 4.58, afternoon = 4.53, p = .0002). Significant associations were not seen for interactivity metrics or medical knowledge. DISCUSSION: Livestreaming may be as engaging as in-person CME. Although teaching effectiveness in livestreaming was lower, this difference was small. CME course planners should consider offering livestream CME while exploring strategies to enhance teaching effectiveness in livestreamed settings.

The relationship between learner engagement and teaching effectiveness: a novel assessment of student engagement in continuing medical education.

BACKGROUND: Continuing medical education (CME) often uses passive educational models including lectures. However, numerous studies have questioned the effectiveness of these less engaging educational strategies. Studies outside of CME suggest that engaged learning is associated with improved educational outcomes. However, measuring participants' engagement can be challenging. We developed and determined the validity evidence for a novel instrument to assess learner engagement in CME. METHODS: We conducted a cross-sectional validation study at a large, didactic-style CME conference. Content validity evidence was established through review of literature and previously published engagement scales and conceptual frameworks on engagement, along with an iterative process involving experts in the field, to develop an eight-item Learner Engagement Instrument (LEI). Response process validity was established by vetting LEI items on item clarity and perceived meaning prior to implementation, as well as using a well-developed online platform with clear instructions. Internal structure validity evidence was based on factor analysis and calculating internal consistency reliability. Relations to other variables validity evidence was determined by examining associations between LEI and previously validated CME Teaching Effectiveness (CMETE) instrument scores. Following each presentation, all participants were invited to complete the LEI and the CMETE. RESULTS: 51 out of 206 participants completed the LEI and CMETE (response rate 25%) Correlations between the LEI and the CMETE overall scores were strong (r = 0.80). Internal consistency reliability for the LEI was excellent (Cronbach's alpha = 0.96). To support validity to internal structure, a factor analysis was performed and revealed a two dimensional instrument consisting of internal and external engagement domains. The internal consistency reliabilities were 0.96 for the internal engagement domain and 0.95 for the external engagement domain. CONCLUSION: Engagement, as measured by the LEI, is strongly related to teaching effectiveness. The LEI is supported by robust validity evidence including content, response process, internal structure, and relations to other variables. Given the relationship between learner engagement and teaching effectiveness, identifying more engaging and interactive methods for teaching in CME is recommended.

Effect of Pause Procedures on Participant Reflection and Commitment-to-Change in Continuing Medical Education.

Problem: Conferences are the most common form of continuing medical education (CME), but their effect on clinician practice is inconsistent. Reflection is a critical step in the process of practice change among clinicians and may lead to improved outcomes following conference-based CME. However, reflection requires time to process newly-learned material. Adequate time for reflection may be noticeably absent during many conference presentations. Intervention: The pause procedure is a 90-second 'pause' during a 30-minute presentation so learners can review and discuss content. The goal of the pause procedure is to stimulate learners' active engagement with newly learned material which will, in turn, promote learner reflection. Context: Fifty-six presentations at two hospital medicine CME conferences were assigned to the pause procedure or control. Study outcomes provided by conference participants were validated reflection scores and commitment-to-change (CTC) statements for each presentation. A post-hoc survey of the intervention group was conducted to assess presenters' experiences with the pause procedure. Impact: A total of 527 conference participants completed presentation evaluations (response rate 72.7%). Presentations incorporating the pause procedure failed to lead higher participant reflection scores (percentage 'top box' score; intervention: 39.2% vs. control: 41.7%, p = 0.40) or participant CTC rates (median [IQR]; intervention: 4.64 [3.04, 10.57] vs. control: 8.16 [5.28, 17.12], p = 0.13) than control presentations. However, the majority of presenters (16 out of 17 survey respondents) had never before used the intervention and little active engagement among learners was noted during the pause procedure. Lessons Learned: Adding the pause procedure to CME presentations did not lead to greater reflection or CTC among clinician learners. However, presenters had limited experience with the intervention, which may have reduced their fidelity to the educational principles of the pause procedure. Faculty development may be necessary when planning a new educational intervention that is to be implemented by conference presenters.

Characteristics of Effective Continuing Medical Education for Physician Assistants and Nurse Practitioners in Hospital Medicine.

PURPOSE: The purpose of this study was to describe participant characteristics and effective teaching methods at a national continuing medical education (CME) conference on hospital medicine for physician assistants (PAs) and nurse practitioners (NPs). METHODS: In this cross-sectional study, participants provided demographic information and teaching effectiveness scores for each presentation. Associations between teaching effectiveness score and presentation characteristics were determined. RESULTS: In total, 163 of 253 participants (64.4%) completed evaluations of 28 presentations. Many of the participants were younger than 50 years (69.0%), had practiced for fewer than 5 years (41.5%), and worked in nonacademic settings (76.7%). Teaching effectiveness scores were significantly associated with the use of clinical cases (perfect scores for 68.8% of presentations with clinical cases vs. 59.8% without; P = .04). CONCLUSION: Many PAs and NPs at an HM CME conference were early-career clinicians working in nonacademic settings. Presenters at CME conferences in hospital medicine should consider using clinical cases to improve their teaching effectiveness among PA and NP learners.

Chinese physician perceptions regarding industry support of continuing medical education programs: a cross-sectional survey.

Background: Industry funding in continuing medical education has been extensively studied in the USA. Although continuing medical education is also a requirement for Chinese physicians, little is known about Chinese physician perceptions of industry support in continuing medical education.Objective: We aim to determine perceptions regarding industry support for CME among Chinese physicians at a large CME course, examine potential associations between Chinese physicians' perceptions and their demographic characteristics, and compare Chinese and US physicians' perceptions of industry support for CME.Design: We performed a cross-sectional survey of physicians at a nephrology continuing medical education conference in China. All participants received a previously published, anonymous survey consisting of 4 items, with questions asked in English and Mandarin Chinese. Responses were compared with those of a previous cohort in the USA.Results: The response rate was 24% (128/541). Most respondents were nephrologists (112/126, 89%), women (91/128, 71%), and aged 20 to 40 years (79/127, 62%). Most respondents preferred industry-supported continuing medical education (84/123, 68%) or had no preference (33/123, 27%). More clinicians than clinical researchers supported industry offsetting costs (76.9% vs 58.3%; P = .03). Almost half of participants (58/125, 46%) stated that industry-supported continuing medical education was biased in support of industry. Compared with US physicians, Chinese physicians were more likely to believe, or had no opinion, that industry-supported courses were biased (67.2% vs 47.0%; P < .001).Conclusions: Chinese continuing medical education participants preferred industry-sponsored continuing medical education and were strongly in favor of industry offsetting costs, but almost half believed that such education was biased in favor of supporting companies. Concern for bias was higher among Chinese than US physicians. Given participants' concerns, further study examining industry bias in Chinese continuing medical education is recommended.Abbreviations: CME: Continuing medical education; US: USA.

A cross-sectional study of learning styles among continuing medical education participants.

PURPOSE: Experiential learning has been suggested as a framework for planning continuing medical education (CME). We aimed to (1) determine participants' learning styles at traditional CME courses and (2) explore associations between learning styles and participant characteristics. MATERIALS AND METHODS: Cross-sectional study of all participants (n = 393) at two Mayo Clinic CME courses who completed the Kolb Learning Style Inventory and provided demographic data. RESULTS: A total of 393 participants returned 241 surveys (response rate, 61.3%). Among the 143 participants (36.4%) who supplied complete demographic and Kolb data, Kolb learning styles included diverging (45; 31.5%), assimilating (56; 39.2%), converging (8; 5.6%), and accommodating (34; 23.8%). Associations existed between learning style and gender (p = 0.02). For most men, learning styles were diverging (23 of 63; 36.5%) and assimilating (30 of 63; 47.6%); for most women, diverging (22 of 80; 27.5%), assimilating (26 of 80; 32.5%), and accommodating (26 of 80; 32.5%). CONCLUSIONS: Internal medicine and psychiatry CME participants had diverse learning styles. Female participants had more variation in their learning styles than men. Teaching techniques must vary to appeal to all learners. The experiential learning theory sequentially moves a learner from Why? to What? to How? to If? to accommodate learning styles.

Validation of a clinical rotation evaluation for physician assistant students.

BACKGROUND: We conducted a prospective validation study to develop a physician assistant (PA) clinical rotation evaluation (PACRE) instrument. The specific aims of this study were to 1) develop a tool to evaluate PA clinical rotations, and 2) explore associations between validated rotation evaluation scores and characteristics of the students and rotations. METHODS: The PACRE was administered to rotating PA students at our institution in 2016. Factor analysis, internal consistency reliability, and associations between PACRE scores and student or rotation characteristics were determined. RESULTS: Of 206 PACRE instruments sent, 124 were returned (60.2% response). Factor analysis supported a unidimensional model with a mean (SD) score of 4.31 (0.57) on a 5-point scale. Internal consistency reliability was excellent (Cronbach α=0.95). PACRE scores were associated with students' gender (P = .01) and rotation specialty (P = .006) and correlated with students' perception of being prepared (r = 0.32; P < .001) and value of the rotation (r = 0.57; P < .001). CONCLUSIONS: This is the first validated instrument to evaluate PA rotation experiences. Application of the PACRE questionnaire could inform rotation directors about ways to improve clinical experiences. The findings of this study suggest that PA students must be adequately prepared to have a successful experience on their rotations. PA programs should consider offering transition courses like those offered in many medical schools to prepare their students for clinical experiences. Future research should explore whether additional rotation characteristics and educational outcomes are associated with PACRE scores.

Primary care physicians' perceptions of practice improvement as a professional responsibility: a cross-sectional study.

Continuous quality improvement is a component of professionalism. Maintenance of Certification (MOC) is a mechanism in the USA for physicians to keep current with medical knowledge and contribute to practice improvement. Little is known about primary care physicians' perceptions of the practice improvement (Part IV) components of MOC. We aimed to determine primary care physicians' perceptions of their professional responsibility to participate in Part IV MOC. This was a cross-sectional study of primary care physicians using the American Medical Association Masterfile. We developed a nine-item survey, designed from expert consensus and literature to determine views on Part IV MOC as a professional responsibility. We surveyed 1500 randomly selected primary care physicians via mail from November 2014 to May 2015. The response rate was 42% (627 of 1,500): 47% (273 of 585) were family practitioners and 49% (289 of 585) were internists. Factor analysis revealed a two-factor survey, with five items pertaining to positive views of MOC Part IV and four items pertaining to negative views. Internists were more likely to view MOC Part IV as time consuming (82.0% vs. 70.3%, P = .001), expensive (50.9% vs. 38.8%, P = .004), and not relevant to practice (39.1% vs. 23.8%, P < .001). Family medicine practitioners were more likely to view MOC Part IV as improving patient care (64.5% vs. 48.8%, P < .001) and maintaining professional responsibility (48.7% vs. 32.5%, P < .001). Regardless of specialty, most physicians viewed MOC Part IV as time intensive, not beneficial for career advancement, and not a professional responsibility. Family medicine practitioners demonstrated more positive views of MOC Part IV. The difference between family medicine practitioners and internists could be related to the ABIM MOC controversy. Future changes to practice improvement requirements could focus on limiting time requirements and on clinical relevance. ABBREVIATIONS: ABIM: American Board of Internal Medicine; AMA: American Medical Association; CQI: continuous quality improvement; IRB: institutional review board; MOC: Maintenance of Certification; QI: quality improvement.

Flipped Classrooms in Graduate Medical Education: A National Survey of Residency Program Directors.

PURPOSE: To begin to quantify and understand the use of the flipped classroom (FC)-a progressive, effective, curricular model-in internal medicine (IM) education in relation to residency program and program director (PD) characteristics. METHOD: The authors conducted a survey that included the Flipped Classroom Perception Instrument (FCPI) in 2015 regarding programs' use and PDs' perceptions of the FC model. RESULTS: Among the 368 IM residency programs, PDs at 227 (61.7%) responded to the survey and 206 (56.0%) completed the FCPI. Regarding how often programs used the FC model, 34 of the 206 PDs (16.5%) reported "never"; 44 (21.4%) reported "very rarely"; another 44 (21.4%) reported "somewhat rarely"; 59 (28.6%) reported "sometimes"; 16 (7.8%) reported "somewhat often"; and 9 (4.4%) reported "very often." The mean FCPI score (standard deviation [SD]) for the in-class application factor (4.11 [0.68]) was higher (i.e., more favorable) than for the preclass activity factor (3.94 [0.65]) (P < .001). FC perceptions (mean [SD]) were higher among younger PDs (≤ 50 years, 4.12 [0.62]; > 50 years, 3.94 [0.61]; P = .04) and women compared with men (4.28 [0.56] vs. 3.91 [0.62]; P < .001). PDs with better perceptions of FCs had higher odds of using FCs (odds ratio, 4.768; P < .001). CONCLUSIONS: Most IM programs use the FC model at least to some extent, and PDs prefer the interactive in-class components over the independent preclass activities. PDs who are women and younger perceived the model more favorably.

Validation of a Teaching Effectiveness Assessment in Psychiatry Continuing Medical Education.

OBJECTIVE: Little is known about factors associated with effective continuing medical education (CME) in psychiatry. The authors aimed to validate a method to assess psychiatry CME teaching effectiveness and to determine associations between teaching effectiveness scores and characteristics of presentations, presenters, and participants. METHODS: This cross-sectional study was conducted at the Mayo Clinic Psychiatry Clinical Reviews and Psychiatry in Medical Settings. Presentations were evaluated using an eight-item CME teaching effectiveness instrument, its content based on previously published instruments. Factor analysis, internal consistency and interrater reliabilities, and temporal stability reliability were calculated. Associations were determined between teaching effectiveness scores and characteristics of presentations, presenters, and participants. RESULTS: In total, 364 participants returned 246 completed surveys (response rate, 67.6%). Factor analysis revealed a unidimensional model of psychiatry CME teaching effectiveness. Cronbach α for the instrument was excellent at 0.94. Item mean score (SD) ranged from 4.33 (0.92) to 4.71 (0.59) on a 5-point scale. Overall interrater reliability was 0.84 (95% CI, 0.75-0.91), and temporal stability was 0.89 (95% CI, 0.77-0.97). No associations were found between teaching effectiveness scores and characteristics of presentations, presenters, and participants. CONCLUSIONS: This study provides a new, validated measure of CME teaching effectiveness that could be used to improve psychiatry CME. In contrast to prior research in other medical specialties, CME teaching effectiveness scores were not associated with use of case-based or interactive presentations. This outcome suggests the need for distinctive considerations regarding psychiatry CME; a singular approach to CME teaching may not apply to all medical specialties.

Educational Technologies for Physician Continuous Professional Development: A National Survey.

PURPOSE: To determine the past experiences with, current use of, and anticipated use of online learning and simulation-based education among practicing U.S. physicians, and how findings vary by age. METHOD: The authors surveyed 4,648 randomly sampled board-certified U.S. physicians, September 2015 to April 2016, using Internet-based and paper questionnaires. Survey items (some optional) addressed past and current technology usage, perceived technology effectiveness, and anticipated future use of specific technology innovations. RESULTS: Of 988 respondents, 444 completed optional items. Of these, 429/442 (97.1%) had used online learning and 372/442 (84.2%) had used simulation-based education in the past five years. Desire for more online learning was modest (mean [standard deviation], 4.6 [1.5]; 1 = strongly disagree, 7 = strongly agree), as was desire for more simulation-based education (4.2 [1.7]). Both online learning and simulation-based education were perceived as effective (5.2 [1.4]; 5.0 [1.4]). Physicians believed they possess adequate skills for online learning (5.8 [1.2]) and that point-of-care learning is vital to effective patient care (5.3 [1.3]). Only 39.0% used objective performance data to guide their learning choices, although 64.6% agreed that such information would be useful. The highest-rated innovations included a central repository for listing educational opportunities and tracking continuing education credits, an app to award credit for answering patient-focused questions, 5-minute and 20-minute clinical updates, and an e-mailed "question of the week." Responses to most survey items were similar across age groups. CONCLUSIONS: Practicing physicians generally seem receptive and prepared to use a variety of educational technologies, regardless of age.

Relationships Between Reflection and Behavior Change in CME.

INTRODUCTION: Reflection exposes performance gaps and is a step in the process of behavior change among adult learners. However, little is known about the relationships between reflection and behavior change in CME. Our objectives were to measure associations between validated reflection scores and behavior change among CME participants and to identify associations between reflection and characteristics of CME presentations. METHODS: This was a cohort study of attendees at a national hospital medicine CME course. Participants provided reflection scores for each presentation and planned commitment-to-change (CTC) statements at the conclusion of the course. Reflection scores from 1 (strongly disagree) to 5 (strongly agree) were averaged for each presentation. CTC statements were linked to their accompanying presentations. A 3-month postcourse survey was conducted to assess if planned CTCs were successfully implemented. RESULTS: In all, 223 of 281 participants (79.4%) returned evaluations. Of the 195 planned CTC statements available for postcourse analysis, 128 (65.6%) were implemented. Reflection scores correlated with the number of planned CTC statements across all presentations (Pearson correlation, 0.65; P < .001). In addition, higher reflection scores (mean [SD]) were associated with the presence of audience response opportunities (Yes: 4.13 [0.18] versus No: 3.96 [0.16]; P = .01) and the use of clinical cases (Yes: 4.09 [0.18] versus No: 3.86 [0.12]; P < .01). DISCUSSION: To our knowledge, this is the first study to show a relationship between participant reflection and CTC in conference-based CME. Presentations that incorporate clinical cases and audience response systems seem to stimulate participant reflection and behavior change.

Factors Influencing Physicians' Selection of Continuous Professional Development Activities: A Cross-Specialty National Survey.

INTRODUCTION: We sought to understand what influences physicians' decisions about participation in continuous professional development (CPD) activities, and how often physicians engage in specific CPD activities. METHODS: From September 2015 to April 2016, we administered a survey to 4648 randomly sampled licensed US physicians. Survey items addressed perceived barriers to CPD, factors that might influence participation in four prototypical CPD activities (reading an article, or completing a local activity, online course, or far-away course), and frequency of CPD engagement. RESULTS: Nine hundred eighty-eight (21.6%) physicians responded. The most important barriers were time (mean [SD] 3.5 [1.3], 1 = not important, 5 = extremely important) and cost (2.9 [1.3]). In prioritizing factors influencing participation in four prototypical CPD activities, topical relevance consistently had the highest average rank. Quality of content and time to complete the activity were also frequently selected. Over the past 3 years, most physicians reported having participated in patient-focused learning and self-directed learning on a weekly basis; quality improvement and local continuing medical education (CME) activities several times per year; online learning, on-site courses, and national board-related activities a few times per year; and interprofessional learning less than once per year. Physicians believed that they ought to engage more often in all of these activities except board-related activities. They would like CME credit for these activities much more often than currently obtained. DISCUSSION: The reasons physicians select a given CPD activity vary by activity, but invariably include topic and quality of content. Physicians want CME credit for the CPD activities they are already doing.

E-learning in graduate medical education: survey of residency program directors.

BACKGROUND: E-learning-the use of Internet technologies to enhance knowledge and performance-has become a widely accepted instructional approach. Little is known about the current use of e-learning in postgraduate medical education. To determine utilization of e-learning by United States internal medicine residency programs, program director (PD) perceptions of e-learning, and associations between e-learning use and residency program characteristics. METHODS: We conducted a national survey in collaboration with the Association of Program Directors in Internal Medicine of all United States internal medicine residency programs. RESULTS: Of the 368 PDs, 214 (58.2%) completed the e-learning survey. Use of synchronous e-learning at least sometimes, somewhat often, or very often was reported by 85 (39.7%); 153 programs (71.5%) use asynchronous e-learning at least sometimes, somewhat often, or very often. Most programs (168; 79%) do not have a budget to integrate e-learning. Mean (SD) scores for the PD perceptions of e-learning ranged from 3.01 (0.94) to 3.86 (0.72) on a 5-point scale. The odds of synchronous e-learning use were higher in programs with a budget for its implementation (odds ratio, 3.0 [95% CI, 1.04-8.7]; P = .04). CONCLUSIONS: Residency programs could be better resourced to integrate e-learning technologies. Asynchronous e-learning was used more than synchronous, which may be to accommodate busy resident schedules and duty-hour restrictions. PD perceptions of e-learning are relatively moderate and future research should determine whether PD reluctance to adopt e-learning is based on unawareness of the evidence, perceptions that e-learning is expensive, or judgments about value versus effectiveness.

Speaker Introductions at Internal Medicine Grand Rounds: Forms of Address Reveal Gender Bias.

BACKGROUND: Gender bias has been identified as one of the drivers of gender disparity in academic medicine. Bias may be reinforced by gender subordinating language or differential use of formality in forms of address. Professional titles may influence the perceived expertise and authority of the referenced individual. The objective of this study is to examine how professional titles were used in the same and mixed-gender speaker introductions at Internal Medicine Grand Rounds (IMGR). METHODS: A retrospective observational study of video-archived speaker introductions at consecutive IMGR was conducted at two different locations (Arizona, Minnesota) of an academic medical center. Introducers and speakers at IMGR were physician and scientist peers holding MD, PhD, or MD/PhD degrees. The primary outcome was whether or not a speaker's professional title was used during the first form of address during speaker introductions at IMGR. As secondary outcomes, we evaluated whether or not the speakers professional title was used in any form of address during the introduction. RESULTS: Three hundred twenty-one forms of address were analyzed. Female introducers were more likely to use professional titles when introducing any speaker during the first form of address compared with male introducers (96.2% [102/106] vs. 65.6% [141/215]; p < 0.001). Female dyads utilized formal titles during the first form of address 97.8% (45/46) compared with male dyads who utilized a formal title 72.4% (110/152) of the time (p = 0.007). In mixed-gender dyads, where the introducer was female and speaker male, formal titles were used 95.0% (57/60) of the time. Male introducers of female speakers utilized professional titles 49.2% (31/63) of the time (p < 0.001). CONCLUSION: In this study, women introduced by men at IMGR were less likely to be addressed by professional title than were men introduced by men. Differential formality in speaker introductions may amplify isolation, marginalization, and professional discomfiture expressed by women faculty in academic medicine.

Associations between teaching effectiveness and participant self-reflection in continuing medical education.

Effective medical educators can engage learners through self-reflection. However, little is known about the relationships between teaching effectiveness and self-reflection in continuing medical education (CME). We aimed to determine associations between presenter teaching effectiveness and participant self-reflection in conference-based CME. This cross-sectional study evaluated presenters and participants at a national CME course. Participants provided CME teaching effectiveness (CMETE) ratings and self-reflection scores for each presentation. Overall CMETE and CME self-reflection scores (five-point Likert scale with one as strongly disagree and five as strongly agree) were averaged for each presentation. Correlations were measured among self-reflection, CMETE, and presentation characteristics. In total, 624 participants returned 430 evaluations (response, 68.9%) for the 38 presentations. Correlation between CMETE and self-reflection was medium (Pearson correlation, 0.3-0.5) or large (0.5-1.0) for most presentations (n = 33, 86.9%). Higher mean (SD) CME reflection scores were associated with clinical cases (3.66 [0.12] vs. 3.48 [0.14]; p = 0.003) and audience response (3.66 [0.12] vs. 3.51 [0.14]; p = 0.005). To our knowledge, this is the first study to show a relationship between teaching effectiveness and participant self-reflection in conference-based CME. Presenters should consider using clinical cases and audience response systems to increase teaching effectiveness and promote self-reflection among CME learners.