Feedback in Medical Education: An Evidence-based Guide to Best Practices from the Council of Residency Directors in Emergency Medicine.

Within medical education, feedback is an invaluable tool to facilitate learning and growth throughout a physician's training and beyond. Despite the importance of feedback, variations in practice indicate the need for evidence-based guidelines to inform best practices. Additionally, time constraints, variable acuity, and workflow in the emergency department (ED) pose unique challenges to providing effective feedback. This paper outlines expert guidelines for feedback in the ED setting from members of the Council of Residency Directors in Emergency Medicine Best Practices Subcommittee, based on the best evidence available through a critical review of the literature. We provide guidance on the use of feedback in medical education, with a focus on instructor strategies for giving feedback and learner strategies for receiving feedback, and we offer suggestions for fostering a culture of feedback.

Education Theory Made Practical: Creating open educational resources via an apprenticeship model.

Introduction: Clinical faculty may have limited knowledge of education theories and best practices in health professions education. Many faculty development programs focus on passive learning with limited application to practice. There is a need for more active engagement for early career educators. Methods: We created an apprenticeship-based electronic book series focused on translating education theories into practical applications for clinician educators. Chapters were authored by teams of two to four geographically separated early career educators, who were tasked with explaining an education theory and relating it to their educational practice. The chapters underwent internal peer review, followed by open peer review as a blog post and eventual publication. Usage data were collected, and surveys were sent to authors and end-users. Results: Six volumes (60 total chapters) have been created to date by 180 unique authors and 17 editors over a 6-year period. There have been 65,571 total blog page views and 17,180 total book downloads across the five published volumes. Authors reported an increase in their perceived knowledge (pre 2.6 ± 1.7 vs. post 7.2 ± 1.1, mean difference 4.5/9.0, 95% confidence interval [CI] 4.0-5.0, p < 0.001) after writing their chapter. Authors also reported career benefits including authorship for academic advancement/promotion and developing an area of education theory expertise. End-users also reported a mean increase in their perceived knowledge (pre 4.4 ± 2.5 vs. post 7.3 ± 1.4, mean difference 2.9/9.0, 95% CI 2.1-3.8, p < 0.001) after reading a chapter. Conclusion: The Education Theory Made Practical electronic book series represents a proof of concept for an apprenticeship-based model to teach education theory, while also creating scholarship and open access resources for the broader community.

Physician Pipeline and Pathway Programs: An Evidence-based Guide to Best Practices for Diversity, Equity, and Inclusion from the Council of Residency Directors in Emergency Medicine.

Improving the diversity and representation in the medical workforce requires intentional and deliberate efforts to improve the pipeline and pathway for underrepresented in medicine (UIM) applicants. Diversity enhances educational experiences and improves patient care and outcomes. Through a critical review of the literature, in this article we offer evidence-based guidelines for physician pipeline and pathway programs (PP). Recommendations are provided regarding considerations on the types of programs and surrounding implementation to ensure a sound infrastructure and framework. We believe this guide will be valuable for all leaders and faculty members seeking to grow the UIM applicant pool in our efforts to advance diversity, equity, and inclusion within medicine.

Holistic Review, Mitigating Bias, and Other Strategies in Residency Recruitment for Diversity, Equity, and Inclusion: An Evidence-based Guide to Best Practices from the Council of Residency Directors in Emergency Medicine.

Advancement of diversity, equity, and inclusion (DEI) in emergency medicine can only occur with intentional recruitment of residency applicants underrepresented in medicine (UIM). Shared experiences from undergraduate and graduate medical education highlight considerations and practices that can contribute to improved diversity in the resident pool, such as holistic review and mitigating bias in the recruitment process. This review, written by members of the Council of Residency Directors in Emergency Medicine (CORD) Best Practices Subcommittee, offers best practice recommendations for the recruitment of UIM applicants. Recommendations address pre-interview readiness, interview approach, and post-interview strategies that residency leadership may use to implement holistic review and mitigate bias for recruitment of a diverse class.

High risk and low prevalence diseases: Eclampsia.

INTRODUCTION: Eclampsia is a rare partum and puerperal condition that carries a high rate of morbidity and mortality. OBJECTIVE: This review highlights the pearls and pitfalls of the care of patients with eclampsia, including presentation, evaluation, and evidence-based management in the emergency department (ED). DISCUSSION: Eclampsia is a hypertensive disease of pregnancy defined by new onset tonic-clonic, focal, or multifocal seizures or unexplained altered mental status in a pregnant or postpartum patient in the absence of other causative etiologies. However, signs and symptoms of preeclampsia and prodromes of eclampsia are often subtle and non-specific, making the diagnosis difficult. Thus, it should be considered in pregnant and postpartum patients who present to the ED. Laboratory testing including complete blood cell count, renal and liver function panels, electrolytes, glucose, coagulation panel, fibrinogen, lactate dehydrogenase, uric acid, and urinalysis, as well as imaging to include head computed tomography, can assist, but these evaluations should not delay management. Components of treatment include emergent obstetric specialist consultation, magnesium administration, and blood pressure control in patients with hypertension. Definitive treatment of eclampsia requires emergent delivery in pregnant patients. If consultants are not in-house, emergent stabilization and immediate transfer are required. CONCLUSIONS: An understanding of eclampsia can assist emergency clinicians in rapid recognition and timely management of this potentially deadly disease.

Faculty Recruitment, Retention, and Representation in Leadership: An Evidence-Based Guide to Best Practices for Diversity, Equity, and Inclusion from the Council of Residency Directors in Emergency Medicine.

Improving the recruitment, retention, and leadership advancement of faculty who are under-represented in medicine is a priority at many academic institutions to ensure excellence in patient care, research, and health equity. Here we provide a critical review of the literature and offer evidence-based guidelines for faculty recruitment, retention, and representation in leadership. Recommendations for recruitment include targeted recruitment to expand the candidate pool with diverse candidates, holistic review of applications, and incentivizing stakeholders for success with diversity efforts. Retention efforts should establish a culture of inclusivity, promote faculty development, and evaluate for biases in the promotion and tenure process. We believe this guide will be valuable for all leaders and faculty members seeking to advance diversity, equity, and inclusion in their institutions.

Novel tool for assessing the quality of feedback in the emergency room (FEED-ER).

BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME) emphasizes constructive feedback as a critical component of residency training. Despite over a decade of using competency-based milestone evaluations, emergency medicine (EM) residency programs lack a standardized method for assessing the quality of feedback. We developed two novel EM-specific feedback surveys to assess the quality of feedback in the ER (FEED-ER) from both the resident and the faculty perspectives. This study aimed to evaluate the surveys' psychometric properties. METHODS: We developed FEED-ER using a Likert scale with faculty and resident versions based on the ACGME framework and a literature review. The preliminary survey consisted of 25 questions involving the feedback domains of timeliness, respect/communication, specificity, action plan, and feedback culture. We conducted two modified Delphi rounds involving 17 content experts to ensure respondent understanding of the items, item coherence to corresponding feedback domains, thematic saturation of domain content, and time duration. A multicenter study was conducted at five university-based EDs in the United States and one in Thailand in 2019. We evaluated the descriptive statistics of the frequency of responses, validity evidence, and reliability of FEED-ER. RESULTS: A total of 147 EM faculty and 126 EM residents completed the survey. Internal consistency was adequate (Cronbach's alpha > 0.70) and test-retest reliability showed adequate temporal stability (ICC > 0.80) for all dimensions. Content validity was deemed acceptable (CVC > 0.80) for all items. From the 25 items of FEED-ER, 23 loaded into the originally theorized dimensions (with factor loadings > 0.50). Additionally, the five feedback domains were found to be statistically distinct, with correlations between 0.40 and 0.60. The final survey has 23 items. CONCLUSIONS: This is the first study to develop and provide validity evidence for an EM-specific feedback tool that has strong psychometric properties, is reproducible and reliable, and provides an objective measure for assessing the quality of feedback in the ED.

Laboratory Tests in the Patient with Abdominal Pain.

Abdominal pain is one of the most common presenting complaints to the emergency department (ED). More often than not, some degree of laboratory testing is used to narrow the differential diagnosis based on the patient's history and examination. Ordering practices are often guided by evidence, habit, consulting services, and institutional/regional culture. This review highlights relevant laboratory studies that may be ordered in the ED, as well as commentary on indications and diagnostic value of these tests.

Faculty development using a virtual community of practice: Three-year outcomes of the Academic Life in Emergency Medicine Faculty Incubator program.

INTRODUCTION: The Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program is a longitudinal, 1-year, virtual faculty development program for early- and mid-career faculty members that crosses specialties and institutions. This study sought to evaluate the outcomes among 3 years of participants. METHODS: This cross-sectional survey study evaluated postcourse and 1-year outcomes from three graduated classes of the ALiEM Faculty Incubator program. The program evaluation survey was designed to collect outcomes across multiple Kirkpatrick levels using pre/post surveys and tracking of abstracts, publications, speaking opportunities, new leadership positions, and new curricula. RESULTS: Over 3 years, 89 clinician educators participated in the program. Of those, 59 (66%) completed the initial survey and 33 (37%) completed the 1-year survey. Participants reported a significant increase in knowledge (4.1/9.0 vs. 7.0/9.0). The number of abstracts, publications, and invited presentations significantly increased after course completion and continued postcourse. A total of 37 of 59 (62.7%) developed a new curriculum during the course and 19 of 33 (57.6%) developed another new curriculum after the course. A total of 29 of 59 (49.2%) began a new leadership position upon course completion with 15 of 33 (45.5%) beginning another new leadership position 1 year later. DISCUSSION: The ALiEM Faculty Incubator program demonstrated an increase in perceived knowledge and documented academic productivity among early- and mid-career medical educators.

Clinical Teaching: An Evidence-based Guide to Best Practices from the Council of Emergency Medicine Residency Directors.

Clinical teaching is the primary educational tool use to train learners from day one of medical school all the way to the completion of fellowship. However, concerns over time constraints and patient census have led to a decline in bedside teaching. This paper provides a critical review of the literature on clinical teaching with a focus on instructor teaching strategies, clinical teaching models, and suggestions for incorporating technology. Recommendations for instructor-related teaching factors include adequate preparation, awareness of effective teacher attributes, using evidence-based-knowledge dissemination strategies, ensuring good communication, and consideration of environmental factors. Proposed recommendations for potential teaching strategies include the Socratic method, the One-Minute Preceptor model, SNAPPS, ED STAT, teaching scripts, and bedside presentation rounds. Additionally, this article will suggest approaches to incorporating technology into clinical teaching, including just-in-time training, simulation, and telemedical teaching. This paper provides readers with strategies and techniques for improving clinical teaching effectiveness.

Curated Collections for Educators: Five Key Papers on Clinical Teaching.

The ability to teach in the clinical setting is of paramount importance. Clinical teaching is at the heart of medical education, irrespective of the learner's level of training. Learners desire and need effective, competent, and thoughtful clinical teaching from their instructors. However, many clinician-educators lack formal training on this important skill and thus may provide a variable experience to their learners. Although formal training of clinician-educators is standard and required in many other countries, the United States has yet to follow suit, leaving many faculty members to fend for themselves to learn these important skills.  In September 2018, the Academic Life in Emergency Medicine (ALiEM) 2018-2019 Faculty Incubator program discussed the topic of clinical teaching techniques. We gathered the titles of papers that were cited, shared, and recommended within our online discussion forum and compiled the articles pertaining to the topic of clinical teaching techniques. To augment the list, the authors did a formal literature search using the search terms "teaching techniques", "clinical teaching", "medical education", "medical students", and "residents" on Google Scholar and PubMed. Finally, we posted a call for important papers on the topic of clinical teaching techniques on Twitter. Through this process, we identified 48 core articles on the topic of clinical teaching. We conducted a modified Delphi methodology to identify the key papers on the topic. In this paper, we present the five highest-rated articles based on the relevance to junior faculty and faculty developers. This article will review and summarize the articles we found to be the most impactful to improve one's clinical teaching skills.

Curated Collections for Educators: Five Key Papers about Receiving Feedback in Medical Education.

Introduction Feedback is a complex, multi-component interaction that is essential for academic development and advancement. Successful feedback requires active involvement from both the giver and receiver. However, research and guidance on the subject mostly center on the role of the provider of feedback. But the receiver of feedback holds the true power in this interaction, choosing how to interpret the information and deciding whether or not to incorporate the feedback to instill behavioral change. In this article, the authors aim to summarize five key papers related to receiving feedback, in order to outline both relevant information for emerging clinician-educators and discern ways to use this information for faculty development. Methods In order to generate a list of key papers that describe the importance of receiving feedback, the authors conducted a consensus-building process informed by social media sources. Key articles on receiving feedback were aggregated through a literature search. This list was further augmented via an open call on Twitter for important papers regarding receiving feedback. Through these processes, a list of 43 papers was created on the topic of receiving feedback in medical education. After compiling this preliminary list, the authorship group engaged in a modified Delphi approach to build consensus on selecting papers that best described the process of receiving feedback. Results We present the group's five most highly rated papers on the topic of receiving feedback in medical education. These papers were deemed essential and have also been summarized based on their relevance to junior faculty members and faculty developers. Conclusion While giving and receiving feedback are both vital for growth and development, much of the research focuses solely on giving feedback. However, receiving feedback is equally, if not more, important for instilling change in the learner. We explore the power of receiving feedback in medical education through five key papers that analyze the subject. We believe these papers can serve as great learning resources for both junior faculty members and faculty developers. They can assist the junior faculty to cultivate the ability to receive feedback and also serve as resources to aid senior faculty in building faculty-development sessions.

Curated Collections for Educators: Eight Key Papers about Feedback in Medical Education.

Feedback is an essential part of learning, growth, and academic success. Junior faculty members are often unfamiliar with the grounding literature that defines feedback. Many times they receive little education on providing and receiving feedback, resulting in unhelpful "feedback" for both learners and program leadership alike. This article aims to summarize eight key papers on feedback, to outline relevant information for emerging clinician educators, and identify ways to use these resources for the faculty development.  In order to generate a list of key papers that describes the importance and significance of feedback, the authors conducted a consensus-building process to identify the top papers. In August and September, 2018, the 2018-2019 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program discussed the topic of feedback in medical education. A number of papers on the topic was highlighted. This list of papers was further augmented using the suggestions and expertise of guest experts who are leaders in the field of medical education and feedback. The authors also used social media to conduct an open call on Twitter for important papers regarding feedback (utilizing #meded, #Feedback hashtags). Via this process, a list of 88 key papers was identified on the topic of feedback in medical education. After compiling these papers, the authorship group engaged in a modified Delphi approach to build consensus on the top eight papers on feedback. These papers were deemed essential by the authors and have been summarized with respect to their relevance to junior faculty members and to faculty developers. In this manuscript, we present eight key papers addressing feedback in medical education with discussions and applications for junior faculty members and faculty developers. This list of articles that can serve to help junior clinician educators grow in their ability to give effective feedback and also serve as resources upon which senior faculty can design the faculty development sessions.

Curated Collections for Educators: Five Key Papers about Residents as Teachers Curriculum Development.

The Accreditation Council for Graduate Medical Education (ACGME) requires residency programs to prepare residents to teach and assess medical students and other learners. In order to achieve this, many programs develop formal residents as teachers (RAT) curricula. Medical educators may seek the guidance of previously published literature during the development of RAT programs at their institutions. The authors sought to identify key articles published on the subject of RAT programs over the last 10 years. The authors utilized a formal literature search with the help of a medical librarian and identified additional articles from virtual discussions among the author group and an open call for articles on Twitter using the hashtag #MedEd. Virtual discussions occurred within an online community of practice, the Academic Life in Emergency Medicine (ALiEM) Faculty Incubator. The lead author conducted a four-round modified Delphi process among the author group in order to narrow the broad article list to five key articles on RAT programs. The authors summarize each article and provide considerations for junior faculty as well as faculty developers. Curriculum development and program evaluation should utilize established frameworks and evidence-based approaches. The papers identified by this Delphi process will help faculty use best practices when creating or revising new RAT curriculum. In addition, faculty tasked with guiding junior faculty in this process or creating faculty development programs around curriculum development will find these articles to be a great resource for building content.

Evidence-Based Medicine Approach to Abdominal Pain.

The chief complaint of abdominal pain accounts for 5% to 10% of all presentations in the emergency department. With such broad differential and diagnostic modalities available, this article focuses on a systematic approach to evaluating abdominal pain, essential to providing patients with efficient and accurate care.