Faculty Perceptions of Formative Feedback from Medical Students.

Phenomenon: Feedback given by medical students to their teachers during a clerkship has the potential to improve learning by communicating students' needs and providing faculty with information on how to adjust their teaching. Aligning student learning needs and faculty teaching approach could result in increased student understanding and skill development before a clerkship's end. However, little is known about faculty perceptions of formative feedback from medical students and how faculty might respond to such feedback. Approach: In this qualitative study, semistructured interviews of 24 third-year clerkship faculty were conducted to explore faculty opinions about receiving formative feedback from students. Transcripts of these interviews were reviewed, and content analysis was performed. Findings: Faculty endorsed the idea of obtaining formative feedback from medical students. However, probing revealed factors that would significantly influence their receptivity and response to the feedback provided, including (a) who would be giving the feedback, (b) what content was included in the feedback, (c) how the feedback was framed, and (d) why the feedback was given. Although participants endorsed the concept of receiving formative feedback from medical students, their accounts of how they might respond to it presented a mixed picture of receptivity, acceptance, and response. Insights: These findings have practical implications. If formative feedback from medical students to faculty is to be encouraged, institutions need to find ways of creating a feedback culture in which more dialogic models become "the norm" and work with faculty to increase their receptivity to and acceptance of student feedback. This is essential for students to feel safe and be safe from retribution when providing insights into how faculty can better meet their learning needs.

Characteristics of multi-institutional health sciences education research: a systematic review.

OBJECTIVES: Multi-institutional research increases the generalizability of research findings. However, little is known about characteristics of collaborations across institutions in health sciences education research. Using a systematic review process, the authors describe characteristics of published, peer-reviewed multi-institutional health sciences education research to inform educators who are considering such projects. METHODS: Two medical librarians searched MEDLINE, the Education Resources Information Center (ERIC), EMBASE, and CINAHL databases for English-language studies published between 2004 and 2013 using keyword terms related to multi-institutional systems and health sciences education. Teams of two authors reviewed each study and resolved coding discrepancies through consensus. Collected data points included funding, research network involvement, author characteristics, learner characteristics, and research methods. Data were analyzed using descriptive statistics. RESULTS: One hundred eighteen of 310 articles met inclusion criteria. Sixty-three (53%) studies received external and/or internal financial support (87% listed external funding, 37% listed internal funding). Forty-five funded studies involved graduate medical education programs. Twenty (17%) studies involved a research or education network. Eighty-five (89%) publications listed an author with a master's degree or doctoral degree. Ninety-two (78%) studies were descriptive, whereas 26 studies (22%) were experimental. The reported study outcomes were changes in student attitude (38%; n=44), knowledge (26%; n=31), or skill assessment (23%; n=27), as well as patient outcomes (9%; n=11). CONCLUSIONS: Multi-institutional descriptive studies reporting knowledge or attitude outcomes are highly published. Our findings indicate that funding resources are not essential to successfully undertake multi-institutional projects. Funded studies were more likely to originate from graduate medical or nursing programs.

A Proposed Conceptual Framework and Investigation of Upward Feedback Receptivity in Medical Education.

UNLABELLED: WGEA 2015 CONFERENCE ABSTRACT (EDITED). Faculty Perceptions of Receiving Feedback From Third-Year Clerkship Students. Amanda Kost, Heidi Combs, Sherilyn Smith, Eileen Klein, Patricia Kritek, and Lynne Robins. PHENOMENON: In addition to giving feedback to 3rd-year clerkship students, some clerkship instructors receive feedback, requested or spontaneous, from students prior to the clerkship's end. The concept of bidirectional feedback is appealing as a means of fostering a culture of respectful communication and improvement. However, little is known about how teachers perceive this feedback in practice or how it impacts the learning environment. APPROACH: We performed 24 semistructured 30-minute interviews with 3 to 7 attending physician faculty members each in Pediatrics, Internal Medicine, Family Medicine, Surgery, Psychiatry, and Obstetrics and Gynecology who taught in 3rd-year required clerkships during the 2012-2013 academic year. Questions probed teachers' experience with and attitudes toward receiving student feedback. Prompts were used to elicit stories and obtain participant demographics. Interviews were audio-recorded, transcribed, and entered into Dedoose for qualitative analysis. Researchers read transcripts holistically for meaning, designed a coding template, and then independently coded each transcript. A constant comparative approach and regular meetings were used to ensure consistent coding between research team members. FINDINGS: Participants ranged in age from 37 to 74, with 5 to 35 years of teaching experience. Seventy-one percent were male, and 83% identified as White. In our preliminary analysis, our informants reported a range of experience in receiving student feedback prior to the end of a clerkship, varying from no experience to having developed mechanisms to regularly request specific feedback about their programs. Most expressed openness to actively soliciting and receiving student feedback on their teaching during the clerkship although many questioned whether this process was feasible. Actual responses to receiving student feedback were mixed. Some reported having received feedback that motivated change, and others rejected the feedback they received on the grounds that it lacked validity or was inappropriate. Others expressed uncertainty about how they would react to student feedback. Faculty expressed a preference for receiving feedback about behaviors and items that were within their control. INSIGHTS: These findings suggest there is opportunity to pilot implementation of a structured student feedback mechanism, separate from teacher evaluations, in selected 3rd-year clerkships. Materials should developed to help faculty solicit, understand, and respond to student feedback and to help students frame and provide the kinds of feedback to teachers that will lead to suggested improvements. Both these endeavors have the potential to improve the clinical learning environment during 3rd-year clerkships through the cultivation of respectful communication and the encouragement of improvement in teaching efforts.

Further dissemination of medical education projects after presentation at a pediatric national meeting (1998-2008).

BACKGROUND: Further dissemination of medical education work presented at national meetings is limited. PURPOSES: The purpose of this study was to explore dissemination outcomes of scholarly work in pediatric medical education. METHODS: Council on Medical Student Education in Pediatrics (COMSEP) members who presented at COMSEP national meetings from 1998 to 2008 received a questionnaire about scholarly dissemination outcomes. Descriptive statistics and chi-square analysis explored variables related to dissemination. Qualitative analysis of free text comments explored barriers to dissemination. RESULTS: Outcomes were determined for 81% of presentations (138/171). The dissemination rate was 67% (92/138 presentations), with 47 publications (34%). Dissemination rates did not vary by presentation type (poster vs. oral) or project type. There was no relationship between presentation type, project type, and dissemination method. Barriers included perceived inadequate time, mentorship, and methodological skills for scholarly work. CONCLUSIONS: Most projects were further disseminated. Additional resources including mentoring and protected time for scholarly work are needed by educators to optimize dissemination.

Development of Objectives to Inform a National Standardized Primary Palliative Care Curriculum for Health Professions Students.

Introduction: Despite recent educational advances, the need for a national standardized primary palliative care curriculum for health professions students remains evident. Methods: An interprofessional leadership team developed a set of core learning objectives built on previously published competencies. A survey was then sent to palliative care experts for feedback and consensus. Results: Twenty-eight of 31 objectives met a 75% consensus threshold, 2 were combined with others, and 12 were refined based on survey feedback. Discussion: With interprofessional input at all stages, we finalized a comprehensive list of 26 learning objectives for a primary palliative care curriculum targeting health professions students. These objectives will be widely available through an online course but can also be adopted for use by individual educators across health professions institutions. These objectives and related curriculum are critical to producing practice-ready clinicians who are prepared to care for the burgeoning population of seriously ill patients.

Where do medical students turn? The role of the assigned mentor in the fabric of support during medical school.

BACKGROUND: The University of Washington School of Medicine implemented an assigned mentoring program in 2002. The College Mentors are assigned at matriculation, advise students throughout medical school, and teach and evaluate students in the 2nd-year Introduction to Clinical Medicine course. PURPOSE: The purpose of the study was to determine from whom students report they would seek advice and support for academic, professional, personal, and research issues. METHODS: A cross-sectional cohort survey asking students whom they would first contact about academic, personal, professional, and research issues was administered to three cohorts of students in 2007. RESULTS: Students reported that they would contact their College Mentor first for general academic progress (49.6%), personal issues (36.2%), and professional issues (64.1%) but not for research issues. CONCLUSIONS: Students identified their College Mentor as a primary contact for academic, professional, and personal issues, suggesting that neither the mentors' assigned status or evaluator role were barriers to the mentoring relationship.

A collaborative model for developing and maintaining virtual patients for medical education.

There is great interest in using computer-assisted instruction in medical education, but getting computer-assisted instruction materials used broadly is difficult to achieve. We describe a successful model for the development and maintenance of a specific type of computer-assisted instruction - virtual patients - in medical education. The collaborative model's seven key components are described and compared to other models of diffusion of innovation and curriculum development. The collaborative development model that began in one medical discipline is now extended to two additional disciplines, through partnerships with their respective clerkship director organizations. We believe that the ability to achieve broad use of virtual patients, and to transition the programs from successfully relying on grant funding to financially self-sustaining, resulted directly from the collaborative development and maintenance process. This process can be used in other learning environments and for the development of other types of computer-assisted instruction programs.

Evolving roles of clerkship directors: have expectations changed?

BACKGROUND: Physician educators directing medical student programs face increasingly more complex challenges to ensure students receive appropriate preparation to care for patients. The Alliance for Clinical Education (ACE) defined expectations of and for clerkship directors in 2003. Since then, much has changed in medical education and health care. METHODS: ACE conducted a panel discussion at the 2016 Association of American Medical Colleges Learn Serve Lead conference, soliciting input on these expectations and the changing roles of clerkship directors. Using workshops as a cross-sectional study design, participants reacted to roles and responsibilities of clerkship directors identified in the literature using an audience response system and completing worksheets. RESULTS: The participants represented different disciplines of medicine and ranged from clerkship directors to deans of curriculum. Essential clerkship director qualifications identified by participants included: enthusiasm, experience teaching, and clinical expertise. Essential tasks included grading and assessment and attention to accreditation standards. Participants felt clerkship directors need adequate resources, including budget oversight, full-time clerkship support, and dedicated time to be the clerkship director. To whom clerkship directors report was mixed. Clerkship directors look to their chair for career advice, and they also report to the dean to ensure educational standards are being met. Expectations to meet accreditation standards and provide exemplary educational experiences can be difficult to achieve if clerkship directors' time and resources are limited. CONCLUSIONS: Participant responses indicated the need for a strong partnership between department chairs and the dean's office so that clerkship directors can fulfill their responsibilities. Our results indicate a need to ensure clerkship directors have the time and resources necessary to manage clinical medical student education in an increasingly complex health care environment. Further studies need to be conducted to obtain more precise data on the true amount of time they are given to do that role.

First-year medical students' perspectives on continuity of care.

BACKGROUND AND OBJECTIVES: The objective of this research was to obtain and describe medical students' perspectives about continuity of care while they are participating in a preclinical practice-based preceptorship. METHODS: Within the context of a preclinical preceptorship, students completed directed readings, conducted patient and physician interviews, and wrote reflections about continuity of care. Two coders independently analyzed a randomly selected subset of de-identified reflections (78 of 170) to describe predominant themes. RESULTS: During preceptorship, students interacted with patients affected by wide-ranging diseases, from diabetes to multiple sclerosis, within primary care and specialty clinical settings located in geographically diverse regions. Drawing on personal experience and interviews with patients and physicians, students reported benefits of continuity of care for patients and physicians concordant with claims from the literature, including improved medical management, better interpersonal communication, increased patient compliance, and higher levels of trust. Students also offered perspectives regarding challenges of and impediments to providing continuity of care, including managed care and work hour constraints, lack of comprehensive coordinated services, and specialty-driven care. CONCLUSIONS: Preclinical medical students are able to identify both benefits and barriers to continuity of care. These topics can provide a foundation for a future curriculum and may need to be explicitly addressed as students choose careers in medicine.

A Multi-Institution Collaboration to Define Core Content and Design Flexible Curricular Components for a Foundational Medical School Course: Implications for National Curriculum Reform.

Medical educators have not reached widespread agreement on core content for a U.S. medical school curriculum. As a first step toward addressing this, five U.S. medical schools formed the Robert Wood Johnson Foundation Reimagining Medical Education collaborative to define, create, implement, and freely share core content for a foundational medical school course on microbiology and immunology. This proof-of-concept project involved delivery of core content to preclinical medical students through online videos and class-time interactions between students and facilitators. A flexible, modular design allowed four of the medical schools to successfully implement the content modules in diverse curricular settings. Compared with the prior year, student satisfaction ratings after implementation were comparable or showed a statistically significant improvement. Students who took this course at a time point in their training similar to when the USMLE Step 1 reference group took Step 1 earned equivalent scores on National Board of Medical Examiners-Customized Assessment Services microbiology exam items. Exam scores for three schools ranged from 0.82 to 0.84, compared with 0.81 for the national reference group; exam scores were 0.70 at the fourth school, where students took the exam in their first quarter, two years earlier than the reference group. This project demonstrates that core content for a foundational medical school course can be defined, created, and used by multiple medical schools without compromising student satisfaction or knowledge. This project offers one approach to collaboratively defining core content and designing curricular resources for preclinical medical school education that can be shared.

Teaching patient communication skills to medical students: a review of randomized controlled trials.

Tools to examine the effects of teaching interventions across a variety of studies are needed. The authors perform a meta-analysis of 24 randomized controlled trials evaluating the effects of teaching on medical students' patient communication skills. Study quality is rated using a modified Jadad score, and standardized mean difference effect size (d) measures are calculated. Fifteen of 24 studies have sufficient data for analysis. Students' ability to establish rapport improves after teaching. The effects are large when the teaching intervention was small group discussion (n = 5) or giving structured feedback on a student-patient interview (n = 6). A similar effect of teaching is seen on student data gathering skills (n = 5). Teaching medical students patient communication skills using small group discussion or providing feedback on a student-patient interview results in improvement in student performance.

Early introduction of clinical skills improves medical student comfort at the start of third-year clerkships.

BACKGROUND: To determine whether introducing clinical skills during the second year of medical school, via a competency-based College system approach, improves comfort level for medical students entering third-year clinical rotations. METHOD: From 2003-2005, two cohorts of third-year medical students at the University of Washington were surveyed on their comfort level in the categories of history taking, physical examination, communication, and patient care. RESULTS: The cohort of students exposed to the College system reported a statistically significant greater comfort level in half of the measured areas, and in at least one area within each general category. No area of study showed a statistically significant decline. CONCLUSION: A competency-based College system improves medical student comfort in core clinical skills at the start of the third year curriculum.

The Development and Preliminary Validation of a Rubric to Assess Medical Students' Written Summary Statements in Virtual Patient Cases.

PURPOSE: The ability to create a concise summary statement can be assessed as a marker for clinical reasoning. The authors describe the development and preliminary validation of a rubric to assess such summary statements. METHOD: Between November 2011 and June 2014, four researchers independently coded 50 summary statements randomly selected from a large database of medical students' summary statements in virtual patient cases to each create an assessment rubric. Through an iterative process, they created a consensus assessment rubric and applied it to 60 additional summary statements. Cronbach alpha calculations determined the internal consistency of the rubric components, intraclass correlation coefficient (ICC) calculations determined the interrater agreement, and Spearman rank-order correlations determined the correlations between rubric components. Researchers' comments describing their individual rating approaches were analyzed using content analysis. RESULTS: The final rubric included five components: factual accuracy, appropriate narrowing of the differential diagnosis, transformation of information, use of semantic qualifiers, and a global rating. Internal consistency was acceptable (Cronbach alpha 0.771). Interrater reliability for the entire rubric was acceptable (ICC 0.891; 95% confidence interval 0.859-0.917). Spearman calculations revealed a range of correlations across cases. Content analysis of the researchers' comments indicated differences in their application of the assessment rubric. CONCLUSIONS: This rubric has potential as a tool for feedback and assessment. Opportunities for future study include establishing interrater reliability with other raters and on different cases, designing training for raters to use the tool, and assessing how feedback using this rubric affects students' clinical reasoning skills.

Multi-institutional development and utilization of a computer-assisted learning program for the pediatrics clerkship: the CLIPP Project.

Computer-assisted instruction (CAI) holds significant promise for meeting the current challenges of medical education by providing consistent and quality teaching materials regardless of training site. The Computer-assisted Learning in Pediatrics Project (CLIPP) was created over three years (2000-2003) to meet this potential through multi-institutional development of interactive Internet-based patient simulations that comprehensively teach the North American core pediatrics clerkship curriculum. Project development adhered to four objectives: (1) comprehensive coverage of the core curriculum; (2) uniform approach to CAI pedagogy; (3) multi-institutional development by educators; and (4) extensive evaluation by users. Pediatrics clerkship directors from 30 institutions worked in teams to develop a series of 31 patient case simulations. An iterative process of case content and pedagogy development, case authoring, peer review, and pilot-testing ensured that the needs of clerkship directors and medical students were met. Fifty medical schools in the United States and Canada are presently using CLIPP. More than 8,000 students have completed over 98,000 case sessions, with an average of 2,000 case sessions completed per week at this time. Each CLIPP case has been completed by more than 3,000 students. The current cost of CLIPP development is approximately $70 per student user, or $6 per case session. The project's success demonstrates that multi-institutional development and implementation of a peer-reviewed comprehensive CAI learning program by medical educators is feasible and provides a useful model for other organizations to develop similar programs. Although CAI development is both time-consuming and costly, the initial investment decreases significantly with broad use over time.

Promoting fundamental clinical skills: a competency-based college approach at the University of Washington.

The focus on fundamental clinical skills in undergraduate medical education has declined over the last several decades. Dramatic growth in the number of faculty involved in teaching and increasing clinical and research commitments have contributed to depersonalization and declining individual attention to students. In contrast to the close teaching and mentoring relationship between faculty and students 50 years ago, today's medical students may interact with hundreds of faculty members without the benefit of a focused program of teaching and evaluating clinical skills to form the core of their four-year curriculum. Bedside teaching has also declined, which may negatively affect clinical skills development. In response to these and other concerns, the University of Washington School of Medicine has created an integrated developmental curriculum that emphasizes bedside teaching and role modeling, focuses on enhancing fundamental clinical skills and professionalism, and implements these goals via a new administrative structure, the College system, which consists of a core of clinical teachers who spend substantial time teaching and mentoring medical students. Each medical student is assigned a faculty mentor within a College for the duration of his or her medical school career. Mentors continuously teach and reflect with students on clinical skills development and professionalism and, during the second year, work intensively with them at the bedside. They also provide an ongoing personal faculty contact. Competency domains and benchmarks define skill areas in which deepening, progressive attention is focused throughout medical school. This educational model places primary focus on the student.

Adverse Events in Pediatric Patients Receiving Long-Term Outpatient Antimicrobials.

BACKGROUND: Although long treatment courses of outpatient antimicrobials are often used in pediatric patients, few data exist regarding the frequency of adverse events (AEs) associated with these medications. METHODS: We performed a retrospective cohort study of all patients seen in the Infectious Diseases clinic at a tertiary referral children's hospital from August 1, 2009 to August 1, 2011. We included patients who received ≥14 days of oral or intravenous antibiotic, antiviral, or antifungal medications. Patients receiving only prophylactic medications or human immunodeficiency virus treatment were excluded. RESULTS: Three hundred thirty-five subjects met inclusion criteria, with a median age of 7.4 years at start of therapy. The cohort was predominantly male (60%), white (54%), and previously healthy (59%). A majority (88.4%) of subjects were treated for bacterial infections. ß-Lactam agents were the most commonly used antimicrobial class (210 subjects; 62.7%), followed by clindamycin (86; 25.7%), rifampin (76; 22.7%), and vancomycin (62; 18.5%). Overall, 107 (31.9%) subjects experienced 151 distinct AEs. The most common individual AE noted was diarrhea (44; 29.1% of all AEs). Serious AEs developed in 42 (12.5%) subjects, including allergic reactions (15; 11.3% of all AEs), venous catheter-related complications (14; 13.0% of those with catheters), neutropenia (9; 3.0%), renal insufficiency (7; 2.5%), and hepatotoxicity (3; 1.1%). Rates of AEs were similar between those on oral and intravenous antimicrobials. CONCLUSIONS: In our study population, patients on prolonged oral or intravenous outpatient antimicrobials experienced AEs frequently. These findings support the need for close monitoring of pediatric patients on prolonged antimicrobial therapy and vigilance for unwanted effects of these medications.

Successful Treatment of Parainfluenza Virus Respiratory Tract Infection With DAS181 in 4 Immunocompromised Children.

BACKGROUND: Parainfluenza virus (PIV), a common pediatric pathogen, is associated with significant morbidity in immunocompromised (IC) hosts. DAS181, a novel sialidase fusion protein inhibitor, seems to be effective against PIV in vitro and in vivo; its use in IC children has not been evaluated. METHODS: Patients were diagnosed with PIV infection using a quantitative reverse transcription-polymerase chain reaction. DAS181 was obtained under emergency investigational new drug applications and was administered via aerosol chamber or nebulizer. Patients were assessed daily for their clinical condition and adverse outcomes. RESULTS: Four pediatric hematopoietic cell transplantation (HCT) patients with PIV detected in respiratory specimens were identified and treated with DAS 181. Patients 1 and 2 were diagnosed with PIV lower respiratory tract infection (LRTI) by bronchoalveolar lavage at 9 months and 2 days after allogeneic transplantation, respectively. Patient 3 was on chemotherapy prior to planned autologous HCT at time of PIV diagnosis from a nasal swab. Patient 4 was diagnosed with PIV via nasal wash 2 days after HCT. Patients 1-3 had clinical symptoms and chest imaging consistent with LRTI. Inhaled DAS181 was administered for 5-10 days. All 4 patients tolerated therapy well. Clinical improvement in oxygen requirement and respiratory rate was observed in all patients who required oxygen at therapy initiation. Viral load decreased in all patients within 1 week of therapy and became undetectable by day 3 of therapy in patient 3. CONCLUSION: DAS181 was used to treat 4 severely IC pediatric patients with PIV disease. The drug was well tolerated. Improvement in both viral loads and symptoms after initiation of therapy was observed in all cases. This report supports prospective, randomized studies in IC patients with PIV infection.

Finding effective strategies for teaching ethics: a comparison trial of two interventions.

PURPOSE: To compare the effects of two teaching methods (written case analyses and written case analyses with group discussion) on students' recognition and assessment of common ethical dilemmas. METHOD: In 1999-2000, all third-year students at the University of Washington School of Medicine on a pediatrics clinical rotation participated in the study. Eighty students were based in Seattle and 66 were in community sites in a five-state area. All students received three scenarios with written instructions for ethical analysis, submitted written answers, and received written feedback from a single evaluator. The Seattle students also participated in an hour-long, one-time discussion group about the cases. All students submitted a final case analysis. Four components of the case analyses were evaluated: ability to identify ethical issues, see multiple viewpoints, formulate an action plan, and justify their actions. One investigator evaluated a masked subset of the case analyses from both groups to assess whether teaching method affected the students' ability to recognize and assess ethical problems. RESULTS: Forty-eight of 146 available case analysis sets (each set included three initial analyses plus one final analysis) were masked and coded. Performances on the initial analyses were similar in both groups (p >.2-.8). The discussion group had a higher absolute increase in total score (p =.017) and in ability to formulate a plan (p =.013) on the final case analysis. Performances otherwise remained largely similar. CONCLUSIONS: Students' recognition and assessment of ethical issues in pediatrics improves following a case-based exercise with structured feedback. Group discussion may optimize the learning experience and increase students' satisfaction.