A 360-degree assessment of teaching effectiveness using a structured-videorecorded observed teaching exercise for faculty development.

BACKGROUND: Filming teaching sessions were reported in the medical literature in the 1980s and 1990s but appear to have been an underreported and/or underutilized teaching tool since that time. National faculty development programs, such as the Harvard Macy Institute (HMI) Program for Educators in Health Professions and the Stanford Faculty Development Center for Medical Teachers program, have attempted to bridge this gap in formal instruction in teaching skills through microteaching sessions involving videos for self- and peer-assessment and feedback. OBJECTIVE: Current video-feedback faculty development initiatives are time intensive and impractical to implement broadly at an institutional level. Further, results of peer feedback have not been frequently reported in the literature at the institutional level. Our research aims to propose a convenient and effective process for incorporating video analysis into faculty devleopment programs. DESIGN: Our work describes a novel technique using video-recorded, simulated teaching exercises to compile multi-dimensional feedback as an aid in faculty development programs that promote teaching-skill development. This research evaluated the effectiveness of a focused teaching practicum designed for faculty in multiple specialty departments with large numbers of older patients into a geriatrics-based faculty development program. Effectiveness of the practicum is evaluated using quantitative scoring and qualitative analysis of self-reflection as well as peer and trainee input. RESULTS: VOTE sessions demonstrate an important exportable product which enable faculty to receive a detailed 360-degree assessment of their teaching. CONCLUSION: This intervention can be easily replicated and revised, as needed, to fit into the educational curriculum at other academic medical centers.

Tools to Assess Behavioral and Social Science Competencies in Medical Education: A Systematic Review.

PURPOSE: Behavioral and social science (BSS) competencies are needed to provide quality health care, but psychometrically validated measures to assess these competencies are difficult to find. Moreover, they have not been mapped to existing frameworks, like those from the Liaison Committee on Medical Education (LCME) and Accreditation Council for Graduate Medical Education (ACGME). This systematic review aimed to identify and evaluate the quality of assessment tools used to measure BSS competencies. METHOD: The authors searched the literature published between January 2002 and March 2014 for articles reporting psychometric or other validity/reliability testing, using OVID, CINAHL, PubMed, ERIC, Research and Development Resource Base, SOCIOFILE, and PsycINFO. They reviewed 5,104 potentially relevant titles and abstracts. To guide their review, they mapped BSS competencies to existing LCME and ACGME frameworks. The final included articles fell into three categories: instrument development, which were of the highest quality; educational research, which were of the second highest quality; and curriculum evaluation, which were of lower quality. RESULTS: Of the 114 included articles, 33 (29%) yielded strong evidence supporting tools to assess communication skills, cultural competence, empathy/compassion, behavioral health counseling, professionalism, and teamwork. Sixty-two (54%) articles yielded moderate evidence and 19 (17%) weak evidence. Articles mapped to all LCME standards and ACGME core competencies; the most common was communication skills. CONCLUSIONS: These findings serve as a valuable resource for medical educators and researchers. More rigorous measurement validation and testing and more robust study designs are needed to understand how educational strategies contribute to BSS competency development.

Teaching medical student geriatrics competencies in 1 week: an efficient model to teach and document selected competencies using clinical and community resources.

The Association of American Medical Colleges (AAMC) and the John A. Hartford Foundation published geriatrics competencies for medical students in 2008 defining specific knowledge and skills that medical students should be able to demonstrate before graduation. Medical schools, often with limited geriatrics faculty resources, face challenges in teaching and assessing these competencies. As an initial step to facilitate more-efficient implementation of the competencies, a 1-week geriatrics rotation was developed for the third year using clinical, community, and self-directed learning resources. The Wake Forest University School of Medicine Acute Care for the Elderly Unit serves as home base, and each student selects a half-day outpatient or long-term care experience. Students also perform a home-based falls-risk assessment with a Meals-on-Wheels client. The objectives for the rotation include 20 of the 26 individual AAMC competencies and specific measurable tracking tasks for seven individual competencies. In the evaluation phase, 118 students completed the rotation. Feedback was positive, with an average rating of 7.1 (1 = worst, 10 = best). Students completed a 23-item pre- and post-knowledge test, and average percentage correct improved by 15% (P < .001); this improvement persisted at graduation (2 years after the pretest). On a 12-item survey of attitudes toward older adults, improvement was observed immediately after the rotation that did not persist at graduation. Ninety-seven percent of students documented completion of the competency-based tasks. This article provides details of development, structure, evaluation, and lessons learned that will be useful for other institutions considering a brief, concentrated geriatrics experience in the third year of medical school.

Developing a problem-based learning (PBL) curriculum for professionalism and scientific integrity training for biomedical graduate students.

A multidisciplinary faculty committee designed a curriculum to shape biomedical graduate students into researchers with a high commitment to professionalism and social responsibility and to provide students with tools to navigate complex, rapidly evolving academic and societal environments with a strong ethical commitment. The curriculum used problem-based learning (PBL), because it is active and learner-centred and focuses on skill and process development. Two courses were developed: Scientific Professionalism: Scientific Integrity addressed discipline-specific and broad professional norms and obligations for the ethical practice of science and responsible conduct of research (RCR). Scientific Professionalism: Bioethics and Social Responsibility focused on current ethical and bioethical issues within the scientific profession, and implications of research for society. Each small-group session examined case scenarios that included: (1) learning objectives for professional norms and obligations; (2) key ethical issues and philosophies within each topic area; (3) one or more of the RCR instructional areas; and (4) at least one type of moral reflection. Cases emphasised professional standards, obligations and underlying philosophies for the ethical practice of science, competing interests of stakeholders and oversight of science (internal and external). To our knowledge, this is the first use of a longitudinal, multi-semester PBL course to teach scientific integrity and professionalism. Both faculty and students endorsed the active learning approach for these topics, in contrast to a compliance-based approach that emphasises learning rules and regulations.

Problem-based learning for professionalism and scientific integrity training of biomedical graduate students: process evaluation.

OBJECTIVE: We conducted a process evaluation to (a) assess the effectiveness of a new problem-based learning curriculum designed to teach professionalism and scientific integrity to biomedical graduate students and (b) modify the course to enhance its relevance and effectiveness. The content presented realistic cases and issues in the practice of science, to promote skill development and to acculturate students to professional norms of science. METHOD: We used 5-step Likert-scaled questions, open-ended questions, and interviews of students and facilitators to assess curricular effectiveness. RESULTS: Both facilitators and students perceived course objectives were achieved. For example, respondents preferred active learning over lectures; both faculty and students perceived that the curriculum increased their understanding of norms, role obligations and responsibilities of professional scientists. They also reported an increased ability to identify ethical situations and felt that they had developed skills in moral reasoning and effective group work. CONCLUSIONS: These data helped to improve course implementation and instructional material. For example, to correct a negative perception that this was an 'ethics' course, we redesigned case debriefing activities to reinforce learning objectives and important skills. We refined cases to be more engaging and relevant for students, and gave facilitators more specific training and resources for each case. The problem-based learning small group strategy can stimulate an environment whereby participants are more aware of ethical implications of science, and increase their socialisation and open communication about professional behaviour.

Impacting student anxiety for the USMLE Step 1 through process-oriented preparation.

BACKGROUND: Standardized examinations are the key components of medical education. The USMLE Step 1 is the first of these important milestones. Success on this examination requires both content competency and efficient strategies for study and review. Students employ a wide variety of techniques in studying for this examination, with heavy reliance on personal study habits and advice from other students. Nevertheless, few medical curricula formally address these strategies. METHODS: In response to student-generated critique at our institution, a five-part seminar series on process-oriented preparation was developed and implemented to address such concerns. The series focused on early guidance and preparation strategies for Step 1 and the many other important challenges in medical school. Emphasis was placed on facilitating conversation and mentorship opportunities between students. RESULTS & CONCLUSIONS: A profoundly positive experience was reported by our medical students that included a decreased anxiety level for the Step 1 examination.

Development of an asset map of medical education research activity.

INTRODUCTION: Medical education research is gaining recognition as scholarship within academic medical centers. This survey was conducted at a medium-sized academic medical center in the United States. The purpose of the study was to learn faculty interest in research in medical education, so assets could be used to develop educational scholarship further. METHODS: A cross-sectional study design was used to survey faculty activity and interest in medical education research at Wake Forest University School of Medicine (WFUSM). RESULTS: Overall response rate was 31% (263 out of 855) of faculty. Over half (60%) indicated interest in education research with 18% of the respondents currently involved in education research. If faculty were aware that education scholarship can lead to advancement, they were more likely to be involved in conducting such research ( p < 0.01). A total of 22% did not understand what was meant by education research and 17% had no interest in education research. DISCUSSION: Interest in medical education research and scholarship is evident at WFUSM. Experience in conducting education research and understanding of the nature of this type of research have not yet been fully developed. There appears to be a core set of faculty interested in conducting education research who may serve as a resource for faculty development in future medical education scholarship.