The impact on medical practice of commitments to change following CME lectures: a randomized controlled trial.

BACKGROUND: Self-reported commitment to change (CTC) could be a potentially valuable method to address the need for continuing medical education (CME) to demonstrate clinical outcomes. AIM: This study determines: (1) are clinicians who make CTCs more likely to report changes in their medical practices and (2) do these changes persist over time? METHODS: Intervention participants (N = 80) selected up to three commitments from a predefined list following the lecture, while control participants (N = 64) generated up to three commitments at 7 days post-lecture. At 7 and 30 days post-lecture, participants were queried if any practice change occurred as a result of attending the lecture. RESULTS: About 91% of the intervention group reported practice changes consistent with their commitments at 7 days. Only 32% in the control group reported changes (z = 7.32, p < 0.001). At 30 days, more participants in the intervention group relative to the control group reported change (58% vs. 22%, z = 3.74, p < 0.01). Once a participant from either group made a commitment, there were no differences in reported changes (63% vs. 67%, z = <0.00, p = 0.38). CONCLUSION: Integration of CTC is an effective method of reinforcing learning and measuring outcomes.

The Family Medicine Curriculum Resource Project: implications for faculty development.

Faculty development implications related to implementing the Family Medicine Curriculum Resource (FMCR) Project provide an opportunity to look at the recommendations of the Society of Teachers of Family Medicine's federally funded Faculty Futures Initiative (FFI) and the recent Future of Family Medicine (FFM) project. Implications for faculty development include the importance of the clerkship setting, originally defined in 1991, with new features added in today's practice environment as outlined by the FFM and the changing assumptions in approaching faculty development. Previously, faculty development focused on teaching learners to master current knowledge. Now, faculty must teach learners how to master new competencies throughout their lives; learners need to learn how they and others learn now. Teaching must focus on how to learn in the future as well as what to learn for the present. Competence ("what individuals know or are able to do in terms of knowledge, skills, and attitudes") has become the focus of curriculum development efforts over the last few years and most appropriately serves as the focus of curriculum development in the FMCR Project. Implications for developing teachers and preceptors focus on the skills and circumstances required to teach and evaluate all types (cognitive, metacognitive, and affective) of competence. In the new culture, novel teaching methods will serve as the focus of faculty development in teaching and of educational ("best practices") research.

Factors influencing preceptors' responses to medical errors: a factorial survey.

BACKGROUND: Preceptors must respond to trainees' medical errors, but little is known about what factors influence their responses. METHOD: A total of 115 primary care preceptors from 16 medical schools responded to two medical error vignettes involving a trainee. Nine trainee-related factors were randomly varied. Preceptors indicated whether they would discuss what led to the error, provide reassurance, share responsibility, express disappointment, and adjust their written evaluation of the trainee. RESULTS: Almost all preceptors would discuss what led to the error; relatively few would express disappointment. The trainee's prior history of errors, knowledge level relative to peers, receptivity to feedback, training level, emotional reaction, offering to apologize, and offering an excuse were predictive of preceptors' responses; gender and time-in-office were not. CONCLUSION: This study identified seven trainee-related factors as predictive of preceptors' responses to medical errors. More research is needed to identify other influential factors, and to improve teaching from medical errors.

Primary care renewal: regional faculty development and organizational change.

BACKGROUND: Many reports, including the Future of Family Medicine, have called for change in primary care, but few have defined, implemented, and evaluated mechanisms to address such change. The regional, interdisciplinary Primary Care Renewal Project was designed to address problems in primary care practice and teaching related to practice management, compensation, increasing responsibility for teaching, and faculty development. METHODS: Twelve northeastern US medical schools assembled a conference attended by teams of key stakeholders representing both clinical and educational missions. Teams developed and implemented an institutional plan to address identified needs. Outcome data was collected during, and for 1 year after, the conference. RESULTS: Findings demonstrate novel ways of improving learning experiences, coordinating and centralizing planning efforts, and addressing faculty needs. The magnitude of organizational change ranged from establishing new administrative units with significant institutional authority (eg, restructuring dean's office) to enhancing the strategic planning process and refining mission statements to reflect emphasis on primary care. CONCLUSIONS: A well-planned, regional interdisciplinary effort that fosters the development of concrete plans can be associated with significant change in medical education. A central theme emerged--that primary care medicine will survive only if institutions align their educational and clinical missions and foster system-wide change.

Transforming the culture of surgical education: promoting teacher identity through human factors training.

CONTEXT: Promoting a culture of teaching may encourage students to choose a surgical career. Teaching in a human factors (HF) curriculum, the nontechnical skills of surgery, is associated with surgeons' stronger identity as teachers and with clinical students' improved perception of surgery and satisfaction with the clerkship experience. OBJECTIVE: To describe the effects of an HF curriculum on teaching culture in surgery. DESIGN, SETTING, PARTICIPANTS, AND INTERVENTION: Surgeons and educators developed an HF curriculum including communication, teamwork, and work-life balance. MAIN OUTCOME MEASURES: Teacher identity, student interest in a surgical career, student perception of the HF curriculum, and teaching awards. RESULTS: Ninety-two of 123 faculty and residents in a single program (75% of total) completed a survey on teacher identity. Fifteen of the participants were teachers of HF. Teachers of HF scored higher than control participants on the total score for teacher identity (P < .001) and for subcategories of global teacher identity (P = .001), intrinsic satisfaction (P = .001), skills and knowledge (P = .006), belonging to a group of teachers (P < .001), feeling a responsibility to teach (P = .008), receiving rewards (P =.01), and HF (P = .02). Third-year clerks indicated that they were more likely to select surgery as their career after the clerkship and rated the curriculum higher when it was taught by surgeons than when taught by educators. Of the teaching awards presented to surgeons during HF years, 100% of those awarded to attending physicians and 80% of those awarded to residents went to teachers of HF. CONCLUSION: Curricular focus on HF can strengthen teacher identity, improve teacher evaluations, and promote surgery as a career choice.

The video-based test of communication skills: description, development, and preliminary findings.

BACKGROUND: The importance of assessing physician-patient communication skills is widely recognized, but assessment methods are limited. Objective structured clinical examinations are time-consuming and resource intensive. For practicing physicians, patient surveys may be useful, but these also require substantial resources. Clearly, it would be advantageous to develop alternative or supplemental methods for assessing communication skills of medical students, residents, and physicians. DESCRIPTION: The Video-based Test of Communication Skills (VTCS) is an innovative, computer-administered test, consisting of 20 very short video vignettes. In each vignette, a patient makes a statement or asks a question. The examinee responds verbally, as if it was a real encounter and he or she were the physician. Responses are recorded for later scoring. Test administration takes approximately 1 h. EVALUATION: Generalizability studies were conducted, and scores for two groups of physicians predicted to differ in their communication skills were compared. Preliminary results are encouraging; the estimated g coefficient for the communication score for 20-vignette test (scored by five raters) is 0.79; g for the personal/affective score under the same conditions is 0.62. Differences between physicians were in the predicted direction, with physicians considered "at risk" for communication difficulties scoring lower than those not so identified. CONCLUSIONS: The VTCS is a short, portable test of communication skills. Results reported here suggest that scores reflect differences in skill levels and are generalizable. However, these findings are based on very small sample sizes and must be considered preliminary. Additional work is required before it will be possible to argue confidently that this test in particular, and this approach to testing communication skills in general, is valuable and likely to make a substantial contribution to assessment in medical education.

The relationship between checklist scores on a communication OSCE and analogue patients' perceptions of communication.

Many efforts to teach and evaluate physician-patient communication are based on two assumptions: first, that communication can be conceptualized as consisting of specific observable behaviors, and second, that physicians who exhibit certain behaviors are more effective in communicating with patients. These assumptions are usually implicit, and are seldom tested. The purpose of this study was to investigate whether specific communication behaviors are positively related to patients' perceptions of effective communication. Trained raters used a checklist to record the presence or absence of specific communication behaviors in 100 encounters in a communication Objective Structured Clinical Examination (OSCE). Lay volunteers served as analogue patients and rated communication during each encounter. Correlations between checklist scores and analogue patients' ratings were not significantly different from zero for four of five OSCE cases studied. Within each case, certain communication behaviors did appear to be related to patients' ratings, but the critical behaviors were not consistent across cases. We conclude that scores from OSCE communication checklists may not predict patients' perceptions of communication. Determinants of patient perceptions of physician communication may be more subtle, more complex, and more case-specific than we were able to capture with the current checklist.

Teaching and medical errors: primary care preceptors' views.

PURPOSE: To assess primary care preceptors' perceptions of the issues involved in teaching when medical errors occur. In particular, we examined preceptors' responses to trainees involved in medical errors, factors influencing their response, and their perceptions of barriers to teaching from medical errors. METHODS: A total of 38 primary care preceptors participated in 7 focus groups on teaching and medical errors. Participants were drawn from medical schools throughout the northeastern USA. Content analysis of transcripts identified major themes. RESULTS: We developed a framework describing how preceptors and learners respond to medical errors, the factors that influence these responses, and the relationships between these. We also identified barriers to teaching from medical errors. Preceptors are especially sensitive to learners' distress as a result of errors. Emotional distress and self-doubt are seen as inimical to learning, possibly causing more attention to be directed to emotional support than to correction and instruction. At the same time, accepting responsibility for errors was seen as prerequisite to learning. For many preceptors, vivid recollections of their own errors during training were influential in determining how they in turn responded as preceptors; none reported having received training in this area. CONCLUSION: This study describes preceptors' experiences of responding to trainees' medical errors, and identifies barriers to teaching from errors. The intersection of patient safety and medical education is a critical area for future research. We propose a framework that may help guide future research efforts, which should focus on identifying factors that promote faculty development to optimise learning and reduce the likelihood of future errors.