A survey of student assessment in U.S. medical schools: the balance of breadth versus fidelity.

BACKGROUND: Faced with the challenge to develop models of assessment relevant to work of physicians, medical schools have broadened their assessment of medical student competency. PURPOSE: U.S. medical schools were surveyed to determine the extent to which student assessments have broadened beyond multiple-choice question (MCQ) examinations and preceptor ratings. METHODS: A survey mailed to 126 accredited U.S. medical schools asked respondents to indicate the frequency with which a variety of assessment methods were used in each year of the curriculum. RESULTS: Examinations dominated preclinical assessments. Year 3 relied heavily on faculty ratings, live observations, and MCQs. Preceptor ratings were used most in year 4. CONCLUSIONS: A variety of competency assessments currently are used; MCQs remain a core assessment method. Year 3 had the greatest breadth of assessment strategies. The findings suggest that educators continue to be challenged to balance the breadth of competencies sampled with the fidelity of the assessment experience.

The emperor's new clothes: the OSCE reassessed.

In response to increasing concerns about the prevalence of knowledge- based assessments of medical student competency, leaders in medical education have emphasized the importance of methods that quantify student performance. As a result, the use of objective structured clinical examinations (OSCEs) is viewed by many as the newest and most promising technique for assessing students' abilities. In considering the implementation of a fourth-year OSCE, faculty at the College of Human Medicine at Michigan State University became uncomfortable with some of the technical limitations of the method (limited generalizability; weak linkages to the curriculum; little opportunity provided for improvement in examinees' skills; and others), as well as the possible ramifications of such an innovation within their school's specific curricular and organizational contexts. This essay is offered as a reflection of the challenges and possible alternatives that have emerged as the faculty have considered how best to design and implement performance-based assessment within their institution. Rather than using the OSCE as a milestone marker of student performance, they consider the possibility of smaller assessment events, closely tied to the curriculum and consistent with the guiding principles of the medical school.

Efficacy of a one-month training block in psychosocial medicine for residents: a controlled study.

STUDY OBJECTIVE: To determine the efficacy of a comprehensive, one-month psychosocial training program for first-year medical residents. DESIGN: Nonrandomized, controlled study with immediate pre/post evaluation. Limited evaluation of some residents was also conducted an average of 15 months after teaching. SETTING: Community-based, primary care-oriented residency program at Michigan State University (MSU). SUBJECTS: All 28 interns from the single-track MSU residency program during 1986/87-88/89 participated in this required rotation; there was no dropout or instance of noncompliance with the study. In the follow-up study in 1989, all 13 available trainees participated. Of 20 untrained, volunteer controls, ten were second/third-year residents in the same program during 1986/87 and ten were interns from a similar MSU program in Kalamazoo, MI, during 1988/89. TEACHING INTERVENTION: An experiential, skill-oriented, and learner-centered rotation with competency-based objects focused on communication and relationship-building skills and on the diagnosis and management of psychologically disturbed medical patients. MEASUREMENTS AND MAIN RESULTS: The two subsets of the control group were combined because residents and training programs were similar and because means and standard deviations for the subsets were similar on all measures. By two-way analyses of variance (group x gender), the trainee group showed significantly greater gains (p less than 0.001) on questionnaires addressing knowledge, self-assessment, and attitudes; a mean of 15 months following training, there was no significant deterioration of attitude scores. All trainees were also able to identify previously unrecognized, potentially deleterious personal responses using a systematic rating procedure. Residents' acceptance of the program was high. CONCLUSIONS: Intensive, comprehensive psychosocial training was well accepted by residents. It improved their knowledge, self-awareness, self-assessment, and attitudes, the latter improvement persisting well beyond training.

The patient's story: integrating the patient- and physician-centered approaches to interviewing.

Patients produce biopsychosocial stories that integrate material from the medical and personal aspects of their lives. Capturing the personal aspect of the story requires that a patient-centered approach to clinical interviewing complement the equally important physician-centered approach. Patient-centered interviewing actively involves the patient and ensures that his or her perceptions, needs, and concerns are articulated during the physician-patient interaction. In our article, we define patient-centered interviewing and provide a rationale for using it. We also describe how patient-centered interviewing is done, how it is integrated with the physician-centered approach, and how to understand the product of this complementary approach to clinical interviewing, the patient's biopsychosocial story.

Residents' attitudes towards and skills in counseling: using undetected standardized patients.

OBJECTIVE: To identify the frequency and quality of certain prevention-oriented counseling skills of resident physicians and to compare these skills with the residents' attitudes towards and knowledge about primary prevention. DESIGN: Longitudinal descriptive study. PATIENTS/PARTICIPANTS: 54 PGY-1-3 internal medicine and family practice residents enrolled in three training programs affiliated with Michigan State University's College of Human Medicine. INTERVENTION: Trainees' attitudes towards and knowledge about certain prevention activities were captured by an instrument designed for this study using 127 Likert scales. Counseling skills were assessed with one of two standardized patients. Residents were unaware of the simulation, which occurred in their routinely scheduled ambulatory care setting. Audiotapes of the interactions were rated by blinded, independent raters. Residents had strong positive beliefs about the role of primary care physicians in counseling patients, high levels of knowledge about what the counseling should entail, and high self-assessment about the frequency and quality of their own counseling interventions. Skill levels, however, were at or below a level defined as minimally acceptable. CONCLUSION: Resident physicians' skill levels, as measured in this study, are inadequate to accomplish routine counseling interventions in the primary care setting. These results suggest that more reliance should be placed on direct observation of physicians, ideally in nonreactive settings, for purposes of drawing conclusions about physician performance. Further, these results have implications for the training of students and residents in the area of counseling for prevention.

Facilitating patient participation: the doctor-patient encounter.

Our purpose in undertaking this review has been to extract from the literature behavioral prescriptions for physicians and strategies for prevention. We have demonstrated that the physician who wishes to be a successful counselor needs to ensure that the patient knows what to do, work toward patient commitment to behavior change, negotiate and tailor the specifics of the treatment, and be a warm, attentive interviewer who provides support to patients by attending to emotional responses as they arise. We have suggested ways that the encounter can be embedded in a functioning primary care organization where other members of the team are involved, and where follow-up mobilization of social support and the systematic application of behavioral techniques can achieve permanent behavior change.

Deben tratarse las extrasistoles ventriculares asintomaticas? / Should the nonsyntomatic ventricular extrasystoles be treated?

Los complejos ventriculares prematuros, mas conocidos por el nombre de extrasistoles ventriculares, son las mas corrientes de las disritmias que se dan, tanto en el hombre sano como en el enfermo

A course component to teach interviewing skills in informing and motivating patients.

In the present study, the authors implemented and evaluated a course component to teach three types of interviewing skills: giving information to patients, handling emotions on the part of patients, and motivating patients. The authors developed a seven-week course for second-year students that included identification and demonstration of explicit interviewing skills, practice with simulated patients, and feedback in a small-group setting. Thirty of the 104 students in the course were randomly selected for evaluation before and after the course. They showed statistically significant increases in their interviewing skills, based on ratings of videotaped interviews with simulated patients after the course, but did not change significantly in self-assessment of their level of confidence in aspects of conducting the interviews.

Women's and physicians' utilities for health outcomes in estrogen replacement therapy.

Estrogen replacement therapy (ERT) prevents fractures and relieves vasomotor symptoms, but it increases the risk of endometrial cancer. Previous studies and national prescribing patterns show that physicians are conservative in their approach to this therapy. The authors interviewed physicians and perimenopausal women to assess their utilities for the various health outcomes of estrogen replacement therapy. On all outcomes, physicians rated illness episodes followed by recovery as being closer to perfect health than did perimenopausal women. Physicians, in judging which outcomes were most important to women, estimated relief of symptoms above fracture prevention, whereas women rated fracture prevention above symptom relief. These results emphasize the need to assess patients' utilities directly, particularly when utilities for the outcome of a particular therapy may influence the choice of a therapeutic regimen.

Self-poisoning: outcome and complications in the community hospital.

One hundred sixty cases of self-poisoning of patients aged 15 years and older were treated on the wards of the four community hospitals of Lansing, Michigan, in 1981. Most cases (91 percent) were intentional and represented suicide attempts. The complication rate was 13.8 percent and the overdose-related mortality rate 0.6 percent. Aspiration pneumonia was the most common complication, followed by respiratory failure and seizures. No patient with a level of consciousness stage 0 or 1 in the emergency room had a major overdose-related complication with permanent sequelae, and this group represented 80 percent of the cases. One possible guideline for managing the self-poisoner is level of consciousness in the emergency room.

Comparison of physicians' decisions regarding estrogen replacement therapy for menopausal women and decisions derived from a decision analytic model.

Decisions regarding estrogen replacement therapy were obtained from 50 physicians for 12 cases representing menopausal women with systematically varying levels of cancer risk, fracture risk, and symptom severity. Their decisions were compared with a decision analytic model for which each physician provided needed quantities--subjective probabilities, utilities of various outcomes, and weightings of the importance of the outcome categories. The majority of observed decisions were not to treat. By contrast, the decision analysis based on physician-provided estimates indicated that the optimal strategy was either to treat or a toss-up. Sensitivity analysis showed that these conclusions would hold over all possible utilities, over all plausible probabilities of cancer, and so long as symptom relief and fracture prevention were also considered as treatment objectives. The increased probability of early detection of cancer by regular follow-up was systematically incorporated into the decision analysis but apparently neglected in unaided clinical judgment, which follows the principle of minimizing the most important risk, regardless of its probability.

Physicians' judgments about estrogen replacement therapy for menopausal women.

A study was undertaken to determine how physicians decide when to prescribe estrogen. Twenty-five gynecologists and 25 family physicians responded to case histories and a questionnaire regarding estrogen administration. There was no difference in mean probability of prescribing, 0.42 for gynecologists and 0.40 for family physicians. Endometrial cancer risk and vasomotor symptom severity were significant factors in prescribing judgments; osteoporosis risk and current treatment status were not. In linear regression analysis the constant, not factor weights, were significantly related to each physician's overall likelihood of prescribing and to the individual's self-characterization as prescriber or nonprescriber. Most physicians indicated that estrogen reduces fracture risk, and that progestin reduces cancer risk. Physicians' responses to cases were not consistent with these stated beliefs about estrogen effects.

Asymptomatic ventricular ectopy. To treat or not to treat?

Ventricular ectopy that is bothersome to the patient warrants treatment, but the asymptomatic cases present the physician with a dilemma of whether or not treatment is justified. In patients free of organic heart disease, antiarrhythmic therapy does not appear to be necessary. Post myocardial infarction (MI) patients should be considered for beta-blocker therapy regardless of the presence of ventricular ectopy. In the post-MI patient with risk factors for sudden death, treatment of complex dysrhythmia may be warranted, despite the lack of documented benefit.