Predictive value of letters of recommendation vs questionnaires for emergency medicine resident performance.

OBJECTIVE: To evaluate the predictive value of standard letters of recommendation (LORs) vs preprinted questionnaires (PPQs) for resident performance at one emergency medicine (EM) residency program. METHODS: A retrospective association of LORs and PPQs with in-training residents performance ratings was done at one EM residency program. The residency application files of EM residents who completed the program were reviewed to locate files that had LORs and PPQs written by the same author. Seventeen resident files contained 32 LOR/PPQ pairs. These LORs and PPQs were submitted in a blinded fashion to 3 outside EM residency directors. Each LOR and PPQ was evaluated for the applicant's suitability for the specialty of EM, medical knowledge, procedural skills, interpersonal skills, motivation, and overall rank. The scores given by the outside reviewers were compared with resident performance ratings determined by 5 EM attending physicians who evaluated the residents along the same 6 dimensional ratings. RESULTS: Statistically, no differences were found between the LORs and PPQs in predicting resident performance. CONCLUSIONS: PPQs may substitute for LORs in the evaluation of resident applicants.

Paramedic diagnostic accuracy for patients complaining of chest pain or shortness of breath.

INTRODUCTION: A multitude of life-threatening and nonlife-threatening processes cause chest pain and shortness of breath. Prehospital therapy for these patients may be lifesaving and includes pharmacologic interventions, as well as invasive procedures. Appropriate therapy depends on the diagnostic skills of the paramedic. OBJECTIVE: This study was undertaken to determine the accuracy of the paramedic diagnosis in patients transported with a chief complaint of pain or shortness of breath. SETTING: Multihospital, one large municipal hospital, one community hospital. DESIGN: Prospective, cross-sectional study. Paramedics evaluated the patient and then completed a standard form indicating the diagnosis. The paramedic's and final emergency physician's diagnoses were compared to assess the accuracy of the paramedic diagnosis. POPULATION: All patients who complained of chest pain or shortness of breath, transported to the study centers by the city of Denver paramedics, were eligible for the study. Ninety-nine of the 102 patients enrolled had complete records for analysis and were entered into the study. RESULTS: Diagnostic concordance data were analyzed by organ system (e.g., cardiac, pulmonary, etc.) and for specific diagnoses using the kappa statistic and McNemar's chi-square analysis for discordant pairs. Using the kappa statistic, there was statistically significant concordance between the paramedic and emergency-physician diagnosis for cardiac (p = 0.0001; kappa value = 0.54) and pulmonary organ systems (p = 0.0001; kappa value = 0.61). Overall, for organ system diagnosis, the paramedics had an 82% accuracy (p = 0.05) rating. For specific cardiac and pulmonary diagnosis, paramedics had good concordance with emergency physicians. CONCLUSIONS: Overall, paramedics have excellent diagnostic agreement with emergency-physician diagnosis by organ system. They retained good agreement on specific cardiac diagnoses and pulmonary diagnosis.