Value of General Medical Knowledge Examinations in Performance Assessment of Practicing Physicians With Potential Competence and Performance Deficiencies.

INTRODUCTION: Problems with a physician's performance may arise at any point during their career. As such, there is a need for effective, valid tools and processes to accurately assess and identify deficiencies in competence or performance. Although scores on multiple-choice questions have been shown to be predictive of some aspects of physician performance in practicing physicians, their relationship to overall clinical competence is somewhat uncertain particularly after the first 10 years of practice. As such, the purpose of this study was to examine how a general medical knowledge multiple-choice question examination is associated with a comprehensive assessment of competence and performance in experienced practicing physicians with potential competence and performance deficiencies. METHODS: The study included 233 physicians, of varying specialties, assessed by the University of California, San Diego Physician Assessment and Clinical Education Program (PACE), between 2008 and 2012, who completed the Post-Licensure Assessment System Mechanisms of Disease (MoD) examination. Logistic regression determined if the examination score significantly predicted passing assessment outcome after correcting for gender, international medical graduate status, certification status, and age. RESULTS: Most physicians (89.7%) received an overall passing assessment outcome on the PACE assessment. The mean MoD score was 66.9% correct, with a median of 68.0%. Logistic regression (P = .038) was significant in indicating that physicians with higher MoD examination scores had an increased likelihood of achieving a passing assessment outcome (odds ratio = 1.057). DISCUSSION: Physician MoD scores are significant predictors of overall physician competence and performance as evaluated by PACE assessment.

Remediation of the deficiencies of physicians across the continuum from medical school to practice: a thematic review of the literature.

Despite widespread endorsement of competency-based assessment of medical trainees and practicing physicians, methods for identifying those who are not competent and strategies for remediation of their deficits are not standardized. This literature review describes the published studies of deficit remediation at the undergraduate, graduate, and continuing medical education levels. Thirteen studies primarily describe small, single-institution efforts to remediate deficient knowledge or clinical skills of trainees or below-standard-practice performance of practicing physicians. Working from these studies and research from the learning sciences, the authors propose a model that includes multiple assessment tools for identifying deficiencies, individualized instruction, deliberate practice followed by feedback and reflection, and reassessment. The findings of the study reveal a paucity of evidence to guide best practices of remediation in medical education at all levels. There is an urgent need for multiinstitutional, outcomes-based research on strategies for remediation of less than fully competent trainees and physicians with the use of long-term follow-up to determine the impact on future performance.

Toward meeting the challenge of physician competence assessment: the University of California, San Diego Physician Assessment and Clinical Education (PACE) Program.

Physician competence and performance problems contribute to medical errors and substandard health care quality. Assessment of the clinical competence of practicing physicians, however, is challenging. Although physician competence assessment undoubtedly does take place at the local level (e.g., hospital, medical group), it is difficult to objectively assess a partner, colleague, or friend. Moreover, the methodologies used and the outcomes are necessarily veiled by peer review statutes. Consequently, there is a need for regional or national assessment centers with the knowledge, skill, and experience to perform clinical competence assessments on individual physicians and provide or direct remediation, when appropriate. The University of California, San Diego (UCSD) Physician Assessment and Clinical Education (PACE) Program was founded at the UCSD School of Medicine in 1996 for this purpose. From inception in 1996 through the first quarter of 2009, 867 physicians have participated in the UCSD PACE Program. The PACE Program is divided into two components. Phase I includes two days of multilevel, multimodal testing, and Phase II is a five-day, preceptor-based formative assessment program taking place in the residency program of the physician's specialty. From July 2002 through December 2005, a study of 298 physician participants of the UCSD PACE Program was conducted.The future of the comprehensive assessment of practicing physicians depends on (1) development and standardization of instruments, techniques, and procedures for measuring competence and performance, including in-practice measures, (2) collaborative networking of assessment programs, (3) cost control, and (4) continued development of remedial measures that correspond to assessment findings.