Exploration of failure on the subspecialty examination for child and adolescent psychiatry.

OBJECTIVE: The purposes of this study were to compare first-time performance on the oral examination for certification in child and adolescent psychiatry with first-time performance on the written and oral examinations for certification in general psychiatry and to identify factors that contribute to failure on the child and adolescent psychiatry oral examination. METHOD: To address the first question, two successive cohorts of first-time child and adolescent psychiatry candidates were identified, and chi-square analyses were used to explore the relationship between first-time performance on the different examinations. For the second question, a special checklist was developed and completed for all candidates who failed any section of the oral examination for child and adolescent psychiatry three successive times. RESULTS: There was no relationship between passing or failing the written and oral examinations for general psychiatry on the first attempt and passing or failing the child and adolescent psychiatry oral examination on the first attempt. The checklist results suggested that the failing candidates had difficulty in organizing and integrating case material. Other weaknesses were related to the specific sections of the oral examination. CONCLUSIONS: The results suggest that the knowledge and skills that are required to pass the child and adolescent psychiatry oral examination are different from those of the general psychiatry examination. The information about weaknesses should be of interest to general and child and adolescent psychiatric educators, candidates, and service delivery agencies.

Reliability of the Part II board certification examination in psychiatry: examination stability.

OBJECTIVE: The aim of this study was to examine the reliability (examination stability) of the American Board of Psychiatry and Neurology (ABPN) Part II (oral) examination in psychiatry. METHOD: The authors analyzed the consistency (agreement between grades given by two independent examiners) for a 1-year examination cycle using a weighted kappa statistic and compared different parts of the examination (live patient and videotape), different examination sites, different days, and different times of the day. RESULTS: There was no significant difference in agreement between examiners by different parts of the examination, examination site, day of the week, or time of day. CONCLUSIONS: The stability of the Part II ABPN examination in psychiatry is not influenced significantly by the format or site of administration. Candidate performance is the predominant factor in the determination of passing or failing grades.

Reliability of the Part II Board Certification Examination in Psychiatry: interexaminer consistency.

OBJECTIVE: The aim of the study was to examine the reliability (interexaminer consistency) of the American Board of Psychiatry and Neurology (ABPN) Part II (oral) examination in psychiatry. METHOD: Grades were assigned independently by two examiners who observed the same examination in a 1-year cycle (1,422 candidates, two examinations each). The consistency between these pairs of grades (pass, condition, fail) was analyzed using a weighted kappa statistic. RESULTS: There was perfect agreement between examiners in 67% of examinations, minor disagreement in 26%, and major disagreement in 7% (weighted kappa = 0.54-0.56). CONCLUSIONS: The Part II ABPN examination demonstrates fair to good reliability as measured by interexaminer consistency. Development of more explicit grading criteria should further improve examiner agreement in future examinations.

How well does the psychiatry residency in-training examination predict performance on the American Board of Psychiatry and Neurology. Part I. Examination?

OBJECTIVE: Scores on the American College of Psychiatrists' Psychiatry Residency In-Training Examination (PRITE) were correlated with scores on the American Board of Psychiatry and Neurology (ABPN) Part I examination in psychiatry. METHOD: Pearson correlations between 1992 PRITE scores and 1994 ABPN Part I psychiatry scores were calculated. Analyses were based on 701 examinees. RESULTS: There was a moderate correlation between scores on the PRITE and ABPN Part I examination in psychiatry and a low correlation of neurology scores. CONCLUSIONS: These correlations were observed even though the two examinations differ in their purposes, content outlines, development, and administration.

A cardiology patient simulator for continuing education of family physicians.

"Harvey," the cardiology patient simulator (CPS), is the result of a new type of simulation technology that allows for repetitive practice of bedside cardiology skills and provides feedback to the learner. "Harvey" is able to realistically simulate an essentially unlimited number of both common and rare cardiac disease. This report describes the use of the CPS in continuing medical education programs conducted for members of the American Academy of Family Physicians. Cardiovascular disorders constitute a significant percentage of the practice of family physicians. The CPS teaching system has great potential for helping them keep their cardiovascular diagnostic skills current and for promoting better understanding of recent advances in the diagnosis and treatment of heart disease. The participants in this study were nearly unanimous in their feeling that the CPS accurately simulates cardiology bedside findings and is a valuable teaching tool with which they would like to again be taught in the future.

Trends in American Board of Psychiatry and Neurology specialties and neurologic subspecialties.

OBJECTIVE: To review the current status and recent trends in the American Board of Psychiatry and Neurology (ABPN) specialties and neurologic subspecialties and discuss the implications of those trends for subspecialty viability. METHODS: Data on numbers of residency and fellowship programs and graduates and ABPN certification candidates and diplomates were drawn from several sources, including ABPN records, Web sites of the Accreditation Council for Graduate Medical Education and the American Medical Association, and the annual medical education issues of the Journal of the American Medical Association. RESULTS: About four-fifths of neurology graduates pursue fellowship training. While most recent neurology and child neurology graduates attempt to become certified by the ABPN, many clinical neurophysiologists elect not to do so. There appears to have been little interest in establishing fellowships in neurodevelopmental disabilities. The pass rate for fellowship graduates is equivalent to that for the "grandfathers" in clinical neurophysiology. Lower percentages of clinical neurophysiologists than specialists participate in maintenance of certification, and maintenance of certification pass rates are high. CONCLUSION: The initial enthusiastic interest in training and certification in some of the ABPN neurologic subspecialties appears to have slowed, and the long-term viability of those subspecialties will depend upon the answers to a number of complicated social, economic, and political questions in the new health care era.

Using Rasch analysis to analyze performance on patient management problems.

This study demonstrates the usefulness of applying Rasch analysis to PMPs. The item and person fit statistics provide the data necessary for determining how well items are functioning and hence how the test might be improved. The results both enhance our understanding of the trait being measured, medical problem solving, and suggest issues that faculty need to be aware of in constructing and scoring PMPs.

A factor analytic study of branching patient management problems.

This study was undertaken to determine the factor analytic structure of patient management problems (PMPs) and to determine whether such factors are stable for different groups taking the same examination and for the same group over time. Two examinations were administered to a group of medical students, the first during their junior year and the second during their senior year. The second examination was also administered to a second class of students during their junior year. Factor analyses results indicated there are two components to medical problem-solving as measured by PMPs-data gathering and management. Both factors were stable over groups and over time.

Test of a cardiology patient simulator with students in fourth-year electives.

A total of 208 fourth-year students at five medical schools participated in an evaluation of a cardiology patient simulator (CPS). One group (116 students) used the CPS during a fourth-year cardiology elective, while another group (92 students) completed a cardiology elective that did not include use of the CPS. There were no differences between the two groups on a multiple-choice test on cardiology and a skills test on the CPS at the beginning of the clerkship. After the clerkship, the students in the CPS group achieved significantly higher scores on a multiple-choice test, a skills test on the CPS, and a skills test on cardiology patients. Both the students and faculty members expressed very favorable attitudes toward the CPS, but the patients perceived no differences between the two student groups. These data demonstrate that the CPS enhances learning both the knowledge and the skills necessary to perform a bedside cardiovascular evaluation and that the skills obtained from use of the simulator are transferable to use with patients.