Psychiatry Clinical Skills Evaluation: a Multisite Study of Validity.

OBJECTIVE: Since 2007, the American Board of Psychiatry and Neurology (ABPN) has required that residency programs conduct a specific clinical skills evaluation (CSE) of physician-patient interaction, psychiatric interview and mental status examination, and case presentation on a directly observed patient interview as a prerequisite for certification. The authors examined a multisite database of CSE assessments to investigate the validity of the evaluation. METHODS: The authors collected 1156 CSE assessments from 4 residency programs conducted over a 6-year period, compared scoring patterns among the programs, score improvement over 4 years of residency, time and number of CSEs required to meet ABPN requirements, and patterns of scoring for individual faculty evaluators. RESULTS: The distribution of scores within each of the 4 programs showed similar, but nonidentical patterns. The number of CSEs required to meet the ABPN standards (3.5) and the point in training at which this was completed (late PGY-2) were the same in all programs. CSE scores were highly correlated with year of training but were not correlated with performance on an unrelated cognitive examination. Individual faculty members tended to stay within a moderate range of scores over multiple residents, partially attributable to year of training. CONCLUSIONS: Taken together, these findings support the validity of the CSE as a measure of residents' clinical skills in the specified areas and demonstrate a moderate-high degree of consistency in the scoring of the CSE across these 4 programs.

Mental Health During Residency Training: Assessing the Barriers to Seeking Care.

OBJECTIVES: Resident and fellow physicians are at elevated risk for developing depression compared to the general population; however, they are also less likely to utilize mental health services. We sought to identify the barriers to seeking mental health treatment among residents across all specialties at a large academic medical center in Chicago, IL. METHODS: Residents and fellows from all programs were asked to complete an anonymous self-report questionnaire. RESULTS: Of the 18% of residents and fellows that completed the survey, 61% felt they would have benefited from psychiatric services. Only 24% of those who felt they needed care actually sought treatment. The most commonly reported barriers to seeking care were lack of time (77%), concerns about confidentiality (67%), concerns about what others would think (58%), cost (56%), and concern for effect on one's ability to obtain licensure (50%). CONCLUSIONS: Despite feeling that they require mental health services, few trainees actually sought care. This study identifies an overall need for improved access to mental health providers and psychoeducation for medical housestaff.

Helping psychiatry residents cope with patient suicide.

OBJECTIVE: Every clinical specialty has its own high risk patient challenges that threaten to undermine their trainees' professional identity, evolving sense of competence. In psychiatric training, it is patient suicide, an all-too frequently encountered consequence of severe mental illness that may leave the treating resident perplexed, guilt-ridden, and uncertain of their suitability for the profession. This study evaluates a patient suicide training program aimed at educating residents about patient suicide, common reactions, and steps to attenuate emotional distress while facilitating learning. METHODS: The intervention was selected aspects of a patient suicide educational program, "Collateral Damages,"-video vignettes, focused discussions, and a patient-based learning exercise. Pre- and post-survey results were compared to assess both knowledge and attitudes resulting from this educational program. Eight psychiatry residency training programs participated in the study, and 167 of a possible 240 trainees (response rate = 69.58 %) completed pre- and post-surveys. RESULTS: Knowledge of issues related to patient suicide increased after the program. Participants reported increased awareness of the common feelings physicians and trainees often experience after a patient suicide, of recommended "next" steps, available support systems, required documentation, and the role played by risk management. CONCLUSIONS: This patient suicide educational program increased awareness of issues related to patient suicide and shows promise as a useful and long overdue educational program in residency training. It will be useful to learn whether this program enhances patient care or coping with actual patient suicide. Similar programs might be useful for other specialties.

Teaching evidence-based approaches to suicide risk assessment and prevention that enhance psychiatric training.

This report describes one in a series of National Institute of Health (NIH) supported conferences aimed at enhancing the ability of leaders of psychiatry residency training to teach research literacy and produce both clinician-scholars and physician-scientists in their home programs. Most psychiatry training directors would not consider themselves research scholars or even well-schooled in evidence based practice. Yet they are the front line educators to prepare tomorrow's psychiatrists to keep up with, critically evaluate, and in some cases actually participate in the discovery of new and emerging psychiatric knowledge. This annual conference is meant to help psychiatry training directors become more enthusiastic, knowledgeable and pedagogically prepared to create research-friendly environments at their home institutions, so that more trainees will, in turn, become research literate, practice evidence-based psychiatry, and enter research fellowships and careers. The overall design of each year's meeting is a series of plenary sessions introducing participants to new information pertaining to the core theme of that year's meeting, integrated with highly interactive small group teaching sessions designed to consolidate knowledge and provide pragmatic teaching tools appropriate for residents at various levels of training. The theme of each meeting, selected to be a compelling and contemporary clinical problem, serves as a vehicle to capture training directors' attention while teaching relevant brain science, research literacy and effective pedagogy. This report describes the content and assessment of the 2011 annual pre-meeting, "Evidence-based Approaches to Suicide Risk Assessment and Prevention: Insights from the Neurosciences and Behavioral Sciences for use in Psychiatry Residency Training."

The effect of an end-of-clerkship review session on NBME psychiatry subject exam scores.

OBJECTIVE: The NBME Psychiatry Subject Examination (PSE) is used throughout North America to test MS-III end-of-clerkship knowledge; yet, literature on PSE preparatory methods remains sparse. This study assesses the effect of a curriculum intervention on NBME PSE scores. METHOD: An optional 1.5-hour review session and accompanying fill-in-the-blank handout was offered to 62 MS-III students 3 days before their exam. Students who did not attend the session were e-mailed the handout with completed answers. The primary outcome measure was a change in scores, with students in the previous year serving as the control group. RESULTS: The average raw PSE score of students offered the review session was 84.53, versus 77.15 for matched controls (p <0.0001). The effect size for the intervention was 0.89. CONCLUSION: This study may suggest that offering a comprehensive review session to third-year medical students 3 days before their NBME PSE significantly improves their scores.

Clinical skills verification in general psychiatry: recommendations of the ABPN Task Force on Rater Training.

OBJECTIVE: The American Board of Psychiatry and Neurology (ABPN) announced in 2007 that general psychiatry training programs must conduct clinical skills verification (CSV), consisting of observed clinical interviews and case presentations during residency, as one requirement to establish graduates' eligibility to sit for the written certification examination. To facilitate implementation of these requirements, the ABPN convened a task force to prepare training materials for faculty and programs to guide them in the CSV process. This article reviews the specific requirements for the CSV experience within general residency programs, and briefly describes the recommendations of the task force for faculty training and program implementation. METHODS: Materials prepared by the ABPN Task Force include background information on the intent of the observed interview, a literature review on assessment methods, aids to train faculty in direct observation of clinical work, directions for effective feedback, notes regarding special issues for cross-cultural trainees, clarification of performance standards, and recommendations for structuring and conducting the assessments. RESULTS: Recommendations of the task force include the use of a variety of clinical settings for CSV assessments, flexibility in the duration of CSV interviews, use of formative and summative feedback after each CSV assessment, and frequent use of the CSV across all years of training. Formal faculty training is recommended to help establish performance parameters, increase interrater reliability, and improve the quality of feedback. CONCLUSIONS: The implementation of the CSV process provides psychiatry training programs with an excellent opportunity to assess how interviewing skills are taught and evaluated. In the process, psychiatry educators have an opportunity to establish performance parameters that will guide the training of residents in patient interaction and evaluation.

What Sustains Residency Program Directors: Social and Interpersonal Factors That Foster Recruitment and Support Retention.

Residency program directors' careers follow several trajectories. For many, the role is relatively short term, lasting 3 to 5 years, during which time the program director may gain educational and administrative experience. However, a sizeable cohort of program directors have remained as program directors for a decade or more, and some have filled the role for the majority of their careers. Over the years, the role of the academic residency program director has become increasingly affected by administrative responsibilities, including scheduling, documentation, and reporting requirements, along with increasing clinical demands that may conflict with ensuring resident wellness and lead to insufficient time to do the job. Burnout in this role is understandable. Given these obstacles, why should any young faculty member choose to become a training director? The authors of this commentary have each served as a residency program director for decades, aggregating approximately 150 years of program director experiences. Based on their collective reflections, the authors describe social and interpersonal aspects of the program director role that have enhanced their professional satisfaction and well-being. These include overseeing residency cycle events from initial interviews through graduation and certification; assuming leadership and social roles in academic departments; counseling, mentoring, and assisting residents with work-personal life difficulties; and helping trainees and programs weather a variety of traumatic circumstances. These life-enriching experiences can compensate for the challenging aspects of these roles and sustain program directors through exceptionally rewarding careers.

An Article-Based Format for Medical Specialty and Subspecialty Maintenance of Certification.

INTRODUCTION: This article describes an article-based alternative for maintenance of certification that the American Board of Psychiatry and Neurology developed and began pilot testing in 2019. The rationale for and components of the pilot program are presented along with data on participant performance and feedback from the first year of implementation in three primary specialties (neurology, child neurology, and psychiatry) and one subspecialty (child and adolescent psychiatry). METHODS: Evaluation of the pilot program was guided by a widely used validity framework. Data were collected that addressed the five categories of validity evidence: content, response process, internal structure, relation to other variables, and consequences. RESULTS: Enrollment ranged from 66.7% for psychiatrists to 75.3% for child neurologists. For the 2019 cohort, the pass rates ranged from 92.6% for child and adolescent psychiatry to 98.7% for neurology, and very small numbers of diplomates failed or did not complete the process. For psychiatrists, there was a modest, but significant, relationship between performance on previous and subsequent maintenance of certification examinations. Ninety percent or more agreed that: the articles were easy to access and helpful to their practices; the mini-tests were a fair assessment of their understanding of the articles; and their test-taking experience was satisfactory. DISCUSSION: Most eligible diplomates participated in the article-based pilot project, and they strongly preferred this format to the traditional multiple-choice examinations. Most important, the pilot was perceived to be a meaningful and relevant learning activity that had a positive effect on patient care.

Lifelong Learning in Psychiatry and the Role of Certification.

In the early twentieth century, the medical profession focused on the development of specialties and specialty/subspecialty training. Parallel to this development was the establishment of certifying boards, which can evaluate and attest to a physician's mastery of a set of knowledge and skills; the goal is to provide assurance to patients and the public of a certain guarantee of quality of care. In the early decades of "board certification," the examination was a one-time, relatively high-stakes process that assessed knowledge, and often certain skills and clinical reasoning.

The American Psychiatric Association Practice Guideline for the Treatment of Patients With Schizophrenia.

(Reprinted with permission from The American Journal of Psychiatry 2020; 177:868-872).

Encountering Patient Suicide: A Resident's Experience.

OBJECTIVE: The authors reviewed the current literature for psychiatry residents' reactions to the suicide of a patient. This review also examines the responses of training programs to residents after such an incident. METHOD: Using Ovid Medline, the authors conducted a review of the scientific literature from 1966 to 2006, with search phrases consisting of: "patient suicide," "residency training programs," "psychiatry residents," and "therapists-in-training." RESULTS: There are a limited number of studies exploring residents' experiences following a patient suicide. Furthermore, only two studies examined the supportive measures that U.S. psychiatry training programs provide for residents afterwards. The few studies published suggest that the suicide of a patient is quite common during training and that residents undergo significant levels of psychological stress. Residency programs have yet to establish formal training and support systems to help trainees deal with these stressors. CONCLUSIONS: The findings from this review support further investigation into the effects of patient suicide on residents and the implementation of formal supports within psychiatry training.