Evaluating the utility, reliability, and validity of a resident performance evaluation instrument.

OBJECTIVE: The primary goal of this project was to create and evaluate the utility, validity, and reliability of an instrument assessing resident performance during child and adolescent psychiatry (CAP) training. In three stages, the instrument was developed and evaluated for utility in assessing skills critical to CAP. Items on the Global Assessment Evaluation (GAE) were derived from the six core competencies identified by the American College of Graduate Medical Education (ACGME). Secondary goals included producing an instrument that could be used by other CAP training programs and describing a process that could be followed by training programs to create their own assessment instruments. METHODS: Faculty members developed a CAP resident performance evaluation instrument. In a three-stage process, faculty utilized the tool to evaluate residents during and after rotations. Statistical findings guided revisions to improve the utility and reliability of the instrument. For the final version of the GAE, intra-class correlation coefficients were calculated to assess inter-rater reliability, and Principal Components Analysis provided further insight into the dimensions of resident assessment. RESULTS: The final version of the GAE showed overall and construct validity by capturing significant differences among residents and matched faculty members' overall impressions of resident performance. Intra-class correlation coefficient values for the overall score (0.945) and individual scales showed good reliability. Resident performance was not correlated with rotation site or model of care. CONCLUSIONS: The GAE has proved a valuable instrument in tracking the progress, strengths, and weaknesses in resident performance over the course of training. Data from multiple evaluations over time provide useful information about resident performance in a way that one or few evaluations does not. This finding is consistent with the practice of semiannual reviews and the new Clinical Competency Committees, both of which are required by the ACGME.

Assessment of inpatient psychiatric readmission risk among patients discharged on an antipsychotic polypharmacy regimen: A retrospective cohort study.

OBJECTIVE: Patients are frequently prescribed multiple antipsychotic medications, leading to higher healthcare costs and increased risk for side effects. The efficacy of multiple versus single antipsychotics to prevent acute relapse, measured by incidence of inpatient readmission, is investigated in Arizona, USA. METHOD: A retrospective chart review compared socio-demographic and clinical data from 1,010 patients discharged on a single and 377 discharged on multiple antipsychotic medications. Case management records were reviewed for readmission within one year of discharge. RESULTS: Younger age, diagnosis of Schizophrenia or Schizoaffective Disorder, prescription of mood stabilizer, shorter length of stay, and discharge to residential treatment or crisis recovery unit were associated with multiple antipsychotics at discharge. Readmission rates of the single (13.7%) versus multiple (15.9%) antipsychotic groups were not statistically different (p=0.286). Logistic regression analysis established that only age (younger) and the prescription of a mood stabilizer at discharge were significant predictors for increased risk for readmission (p=0.010 and p=0.049, respectively). A Cox survival analysis supported these findings. CONCLUSIONS: Concomitant antipsychotic polypharmacy at discharge did not reduce readmission risk over a one-year period. Given the increased risk of side effects and financial costs of polypharmacy, this study did not provide evidence to support this practice. Strikingly, only two variables predicted readmission risk, younger age and prescription of mood stabilizer. Although practitioners should follow practice guidelines more closely to prevent unnecessary exposure to potentially lethal side effects of antipsychotic polypharmacy, further studies are needed to better identify patients at high risk for readmission.

Treatment outcome and outcome associations in children with pervasive developmental disorders treated with selective serotonin reuptake inhibitors: a chart review.

PURPOSE: The aim of this study was to determine the outcome and predictors of outcome with selective serotonin reuptake inhibitors (SSRIs) in outpatient children and adolescents with pervasive developmental disorders (PDDs). METHOD: Clinic charts were reviewed for 89 outpatient youths with a Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV) diagnosis of a PDD who were treated with SSRIs. Response was determined using the Clinical Global Impressions (CGI) scale. Side-effect and demographic data, including family history, were recorded. RESULTS: Forty-four point nine percent (44.9%) were determined to be much improved and considered responders. Fifty-four percent (54%) of the subjects demonstrated activation side effects. In 35.4% of these subjects, the activation side effects led to drug discontinuation. Pearson chi-squared and regression analysis demonstrated an association between SSRI response and a family history of PDD. There were no significant associations between clinical variables and activation side effects. CONCLUSIONS: SSRI treatment led to modest response rate in this group of youths with PDDs. Activation side effects were frequent, often leading to treatment dropouts. Potential outcome associations include a family history of PDDs.

Brief report: Asperger's syndrome and sibling birth order.

Prior investigations suggest that birth order position may be associated with the risk for developing a pervasive developmental disorder. This retrospective chart review examined the birth order status of 29 psychiatrically-referred patients with Asperger's Syndrome (AS). Eighty-six percent of the subjects were first born. The finding was statistically significant when compared to an expected random distribution of AS subjects χ(2) (1, N = 29) = 9.18, p < 0.01. The reasons for such an association are unclear though birth stoppage, obstetric complications, and immunological mechanisms may play a role.

Cognitive behavioral therapy for the treatment of pediatric posttraumatic stress disorder: a review and meta-analysis.

BACKGROUND AND OBJECTIVES: There is no clear gold standard treatment for childhood posttraumatic stress disorder (PTSD). An annotated bibliography and meta-analysis were used to examine the efficacy of cognitive behavioral therapy (CBT) in the treatment of pediatric PTSD as measured by outcome data from the Child Behavior Checklist (CBCL). METHOD: A literature search produced 21 studies; of these, 10 utilized the CBCL but only eight were both 1) randomized; and 2) reported pre- and post-intervention scores. RESULTS: The annotated bibliography revealed efficacy in general of CBT for pediatric PTSD. Using four indices of the CBCL, the meta-analysis identified statistically significant effect sizes for three of the four scales: Total Problems (TP; -.327; p = .003), Internalizing (INT; -.314; p = .001), and Externalizing (EXT; -.192; p = .040). The results for TP and INT were reliable as indicated by the fail-safe N and rank correlation tests. The effect size for the Total Competence (TCOMP; -.054; p = .620) index did not reach statistical significance. LIMITATIONS: Limitations included methodological inconsistencies across studies and lack of a randomized control group design, yielding few studies for meta-analysis. CONCLUSIONS: The efficacy of CBT in the treatment of pediatric PTSD was supported by the annotated bibliography and meta-analysis, contributing to best practices data. CBT addressed internalizing signs and symptoms (as measured by the CBCL) such as anxiety and depression more robustly than it did externalizing symptoms such as aggression and rule-breaking behavior, consistent with its purpose as a therapeutic intervention.