What Can You Learn About Psychiatry Programs from Their Website? A Content Evaluation for Potential Applicants.

ABSTRACT

OBJECTIVE: This project aimed to assess the information contained on general psychiatry program websites and identify common themes that may be useful and informative for residency applicants. METHODS: A survey study design was used to evaluate all US general psychiatry program websites as listed in the FREIDA database. The evaluation form included 44 binary (yes or no) items. Two reviewers rated each item on all program websites between September 2021 and January 2022. Item discrepancies were settled by a third reviewer. Fisher's exact tests evaluated differences between geographic regions and program types. Multidimensional scaling and Rasch modeling were conducted to examine clustering and the probability of items reported on program websites. RESULTS: A total of 285 websites were identified; 13 were excluded. Internal consistency was high among reviewers, Cronbach's Alpha = 0.927; κ = 0.863. Websites varied considerably in quality. Significant inconsistent reporting was observed by region for current residents' photos and alumni careers (fellowship/jobs); p<0.001. Program types varied regarding information about program faculty, which included significant differences for faculty photo, faculty research interest, and faculty research publications; p<0.001. CONCLUSIONS: While inter-rater reliability was high, considerable variation among websites was observed. Residency programs could be improved by consistently reporting resident and faculty information. Results show that applicants may encounter issues finding pertinent information, as programs' FREIDA link did not direct the user to the residency program website two-thirds of the time.