Are Single-Item Global Ratings Useful for Assessing Health Status?

The research performance of the single-item self-rating In general, would you say your health is: excellent, very good, good, fair, or poor? was evaluated relative to the SF-36 General Health Scale that contains this item, using data for a sample of psychiatric outpatients who had co-occurring chronic physical conditions (N = 177). The scale was more robust than the single-item in cross-sectional validity tests and for predicting 2-year outcomes, but the single-item had stronger discriminant validity as a measure of physical health, especially in post-baseline analyses. Single-item and scale were both sensitive enough to detect change in perceived health over 2 years and a conditional experimental effect on health self-perceptions in a randomized trial. These findings demonstrate that a global single-item can be as valid, reliable, and sensitive as a multi-item scale for longitudinal research purposes, even if the scale performs better in cross-sectional surveys or as a screening measure.

Using Smartphone Apps to Promote Psychiatric and Physical Well-Being.

This pilot study tested the acceptability and usability of a prototype app designed to promote the physical well-being of adults with psychiatric disorders. The application under evaluation, WellWave, promoted walking as a physical exercise, and offered a variety of supportive non-physical activities, including confidential text-messaging with peer staff, and a digital library of readings and videos on recovery from psychiatric illness. Study participants engaged strongly in the app throughout the 4-week study, showing a 94 % mean daily usage rate, and a 73 % mean response rate across all electronic messages and prompts, which approximates the gold standard of 75 % for momentary ecological assessment studies. Seven of the ten study participants averaged two or more walks per week, beginning with 5-min walks and ending with walks lasting 20 min or longer. This responsiveness to the walking prompts, and the overall high rate of engagement in other app features, suggest that adults with psychiatric conditions would welcome and benefit from similar smartphone interventions that promote healthy behaviours in life domains other than exercise. Pilot study results also suggest that smartphone applications can be useful as research tools in the development and testing of theories and practical strategies for encouraging healthy lifestyles. Participants were prompted periodically to rate their own health quality, perceived control over their health, and stage-of-change in adopting a walking routine, and these electronic self-ratings showed acceptable concurrent and discriminant validity, with all participants reporting moderate to high motivation to exercise by the end of the study.

Social value of supported employment for psychosocial program participants.

Members of a psychiatric psychosocial program designed to provide both supported employment and peer support were surveyed about their current social activities, sources of social support, and social life improvement since joining the program. Survey respondents who worked a mainstream job (n=17) reported greater peer contact in community locations, and correspondingly greater social life improvement, than those who remained unemployed or worked volunteer jobs (n=45). Results of a hierarchical regression analysis (N=62) that explored this positive correlation between mainstream work, community-based peer contact, and social life satisfaction suggest that working a job in an integrated setting that paid at least minimum wage encouraged program participants to meet and interact in community locations, thereby strengthening peer mutual support while furthering social integration. This unique pattern of findings requires replication, and we recommend that other psychosocial programs conduct similar quality improvement studies to provide further insights into the relationship between peer support and community integration.

Adapting evidence-based interventions to fit usual practice: staff roles and consumer choice in psychiatric rehabilitation.

This proof-of-concept study tested the viability of adapting a specialized practice to fit multi-service programs by switching from specialist to generalist staff roles. The intervention under study was supported employment, an evidence-based practice for adults with severe mental illness. Program data on participant characteristics, attendance, staff contact, and employment were retrieved for the 2007 calendar year (N = 99). Two hierarchical regression analyses compared (1) participants with any versus no mainstream employment, and (2) participants who started a new job in 2007 versus all other participants. In both analyses, individual participant counts of days on which employment services were provided and count of different employment service providers independently predicted mainstream employment over and above program attendance and background factors. The study program's employment rate approximated rates published for specialized supported employment programs, suggesting that it is feasible to adapt specialized evidence-based practices to fit multi-service settings without compromising service quality.

Viability of using employment rates from randomized trials as benchmarks for supported employment program performance.

Cumulative employment rates published by randomized trials are based on each enrollee's pre-planned 18-24-months of study participation. By contrast, community programs typically report employment rates for clients active in services during a calendar quarter. Using data from three supported employment programs in randomized trials, we show that trial cumulative employment rates are about twice as large as quarterly employment rates for the same program. Therefore, we recommend that administrators, service networks, and mental health authorities begin to publish quarterly employment rates, and quarterly median earnings, to allow policymakers to set realistic performance expectations for supported employment programs.

Preference in random assignment: implications for the interpretation of randomized trials.

Random assignment to a preferred experimental condition can increase service engagement and enhance outcomes, while assignment to a less-preferred condition can discourage service receipt and limit outcome attainment. We examined randomized trials for one prominent psychiatric rehabilitation intervention, supported employment, to gauge how often assignment preference might have complicated the interpretation of findings. Condition descriptions, and greater early attrition from services-as-usual comparison conditions, suggest that many study enrollees favored assignment to new rapid-job-placement supported employment, but no study took this possibility into account. Reviews of trials in other service fields are needed to determine whether this design problem is widespread.

Transforming Dissatisfaction with Services into Self-Determination: A Social Psychological Perspective on Community Program Effectiveness.

A field study of supported employment for adults with mental illness (N=174) provided an experimental test of cognitive dissonance theory. We predicted that most work-interested individuals randomly assigned to a non-preferred program would reject services and lower their work aspirations. However, individuals who chose to pursue employment through a non-preferred program were expected to resolve this dissonance through favorable service evaluations and strong efforts to succeed at work. Significant work interest-by-service preference interactions supported these predictions. Over two years, participants interested in employment who obtained work through a non-preferred program stayed employed a median of 362 days versus 108 days for those assigned to a preferred program, and participants who obtained work through a non-preferred program had higher service satisfaction.

Choice of service provider: how consumer self-determination shaped a psychiatric rehabilitation program.

OBJECTIVE: To document the impact of consumer self-selection of service providers on their service receipt and attendance in a psychiatric rehabilitation program. METHODS: Staff (8 FTE) in a new drop-in resource center tracked their service activities and contacts with consumers using daily service logs. Consumers (N = 46) checked their service needs at enrollment, and recorded their attendance on daily sign-in sheets. Regression analyses were conducted to examine correlations between these service measures and each consumer's count of key providers, with key provider defined as any staff worker with whom the consumer logged the equivalent of more than a full workday of contact (9+ hours) during a 6-month study period. RESULTS: Service log findings suggest that key service providers were chosen by consumers through informal social interactions with staff. Members who had more key providers were more active in the program and more likely to have checked a need for psychiatric care at enrollment. In spite of member choice of provider, caseloads remained small and staff were able to dedicate their time to services related to their specialty training. CONCLUSIONS: Facility-based programs can encourage consumer self-selection of service providers without overloading staff or restricting specialty services if they provide ample time for staff and consumers to get to know one another in informal social interactions.

Using Smartphone Apps to Promote Psychiatric Rehabilitation in a Peer-Led Community Support Program: Pilot Study.

BACKGROUND: Management of severe and persistent mental illness is a complex, resource-intensive challenge for individuals, their families, treaters, and the health care system at large. Community-based rehabilitation, in which peer specialists provide support for individuals managing their own condition, has demonstrated effectiveness but has only been implemented in specialty centers. It remains unclear how the peer-based community rehabilitation model could be expanded, given that it requires significant resources to both establish and maintain. OBJECTIVE: Here, we describe the results from a study of one such program implemented within Waverley Place, a community support program at McLean Hospital, emphasizing psychiatric rehabilitation for individuals with severe and persistent mental illness, as well as describing the challenges encountered during the implementation of the program. Key questions were whether the patients could, and would, successfully use the app. METHODS: The smartphone app offered multiple features relevant to psychiatric rehabilitation, including daily task lists, activity tracking, and text messaging with peer specialists. A 90-day program of activities, goals, and content specific to the community support program was created on the basis of a prior pilot, in collaboration between members of the app development team (WellFrame), and peers, clinical, and research staff associated with the program. Hospital research staff recruited patients into the study, monitored peer and patient engagement, and handled all raw data acquired from the study. RESULTS: Of 100 people approached for the study, a total of 13 provided consent, of which 10 downloaded and used the app. Two patients were unable to complete the app installation. Five used the app regularly as part of their daily lives for at least 20 days of the 90-day program. We were unable to identify any specific factors (eg, clinical or demographic) that affected willingness to consent or engage with the app platform in the very limited sample, although the individuals with significant app use were generally satisfied with the experience. CONCLUSIONS: Smartphone apps may become a useful tool for psychiatric rehabilitation, addressing both psychiatric and co-occurring medical problems. Individualizing functions to each patient and facilitating connection with a certified peer specialist may be an important feature of useful apps. Unlike prior reports emphasizing that patients with schizophrenia will adopt smartphone platforms, we found that implementation of digital tools into existing community support programs for severe and persistent mental illness has many challenges yet to be fully overcome to realize the potential benefits such apps could have to promote systematization and cost reduction for psychiatric rehabilitation.

Supported employment outcomes of a randomized controlled trial of ACT and clubhouse models.

OBJECTIVE: In a randomized controlled trial, a vocationally integrated program of assertive community treatment (ACT) was compared with a certified clubhouse in the delivery of supported employment services. METHODS: Employment rates, total work hours, and earnings for 121 adults with serious mental illness interested in work were compared with published benchmark figures for exemplary supported employment programs. The two programs were then compared on service engagement, retention, and employment outcomes in regression analyses that controlled for background characteristics, program preference, and vocational service receipt. RESULTS: Outcomes for 63 ACT and 58 clubhouse participants met or exceeded most published outcomes for specialized supported employment teams. Compared with the clubhouse program, the ACT program had significantly (p<.05) better service engagement (ACT, 98 percent; clubhouse, 74 percent) and retention (ACT, 79 percent; clubhouse, 58 percent) over 24 months, but there was no significant difference in employment rates (ACT, 64 percent; clubhouse, 47 percent). Compared with ACT participants, clubhouse participants worked significantly longer (median of 199 days versus 98 days) for more total hours (median of 494 hours versus 234 hours) and earned more (median of $3,456 versus $1,252 total earnings). Better work performance by clubhouse participants was partially attributable to higher pay. CONCLUSIONS: Vocationally integrated ACT and certified clubhouses can achieve employment outcomes similar to those of exemplary supported employment teams. Certified clubhouses can effectively provide supported employment along with other rehabilitative services, and the ACT program can ensure continuous integration of supported employment with clinical care.

Does Competitive Work Improve Quality of Life for Adults with Severe Mental Illness? Evidence from a Randomized Trial of Supported Employment.

A randomized trial comparing a facility-based Clubhouse (N = 83) to a mobile Program of Assertive Community Treatment (PACT; N = 84) tested the widely held belief that competitive employment improves global quality of life for adults with severe mental illness. Random regression analyses showed that, over 24 months of study participation, competitively employed Clubhouse participants reported greater global quality of life improvement, particularly with the social and financial aspects of their lives, as well as greater self-esteem and service satisfaction, compared to competitively employed PACT participants. However, there was no overall association between global quality of life and competitive work, or work duration. Future research will determine whether these findings generalize to other certified Clubhouses or to other types of supported employment. Multi-site studies are needed to identify key mechanisms for quality of life improvement in certified Clubhouses, including the possibly essential role of Clubhouse employer consortiums for providing high-wage, socially integrated jobs.

Impact of referral source and study applicants' preference for randomly assigned service on research enrollment, service engagement, and evaluative outcomes.

OBJECTIVE: The inability to blind research participants to their experimental conditions is the Achilles' heel of mental health services research. When one experimental condition receives more disappointed participants, or more satisfied participants, research findings can be biased in spite of random assignment. The authors explored the potential for research participants' preference for one experimental program over another to compromise the generalizability and validity of randomized controlled service evaluations as well as cross-study comparisons. METHOD: Three Cox regression analyses measured the impact of applicants' service assignment preference on research project enrollment, engagement in assigned services, and a service-related outcome, competitive employment. RESULTS: A stated service preference, referral by an agency with a low level of continuity in outpatient care, and willingness to switch from current services were significant positive predictors of research enrollment. Match to service assignment preference was a significant positive predictor of service engagement, and mismatch to assignment preference was a significant negative predictor of both service engagement and employment outcome. CONCLUSIONS: Referral source type and service assignment preference should be routinely measured and statistically controlled for in all studies of mental health service effectiveness to provide a sound empirical base for evidence-based practice.

Bereavement in the context of serious mental illness.

OBJECTIVE: This study examined whether the situational factors that contribute to severe grief in the general population predicted the severity of grief in a sample of persons who had diagnoses of serious mental illness. METHOD: Research participants who had a diagnosis of a serious mental illness and who reported the death of a close friend or family member during a five-year service evaluation project were asked to detail the circumstances that surrounded the death and to rate how the death affected their lives. Key research measures included the self-rated measurement of the impact of the death, the self-rated measurement of the duration of the reported grief, and scores on a psychiatric symptom assessment in the six months after the death. A regression analysis tested the cumulative count of four situational factors-residing with the close friend or family member at the time of the death, the suddenness of the death, having low social support, and having concurrent stressors-as a predictor of severe and prolonged grief. RESULTS: In the sample of 148 individuals with serious mental illness, 33 (22 percent) reported the death of a close friend or family member as a significant life event that resulted in relatively acute and brief grief (15 individuals, or 10 percent) or severe and prolonged grief (18 individuals, or 12 percent). The regression analysis confirmed that the more situational factors that occurred at the time of the death, the more severe the grief reaction was, irrespective of psychiatric symptomatology. CONCLUSIONS: Mental health services for persons with serious mental illness should begin to incorporate preparation for parental death and bereavement counseling as essential services, and such interventions should approach bereavement as a normal rather than a pathological response to interpersonal loss.

Prevalence, severity, and co-occurrence of chronic physical health problems of persons with serious mental illness.

OBJECTIVES: This study examined Medicaid claims forms to determine the prevalence, severity, and co-occurrence of physical illness within a representative sample of persons with serious mental illness (N=147). METHODS: Representativeness of health problems in the study sample was established through comparison with a larger sample of persons with serious mental illness enrolled in Medicaid within the same state. Standardized annual costs were then assigned to Medicaid claims diagnoses, and individual health problem severity was measured as the sum of estimated treatment costs for diagnosed conditions. RESULTS: Seventy-four percent of the study sample (N=109) had been given a diagnosis of at least one chronic health problem, and 50 percent (N=73) had been given a diagnosis of two or more chronic health problems. Of the 14 chronic health conditions surveyed, chronic pulmonary illness was the most prevalent (31 percent incidence) and the most comorbid. Persons with chronic pulmonary illness were second only to those with infectious diseases in average annual cost of treatment ($8,277). Also, 50 percent or more of participants in eight other diagnostic categories had chronic pulmonary illness. A regression analysis identified age, obesity, and substance use disorders as significant predictors of individual health problem severity. CONCLUSIONS: Risk adjustment for physical health is essential when setting performance standards or cost expectations for mental health treatment. Excluding persons with chronic health problems from mental health service evaluations restricts generalizability of research findings and may promote interventions that are inappropriate for many persons with serious mental illness.

A four-year retrospective study of Assertive Community Treatment: change to more frequent, briefer client contact.

The authors explored the feasibility of providing frequent, brief client contact as a strategy for reallocating Assertive Community Treatment (ACT) staff time to new clients, while preserving relationships with current clients and ACT program fidelity standards. A retrospective analysis of 4 years of service records for a high-fidelity ACT team revealed gradual increases in staff-client contact frequency, and corresponding decreases in contact duration. During these years, fidelity to ACT standards remained moderately high, and clients' employment and hospitalization outcomes improved.

When programs benefit some people more than others: tests of differential service effectiveness.

Practitioners need to know for whom evidence-based services are most or least effective, but few services research studies provide this information. Using data from a randomized controlled comparison of supported employment findings for two multi-service psychiatric rehabilitation programs, we illustrate and compare procedures for measuring program-by-client characteristic interactions depicting differential program effectiveness, and then illustrate how a significant program-by-client interaction can explain overall program differences in service effectiveness. Interaction analyses based on cluster analysis-identified sample subgroups appear to provide statistically powerful and meaningful hypothesis tests that can aid in the interpretation of main effect findings and help to refine program theory.

PARENTAL DEATH IN THE LIVES OF PEOPLE WITH SERIOUS MENTAL ILLNESS.

Nearly a fourth (22%) of the participants within a research sample of 148 individuals with serious mental illness reported the death of a loved one as a significant loss, and two thirds of these deaths involved the loss of one or both parents. The key determinant of the severity and duration of grief in response to the death of a parent was whether or not there were extenuating circumstances that complicated the death event, such as co-residence with the deceased at the time of death or a lack of regular social contact with anyone other than the deceased. In all instances of severe or prolonged grief, there was no preparation for the parental death, either through preparatory counseling or practical plans for funeral arrangements, financial repercussions, life-style changes, or residential relocation. Mental health agencies serving people with serious mental illness should begin to incorporate financial and emotional preparation for parental deaths and bereavement counseling as essential services.