Clinical improvement after treatment provided through the Better Outcomes in Mental Health Care (BOiMHC) programme: do some patients show greater improvement than others?

OBJECTIVE: Australia's Better Outcomes in Mental Health Care (BOiMHC) programme enables GPs to refer patients with common mental disorders to allied health professionals for time-limited treatment, through its Access to Allied Psychological Services (ATAPS) projects. This paper considers whether patients who receive care through the ATAPS projects make clinical gains, if so, whether particular patient-related and treatment-related variables are predictive of these outcomes. METHOD: Divisions of General Practice (Divisions), which run the ATAPS projects, are required to enter de-identified data into a minimum dataset, including data on patients' socio-demographic and clinical characteristics, the sessions of care they receive, and their clinical outcomes. We extracted data from January 2006 to June 2010, and examined the difference between mean pre- and post-treatment scores on the range of outcome measures being used by Divisions. We then conducted a linear regression analysis using scores on the most commonly-used outcome measure as the outcome of interest. RESULTS: Pre- and post-treatment outcome data were available for 16 700 patients from nine different outcome measures. Across all measures, the mean difference was statistically significant and indicative of clinical improvement. The most commonly-used measure was the Kessler-10 (K-10), and pre- and post-treatment K-10 data were available for 7747 patients. After adjusting for clustering by Division, outcome on the K-10 was associated with age, levels of income and education, previous receipt of mental health care, number of sessions, treatment received and pre-treatment K-10 score. The benchmark was sufficiently high, however, that even the groups that fared relatively less well still showed strong improvement in absolute terms. CONCLUSIONS: Patients who receive care through the ATAPS projects are making considerable clinical gains. A range of socio-demographic, clinical and treatment-based variables are associated with the levels of outcomes achieved, but improvements are still substantial even for those in the relatively disadvantaged groups.

The complementarity of two major Australian primary mental health care initiatives.

OBJECTIVE: Two pivotal Australian Government primary mental health reforms are the Access to Allied Psychological Services (ATAPS) projects, introduced in July 2001 and implemented by Divisions of General Practice, and the Better Access to Psychiatrists, Psychologists and GPs through the Medicare Benefits Schedule (Better Access) programme, introduced in November 2006. This research explores the reciprocal impact of the uptake of psychological treatment delivered by these two initiatives and the impact of location (rurality and socioeconomic profile) on the uptake of both programmes since the inception of the Better Access programme. ATAPS session delivery, before and after the introduction of the Better Access program, is also examined. METHOD: General Practice Division-level data sources included a minimum dataset containing uptake data of ATAPS services, Medicare Benefits Schedule uptake data supplied by the Medicare Benefits Branch of the Department of Health and Ageing, a Rural, Remote and Metropolitan Area classification, and Indices for Relative Socio Economic Disadvantage (IRSD). Regression analyses were conducted to examine the reciprocal impact of the two programmes and the impact of rurality and socioeconomic status up to December 2008. RESULTS: A dramatic uptake of Better Access sessions, particularly in urban areas, coincided with a temporary reduction in sessions provided under ATAPS, with an overall small positive relationship detected between the two programmes. A greater proportion of ATAPS sessions (45%) have been delivered in rural areas compared with Better Access (18%). The combination of socioeconomic profile, rurality, and Better Access sessions accounted for a small but significant percentage of variance (7%) in the number of ATAPS sessions delivered, with a non-significant independent contribution of Better Access sessions to the prediction of ATAPS sessions. Weak but significant relationships between ATAPS sessions and each of socioeconomic profile (r = 0.22) and rurality (r = -0.24), respectively, were identified. In comparison, socioeconomic profile, rurality, and ATAPS sessions accounted for a much larger and significant percentage of variance (46%) in number of Better Access sessions delivered, with a non-significant independent contribution of ATAPS sessions to the prediction of Better Access sessions. Moderate significant relationships between Better Access sessions and each of socioeconomic profile (r = 0.46) and rurality (r = -0.66), respectively, were identified. The introduction of Better Access appears to have halted the steady increase in the number of ATAPS sessions previously observed. This finding should be interpreted alongside the fact that ATAPS funding is capped. CONCLUSIONS: The findings are policy relevant. ATAPS projects have been successfully providing equity of geographic and socioeconomic access for consumers most in need of subsidized psychological treatment. The uptake of psychological treatment under Better Access has been dramatic, suggesting that the programme is addressing an unmet need.

Meeting demand for psychological services for people with depression and anxiety: recent developments in primary mental health care.

OBJECTIVE: To examine whether there was a reduction in demand for psychological services provided through the Access to Allied Psychological Services (ATAPS) projects after the introduction of the Better Access to Psychiatrists, Psychologists and General Practitioners through the Medicare Benefits Schedule (Better Access) program, and whether any such reduction was greater in urban than rural areas. DESIGN AND SETTING: A Division-level correlation analysis examining the relationship between the monthly number of sessions provided by allied health professionals through the ATAPS projects run by Divisions of General Practice, and allied health professional services reimbursed by Medicare Australia under the Better Access program, between 1 November 2006 and 31 March 2007. MAIN OUTCOME MEASURES: Uptake of each program, assessed by the number of sessions provided. RESULTS: Overall, despite dramatic uptake of the Better Access program in the first 5 months after its introduction, the demand for ATAPS services was not reduced. The correlations between the numbers of sessions provided by both programs overall (r = - 0.078; P = 0.074) and in rural Divisions (r = 0.024; P = 0.703) were not significant. However, there was a significant negative correlation between the numbers of sessions provided by both programs in urban Divisions (r = - 0.142; P = 0.019). CONCLUSIONS: For the first 5 months of the Better Access program, the two programs seemed to operate relatively independently of each other in terms of service provision, but in urban Divisions there was a move towards services provided through the Better Access program. Early indications are that the two programs are providing complementary services and are working together to address a previously unmet need for mental health care.

Improving access to and outcomes from mental health care in rural Australia.

OBJECTIVE: Rural Australians face particular difficulties in accessing mental health care. This paper explores whether 51 rural Access to Allied Psychological Services projects, funded under the Better Outcomes in Mental Health Care program, are improving such access, and, if so, whether this is translating to positive consumer outcomes. DESIGN AND METHOD: The paper draws on three data sources (a survey of models of service delivery, a minimum dataset and three case studies) to examine the operation and achievements of these projects, and makes comparisons with their 57 urban equivalents as relevant. RESULTS: Proportionally, uptake of the projects in rural areas has been higher than in urban areas: more GPs and allied health professionals are involved, and more consumers have received care. There is also evidence that the models of service delivery used in these projects have specifically been designed to resolve issues particular to rural areas, such as difficulties recruiting and retaining providers. The projects are being delivered at no or low cost to consumers, and are achieving positive outcomes as assessed by standardised measures. CONCLUSION: The findings suggest that the rural projects have the potential to improve access to mental health care for rural residents with depression and anxiety, by enabling GPs to refer them to allied health professionals. The findings are discussed with reference to recent reforms to mental health care delivery in Australia.

Building evaluation capacity: definitional and practical implications from an Australian case study.

Internationally, evaluation capacity-building activities have mushroomed as demands have increased for government-funded programs to demonstrate that they are effective and efficient. Despite this, there is a lack of clarity in the way in which evaluation capacity-building is defined and conceptualized. The current paper presents a case study of a national evaluation capacity building exercise that we are in the midst of conducting in Australia, and discusses the findings in relation to definitional, conceptual and practical issues. Specifically, we describe an evaluation capacity building exercise involving over 100 mental health projects, detailing the methods that we employ, some of the challenges that we have faced, and the benefits we feel we are achieving. Our key message is that definitions of evaluation capacity-building should not only make reference to equipping organizations to routinely conduct evaluations, but should also stress the varied uses to which evaluation findings can be put. In addition, such definitions should acknowledge some of the valuable by-products of evaluation capacity building activities, such as the development of shared understandings of the program or project being evaluated.

Better outcomes in mental health care: impact of different models of psychological service provision on patient outcomes.

OBJECTIVE: One hundred and eight Access to Allied Psychological Services projects have been funded under Australia's Better Outcomes in Mental Health Care programme since July 2001. All projects are run by Divisions of General Practice and enable general practitioners (GPs) to refer patients to allied health professionals for evidence-based care. They differ in the models they use to retain, locate and direct referrals to their allied health professionals. This paper examines the extent to which the projects are achieving positive patient outcomes, and explores the association between different models of service delivery and varying levels of patient outcomes. METHOD: The paper draws on two data sources (a purpose-designed minimum dataset and a survey of models of service delivery) to examine the level of patient outcomes within and across projects, and variations in the level of patient outcomes by models of service delivery. RESULTS: The projects are achieving positive effects and these are mostly of large or medium magnitude. The projects do not differ markedly in terms of the patient outcomes they are achieving, despite differences in the models of service delivery they are using. However, those projects implementing a direct referral model, where the GP refers the patient directly to the allied health professional, have significantly greater effect sizes, indicating that they are achieving greater improvements in patient outcomes. In addition, there are non-significant trends toward direct employment of allied health professionals by Divisions being predictive of greater improvements in patient outcomes, and delivery of services from allied health professionals' own rooms being predictive of weaker patient outcomes. CONCLUSIONS: Overwhelmingly, the Access to Allied Psychological Services projects are having a positive impact for patients in terms of their level of functioning, severity of symptoms and/or quality of life. Preliminary indications suggest that a service delivery model incorporating the use of a direct referral system may be associated with superior outcomes. The findings are discussed in the light of the imminent listing of psychologists' services on the Medicare Benefits Schedule.

Models of psychological service provision under Australia's Better Outcomes in Mental Health Care program.

The Access to Allied Psychological Services component of Australia's Better Outcomes in Mental Health Care program enables eligible general practitioners to refer consumers to allied health professionals for affordable, evidence-based mental health care, via 108 projects conducted by Divisions of General Practice. The current study profiled the models of service delivery across these projects, and examined whether particular models were associated with differential levels of access to services. We found: 76% of projects were retaining their allied health professionals under contract, 28% via direct employment, and 7% some other way; Allied health professionals were providing services from GPs' rooms in 63% of projects, from their own rooms in 63%, from a third location in 42%; and The referral mechanism of choice was direct referral in 51% of projects, a voucher system in 27%, a brokerage system in 24%, and a register system in 25%. Many of these models were being used in combination. No model was predictive of differential levels of access, suggesting that the approach of adapting models to the local context is proving successful.