Validity and test-retest reliability of the self-completion adult social care outcomes toolkit (ASCOT-SCT4) with adults with long-term physical, sensory and mental health conditions in England.

BACKGROUND: The Adult Social Care Outcomes Toolkit (ASCOT-SCT4) is a multi-attribute utility index designed for the evaluation of long-term social care services. The measure comprises eight attributes that capture aspects of social care-related quality of life. The instrument has previously been validated with a sample of older adults who used home care services in England. This paper aims to demonstrate the instrument's test-retest reliability and provide evidence for its validity in a diverse sample of adults who use publicly-funded, community-based social care in England. METHODS: A survey of 770 social care service users was conducted in England. A subsample of 100 services users participated in a follow-up interview between 7 and 21 days after baseline. Spearman rank correlation coefficients between the ASCOT-SCT4 index score and the EQ-5D-3 L, the ICECAP-A or ICECAP-O and overall quality of life were used to assess convergent validity. Data on variables hypothesised to be related to the ASCOT-SCT4 index score, as well as rating of individual attributes, were also collected. Hypothesised relationships were tested using one-way ANOVA or Fisher's exact test. Test-retest reliability was assessed using the intra-class correlation coefficient for the ASCOT-SCT4 index score at baseline and follow-up. RESULTS: There were moderate to strong correlations between the ASCOT-SCT4 index and EQ-5D-3 L, the ICECAP-A or ICECAP-O, and overall quality of life (all correlations ≥ 0.3). The construct validity was further supported by statistically significant hypothesised relationships between the ASCOT-SCT4 index and individual characteristics in univariate and multivariate analysis. There was also further evidence for the construct validity for the revised Food and drink and Dignity items. The test-retest reliability was considered to be good (ICC = 0.783; 95% CI: 0.678-0.857). CONCLUSIONS: The ASCOT-SCT4 index has good test-retest reliability for adults with physical or sensory disabilities who use social care services. The index score and the attributes appear to be valid for adults receiving social care for support reasons connected to underlying mental health problems, and physical or sensory disabilities. Further reliability testing with a wider sample of social care users is warranted, as is further exploration of the relationship between the ASCOT-SCT4, ICECAP-A/O and EQ-5D-3 L indices.

The acceptability and feasibility of using the Adult Social Care Outcomes Toolkit (ASCOT) to inform practice in care homes.

BACKGROUND: The Adult Social Care Outcomes Toolkit (ASCOT) measures social care related quality of life (SCRQoL) and can be used to measure outcomes and demonstrate impact across different social care settings. This exploratory study built on previous work by collecting new inter-rater reliability data on the mixed-methods version of the toolkit and exploring how it might be used to inform practice in four case study homes. METHOD: We worked with two care home providers to agree an in-depth study collecting SCRQoL data in four case-study homes. Data was collected about residents' age, ethnicity, cognitive impairment, ability to perform activities of daily living and SCRQoL in the four homes. Feedback sessions with staff and managers were held in the homes two weeks after baseline and follow-up data collected three months later. Interviews with managers explored their views of the feedback and recorded any changes that had been made because of it. RESULTS: Participant recruitment was challenging, despite working in partnership with the homes. Resident response rates ranged from 23 to 54 % with 58 residents from four care homes taking part in the research. 53 % lacked capacity to consent. Inter-rater reliability for the ASCOT ratings of SCRQoL were good at time one (IRR = 0.72) and excellent at time two (IRR = 0.76). During the study, residents' ability to perform activities of daily living declined significantly (z = -2.67, p < .01), as did their expected needs in the absence of services (z = -2.41, p < .05). Despite these rapid declines in functionings, residents' current SCRQoL declined slightly but not significantly (Z = -1.49, p = .14). Staff responded positively to the feedback given and managers reported implementing changes in practice because of it. CONCLUSION: This exploratory study faced many challenges in the recruitment of residents, many of whom were cognitively impaired. Nevertheless, without a mixed-methods approach many of the residents living in the care homes would have been excluded from the research altogether or had their views represented only by a representative or proxy. The value of the mixed-methods toolkit and its potential for use by providers is discussed.

Adapting the adult social care outcomes toolkit (ASCOT) for use in care home quality monitoring: conceptual development and testing.

BACKGROUND: Alongside an increased policy and practice emphasis on outcomes in social care, English local authorities are now obliged to review quality at a service level to help in their new role of ensuring the development of diverse and high-quality care markets to meet the needs of all local people, including self-funders. The Adult Social Care Outcomes Toolkit (ASCOT) has been developed to measure the outcomes of social care for individuals in a variety of care settings. Local authorities have expressed an interest in exploring how the toolkit might be used for their own purposes, including quality monitoring. This study aimed to explore how the care homes version of the ASCOT toolkit might be adapted for use as a care home quality indicator and carry out some preliminary testing in two care homes for older adults. METHODS: Consultations were carried out with professional and lay stakeholders, with an interest in using the tool or the ratings it would produce. These explored demand and potential uses for the measure and fed into the conceptual development. A draft toolkit and method for collecting the data was developed and the feasibility of using it for quality monitoring was tested with one local authority quality monitoring team in two homes for older adults. RESULTS: Stakeholders expressed an interest in care home quality ratings based on residents' outcomes but there were tensions around who might collect the data and how it might be shared. Feasibility testing suggested the measure had potential for use in quality monitoring but highlighted the importance of training in observational techniques and interviewing skills. The quality monitoring officers involved in the piloting recommended that relatives' views be collected in advance of visits, through surveys not interviews. CONCLUSIONS: Following interest from another local authority, a larger evaluation of the measure for use in routine quality monitoring is planned. As part of this, the ratings made using this measure will be validated against the outcomes of individual residents and compared with the quality ratings of the regulator, the Care Quality Commission.

Factor structure and construct validity of the Adult Social Care Outcomes Toolkit for Carers (ASCOT-Carer).

BACKGROUND: The ASCOT-Carer is a self-report instrument designed to measure social care-related quality of life (SCRQoL). This article presents the psychometric testing and validation of the ASCOT-Carer four response-level interview (INT4) in a sample of unpaid carers of adults who receive publicly funded social care services in England. METHODS: Unpaid carers were identified through a survey of users of publicly funded social care services in England. Three hundred and eighty-seven carers completed a face-to-face or telephone interview. Data on variables hypothesised to be related to SCRQoL (e.g. characteristics of the carer, cared-for person and care situation) and measures of carer experience, strain, health-related quality of life and overall QoL were collected. Relationships between these variables and overall SCRQoL score were evaluated through correlation, ANOVA and regression analysis to test the construct validity of the scale. Internal reliability was assessed using Cronbach's alpha and feasibility by the number of missing responses. RESULTS: The construct validity was supported by statistically significant relationships between SCRQoL and scores on instruments of related constructs, as well as with characteristics of the carer and care recipient in univariate and multivariate analyses. A Cronbach's alpha of 0.87 (seven items) indicates that the internal reliability of the instrument is satisfactory and a low number of missing responses (<1 %) indicates a high level of acceptance. CONCLUSION: The results provide evidence to support the construct validity, factor structure, internal reliability and feasibility of the ASCOT-Carer INT4 as an instrument for measuring social care-related quality of life of unpaid carers who care for adults with a variety of long-term conditions, disability or problems related to old age.

Using cost-effectiveness estimates from survey data to guide commissioning: an application to home care.

The aim is to describe and trial a pragmatic method to produce estimates of the incremental cost-effectiveness of care services from survey data. The main challenge is in estimating the counterfactual; that is, what the patient's quality of life would be if they did not receive that level of service. A production function method is presented, which seeks to distinguish the variation in care-related quality of life in the data that is due to service use as opposed to other factors. A problem is that relevant need factors also affect the amount of service used and therefore any missing factors could create endogeneity bias. Instrumental variable estimation can mitigate this problem. This method was applied to a survey of older people using home care as a proof of concept. In the analysis, we were able to estimate a quality-of-life production function using survey data with the expected form and robust estimation diagnostics. The practical advantages with this method are clear, but there are limitations. It is computationally complex, and there is a risk of misspecification and biased results, particularly with IV estimation. One strategy would be to use this method to produce preliminary estimates, with a full trial conducted thereafter, if indicated.

The relationship between building design and residents' quality of life in extra care housing schemes.

Well-designed housing is recognised as being an important factor in promoting a good quality of life. Specialised housing models incorporating care services, such as extra care housing (ECH) schemes are seen as enabling older people to maintain a good quality of life despite increasing health problems that can accompany ageing. Despite the variation in ECH building design little is known about the impact of ECH building design on the quality of life of building users. The evaluation of older people's living environments (EVOLVE) study collected cross-sectional data on building design and quality of life in 23 ECH schemes in England, UK. Residents' quality of life was assessed using the schedule for the evaluation of individual quality of life-direct weighting (SEIQoL-DW) and on the four domains of control, autonomy, self-realisation and pleasure on the CASP-19. Building design was measured on 12 user-related domains by means of a new tool; the EVOLVE tool. Using multilevel linear regression, significant associations were found between several aspects of building design and quality of life. Furthermore, there was evidence that the relationship between building design and quality of life was partly mediated by the dependency of participants and scheme size (number of living units). Our findings suggest that good quality building design in ECH can support the quality of life of residents, but that designing features that support the needs of both relatively independent and frail users is problematic, with the needs of highly dependent users not currently supported as well as could be hoped by ECH schemes.

Quality of life outcomes for residents and quality ratings of care homes: is there a relationship?

BACKGROUND: quality ratings of care homes are used by decision makers in the absence of direct information about outcomes. However, there is little evidence about the relationship between regulators' ratings of homes and residents' quality of life outcomes. OBJECTIVES: to capture social care-related quality of life (SCRQoL) outcomes for residents and investigate the relationship between outcomes and regulator quality ratings of homes. METHODS: data were collected for 366 residents of 83 English care homes for older people inspected during 2008. Outcomes were measured using the Adult Social Care Outcomes Toolkit (ASCOT). Multivariate multilevel modelling was used to investigate the relationship between quality of life outcomes and star ratings of homes, controlling for resident and home characteristics. RESULTS: care homes were delivering substantial gains in SCRQoL, but were more successful in delivering 'basic' (e.g. personal cleanliness) than higher-order domains (e.g. social participation). Outcomes were associated with quality ratings of residential homes but not of nursing homes. CONCLUSIONS: the approach to providing quality ratings by the regulator in England is currently under review. Future quality indicators need to demonstrate their relationship with quality of life outcomes if they are to be a reliable guide to commissioners and private individuals purchasing care.

An assessment of the construct validity of the ASCOT measure of social care-related quality of life with older people.

BACKGROUND: The adult social care outcomes toolkit (ASCOT) includes a preference-weighted measure of social care-related quality of life for use in economic evaluations. ASCOT has eight attributes: personal cleanliness and comfort, food and drink, control over daily life, personal safety, accommodation cleanliness and comfort, social participation and involvement, occupation and dignity. This paper aims to demonstrate the construct validity of the ASCOT attributes. METHODS: A survey of older people receiving publicly-funded home care services was conducted by face-to-face interview in several sites across England. Additional data on variables hypothesised to be related and unrelated to each of the attributes were also collected. Relationships between these variables and the attributes were analysed through chi-squared tests and analysis of variance, as appropriate, to test the construct validity of each attribute. RESULTS: 301 people were interviewed and approximately 10% of responses were given by a proxy respondent. Results suggest that each attribute captured the extent to which respondents exercised choice in how their outcomes were met. There was also evidence for the validity of the control over daily life, occupation, personal cleanliness and comfort, personal safety, accommodation cleanliness and comfort, and social participation and involvement attributes. There was less evidence regarding the validity of the food and drink and dignity attributes, but this may be a consequence of problems finding good data against which to validate these attributes, as well as problems with the distribution of the food and drink item. CONCLUSIONS: This study provides some evidence for the construct validity of the ASCOT attributes and therefore support for ASCOT's use in economic evaluation. It also demonstrated the feasibility of its use among older people, although the need for proxy respondents in some situations suggests that developing a version that is suitable for proxies would be a useful future direction for this work. Validation of the instrument on a sample of younger social care users would also be useful.

The characteristics of residents in extra care housing and care homes in England.

Extra care housing aims to meet the housing, care and support needs of older people, while helping them to maintain their independence in their own private accommodation. It has been viewed as a possible alternative, or even a replacement for residential care. In 2003, the Department of Health announced capital funding to support the development of extra care housing and made the receipt of funding conditional on participating in an evaluative study. This paper presents findings on the characteristics of the residents at the time of moving in, drawing on information collected from the 19 schemes in the evaluation, and a recent comparable study of residents who moved into care homes providing personal care. Overall, the people who moved into extra care were younger and much less physically and cognitively impaired than those who moved into care homes. However, the prevalence of the medical conditions examined was more similar for the two groups, and several of the schemes had a significant minority of residents with high levels of dependence on the Barthel Index of Activities of Daily Living. In contrast, levels of severe cognitive impairment were much lower in all schemes than the overall figure for residents of care homes, even among schemes designed specifically to provide for residents with dementia. The results suggest that, although extra care housing may be operating as an alternative to care homes for some individuals, it is providing for a wider population, who may be making a planned move rather than reacting to a crisis. While extra care supports residents with problems of cognitive functioning, most schemes appear to prefer residents to move in when they can become familiar with their new accommodation before the development of more severe cognitive impairment.

Best-worst scaling vs. discrete choice experiments: an empirical comparison using social care data.

This paper presents empirical findings from the comparison between two principal preference elicitation techniques: discrete choice experiments and profile-based best-worst scaling. Best-worst scaling involves less cognitive burden for respondents and provides more information than traditional "pick-one" tasks asked in discrete choice experiments. However, there is lack of empirical evidence on how best-worst scaling compares to discrete choice experiments. This empirical comparison between discrete choice experiments and best-worst scaling was undertaken as part of the Outcomes of Social Care for Adults project, England, which aims to develop a weighted measure of social care outcomes. The findings show that preference weights from best-worst scaling and discrete choice experiments do reveal similar patterns in preferences and in the majority of cases preference weights--when normalised/rescaled--are not significantly different.

Estimating the value of social care.

Increasingly, health economists are required to work across sectors when evaluating options for improving health, health care and well-being. Social care is a key sector which is both influenced by and influences the use and outcomes of health services. This paper reports on a developing approach to measuring social care outcome, designed to reflect outcomes across client groups. In this process it is important that we reflect the relative importance or value of these domains of outcome. This paper reports on a pilot study that investigated the feasibility of using discrete choice experiments to identify a financial "willingness to accept" valuation of a large number of domains and investigated factors associated with variations in respondents' preferences. We conclude that, while the domains themselves need further work, the approach provides a helpful starting point in the difficult issue of reflecting population preferences for a large number of social care outcome domains.

Developing the evidence base for adult social care practice: The NIHR School for Social Care Research.

In a foreword to Shaping the Future of Care Together, Prime Minister Gordon Brown says that a care and support system reflecting the needs of our times and meeting our rising aspirations is achievable, but 'only if we are prepared to rise to the challenge of radical reform'. A number of initiatives will be needed to meet the challenge of improving social care for the growing older population. Before the unveiling of the green paper, The National Institute for Health Research (NIHR) announced that it has provided £15m over a five-year period to establish the NIHR School for Social Care Research. The School's primary aim is to conduct or commission research that will help to improve adult social care practice in England. The School is seeking ideas for research topics, outline proposals for new studies and expert advice in developing research methods.

The costs of change: a case study of the process of implementing individual budgets across pilot local authorities in England.

Individual budgets form a key element in the objective of the English Government to promote independence among people with needs for social care support. The initiative was designed to provide greater user control but the wider consequences, in terms of the implications for local authorities and their other responsibilities, remain to be addressed. An evaluation of the implementation of individual budgets in 13 local authorities was funded by the Department of Health, using a mixed methods approach to explore the impact of individual budgets both in terms of service user experiences and the implications for the local authority social services. One aspect of the evaluation concentrated on the cost implications of implementing individual budgets for the local authorities. All pilot local authorities were invited to take part in an interview designed to obtain the resources required to implement individual budget. Twelve of the 13 local authorities were part of the study reported in this article. All quantitative analysis was carried out using SPSS 13. Excluding all expenses that might be at least in part associated with the pilot process, in the first year, the estimated mean average cost was 290,000 pounds (median 270,000 pounds). This article will describe the initial approach adopted in estimating set-up costs, followed by a description of the findings for the first year of implementation and likely subsequent set-up costs. We also identify the range of factors that might affect reported costs.

Changing patterns of male and female nurses' participation in the workforce.

AIM: To examine how nursing working lives are changing and what might lie behind these changes. BACKGROUND: In view of continuing concerns about the shortage of nurses, it is important to recognize the factors influencing retention and the implications of changes in the workforce. METHOD: Using an approach previously developed for estimating expected working lives, this paper compares results taken from the 1991 general household Census with the most recent Census. Changes in participation rates are examined and the age at which nurses exit the profession. The destination of those leaving the profession mid-life is also identified. RESULTS: Although the length of expected working life of a female nurse decreased by only one year during the 10-year period, the working life of a male nurse decreased by 9 years. The combined working life reduced from 19 to 15 years. CONCLUSION: Although the emphasis on improving nurse recruitment and retention has been a priority for a number of years, this is not reflected in the length of time nurses remain in the profession especially male nurses. IMPLICATIONS: Shorter working lives of nurses have important implications for the costs of maintaining a qualified work force and for human resource managers and workforce planners.

Provider and care workforce influences on quality of home-care services in England.

A key trend in home care in recent years in England has been movement away from "in-house" service provision by local government authorities (e.g., counties) towards models of service commissioning from independent providers. A national survey in 2003 identified that there were lower levels of satisfaction and perceptions of quality of care among older users of independent providers compared with in-house providers. This paper reports the results of a study that related service users' views of 121 providers with the characteristics of these providers. For the most part, characteristics associated with positive perceptions of quality were more prevalent among in-house providers. Multivariate analyses of independent providers suggested that aspects of the workforce itself, in terms of age and experience, provider perceptions of staff turnover, and allowance of travel time, were the most critical influences on service user experiences of service quality.

Organisation and features of hospital, intermediate care and social services in English sites with low rates of delayed discharge.

In recent years, there has been significant concern, and policy activity, in relation to the problem of delayed discharges from hospital. Key elements of policy to tackle delays include new investment, the establishment of the Health and Social Care Change Agent Team, and the implementation of the Community Care (Delayed Discharge) Act 2003. Whilst the problem of delays has been widespread, some authorities have managed to tackle delays successfully. The aim of the qualitative study reported here was to investigate discharge practice and the organisation of services at sites with consistently low rates of delay, in order to identify factors supporting such good performance. Six 'high performing' English sites (each including a hospital trust, a local authority, and a primary care trust) were identified using a statistical model, and 42 interviews were undertaken with health and social services staff involved in discharge arrangements. Additionally, the authors set out to investigate the experiences of patients in the sites to examine whether there was a cost to patient care and outcomes of discharge arrangements in these sites, but unfortunately, it was not possible to secure sufficient patient participation. Whilst acknowledging the lack of patient experience and outcome data, a range of service elements was identified at the sites that contribute to the avoidance of delays, either through supporting efficiency within individual agencies or enabling more efficient joint working. Sites still struggling with delays should benefit from knowledge of this range. The government's reimbursement scheme appears to have been largely helpful in the study sites, prompting efficiency-driven changes to the organisation of services and discharge systems, but further focused research is required to provide clear evidence of its impact nationally, and in particular, how it impacts on staff, and patients and their families.

Using older home care user experiences in performance monitoring.

Home care services play a fundamental role in England in supporting older and disabled people in their own homes. In order to identify and monitor the degree to which these services are providing good quality services, in 2003 the government required all councils with social services responsibilities (CSSR) to undertake user experience surveys among older service users. The questionnaire was required to include four questions, two of which were designed to be used as Best Value Performance Indicators (BVPI) reflecting the quality of home care of older people. Thirty-four local authorities participated in an extension study providing data from 21 350 home care users. The aim of the study was to answer three questions: (1) Do the performance indicators reflect home care quality? (2) Are the performance indicators using the most appropriate cut-off points? (3) What are the underlying constructs of home care quality? Evidence was found to support the use of two of the performance indicators and the current cut-off point being used for the satisfaction indicator. Factor analysis identified indicators of important dimensions of quality that were associated with overall satisfaction.

The costs of training a nurse practitioner in primary care: the importance of allowing for the cost of education and training when making decisions about changing the professional-mix.

What is already known on this topic * Cost containment through the most effective mix of staff achievable within available resources and organisational priorities is of increasing importance in most health systems. However, there is a dearth of information about the full economic implications of changing skill mix. * In the UK a major shift in the primary care workforce is likely in response to the rapidly developing role of nurse practitioners and policies aimed to encourage GP practices to transfer some of their responsibilities to other, less costly, professionals. * Previous research has developed an approach to incorporating the costs of qualifications, and thus the investment required to develop a skilled workforce, for a variety of health service professionals including GPs. What this study adds * This paper describes a methodology of costing nurse practitioners that incorporates the human capital cost implications of developing a skilled nurse practitioner workforce. With appropriate sources of data the method could be adapted for use internationally. * Including the full cost of qualifications results in nearly a 24 per cent increase in the unit cost of a Nurse Practitioner. * Allowing for all investment costs and adjusting for length of consultation, the cost of a GP consultation was nearly 60 per cent higher than that of a Nurse Practitioner.

Using discrete choice experiments to estimate a preference-based measure of outcome--an application to social care for older people.

This paper reports the results of a study that used discrete choice experiment (DCE) methodology to estimate quality weights for a of social care outcome measure. To reflect different states of need, a five-dimensional profile measure was developed. Experimental design techniques were used to derive a sample of states for which preferences were elicited. The DCE approach was employed to elicit values and regression techniques used to estimate a model that could predict index scores for all 243 possible outcomes. The utility model, estimated on the basis of 297 responses, had good test-retest reliability and converged with preferences elicited from a rating exercise.