Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change.

BACKGROUND: Variation in effectiveness of continuous quality improvement (CQI) interventions between services is commonly reported, but with little explanation of how contextual and other factors may interact to produce this variation. Therefore, there is scant information available on which policy makers can draw to inform effective implementation in different settings. In this paper, we explore how patterns of change in delivery of services may have been achieved in a diverse range of health centers participating in a wide-scale program to achieve improvements in quality of care for Indigenous Australians. METHODS: We elicited key informants' interpretations of factors explaining patterns of change in delivery of guideline-scheduled services over three or more years of a wide-scale CQI project, and inductively analyzed these interpretations to propose fine-grained realist hypotheses about what works for whom and in what circumstances. Data were derived from annual clinical audits from 36 health centers operating in diverse settings, quarterly project monitoring reports, and workshops with 12 key informants who had key roles in project implementation. We abstracted potential context-mechanism-outcome configurations from the data, and based on these, identified potential program-strengthening strategies. RESULTS: Several context-specific, mechanism-based explanations for effectiveness of this CQI project were identified. These were collective valuing of clinical data for improvement purposes; collective efficacy; and organizational change towards a population health orientation. Health centers with strong central management of CQI, and those in which CQI efforts were more dependent on local health center initiative and were adapted to resonate with local priorities were both favorable contexts for collective valuing of clinical data. Where health centers had prior positive experiences of collaboration, effects appeared to be achieved at least partly through the mechanism of collective efficacy. Strong community linkages, staff ability to identify with patients, and staff having the skills and support to take broad ranging action, were favorable contexts for the mechanism of increased population health orientation. CONCLUSIONS: Our study provides evidence to support strategies for program strengthening described in the literature, and extends the understanding of mechanisms through which strategies may be effective in achieving particular outcomes in different contexts.

Do competing demands of physical illness in type 2 diabetes influence depression screening, documentation and management in primary care: a cross-sectional analytic study in Aboriginal and Torres Strait Islander primary health care settings.

BACKGROUND: Relatively little is known about how depression amongst people with chronic illness is identified and managed in diverse primary health care settings. We evaluated the role of complex physical needs in influencing current practice of depression screening, documentation and antidepressant prescriptions during a 12-month period, among adults with Type 2 diabetes attending Aboriginal and Torres Strait Islander primary care health centres in Australia. METHODS: We analysed clinical audit data from 44 health centres participating in a continuous quality improvement initiative, using previously reported standard sampling and data extraction protocols. Eligible patients were those with Type 2 diabetes with health centre attendance within the past 12 months. We compared current practice in depression screening, documentation and antidepressant prescription between patients with different disease severity and co-morbidity. We used random effects multiple logistic regression models to adjust for potential confounders and for clustering by health centre. RESULTS: Among the 1174 patients with diabetes included, median time since diagnosis was 7 years, 19% of patients had a co-existing diagnosis of Ischaemic Heart Disease and 1/3 had renal disease. Some 70% of patients had HbAc1>7.0%; 65% had cholesterol >4.0 mmol1-1 and 64% had blood pressure>130/80 mmHg. Documentation of screening for depression and of diagnosed depression were low overall (5% and 6% respectively) and lower for patients with renal disease (Adjusted odds ratio [AOR] 0.21; 95% confidence interval [CI] 0.14 to 0.31 and AOR 0.34; 95% CI 0.15 to 0.75), and for those with poorly controlled disease (HbA1c>7.00 (AOR 0.40; 95% CI 0.23 to 0.68 and AOR 0.51; 95% CI 0.30 to 84)). Screening for depression was lower for those on pharmaceutical treatment for glycaemic control compared to those not on such treatment. Antidepressant prescription was not associated with level of diabetes control or disease severity. CONCLUSIONS: Background levels of depression screening and documentation were low overall and significantly lower for patients with greater disease severity. Strategies to improve depression care for vulnerable populations are urgently required. An important first step in the Australian Indigenous primary care context is to identify and address barriers to the use of current clinical guidelines for depression screening and care.

Variation in quality of preventive care for well adults in Indigenous community health centres in Australia.

BACKGROUND: Early onset and high prevalence of chronic disease among Indigenous Australians call for action on prevention. However, there is deficiency of information on the extent to which preventive services are delivered in Indigenous communities. This study examined the variation in quality of preventive care for well adults attending Indigenous community health centres in Australia. METHODS: During 2005-2009, clinical audits were conducted on a random sample (stratified by age and sex) of records of adults with no known chronic disease in 62 Indigenous community health centres in four Australian States/Territories (sample size 1839). MAIN OUTCOME MEASURES: i) adherence to delivery of guideline-scheduled services within the previous 24 months, including basic measurements, laboratory investigations, oral health checks, and brief intervention on lifestyle modification; and ii) follow-up of abnormal findings. RESULTS: Overall delivery of guideline-scheduled preventive services varied widely between health centres (range 5-74%). Documentation of abnormal blood pressure reading ([greater than or equal to]140/90 mmHg), proteinuria and abnormal blood glucose ([greater than or equal to]5.5 mmol/L) was found to range between 0 and > 90% at the health centre level. A similarly wide range was found between health centres for documented follow up check/test or management plan for people documented to have an abnormal clinical finding. Health centre level characteristics explained 13-47% of variation in documented preventive care, and the remaining variation was explained by client level characteristics. CONCLUSIONS: There is substantial room to improve preventive care for well adults in Indigenous primary care settings. Understanding of health centre and client level factors affecting variation in the care should assist clinicians, managers and policy makers to develop strategies to improve quality of preventive care in Indigenous communities.

Delivery of maternal health care in Indigenous primary care services: baseline data for an ongoing quality improvement initiative.

BACKGROUND: Australia's Aboriginal and Torres Strait Islander (Indigenous) populations have disproportionately high rates of adverse perinatal outcomes relative to other Australians. Poorer access to good quality maternal health care is a key driver of this disparity. The aim of this study was to describe patterns of delivery of maternity care and service gaps in primary care services in Australian Indigenous communities. METHODS: We undertook a cross-sectional baseline audit for a quality improvement intervention. Medical records of 535 women from 34 Indigenous community health centres in five regions (Top End of Northern Territory 13, Central Australia 2, Far West New South Wales 6, Western Australia 9, and North Queensland 4) were audited. The main outcome measures included: adherence to recommended protocols and procedures in the antenatal and postnatal periods including: clinical, laboratory and ultrasound investigations; screening for gestational diabetes and Group B Streptococcus; brief intervention/advice on health-related behaviours and risks; and follow up of identified health problems. RESULTS: The proportion of women presenting for their first antenatal visit in the first trimester ranged from 34% to 49% between regions; consequently, documentation of care early in pregnancy was poor. Overall, documentation of routine antenatal investigations and brief interventions/advice regarding health behaviours varied, and generally indicated that these services were underutilised. For example, 46% of known smokers received smoking cessation advice/counselling; 52% of all women received antenatal education and 51% had investigation for gestational diabetes. Overall, there was relatively good documentation of follow up of identified problems related to hypertension or diabetes, with over 70% of identified women being referred to a GP/Obstetrician. CONCLUSION: Participating services had both strengths and weaknesses in the delivery of maternal health care. Increasing access to evidence-based screening and health information (most notably around smoking cessation) were consistently identified as opportunities for improvement across services.

Study protocol: national research partnership to improve primary health care performance and outcomes for Indigenous peoples.

BACKGROUND: Strengthening primary health care is critical to reducing health inequity between Indigenous and non-Indigenous Australians. The Audit and Best practice for Chronic Disease Extension (ABCDE) project has facilitated the implementation of modern Continuous Quality Improvement (CQI) approaches in Indigenous community health care centres across Australia. The project demonstrated improvements in health centre systems, delivery of primary care services and in patient intermediate outcomes. It has also highlighted substantial variation in quality of care. Through a partnership between academic researchers, service providers and policy makers, we are now implementing a study which aims to 1) explore the factors associated with variation in clinical performance; 2) examine specific strategies that have been effective in improving primary care clinical performance; and 3) work with health service staff, management and policy makers to enhance the effective implementation of successful strategies. METHODS/DESIGN: The study will be conducted in Indigenous community health centres from at least six States/Territories (Northern Territory, Western Australia, New South Wales, South Australia, Queensland and Victoria) over a five year period. A research hub will be established in each region to support collection and reporting of quantitative and qualitative clinical and health centre system performance data, to investigate factors affecting variation in quality of care and to facilitate effective translation of research evidence into policy and practice. The project is supported by a web-based information system, providing automated analysis and reporting of clinical care performance to health centre staff and management. DISCUSSION: By linking researchers directly to users of research (service providers, managers and policy makers), the partnership is well placed to generate new knowledge on effective strategies for improving the quality of primary health care and fostering effective and efficient exchange and use of data and information among service providers and policy makers to achieve evidence-based resource allocation, service planning, system development, and improvements of service delivery and Indigenous health outcomes.

Study protocol: Audit and Best Practice for Chronic Disease Extension (ABCDE) Project.

BACKGROUND: A growing body of international literature points to the importance of a system approach to improve the quality of care in primary health care settings. Continuous Quality Improvement (CQI) concepts and techniques provide a theoretically coherent and practical way for primary care organisations to identify, address, and overcome the barriers to improvements. The Audit and Best Practice for Chronic Disease (ABCD) study, a CQI-based quality improvement project conducted in Australia's Northern Territory, has demonstrated significant improvements in primary care service systems, in the quality of clinical service delivery and in patient outcomes related to chronic illness care. The aims of the extension phase of this study are to examine factors that influence uptake and sustainability of this type of CQI activity in a variety of Indigenous primary health care organisations in Australia, and to assess the impact of collaborative CQI approaches on prevention and management of chronic illness and health outcomes in Indigenous communities. METHODS/DESIGN: The study will be conducted in 40-50 Indigenous community health centres from 4 States/Territories (Northern Territory, Western Australia, New South Wales and Queensland) over a five year period. The project will adopt a participatory, quality improvement approach that features annual cycles of: 1) organisational system assessment and audits of clinical records; 2) feedback to and interpretation of results with participating health centre staff; 3) action planning and goal setting by health centre staff to achieve system changes; and 4) implementation of strategies for change. System assessment will be carried out using a System Assessment Tool and in-depth interviews of key informants. Clinical audit tools include two essential tools that focus on diabetes care audit and preventive service audit, and several optional tools focusing on audits of hypertension, heart disease, renal disease, primary mental health care and health promotion. The project will be carried out in a form of collaborative characterised by a sequence of annual learning cycles with action periods for CQI activities between each learning cycle. Key outcome measures include uptake and integration of CQI activities into routine service activity, state of system development, delivery of evidence-based services, intermediate patient outcomes (e.g. blood pressure and glucose control), and health outcomes (complications, hospitalisations and mortality). CONCLUSION: The ABCD Extension project will contribute directly to the evidence base on effectiveness of collaborative CQI approaches on prevention and management of chronic disease in Australia's Indigenous communities, and to inform the operational and policy environments that are required to incorporate CQI activities into routine practice.

Describing and analysing primary health care system support for chronic illness care in Indigenous communities in Australia's Northern Territory - use of the Chronic Care Model.

BACKGROUND: Indigenous Australians experience disproportionately high prevalence of, and morbidity and mortality from chronic illness such as diabetes, renal disease and cardiovascular disease. Improving the understanding of how Indigenous primary care systems are organised to deliver chronic illness care will inform efforts to improve the quality of care for Indigenous people. METHODS: This cross-sectional study was conducted in 12 Indigenous communities in Australia's Northern Territory. Using the Chronic Care Model as a framework, we carried out a mail-out survey to collect information on material, financial and human resources relating to chronic illness care in participating health centres. Follow up face-to-face interviews with health centre staff were conducted to identify successes and difficulties in the systems in relation to providing chronic illness care to community members. RESULTS: Participating health centres had distinct areas of strength and weakness in each component of systems: 1) organisational influence - strengthened by inclusion of chronic illness goals in business plans, appointment of designated chronic disease coordinators and introduction of external clinical audits, but weakened by lack of training in disease prevention and health promotion and limited access to Medicare funding; 2) community linkages - facilitated by working together with community organisations (e.g. local stores) and running community-based programs (e.g. "health week"), but detracted by a shortage of staff especially of Aboriginal health workers working in the community; 3) self management - promoted through patient education and goal setting with clients, but impeded by limited focus on family and community-based activities due to understaffing; 4) decision support - facilitated by distribution of clinical guidelines and their integration with daily care, but limited by inadequate access to and support from specialists; 5) delivery system design - strengthened by provision of transport for clients to health centres, separate men's and women's clinic rooms, specific roles of primary care team members in relation to chronic illness care, effective teamwork, and functional pathology and pharmacy systems, but weakened by staff shortage (particularly doctors and Aboriginal health workers) and high staff turnover; and 6) clinical information systems - facilitated by wide adoption of computerised information systems, but weakened by the systems' complexity and lack of IT maintenance and upgrade support. CONCLUSION: Using concrete examples, this study translates the concept of the Chronic Care Model (and associated systems view) into practical application in Australian Indigenous primary care settings. This approach proved to be useful in understanding the quality of primary care systems for prevention and management of chronic illness. Further refinement of the systems should focus on both increasing human and financial resources and improving management practice.

Delivery of child health services in Indigenous communities: implications for the federal government's emergency intervention in the Northern Territory.

OBJECTIVES: To describe delivery of child health services in Australian Aboriginal communities, and to identify gaps in services required to improve the health of Aboriginal children. DESIGN: Cross-sectional baseline audit for a quality improvement intervention. SETTING AND PARTICIPANTS: 297 children aged at least 3 months and under 5 years in 11 Aboriginal communities in the Northern Territory, Far West New South Wales and Western Australia in 2006. MAIN OUTCOME MEASURES: Adherence to guideline-scheduled services including clinical examinations, brief interventions or advice on health-related behaviour and risks, and enquiry regarding social conditions; and recorded follow-up of identified problems. RESULTS: Documentation of delivery of specific clinical examinations (26%-80%) was relatively good, but was poorer for brief interventions or advice on health-related behaviour and risks (5%-36%) and enquiry regarding social conditions (3%-11%). Compared with children in Far West NSW and WA, those attending NT centres were significantly more likely to have a record of growth faltering, underweight, chronic ear disease, anaemia, or chronic respiratory disease (P < 0.005). Only 11%-13% of children with identified social problems had an assessment report on file. An action plan was documented for 22% of children with growth faltering and 13% with chronic ear disease; 43% of children with chronic respiratory disease and 31% with developmental delay had an assessment report on file. CONCLUSION: Existing systems are not providing for adequate follow-up of identified medical and social problems for children living in remote Aboriginal communities; development of systems for immediate and longer-term sustainable responses to these problems should be a priority. Without effective systems for follow-up, screening children for disease and adverse social circumstances will result in little or no benefit.

Delivery of preventive health services to Indigenous adults: response to a systems-oriented primary care quality improvement intervention.

OBJECTIVE: To describe changes in delivery of preventive services among adults in Aboriginal communities that occurred in association with a systems-oriented intervention. DESIGN, SETTING AND PARTICIPANTS: A quality improvement intervention with a 2-year follow-up was undertaken at 12 Aboriginal community health centres in the Northern Territory between January 2002 and December 2005. The study involved 360 well adults aged 16-49 years who had no known diagnosis of chronic disease. INTERVENTION: Two annual cycles of assessment, feedback workshops, action planning, and implementation of system changes. Assessment included a structured review of health service systems and an audit of clinical records. MAIN OUTCOME MEASURES: Adherence to guideline-scheduled preventive services including taking basic measurements, laboratory investigations, lifestyle counselling and pneumococcal vaccination. RESULTS: Of 12 preventive services measured, delivery of four services showed improvement over the study period: counselling on diet increased from 3% to 8% (P = 0.018); counselling on physical activity from 2% to 8% (P = 0.006); counselling on smoking from 2% to 11% (P = 0.003); and counselling on alcohol from 2% to 10% (P = 0.007). There was no improvement in important measures such as monitoring of waist circumference, blood pressure and blood glucose level, and delivery of pneumococcal vaccination. CONCLUSION: Our systems-oriented intervention was associated with some improvement in counselling activities, but no significant improvement in delivery of other preventive services. The main reason may be that implementation focused more on chronic illness management than preventive services for generally well adults.

Indigenous health: effective and sustainable health services through continuous quality improvement.

The Australian government's Healthy for Life program is supporting capacity development in Indigenous primary care using continuous quality improvement (CQI) techniques. An important influence on the Healthy for Life program has been the ABCD research project. The key features contributing to the success of the project are described. The ABCD research project: uses a CQI approach, with an ongoing cycle of gathering data on how well organisational systems are functioning, and developing and then implementing improvements; is guided by widely accepted principles of community-based research, which emphasise participation; and adheres to the principles and values of Indigenous health research and service delivery. The potential for improving health outcomes in Aboriginal and Torres Strait Islander communities using a CQI approach should be strengthened by clear clinical and managerial leadership, supporting service organisations at the community level, and applying participatory-action principles.

Preventive medical care in remote Aboriginal communities in the Northern Territory: a follow-up study of the impact of clinical guidelines, computerised recall and reminder systems, and audit and feedback.

BACKGROUND: Interventions to improve delivery of preventive medical services have been shown to be effective in North America and the UK. However, there are few studies of the extent to which the impact of such interventions has been sustained, or of the impact of such interventions in disadvantaged populations or remote settings. This paper describes the trends in delivery of preventive medical services following a multifaceted intervention in remote community health centres in the Northern Territory of Australia. METHODS: The intervention comprised the development and dissemination of best practice guidelines supported by an electronic client register, recall and reminder systems and associated staff training, and audit and feedback. Clinical records in seven community health centres were audited at regular intervals against best practice guidelines over a period of three years, with feedback of audit findings to health centre staff and management. RESULTS: Levels of service delivery varied between services and between communities. There was an initial improvement in service levels for most services following the intervention, but improvements were in general not fully sustained over the three year period. CONCLUSIONS: Improvements in service delivery are consistent with the international experience, although baseline and follow-up levels are in many cases higher than reported for comparable studies in North America and the UK. Sustainability of improvements may be achieved by institutionalisation of relevant work practices and enhanced health centre capacity.