Assessing appropriateness of paediatric asthma management: A population-based sample survey.

BACKGROUND AND OBJECTIVE: We conducted a comprehensive assessment of guideline adherence in paediatric asthma care, including inpatient and ambulatory services, in Australia. METHODS: National and international clinical practice guidelines (CPG) relating to asthma in children were searched and 39 medical record audit indicator questions were developed. Retrospective medical record review was conducted across hospital inpatient admissions, emergency department (ED) presentations, general practice (GP) and paediatrician consultations in three Australian states for children aged ≤15 years receiving care in 2012 and 2013. Eligibility of, and adherence to, indicators was assessed from medical records by nine experienced and purpose-trained paediatric nurses (surveyors). RESULTS: Surveyors conducted 18 453 asthma indicator assessments across 1600 visits for 881 children in 129 locations. Overall, the adherence for asthma care across the 39 indicators was 58.1%, with 54.4% adherence at GP (95% CI: 46.0-62.5), 77.7% by paediatricians (95% CI: 40.5-97.0), 79.9% in ED (95% CI: 70.6-87.3) and 85.1% for inpatient care (95% CI: 76.7-91.5). For 14 acute asthma indicators, overall adherence was 56.3% (95% CI: 47.6-64.7). Lowest adherences were for recording all four types of vital signs in children aged >2 years presenting with asthma attack (15.1%, 95% CI: 8.7-23.7), and reviewing patients' compliance, inhaler technique and triggers prior to commencing a new drug therapy (20.5%, 95% CI: 10.1-34.8). CONCLUSION: The study demonstrated differences between existing care and CPG recommendations for paediatric asthma care in Australia. Evidence-based interventions to improve adherence to CPG may help to standardize quality of paediatric asthma care and reduce variation of care.

Assessing the appropriateness of paediatric antibiotic overuse in Australian children: a population-based sample survey.

BACKGROUND: Infections caused by antibiotic resistant pathogens are increasing, with antibiotic overuse a key contributing factor. OBJECTIVE: The CareTrack Kids (CTK) team assessed the care of children in Australia aged 0-15 years in 2012 and 2013 to determine the proportion of care in line with clinical practice guidelines (CPGs) for 17 common conditions. This study analyses indicators relating to paediatric antibiotic overuse to identify those which should be prioritised by antimicrobial stewardship and clinical improvement programs. METHOD: A systematic search was undertaken for national and international CPGs relevant to 17 target conditions for Australian paediatric care in 2012-2013. Recommendations were screened and ratified by reviewers. The sampling frame comprised three states containing 60% of the Australian paediatric population (South Australia, New South Wales and Queensland). Multi-stage cluster sampling was used to select general practices, specialist paediatric practices, emergency departments and hospital inpatient services, and medical records within these. Medical records were reviewed by experienced paediatric nurses, trained to assess eligibility for indicator assessment and compliance with indicators. Adherence rates were estimated. RESULTS: Ten antibiotic overuse indicators were identified; three for tonsillitis and one each for seven other conditions. A total of 2621 children were assessed. Estimated adherence for indicators ranged from 13.8 to 99.5% while the overall estimate of compliance was 61.9% (95% CI: 47.8-74.7). Conditions with high levels of appropriate avoidance of antibiotics were gastroenteritis and atopic eczema without signs of infection, bronchiolitis and croup. Indicators with less than 50% adherence were asthma exacerbation in children aged > 2 years (47.1%; 95% CI: 33.4-61.1), sore throat with no other signs of tonsillitis (40.9%; 95% CI: 16.9, 68.6), acute otitis media in children aged > 12 months who were mildly unwell (13.8%; 95% CI: 5.1, 28.0), and sore throat and associated cough in children aged < 4 years (14.3%; 95% CI: 9.9, 19.7). CONCLUSION: The results of this study identify four candidate indicators (two for tonsillitis, one for otitis media and one for asthma) for monitoring by antibiotic stewardship and clinical improvement programs in ambulatory and hospital paediatric care, and intervention if needed.

Management of fever in Australian children: a population-based sample survey.

BACKGROUND: Fever in childhood is a common acute presentation requiring clinical triage to identify the few children who have serious underlying infection. Clinical practice guidelines (CPGs) have been developed to assist clinicians with this task. This study aimed to assess the proportion of care provided in accordance with CPG recommendations for the management of fever in Australian children. METHODS: Clinical recommendations were extracted from five CPGs and formulated into 47 clinical indicators for use in auditing adherence. Indicators were categorised by phase of care: assessment, diagnosis and treatment. Patient records from children aged 0 to 15 years were sampled from general practices (GP), emergency departments (ED) and hospital admissions in randomly-selected health districts in Queensland, New South Wales and South Australia during 2012 and 2013. Paediatric nurses, trained to assess eligibility for indicator assessment and adherence, reviewed eligible medical records. Adherence was estimated by individual indicator, phase of care, age-group and setting. RESULTS: The field team conducted 14,879 eligible indicator assessments for 708 visits by 550 children with fever in 58 GP, 34 ED and 28 hospital inpatient settings. For the 33 indicators with sufficient data, adherence ranged from 14.7 to 98.1%. Estimated adherence with assessment-related indicators was 51.3% (95% CI: 48.1-54.6), 77.5% (95% CI: 65.3-87.1) for diagnostic-related indicators and 72.7% (95% CI: 65.3-79.3) for treatment-related indicators. Adherence for children < 3 months of age was 73.4% (95% CI: 58.0-85.8) and 64.7% (95% CI: 57.0-71.9) for children 3-11 months of age, both significantly higher than for children aged 4-15 years (53.5%; 95% CI: 50.0-56.9). The proportion of adherent care for children attending an ED was 77.5% (95% CI: 74.2-80.6) and 76.7% (95% CI: 71.7-81.3) for children admitted to hospital, both significantly higher than for children attending a GP (40.3%; 95% CI: 34.6-46.1). CONCLUSIONS: This study reports a wide range of adherence by clinicians to 47 indicators of best practice for the management of febrile children, sampled from urban and rural regions containing 60% of the Australian paediatric population. Documented adherence was lowest for indicators related to patient assessment, for care provided in GP settings, and for children aged 4-15 years.

Assessing the appropriateness of the management of otitis media in Australia: A population-based sample survey.

AIM: Acute otitis media (AOM) is the most common infectious disease for which antibiotics are prescribed; its management is costly and has the potential to increase the antimicrobial resistance of this infection. This study measured the levels of adherence to the clinical practice guidelines (CPGs) of AOM and otitis media with effusion (OME) management in Australian children. METHODS: We searched for national and international CPGs relating to AOM and OME in children and created 37 indicators for assessment. We reviewed medical records for adherence to these indicators in 120 locations, across one inpatient and three ambulatory health-care settings. Our review sample was obtained from three Australian states that contain 60% of the nation's children. RESULTS: We reviewed the records of 1063 children with one or more assessments of CPG adherence for otitis media. Of 22 indicators with sufficient data, estimated adherence ranged from 7.4 to 99.1%. Overuse of treatment, particularly overprescribing of antibiotics, was more common than underuse. A frequent lack of adherence with recommended care was observed for children aged between 1 and 2 years with AOM. Adherence varied by health-care setting, with emergency departments and inpatient settings more adherent to CPGs than general practices. CONCLUSIONS: Our assessment of a number of indicators in the common settings in which otitis media is treated found that guideline adherence varied widely between individual indicators. Internationally agreed standards for diagnosis and treatment, coupled with clinician education on the existence and content of CPGs and clinical decision support, are needed to improve the management of children presenting with AOM and OME.

Conclusion: the road ahead: where should we go now to improve healthcare quality in acute settings?

This final article in our 12-part series articulating a suite of quality improvement studies completes our report on the Deepening our Understanding of Quality in Australia (DUQuA) program of work. Here, we bring the Supplement's key findings and contributions together, tying up loose ends. Traversing the DUQuA articles, we first argued the case for the research, conducted so that an in-depth analysis of one country's health system, completed 5 years after the landmark Deepening our Understanding of Quality Improvement in Europe (DUQuE), was available. We now provide a digest of the learning from each article. Essentially, we have contributed an understanding of quality and safety activities in 32 of the largest acute settings in Australia, developed a series of scales and tools for use within Australia, modifiable for other purposes elsewhere, and provided a platform for future studies of this kind. Our main message is, despite the value of publishing an intense study of quality activities in 32 hospitals in one country, there is no gold standard, one-size-fits-all methodology or guarantee of success in quality improvement activities, whether the initiatives are conducted at departmental, organization-wide or whole-of-systems levels. Notwithstanding this, armed with the tools, scales and lessons from DUQuA, we hope we have provided many more options and opportunities for others going about strengthening their quality improvement activities, but we do not claim to have solved all problems or provided a definitive approach. In our view, quality improvement initiatives are perennially challenging, and progress hard-won. Effective measurement, evaluating progress over time, selecting a useful suite of quality methods and having the persistence to climb the improvement gradient over time, using all the expertise and tools available, is at the core of the work of quality improvement and will continue to be so.

Do quality management systems influence clinical safety culture and leadership? A study in 32 Australian hospitals.

OBJECTIVE: This study aimed to explore the associations between the organization-level quality arrangements, improvement and implementation and department-level safety culture and leadership measures across 32 large Australian hospitals. DESIGN: Quantitative observational study, using linear and multi-level modelling to identify relationships between quality management systems and clinician safety culture and leadership. SETTING: Thirty-two large Australian public hospitals. PARTICIPANTS: Quality audit at organization level, senior quality manager at each participating hospital, 1382 clinicians (doctors, nurses and allied health professionals). MAIN OUTCOME MEASURES: Associations between organization-level quality measures and department-level clinician measures of teamwork climate, safety climate and leadership for acute myocardial infarction (AMI), hip fracture and stroke treatment conditions. RESULTS: We received 1332 valid responses from participants. The quality management systems index (QMSI, a questionnaire-based measure of the hospitals' quality management structures) was 'positively' associated with all three department-level scales in the stroke department, with safety culture and leadership in the emergency department, but with none of the three scales in the AMI and hip fracture departments. The quality management compliance index (QMCI, an external audit-based measure of the quality improvement activities) was 'negatively' associated with teamwork climate and safety climate in AMI departments, after controlling for QMSI, but not in other departments. There was no association between QMCI and leadership in any department, after controlling for QMSI, and there was no association between the clinical quality implementation index (CQII, an external audit-based measure of the level of implementation of quality activities) and any of the three department-level scales in any of the four departments, after controlling for both QMSI and QMCI. CONCLUSIONS: The influence of organization-level quality management systems on clinician safety culture and leadership varied depending on the hospital department, suggesting that whilst there was some consistency on patient safety attitudes and behaviours throughout the organizations, there were also other factors at play.

Implementation and data-related challenges in the Deepening our Understanding of Quality in Australia (DUQuA) study: implications for large-scale cross-sectional research.

Healthcare organisations vary in the degree to which they implement quality and safety systems and strategies. Large-scale cross-sectional studies have been implemented to explore whether this variation is associated with outcomes relevant at the patient level. The Deepening our Understanding of Quality in Australia (DUQuA) study draws from earlier research of this type, to examine these issues in 32 Australian hospitals. This paper outlines the key implementation and analysis challenges faced by DUQuA. Many of the logistical difficulties of implementing DUQuA derived from compliance with the administratively complex and time-consuming Australian ethics and governance system designed principally to protect patients involved in clinical trials, rather than for low-risk health services research. The complexity of these processes is compounded by a lack of organizational capacity for multi-site health services research; research is expected to be undertaken in addition to usual work, not as part of it. These issues likely contributed to a relatively low recruitment rate for hospitals (41% of eligible hospitals). Both sets of issues need to be addressed by health services researchers, policymakers and healthcare administrators, if health services research is to flourish. Large-scale research also inevitably involves multiple measurements. The timing for applying these measures needs to be coherent, to maximise the likelihood of finding real relationships between quality and safety systems and strategies, and patient outcomes; this timing was less than ideal in DUQuA, in part due to administrative delays. Other issues that affected our study include low response rates for measures requiring recruitment of clinicians and patients, missing data and a design that necessarily included multiple statistical comparisons. We discuss how these were addressed. Successful completion of these projects relies on mutual and ongoing commitment, and two-way communication between the research team and hospital staff at all levels. This will help to ensure that enthusiasm and engagement are established and maintained.

The clinician safety culture and leadership questionnaire: refinement and validation in Australian public hospitals.

OBJECTIVE: This study aimed to refine and validate a tool to measure safety culture and leadership in Australian hospitals. DESIGN: The clinician safety culture and leadership questionnaire was constructed by combining and refining the following two previously validated scales: Safety Attitudes Questionnaire and the Leadership Effectiveness Survey. Statistical processes were used to explore the factor structure, reliability, validity and descriptive statistics of the new instrument. SETTING: Thirty-two large Australian public hospitals. PARTICIPANTS: 1382 clinicians (doctors, nurses and allied health professionals). MAIN OUTCOME MEASURE(S): Descriptive statistics, structure and validity of clinician safety culture and leadership scale. RESULTS: We received 1334 valid responses from participants. The distribution of ratings was left-skewed, with a small ceiling effect, meaning that scores were clustered toward the high end of the scale. Using confirmatory factor analysis, we confirmed the structure of the three scales as a combined measure of safety culture and leadership. The data were divided into equal calibration and validation datasets. For the calibration dataset, the Chi-square: df ratio was 4.4, the root mean square error of approximation RMSEA (a measure of spread of the data) was 0.071, the standardized root mean square residual SRMR (an absolute measure of the fit of the data) was 0.058 and the Confirmatory Fit Index (CFI) (another test confirming the fit of the data) was 0.82; while none of the indices suggested good fit, all but CFI fell within acceptable thresholds. All factors demonstrated adequate internal consistency and construct reliability, as desired. All three domains achieved discriminant validity through cross-loadings, meaning that the three domains were determined to be independent constructs. Results for the validation dataset were effectively identical to those found in the calibration dataset. CONCLUSIONS: While the model may benefit from additional refinement, we have validated the tool for measuring clinician safety culture and leadership in our Australian sample. The DUQuA safety culture and leadership scale can be used by Australian hospitals to assess clinician safety culture and leadership, and is readily modifiable for other health systems depending on their needs.

Organization quality systems and department-level strategies: refinement of the Deepening our Understanding in Quality in Australia (DUQuA) organization and department-level scales.

OBJECTIVE: The aim of this study was to develop and refine indices to measure organization and care pathway-level quality management systems in Australian hospitals. DESIGN: A questionnaire survey and audit tools were derived from instruments validated as part of the Deepening Our Understanding of Quality improvement in Europe (DUQuE) study, adapted for Australian hospitals through expert opinion. Statistical processes were used to explore the factor structure, reliability and non-redundancy and descriptive statistics of the scales. SETTING: Thirty-two large Australian public hospitals. PARTICIPANTS: Audit of quality management processes at organization-level and care pathway processes at department level for three patient conditions (acute myocardial infarction (AMI), hip fracture and stroke) and senior quality manager, at each of the 32 participating hospitals. MAIN OUTCOME MEASURE(S): The degree of quality management evident at organization and care pathway levels. RESULTS: Analysis yielded seven quality systems and strategies scales. The three hospital-level measures were: the Quality Management Systems Index (QMSI), the Quality Management Compliance Index (QMCI) and the Clinical Quality Implementation Index (CQII). The four department-level measures were: Specialised Expertise and Responsibility (SER), Evidence-Based Organisation of Pathways (EBOP), Patient Safety Strategies (PSS) and Clinical Review (CR). For QMCI, and for seven out of eight subscales in QMSI, adequate internal consistency (Cronbach's $\alpha$ >0.8) was achieved. For CQII, lack of variation and ceiling effects in the data resulted in very low internal consistency scores, but items were retained for theoretical reasons. Internal consistency was high for CR (Cronbach's $\alpha$ 0.74-0.88 across the three conditions), and this was supported by all item-total correlations exceeding the desired threshold. For EBOP, Cronbach's $\alpha$ was acceptable for hip fracture (0.80) and stroke (0.76), but only moderate for AMI (0.52). PSS and SER scales were retained for theoretical reasons, although internal consistencies were only moderate (SER) to poor (PSS). CONCLUSIONS: The Deepening our Understanding of Quality in Australia (DUQuA) organization and department scales can be used by Australian hospital managers to assess and measure improvement in quality management at organization and department levels within their hospitals and are readily modifiable for other health systems depending on their needs.

The relationships between quality management systems, safety culture and leadership and patient outcomes in Australian Emergency Departments.

OBJECTIVE: We aimed to examine whether Emergency Department (ED) quality strategies, safety culture and leadership were associated with patient-level outcomes, after controlling for other organization-level factors, in 32 large Australian hospitals. DESIGN: Quantitative observational study, using linear and multi-level modelling to identify relationships between quality management systems at organization level; quality strategies at ED level for acute myocardial infarction (AMI), hip fracture and stroke; clinician safety culture and leadership and patient-level outcomes of waiting time and length of stay. SETTING: Thirty-two large Australian public hospitals. PARTICIPANTS: Audit of quality management processes at organization and ED levels, senior quality manager at each of the 32 participating hospitals, 394 ED clinicians (doctors, nurses and allied health professionals). MAIN OUTCOME MEASURE(S): Within the multi-level model, associations were assessed between organization-level quality measures and ED quality strategies; organization-level quality measures and ED quality strategies and ward-level clinician measures of teamwork climate (TC), safety climate (SC) and leadership for AMI, hip fracture and stroke treatment conditions; and organization-level quality measures and ED quality strategies and ward-level clinician measures of TC, SC and leadership, and ED waiting time and length of stay (performance). RESULTS: We found seven statistically significant associations between organization-level quality systems and ED-level quality strategies; four statistically significant associations between quality systems and strategies and ED safety culture and leadership; and nine statistically significant associations between quality systems and strategies and ED safety culture and leadership, and ED waiting time and length of stay. CONCLUSIONS: Organization-level quality structures influence ED-level quality strategies, clinician safety culture and leadership and, ultimately, waiting time and length of stay for patients. By focusing only on time-based measures of ED performance we risk punishing EDs that perform well on patient safety measures. We need to better understand the trade-offs between implementing safety culture and quality strategies and improving patient flow in the ED, and to place more emphasis on other ED performance measures in addition to time.

Do organization-level quality management systems influence department-level quality? A cross-sectional study across 32 large hospitals in Australia.

OBJECTIVE: Little is known about the influence that hospital quality systems have on quality at department level, in Australia and elsewhere. This study assessed the relationships between organizational-level quality management systems, and the extent to which hospital-level quality management systems and department-level quality management strategies are related. DESIGN: A multi-level, cross-sectional, mixed-method study. SETTING AND PARTICIPANTS: As part of the Deepening our Understanding of Quality in Australia (DUQuA) project, we invited all large hospitals in Australia (~200 or more beds) which provided acute myocardial infarction (AMI), hip fracture and stroke care. The quality managers of these hospitals were the respondents for one of seven measures of hospital quality management systems and strategies. Data across the six remaining measures were collected through site visits by external surveyors assessing the participating hospitals. MAIN OUTCOME MEASURES: Relationships were assessed between three organization-level quality management system measures: a self-report measure assessing organization-level quality activities (quality management systems index, QMSI); externally assessed organization-level compliance to procedures used to plan, monitor and improve quality of care (quality management compliance index, QMCI); and externally assessed implementation of quality systems (clinical quality implementation index, CQII). Associations were also assessed between organization-level quality management systems and department-level quality management strategies: how clinical responsibilities are assigned for a particular condition; whether department organization processes are organized to facilitate evidence-based care recommendations; compliance with selected recommendations of international agencies; and whether clinical reviews are performed systematically. RESULTS: Of 78 invited hospitals, 32 participated in the study. QMSI was positively associated with QMCI and CQII, but after controlling for QMSI, no relationship was found between QMCI and CQII. There appears to be a cluster of relationships between QMSI and department-level measures, but this was not consistent across all departments. CONCLUSION: This is the first national study undertaken in Australia to assess relationships within and between organization-level and department-level quality management systems. These quality management system tools align with many components of accreditation standards and may be useful for hospitals in continuously monitoring and driving improvement.

Validation of the patient measure of safety (PMOS) questionnaire in Australian public hospitals.

OBJECTIVE: Patients can provide a unique perspective on the safety of care in hospitals. Understanding that the extent to which the way hospitals are organized for quality and safety is associated with patient perceptions of care is becoming increasingly valued and necessary for the direction of targeted interventions across healthcare systems. The UK-developed patient measure of safety (PMOS) assesses eight domains of ward safety from the patient point of view and has recently been adapted and piloted in Australia. The aim of this study is to test the psychometric properties of PMOS-Australia (PMOS-A) amongst a large cohort of hospitalized patients. DESIGN: Cross-sectional questionnaire validation assessment. SETTING AND PARTICIPANTS: As part of the DUQuA project, the PMOS-A survey was distributed within acute myocardial infarction, hip fracture and stroke departments across 32 large public hospitals in Australia. Patients could complete the PMOS-A independently, or request the assistance of a family member/guardian, or staff on the wards-space was included to record mode of completion. MAIN OUTCOME MEASURES: Confirmatory factor analysis (CFA) was undertaken on a calibration sample to generate the model, and a validation sample was used to cross-validate the model. A subset of only those participants who received assistance for PMOS-A completion was also tested using CFA on a calibration and validation sample. Model fit indices (chi-square to degrees of freedom ratio [Chi-square:DF], root mean square error of approximation [RMSEA], comparative fit indices [CFI], standardized root mean squared residual [SRMR]), Cronbach's α, average inter-item correlations, construct reliability and cross-loadings were examined with reference to recommended thresholds to establish the extent of convergent validity and discriminant validity. A marker of criterion validity was assessed through testing associations between the PMOS-A and adherence to clinical guidelines. RESULTS: Across the calibration and validation samples of the full (N = 911) and assisted completers only subset (N = 490), three (Chi-square:DF, SRMR, RMSEA) of the four indices consistently or almost always met thresholds for acceptable model fit. CFI indices did not meet the recommended limits (0.72-0.78, against a target > 0.9). Positive relationships were found for all tests between PMOS-A and adherence to clinical guidelines, and these were significant when assessed in the calibration datasets for the full and assisted completion samples. CONCLUSION: A sufficiently reliable and valid measure of patient perceptions of safety has been developed. These findings should provide adequate support to justify the use of this measure to assess patient perceptions of safety in Australian hospitals and can be modified for use elsewhere.

Deepening our Understanding of Quality in Australia (DUQuA): An overview of a nation-wide, multi-level analysis of relationships between quality management systems and patient factors in 32 hospitals.

OBJECTIVE: The Deepening our Understanding of Quality in Australia (DUQuA) project is a multisite, multi-level, cross-sectional study of 32 of the largest hospitals in Australia. This overview examines relationships between (i) organization-level quality management systems and department-level quality management strategies and (ii) patient-level measures (clinical treatment processes, patient-reported perceptions of care and clinical outcomes) within Australian hospitals. DESIGN: We examined hospital quality improvement structures, processes and outcomes, collecting data at organization, department and patient levels for acute myocardial infarction (AMI), hip fracture and stroke. Data sources included surveys of quality managers, clinicians and patients, hospital visits, medical record reviews and national databases. Outcomes data and patient admissions data were analysed. Relationships between measures were evaluated using multi-level models. We based the methods on the Deepening our Understanding of Quality Improvement in Europe (DUQuE) framework, extending that work in parts and customizing the design to Australian circumstances. SETTING, PARTICIPANTS AND OUTCOME MEASURES: The 32 hospitals, containing 119 participating departments, provided wide representation across metropolitan, inner and outer regional Australia. We obtained 31 quality management, 1334 clinician and 857 patient questionnaires, and conducted 2401 medical record reviews and 151 external assessments. External data via a secondary source comprised 14 460 index patient admissions across 14 031 individual patients. Associations between hospital, Emergency Department (ED) and department-level systems and strategies and five patient-level outcomes were assessed: 19 of 165 associations (11.5%) were statistically significant, 12 of 79 positive associations (15.2%) and 7 of 85 negative associations (8.2%). RESULTS: We did not find clear relationships between hospital-level quality management systems, ED or department quality strategies and patient-level outcomes. ED-level clinical reviews were related to adherence to clinical practice guidelines for AMI, hip fracture and stroke, but in different directions. The results, when considered alongside the DUQuE results, are suggestive that front line interventions may be more influential than department-level interventions when shaping quality of care and that multi-pronged strategies are needed. Benchmark reports were sent to each participating hospital, stimulating targeted quality improvement activities. CONCLUSIONS: We found no compelling relationships between the way care is organized and the quality of care across three targeted patient-level outcome conditions. The study was cross-sectional, and thus we recommend that the relationships studied should be assessed for changes across time. Tracking care longitudinally so that quality improvement activities are monitored and fed back to participants is an important initiative that should be given priority as health systems strive to develop their capacity for quality improvement over time.

Bending the quality curve.

With this paper, we initiate the Supplement on Deepening our Understanding of Quality in Australia (DUQuA). DUQuA is an at-scale, cross-sectional research programme examining the quality activities in 32 large hospitals across Australia. It is based on, with suitable modifications and extensions, the Deepening our Understanding of Quality improvement in Europe (DUQuE) research programme, also published as a Supplement in this Journal, in 2014. First, we briefly discuss key data about Australia, the health of its population and its health system. Then, to provide context for the work, we discuss previous activities on the quality of care and improvement leading up to the DUQuA studies. Next, we present a selection of key interventional studies and policy and institutional initiatives to date. Finally, we conclude by outlining, in brief, the aims and scope of the articles that follow in the Supplement. This first article acts as a framing vehicle for the DUQuA studies as a whole. Aggregated, the series of papers collectively attempts an answer to the questions: what is the relationship between quality strategies, both hospital-wide and at department level? and what are the relationships between the way care is organised, and the actual quality of care as delivered? Papers in the Supplement deal with a multiplicity of issues including: how the DUQuA investigators made progress over time, what the results mean in context, the scales designed or modified along the way for measuring the quality of care, methodological considerations and provision of lessons learnt for the benefit of future researchers.

The quality of preventive care for pre-school aged children in Australian general practice.

BACKGROUND: Variable and poor care quality are important causes of preventable patient harm. Many patients receive less than recommended care, but the extent of the problem remains largely unknown. The CareTrack Kids (CTK) research programme sought to address this evidence gap by developing a set of indicators to measure the quality of care for common paediatric conditions. In this study, we focus on one clinical area, 'preventive care' for pre-school aged children. Our objectives were two-fold: (i) develop and validate preventive care quality indicators and (ii) apply them in general medical practice to measure adherence. METHODS: Clinical experts (n = 6) developed indicator questions (IQs) from clinical practice guideline (CPG) recommendations using a multi-stage modified Delphi process, which were pilot tested in general practice. The medical records of Australian children (n = 976) from general practices (n = 80) in Queensland, New South Wales and South Australia identified as having a consultation for one of 17 CTK conditions of interest were retrospectively reviewed by trained paediatric nurses. Statistical analyses were performed to estimate percentage compliance and its 95% confidence intervals. RESULTS: IQs (n = 43) and eight care 'bundles' were developed and validated. Care was delivered in line with the IQs in 43.3% of eligible healthcare encounters (95% CI 30.5-56.7). The bundles of care with the highest compliance were 'immunisation' (80.1%, 95% CI 65.7-90.4), 'anthropometric measurements' (52.7%, 95% CI 35.6-69.4) and 'nutrition assessments' (38.5%, 95% CI 24.3-54.3), and lowest for 'visual assessment' (17.9%, 95% CI 8.2-31.9), 'musculoskeletal examinations' (24.4%, 95% CI 13.1-39.1) and 'cardiovascular examinations' (30.9%, 95% CI 12.3-55.5). CONCLUSIONS: This study is the first known attempt to develop specific preventive care quality indicators and measure their delivery to Australian children in general practice. Our findings that preventive care is not reliably delivered to all Australian children and that there is substantial variation in adherence with the IQs provide a starting point for clinicians, researchers and policy makers when considering how the gap between recommended and actual care may be narrowed. The findings may also help inform the development of specific improvement interventions, incentives and national standards.

Assessing the quality of care for paediatric depression and anxiety in Australia: A population-based sample survey.

OBJECTIVE: We examine the prevalence of quality care (as measured by adherence to recommendations in clinical practice guidelines) for Australian paediatric patients (⩽15 years) with depression and/or anxiety, using data from the CareTrack Kids study; a population-based study of the quality of healthcare practice in inpatient and ambulatory healthcare settings. METHODS: A multistage stratified sample identified records of 6689 children. Of these, 156 records were identified for depression and 356 for anxiety. These were assessed for adherence to 15 depression and 13 anxiety indicators, respectively, using a review of medical records. RESULTS: Adherence to assessment and management guidelines was low for both conditions: assessment bundle (depression = 33%, 95% confidence interval = [20, 48]; anxiety = 54%, 95% confidence interval = [43, 64] and depression management bundle = 35%, 95% confidence interval = [15, 60]). Across both conditions, the highest adherence was recorded for indicators that addressed prescription of medications (e.g. venlafaxine, 100%; benzodiazepines, 100%; selective serotonin reuptake inhibitor, 94% and antidepressants, 91%), while compliance was the lowest for ensuring children with depression had an emergency safety plan (44%), informing parents of the risks and benefits of prescribed anxiety medication (51%) and assessment for other causes (59% for depression; 68% for anxiety). CONCLUSION: These findings suggest that strategies are needed to improve guideline adherence for mental health disorders in children and adolescents, particularly among general practitioners. Learning from these indicators could inform clinical prompts in electronic medical records, as well as links to additional information, to assist in decision-making and streamline work practices.

Assessing the adherence to guidelines in the management of croup in Australian children: a population-based sample survey.

OBJECTIVE: To determine the extent to which care received by Australian children presenting with croup is in agreement with Clinical Practice Guidelines (CPGs). DESIGN: Retrospective population-based sample survey. Croup clinical indicators were derived from CPGs. DATA SOURCES/STUDY SETTING: Medical records from three healthcare settings were sampled for selected visits in 2012 and 2013 in three Australian states. DATA COLLECTION: Data were collected by nine experienced paediatric nurses, trained to assess eligibility for indicator assessment and adherence to CPGs. Surveyors undertook criterion-based medical record reviews using an electronic data collection tool. RESULTS: Documented guideline adherence was lower for general practitioners (65.9%; 95% CI: 60.8-70.6) than emergency departments (91.1%; 95% CI: 89.5-92.5) and inpatient admissions (91.3%; 95% CI: 88.1-93.9). Overall adherence was very low for a bundle of 10 indicators related to assessment (4.5%; 95% CI: 2.4-7.6) but higher for a bundle of four indicators relating to the avoidance of inappropriate therapy (83.1%; 95% CI: 59.5-96.0). CONCLUSIONS: Most visits for croup were characterized by appropriate treatment in all healthcare settings. However, most children had limited documented clinical assessments, and some had unnecessary tests or inappropriate therapy, which has potential quality and cost implications. Universal CPG and clinical assessment tools may increase clinical consistency.

The future of health systems to 2030: a roadmap for global progress and sustainability.

Most research on health systems examines contemporary problems within one, or at most a few, countries. Breaking with this tradition, we present a series of case studies in a book written by key policymakers, scholars and experts, looking at health systems and their projected successes to 2030. Healthcare Systems: Future Predictions for Global Care includes chapters on 52 individual countries and five regions, covering a total of 152 countries. Synthesised, two key contributions are made in this compendium. First, five trends shaping the future healthcare landscape are analysed: sustainable health systems; the genomics revolution; emerging technologies; global demographics dynamics; and new models of care. Second, nine main themes arise from the chapters: integration of healthcare services; financing, economics and insurance; patient-based care and empowering the patient; universal healthcare; technology and information technology; aging populations; preventative care; accreditation, standards, and policy; and human development, education and training. These five trends and nine themes can be used as a blueprint for change. They can help strengthen the efforts of stakeholders interested in reform, ranging from international bodies such as the World Health Organization, the International Society for Quality in Health Care and the World Bank, through to national bodies such as health departments, quality and safety agencies, non-government organisations (NGO) and other groups with an interest in improving healthcare delivery systems. This compendium offers more than a glimpse into the future of healthcare-it provides a roadmap to help shape thinking about the next generation of caring systems, extrapolated over the next 15 years.

Quality of Health Care for Children in Australia, 2012-2013.

Importance: The quality of routine care for children is rarely assessed, and then usually in single settings or for single clinical conditions. Objective: To estimate the quality of health care for children in Australia in inpatient and ambulatory health care settings. Design, Setting, and Participants: Multistage stratified sample with medical record review to assess adherence with quality indicators extracted from clinical practice guidelines for 17 common, high-burden clinical conditions (noncommunicable [n = 5], mental health [n = 4], acute infection [n = 7], and injury [n = 1]), such as asthma, attention-deficit/hyperactivity disorder, tonsillitis, and head injury. For these 17 conditions, 479 quality indicators were identified, with the number varying by condition, ranging from 9 for eczema to 54 for head injury. Four hundred medical records were targeted for sampling for each of 15 conditions while 267 records were targeted for anxiety and 133 for depression. Within each selected medical record, all visits for the 17 targeted conditions were identified, and separate quality assessments made for each. Care was evaluated for 6689 children 15 years of age and younger who had 15 240 visits to emergency departments, for inpatient admissions, or to pediatricians and general practitioners in selected urban and rural locations in 3 Australian states. These visits generated 160 202 quality indicator assessments. Exposures: Quality indicators were identified through a systematic search of local and international guidelines. Individual indicators were extracted from guidelines and assessed using a 2-stage Delphi process. Main Outcomes and Measures: Quality of care for each clinical condition and overall. Results: Of 6689 children with surveyed medical records, 53.6% were aged 0 to 4 years and 55.5% were male. Adherence to quality of care indicators was estimated at 59.8% (95% CI, 57.5%-62.0%; n = 160 202) across the 17 conditions, ranging from a high of 88.8% (95% CI, 83.0%-93.1%; n = 2638) for autism to a low of 43.5% (95% CI, 36.8%-50.4%; n = 2354) for tonsillitis. The mean adherence by condition category was estimated as 60.5% (95% CI, 57.2%-63.8%; n = 41 265) for noncommunicable conditions (range, 52.8%-75.8%); 82.4% (95% CI, 79.0%-85.5%; n = 14 622) for mental health conditions (range, 71.5%-88.8%); 56.3% (95% CI, 53.2%-59.4%; n = 94 037) for acute infections (range, 43.5%-69.8%); and 78.3% (95% CI, 75.1%-81.2%; n = 10 278) for injury. Conclusions and Relevance: Among a sample of children receiving care in Australia in 2012-2013, the overall prevalence of adherence to quality of care indicators for important conditions was not high. For many of these conditions, the quality of care may be inadequate.

Accomplishing reform: successful case studies drawn from the health systems of 60 countries.

Healthcare reform typically involves orchestrating a policy change, mediated through some form of operational, systems, financial, process or practice intervention. The aim is to improve the ways in which care is delivered to patients. In our book 'Health Systems Improvement Across the Globe: Success Stories from 60 Countries', we gathered case-study accomplishments from 60 countries. A unique feature of the collection is the diversity of included countries, from the wealthiest and most politically stable such as Japan, Qatar and Canada, to some of the poorest, most densely populated or politically challenged, including Afghanistan, Guinea and Nigeria. Despite constraints faced by health reformers everywhere, every country was able to share a story of accomplishment-defining how their case example was managed, what services were affected and ultimately how patients, staff, or the system overall, benefited. The reform themes ranged from those relating to policy, care coverage and governance; to quality, standards, accreditation and regulation; to the organization of care; to safety, workforce and resources; to technology and IT; through to practical ways in which stakeholders forged collaborations and partnerships to achieve mutual aims. Common factors linked to success included the 'acorn-to-oak tree' principle (a small scale initiative can lead to system-wide reforms); the 'data-to-information-to-intelligence' principle (the role of IT and data are becoming more critical for delivering efficient and appropriate care, but must be converted into useful intelligence); the 'many-hands' principle (concerted action between stakeholders is key); and the 'patient-as-the-pre-eminent-player' principle (placing patients at the centre of reform designs is critical for success).