The quality of care delivered to residents in long-term care in Australia: an indicator-based review of resident records (CareTrack Aged study).

BACKGROUND: This study estimated the prevalence of evidence-based care received by a population-based sample of Australian residents in long-term care (LTC) aged ≥ 65 years in 2021, measured by adherence to clinical practice guideline (CPG) recommendations. METHODS: Sixteen conditions/processes of care amendable to estimating evidence-based care at a population level were identified from prevalence data and CPGs. Candidate recommendations (n = 5609) were extracted from 139 CPGs which were converted to indicators. National experts in each condition rated the indicators via the RAND-UCLA Delphi process. For the 16 conditions, 236 evidence-based care indicators were ratified. A multi-stage sampling of LTC facilities and residents was undertaken. Trained aged-care nurses then undertook manual structured record reviews of care delivered between 1 March and 31 May 2021 (our record review period) to assess adherence with the indicators. RESULTS: Care received by 294 residents with 27,585 care encounters in 25 LTC facilities was evaluated. Residents received care for one to thirteen separate clinical conditions/processes of care (median = 10, mean = 9.7). Adherence to evidence-based care indicators was estimated at 53.2% (95% CI: 48.6, 57.7) ranging from a high of 81.3% (95% CI: 75.6, 86.3) for Bladder and Bowel to a low of 12.2% (95% CI: 1.6, 36.8) for Depression. Six conditions (skin integrity, end-of-life care, infection, sleep, medication, and depression) had less than 50% adherence with indicators. CONCLUSIONS: This is the first study of adherence to evidence-based care for people in LTC using multiple conditions and a standardised method. Vulnerable older people are not receiving evidence-based care for many physical problems, nor care to support their mental health nor for end-of-life care. The six conditions in which adherence with indicators was less than 50% could be the focus of improvement efforts.

Is it possible to make 'living' guidelines? An evaluation of the Australian Living Stroke Guidelines.

BACKGROUND: Keeping best practice guidelines up-to-date with rapidly emerging research evidence is challenging. 'Living guidelines' approaches enable continual incorporation of new research, assisting healthcare professionals to apply the latest evidence to their clinical practice. However, information about how living guidelines are developed, maintained and applied is limited. The Stroke Foundation in Australia was one of the first organisations to apply living guideline development methods for their Living Stroke Guidelines (LSGs), presenting a unique opportunity to evaluate the process and impact of this novel approach. METHODS: A mixed-methods study was conducted to understand the experience of LSGs developers and end-users. We used thematic analysis of one-on-one semi-structured interview and online survey data to determine the feasibility, acceptability, and facilitators and barriers of the LSGs. Website analytics data were also reviewed to understand usage. RESULTS: Overall, the living guidelines approach was both feasible and acceptable to developers and users. Facilitators to use included collaboration with multidisciplinary clinicians and stroke survivors or carers. Increased workload for developers, workload unpredictability, and limited information sharing, and interoperability of technological platforms were identified as barriers. Users indicated increased trust in the LSGs (69%), likelihood of following the LSGs (66%), and frequency of access (58%), compared with previous static versions. Web analytics data showed individual access by 16,517 users in 2016 rising to 53,154 users in 2020, a threefold increase. There was also a fourfold increase in unique LSG pageviews from 2016 to 2020. CONCLUSIONS: This study, the first evaluation of living guidelines, demonstrates that this approach to stroke guideline development is feasible and acceptable, that these approaches may add value to developers and users, and may increase guideline use. Future evaluations should be embedded along with guideline implementation to capture data prospectively.

Comparing rates of adverse events detected in incident reporting and the Global Trigger Tool: a systematic review.

Many hospitals continue to use incident reporting systems (IRSs) as their primary patient safety data source. The information IRSs collect on the frequency of harm to patients [adverse events (AEs)] is generally of poor quality, and some incident types (e.g. diagnostic errors) are under-reported. Other methods of collecting patient safety information using medical record review, such as the Global Trigger Tool (GTT), have been developed. The aim of this study was to undertake a systematic review to empirically quantify the gap between the percentage of AEs detected using the GTT to those that are also detected via IRSs. The review was conducted in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. Studies published in English, which collected AE data using the GTT and IRSs, were included. In total, 14 studies met the inclusion criteria. All studies were undertaken in hospitals and were published between 2006 and 2022. The studies were conducted in six countries, mainly in the USA (nine studies). Studies reviewed 22 589 medical records using the GTT across 107 institutions finding 7166 AEs. The percentage of AEs detected using the GTT that were also detected in corresponding IRSs ranged from 0% to 37.4% with an average of 7.0% (SD 9.1; median 3.9 and IQR 5.2). Twelve of the fourteen studies found <10% of the AEs detected using the GTT were also found in corresponding IRSs. The >10-fold gap between the detection rates of the GTT and IRSs is strong evidence that the rate of AEs collected in IRSs in hospitals should not be used to measure or as a proxy for the level of safety of a hospital. IRSs should be recognized for their strengths which are to detect rare, serious, and new incident types and to enable analysis of contributing and contextual factors to develop preventive and corrective strategies. Health systems should use multiple patient safety data sources to prioritize interventions and promote a cycle of action and improvement based on data rather than merely just collecting and analysing information.

Unsafe care in residential settings for older adults: a content analysis of accreditation reports.

Residents of aged care services can experience safety incidents resulting in preventable serious harm. Accreditation is a commonly used strategy to improve the quality of care; however, narrative information within accreditation reports is not generally analysed as a source of safety information to inform learning. In Australia, the Aged Care Quality and Safety Commission (ACQSC), the sector regulator, undertakes over 500 accreditation assessments of residential aged care services against eight national standards every year. From these assessments, the Aged Care Quality and Safety Commission generates detailed Site Audit Reports. In over one-third (37%) of Site Audit Reports, standards relating to Personal and Clinical Care (Standard 3) are not being met. The aim of this study was to identify the types of resident Safety Risks that relate to Personal and Clinical Care Standards not being met during accreditation or re-accreditation. These data could inform priority setting at policy, regulatory, and service levels. An analytical framework was developed based on the World Health Organization's International Classification for Patient Safety and other fields including Clinical Issue (the issue related to the incident impacting the resident, e.g. wound/skin or pain). Information relating to safety incidents in the Site Audit Reports was extracted, and a content analysis undertaken using the analytical framework. Clinical Issue and the International Classification for Patient Safety-based classification were combined to describe a clinically intuitive category ('Safety Risks') to describe ways in which residents could experience unsafe care, e.g. diagnosis/assessment of pain. The resulting data were descriptively analysed. The analysis included 65 Site Audit Reports that were undertaken between September 2020 and March 2021. There were 2267 incidents identified and classified into 274 types of resident Safety Risks. The 12 most frequently occurring Safety Risks account for only 32.3% of all incidents. Relatively frequently occurring Safety Risks were organisation management of infection control; diagnosis/assessment of pain, restraint, resident behaviours, and falls; and multiple stages of wounds/skin management, e.g. diagnosis/assessment, documentation, treatment, and deterioration. The analysis has shown that accreditation reports contain valuable data that may inform prioritization of resident Safety Risks in the Australian residential aged care sector. A large number of low-frequency resident Safety Risks were detected in the accreditation reports. To address these, organizations may use implementation science approaches to facilitate evidence-based strategies to improve the quality of care delivered to residents. Improving the aged care workforces' clinical skills base may address some of the Safety Risks associated with diagnosis/assessment and wound management.

Designing clinical indicators for common residential aged care conditions and processes of care: the CareTrack Aged development and validation study.

BACKGROUND: People who live in aged care homes have high rates of illness and frailty. Providing evidence-based care to this population is vital to ensure the highest possible quality of life. OBJECTIVE: In this study (CareTrack Aged, CT Aged), we aimed to develop a comprehensive set of clinical indicators for guideline-adherent, appropriate care of commonly managed conditions and processes in aged care. METHODS: Indicators were formulated from recommendations found through systematic searches of Australian and international clinical practice guidelines (CPGs). Experts reviewed the indicators using a multiround modified Delphi process to develop a consensus on what constitutes appropriate care. RESULTS: From 139 CPGs, 5609 recommendations were used to draft 630 indicators. Clinical experts (n = 41) reviewed the indicators over two rounds. A final set of 236 indicators resulted, mapped to 16 conditions and processes of care. The conditions and processes were admission assessment; bladder and bowel problems; cognitive impairment; depression; dysphagia and aspiration; end of life/palliative care; hearing and vision; infection; medication; mobility and falls; nutrition and hydration; oral and dental care; pain; restraint use; skin integrity and sleep. CONCLUSIONS: The suite of CT Aged clinical indicators can be used for research and assessment of the quality of care in individual facilities and across organizations to guide improvement and to supplement regulation or accreditation of the aged care sector. They are a step forward for Australian and international aged care sectors, helping to improve transparency so that the level of care delivered to aged care consumers can be rigorously monitored and continuously improved.

Assessing appropriateness of paediatric asthma management: A population-based sample survey.

BACKGROUND AND OBJECTIVE: We conducted a comprehensive assessment of guideline adherence in paediatric asthma care, including inpatient and ambulatory services, in Australia. METHODS: National and international clinical practice guidelines (CPG) relating to asthma in children were searched and 39 medical record audit indicator questions were developed. Retrospective medical record review was conducted across hospital inpatient admissions, emergency department (ED) presentations, general practice (GP) and paediatrician consultations in three Australian states for children aged ≤15 years receiving care in 2012 and 2013. Eligibility of, and adherence to, indicators was assessed from medical records by nine experienced and purpose-trained paediatric nurses (surveyors). RESULTS: Surveyors conducted 18 453 asthma indicator assessments across 1600 visits for 881 children in 129 locations. Overall, the adherence for asthma care across the 39 indicators was 58.1%, with 54.4% adherence at GP (95% CI: 46.0-62.5), 77.7% by paediatricians (95% CI: 40.5-97.0), 79.9% in ED (95% CI: 70.6-87.3) and 85.1% for inpatient care (95% CI: 76.7-91.5). For 14 acute asthma indicators, overall adherence was 56.3% (95% CI: 47.6-64.7). Lowest adherences were for recording all four types of vital signs in children aged >2 years presenting with asthma attack (15.1%, 95% CI: 8.7-23.7), and reviewing patients' compliance, inhaler technique and triggers prior to commencing a new drug therapy (20.5%, 95% CI: 10.1-34.8). CONCLUSION: The study demonstrated differences between existing care and CPG recommendations for paediatric asthma care in Australia. Evidence-based interventions to improve adherence to CPG may help to standardize quality of paediatric asthma care and reduce variation of care.

The quality of preventive care for pre-school aged children in Australian general practice.

BACKGROUND: Variable and poor care quality are important causes of preventable patient harm. Many patients receive less than recommended care, but the extent of the problem remains largely unknown. The CareTrack Kids (CTK) research programme sought to address this evidence gap by developing a set of indicators to measure the quality of care for common paediatric conditions. In this study, we focus on one clinical area, 'preventive care' for pre-school aged children. Our objectives were two-fold: (i) develop and validate preventive care quality indicators and (ii) apply them in general medical practice to measure adherence. METHODS: Clinical experts (n = 6) developed indicator questions (IQs) from clinical practice guideline (CPG) recommendations using a multi-stage modified Delphi process, which were pilot tested in general practice. The medical records of Australian children (n = 976) from general practices (n = 80) in Queensland, New South Wales and South Australia identified as having a consultation for one of 17 CTK conditions of interest were retrospectively reviewed by trained paediatric nurses. Statistical analyses were performed to estimate percentage compliance and its 95% confidence intervals. RESULTS: IQs (n = 43) and eight care 'bundles' were developed and validated. Care was delivered in line with the IQs in 43.3% of eligible healthcare encounters (95% CI 30.5-56.7). The bundles of care with the highest compliance were 'immunisation' (80.1%, 95% CI 65.7-90.4), 'anthropometric measurements' (52.7%, 95% CI 35.6-69.4) and 'nutrition assessments' (38.5%, 95% CI 24.3-54.3), and lowest for 'visual assessment' (17.9%, 95% CI 8.2-31.9), 'musculoskeletal examinations' (24.4%, 95% CI 13.1-39.1) and 'cardiovascular examinations' (30.9%, 95% CI 12.3-55.5). CONCLUSIONS: This study is the first known attempt to develop specific preventive care quality indicators and measure their delivery to Australian children in general practice. Our findings that preventive care is not reliably delivered to all Australian children and that there is substantial variation in adherence with the IQs provide a starting point for clinicians, researchers and policy makers when considering how the gap between recommended and actual care may be narrowed. The findings may also help inform the development of specific improvement interventions, incentives and national standards.

Randomised study demonstrates sustained benefits of a pre-school intervention designed to improve nutrition and physical activity practices.

BACKGROUND: Health-promoting programmes must demonstrate sustained efficacy in order to make a true impact on public health. This study aimed to determine the effect of the Healthy Incentive for Pre-schools project on health-promoting practices in full-day-care pre-schools 18 months after a training intervention. METHODS: Thirty-seven pre-schools completed the initial study and were included in this follow-up study. The intervention consisted of one training session with either the pre-school 'manager-only' or 'manager and staff' using a specifically developed needs-based training resource pack comprised of written educational material and a validated health-promoting practice evaluation tool. Direct observation data of health-promoting practices were collected and allocated a score using the evaluation tool by a research dietitian at three time points; pre-intervention, between 6 and 9 months post-intervention and at 18-month follow-up. An award system was used to incentivise pre-schools to improve their scores. RESULTS: Health-promoting practice scores improved significantly (P < 0.001) from the 6-9 month post-intervention to the 18-month follow-up evaluation. No significant differences were observed between 'manager-only' and 'manager and staff' trained pre-schools. CONCLUSIONS: The introduction of a pre-school evaluation tool supported by a training resource was successfully used to incentivise pre-schools to sustain and improve health-promoting practices 18 months after intervention training.

Assessing the quality of care for paediatric depression and anxiety in Australia: A population-based sample survey.

OBJECTIVE: We examine the prevalence of quality care (as measured by adherence to recommendations in clinical practice guidelines) for Australian paediatric patients (⩽15 years) with depression and/or anxiety, using data from the CareTrack Kids study; a population-based study of the quality of healthcare practice in inpatient and ambulatory healthcare settings. METHODS: A multistage stratified sample identified records of 6689 children. Of these, 156 records were identified for depression and 356 for anxiety. These were assessed for adherence to 15 depression and 13 anxiety indicators, respectively, using a review of medical records. RESULTS: Adherence to assessment and management guidelines was low for both conditions: assessment bundle (depression = 33%, 95% confidence interval = [20, 48]; anxiety = 54%, 95% confidence interval = [43, 64] and depression management bundle = 35%, 95% confidence interval = [15, 60]). Across both conditions, the highest adherence was recorded for indicators that addressed prescription of medications (e.g. venlafaxine, 100%; benzodiazepines, 100%; selective serotonin reuptake inhibitor, 94% and antidepressants, 91%), while compliance was the lowest for ensuring children with depression had an emergency safety plan (44%), informing parents of the risks and benefits of prescribed anxiety medication (51%) and assessment for other causes (59% for depression; 68% for anxiety). CONCLUSION: These findings suggest that strategies are needed to improve guideline adherence for mental health disorders in children and adolescents, particularly among general practitioners. Learning from these indicators could inform clinical prompts in electronic medical records, as well as links to additional information, to assist in decision-making and streamline work practices.

Assessing the adherence to guidelines in the management of croup in Australian children: a population-based sample survey.

OBJECTIVE: To determine the extent to which care received by Australian children presenting with croup is in agreement with Clinical Practice Guidelines (CPGs). DESIGN: Retrospective population-based sample survey. Croup clinical indicators were derived from CPGs. DATA SOURCES/STUDY SETTING: Medical records from three healthcare settings were sampled for selected visits in 2012 and 2013 in three Australian states. DATA COLLECTION: Data were collected by nine experienced paediatric nurses, trained to assess eligibility for indicator assessment and adherence to CPGs. Surveyors undertook criterion-based medical record reviews using an electronic data collection tool. RESULTS: Documented guideline adherence was lower for general practitioners (65.9%; 95% CI: 60.8-70.6) than emergency departments (91.1%; 95% CI: 89.5-92.5) and inpatient admissions (91.3%; 95% CI: 88.1-93.9). Overall adherence was very low for a bundle of 10 indicators related to assessment (4.5%; 95% CI: 2.4-7.6) but higher for a bundle of four indicators relating to the avoidance of inappropriate therapy (83.1%; 95% CI: 59.5-96.0). CONCLUSIONS: Most visits for croup were characterized by appropriate treatment in all healthcare settings. However, most children had limited documented clinical assessments, and some had unnecessary tests or inappropriate therapy, which has potential quality and cost implications. Universal CPG and clinical assessment tools may increase clinical consistency.