Birang Daruganora: what do Aboriginal and Torres Strait Islander communities need in a new hospital? A qualitative study.

OBJECTIVES: To elicit the Aboriginal community's cultural and healthcare needs and views about six prominent and emerging models of care, to inform the development of a new hospital. DESIGN: Cross-sectional qualitative study co-designed and co-implemented by Aboriginal team members. SETTING: Western Sydney, New South Wales, Australia. PARTICIPANTS: Aboriginal and Torres Strait Islander healthcare providers (n=2) and community members (n=18) aged between 21 and 60+ years participated in yarning circles (20 participants; 14 female, 6 male). RESULTS: Handwritten notes from yarning circles were inductively analysed to synthesise the cultural and healthcare needs of providers and community members in relation to a new hospital and six models of care. Three primary themes emerged in relation to future hospitals. These were 'culturally responsive spaces', 'culturally responsive systems' and 'culturally responsive models of care'. Strengths (eg, comfort, reduced waiting time, holistic care), barriers (eg, logistics, accessibility, literacy) and enablers (eg, patient navigator role, communication pathways, streamlined processes) were identified for each of the six models of care. CONCLUSIONS: Aboriginal and Torres Strait Islander community members and providers are invested in the co-creation of an innovative, well-integrated hospital that meets the needs of the community. Common themes of respect and recognition, relationships and partnering, and capacity building emerged as important consumer and provider considerations when developing and evaluating care services. Participants supported a range of models citing concerns about accessibility and choice when discussing evidence-based models of care.

Implementation of large, multi-site hospital interventions: a realist evaluation of strategies for developing capability.

BACKGROUND: This study presents guidelines for implementation distilled from the findings of a realist evaluation. The setting was local health districts in New South Wales, Australia that implemented three clinical improvement initiatives as part of a state-wide program. We focussed on implementation strategies designed to develop health professionals' capability to deliver value-based care initiatives for multisite programs. Capability, which increases implementers' ability to cope with unexpected scenarios is key to managing change. METHODS: We used a mixed methods realist evaluation which tested and refined program theories elucidating the complex dynamic between context (C), mechanism (M) and outcome (O) to determine what works, for whom, under what circumstances. Data was drawn from program documents, a realist synthesis, informal discussions with implementation designers, and interviews with 10 key informants (out of 37 identified) from seven sites. Data analysis employed a retroductive approach to interrogate the causal factors identified as contributors to outcomes. RESULTS: CMO statements were refined for four initial program theories: Making it Relevant- where participation in activities was increased when targeted to the needs of the staff; Investment in Quality Improvement- where engagement in capability development was enhanced when it was valued by all levels of the organisation; Turnover and Capability Loss- where the effects of staff turnover were mitigated; and Community-Wide Priority- where there was a strategy of spanning sites. From these data five guiding principles for implementers were distilled: (1) Involve all levels of the health system to effectively implement large-scale capability development, (2) Design capability development activities in a way that supports a learning culture, (3) Plan capability development activities with staff turnover in mind, (4) Increased capability should be distributed across teams to avoid bottlenecks in workflows and the risk of losing key staff, (5) Foster cross-site collaboration to focus effort, reduce variation in practice and promote greater cohesion in patient care. CONCLUSIONS: A key implementation strategy for interventions to standardise high quality practice is development of clinical capability. We illustrate how leadership support, attention to staff turnover patterns, and making activities relevant to current issues, can lead to an emergent learning culture.

Marked variations in medical provider and out-of-pocket costs for radical prostatectomy procedures in Australia.

Objectives Unwarranted clinical variations in radical prostatectomy (RP) procedures are frequently reported, yet less attention is given to the variations in associated costs. This issue can further widen disparities in access to care and provoke questions about the overall value of the procedure. The present paper aimed to delve into the disparities in hospital, medical provider and out-of-pocket costs for RP procedures in Australia, discussing plausible causes and potential policy opportunities. Methods A retrospective cohort study using Medibank Private claims data for RP procedures conducted in Australian hospitals between 1 January 2015 and 31 December 2020 was undertaken. Results Considerable variations in both medical provider and out-of-pocket costs were observed across the country, with variations evident between different states or territories. Particularly striking were the discrepancies in the costs charged by medical providers, with a notable contrast between the 10th and 90th percentiles revealing a substantial difference of A$9925. Hospitals in Australia exhibited relatively comparable charges for RP procedures. Conclusions Initiatives such as enhancing transparency regarding individual medical provider costs and implementing fee regulations with healthcare providers may be useful in curbing the variations in RP procedure costs.

Analysis of applying a patient safety taxonomy to patient and clinician-reported incident reports during the COVID-19 pandemic: a mixed methods study.

BACKGROUND: The COVID-19 pandemic resulted in major disruption to healthcare delivery worldwide causing medical services to adapt their standard practices. Learning how these adaptations result in unintended patient harm is essential to mitigate against future incidents. Incident reporting and learning system data can be used to identify areas to improve patient safety. A classification system is required to make sense of such data to identify learning and priorities for further in-depth investigation. The Patient Safety (PISA) classification system was created for this purpose, but it is not known if classification systems are sufficient to capture novel safety concepts arising from crises like the pandemic. We aimed to review the application of the PISA classification system during the COVID-19 pandemic to appraise whether modifications were required to maintain its meaningful use for the pandemic context. METHODS: We conducted a mixed-methods study integrating two phases in an exploratory, sequential design. This included a comparative secondary analysis of patient safety incident reports from two studies conducted during the first wave of the pandemic, where we coded patient-reported incidents from the UK and clinician-reported incidents from France. The findings were presented to a focus group of experts in classification systems and patient safety, and a thematic analysis was conducted on the resultant transcript. RESULTS: We identified five key themes derived from the data analysis and expert group discussion. These included capitalising on the unique perspective of safety concerns from different groups, that existing frameworks do identify priority areas to investigate further, the objectives of a study shape the data interpretation, the pandemic spotlighted long-standing patient concerns, and the time period in which data are collected offers valuable context to aid explanation. The group consensus was that no COVID-19-specific codes were warranted, and the PISA classification system was fit for purpose. CONCLUSIONS: We have scrutinised the meaningful use of the PISA classification system's application during a period of systemic healthcare constraint, the COVID-19 pandemic. Despite these constraints, we found the framework can be successfully applied to incident reports to enable deductive analysis, identify areas for further enquiry and thus support organisational learning. No new or amended codes were warranted. Organisations and investigators can use our findings when reviewing their own classification systems.

Is there an association between out-of-pocket hospital costs, quality and care outcomes? A systematic review of contemporary evidence.

BACKGROUND: Out of pocket (OOP) costs vary substantially by health condition, procedure, provider, and service location. Evidence of whether this variation is associated with indicators of healthcare quality and/or health outcomes is lacking. METHODS: The current review aimed to explore whether higher OOP costs translate into better healthcare quality and outcomes for patients in inpatient settings. The review also aimed to identify the population and contextual-level determinants of inpatient out-of-pocket costs. A systematic electronic search of five databases: Scopus, Medline, Psych Info, CINAHL and Embase was conducted between January 2000 to October 2022. Study procedures and reporting complied with PRISMA guidelines. The protocol is available at PROSPERO (CRD42022320763). FINDINGS: A total of nine studies were included in the final review. A variety of quality and health outcomes were examined in the included studies across a range of patient groups and specialities. The scant evidence available and substantial heterogeneity created challenges in establishing the nature of association between OOP costs and healthcare quality and outcomes. Nonetheless, the most consistent finding was no significant association between OOP cost and inpatient quality of care and outcomes. INTERPRETATION: The review findings overall suggest no beneficial effect of higher OOP costs on inpatient quality of care and health outcomes. Further work is needed to elucidate the determinants of OOP hospital costs. FUNDING: This study was funded by Medibank Better Health Foundation.

Issues and complexities in safety culture assessment in healthcare.

The concept of safety culture in healthcare-a culture that enables staff and patients to be free from harm-is characterized by complexity, multifacetedness, and indefinability. Over the years, disparate and unclear definitions have resulted in a proliferation of measurement tools, with lack of consensus on how safety culture can be best measured and improved. A growing challenge is also achieving sufficient response rates, due to "survey fatigue," with the need for survey optimisation never being more acute. In this paper, we discuss key challenges and complexities in safety culture assessment relating to definition, tools, dimensionality and response rates. The aim is to prompt critical reflection on these issues and point to possible solutions and areas for future research.

Comparing rates of adverse events detected in incident reporting and the Global Trigger Tool: a systematic review.

Many hospitals continue to use incident reporting systems (IRSs) as their primary patient safety data source. The information IRSs collect on the frequency of harm to patients [adverse events (AEs)] is generally of poor quality, and some incident types (e.g. diagnostic errors) are under-reported. Other methods of collecting patient safety information using medical record review, such as the Global Trigger Tool (GTT), have been developed. The aim of this study was to undertake a systematic review to empirically quantify the gap between the percentage of AEs detected using the GTT to those that are also detected via IRSs. The review was conducted in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. Studies published in English, which collected AE data using the GTT and IRSs, were included. In total, 14 studies met the inclusion criteria. All studies were undertaken in hospitals and were published between 2006 and 2022. The studies were conducted in six countries, mainly in the USA (nine studies). Studies reviewed 22 589 medical records using the GTT across 107 institutions finding 7166 AEs. The percentage of AEs detected using the GTT that were also detected in corresponding IRSs ranged from 0% to 37.4% with an average of 7.0% (SD 9.1; median 3.9 and IQR 5.2). Twelve of the fourteen studies found <10% of the AEs detected using the GTT were also found in corresponding IRSs. The >10-fold gap between the detection rates of the GTT and IRSs is strong evidence that the rate of AEs collected in IRSs in hospitals should not be used to measure or as a proxy for the level of safety of a hospital. IRSs should be recognized for their strengths which are to detect rare, serious, and new incident types and to enable analysis of contributing and contextual factors to develop preventive and corrective strategies. Health systems should use multiple patient safety data sources to prioritize interventions and promote a cycle of action and improvement based on data rather than merely just collecting and analysing information.

Experience-based codesign approach to improve care in Australian emergency departments for complex consumer cohorts: the MyED project protocol, Stages 1.1-1.3.

INTRODUCTION: Emergency department (ED) care must adapt to meet current and future demands. In Australia, ED quality measures (eg, prolonged length of stay, re-presentations or patient experience) are worse for older adults with multiple comorbidities, people who have a disability, those who present with a mental health condition, Indigenous Australians, and those with a culturally and linguistically diverse (CALD) background. Strengthened ED performance relies on understanding the social and systemic barriers and preferences for care of these different cohorts, and identifying viable solutions that may result in sustained improvement by service providers. A collaborative 5-year project (MyED) aims to codesign, with ED users and providers, new or adapted models of care that improve ED performance, improve patient outcomes and improve patient experience for these five cohorts. METHODS AND ANALYSIS: Experience-based codesign using mixed methods, set in three hospitals in one health district in Australia. This protocol introduces the staged and incremental approach to the whole project, and details the first research elements: ethnographic observations at the ED care interface, interviews with providers and interviews with two patient cohorts-older adults and adults with a CALD background. We aim to sample a diverse range of participants, carefully tailoring recruitment and support. ETHICS AND DISSEMINATION: Ethics approval has been obtained from the Western Sydney Local Health District Human Research Ethics Committee (2022/PID02749-2022/ETH02447). Prior informed written consent will be obtained from all research participants. Findings from each stage of the project will be submitted for peer-reviewed publication. Project outputs will be disseminated for implementation more widely across New South Wales, Australia.

Birang Daruganora: a protocol for a qualitative study to elicit Aboriginal and Torres Strait Islander community views about cultural needs and experiences for a new Australian health facility.

INTRODUCTION: To address challenges regarding the delivery of healthcare, governments and health services are focusing on the implementation of models that are flexible, person-centred, cost-effective and integrate hospital services more closely with primary healthcare and social services. Such models increasingly embed consumer codesign, multidisciplinary teams and leverage digital technologies, such as telehealth, attempting to deliver care more seamlessly and to continually improve services. This paper provides a study protocol to describe a method to explore Aboriginal and/or Torres Strait Islander consumer and healthcare provider needs and expectations for the design and development of a new healthcare facility in Australia. METHODS AND ANALYSIS: A qualitative study of consumer members' and health providers' needs and expectations. Data collection includes a short consumer-specific and provider-specific, demographic questionnaire and culturally appropriate facilitator-coordinated consultation workshops. Data will be analysed thematically (qualitatively). ETHICS AND DISSEMINATION: The results will be actively disseminated through peer-reviewed journals, conference presentations, reports to stakeholders and community meetings. This study was reviewed and approved by a health service-based Ethics Committee in New South Wales, Australia and the Aboriginal Health and Medical Research Committee.

Innovative models of care for the health facility of the future: a protocol for a mixed-methods study to elicit consumer and provider views.

INTRODUCTION: To address the challenges of rapidly changing healthcare, governments and health services are increasingly emphasising healthcare delivery models that are flexible, person centred, cost-effective and integrate hospital services more closely with primary healthcare and social services. In addition, such models increasingly embed consumer codesign, integration of services, and leverage digital technologies such as telehealth and sophisticated medical records systems. OBJECTIVES: This paper provides a study protocol to describe a method to elicit consumer and healthcare provider needs and expectations for the development of innovative care models. METHODS AND ANALYSIS: A literature review identified six key models of care, supported by a common theme of consumer-focused care, along with the international evidence supporting the efficacy of these models. A mixed-methods study of the needs and expectations of consumer members and health providers who reside or work in the area of a new hospital catchment will be undertaken. They will complete a community-specific and provider-specific, short demographic questionnaire (delivered during the recruitment process) and be assigned to facilitator-coordinated online workshops comprising small focus groups. Follow-up interviews will be offered. Culturally and linguistically diverse members and Aboriginal and Torres Strait Islander Elders and their communities will also be consulted. Data will be analysed thematically (qualitative) and statistically (quantitative), and findings synthesised using a triangulated approach. ETHICS AND DISSEMINATION: The results will be actively disseminated through peer-reviewed journals, conference presentations and in a report to stakeholders. This study was reviewed and approved by the relevant Ethics Committee in New South Wales, Australia.

Emergency department clinical leads' experiences of implementing primary care services where GPs work in or alongside emergency departments in the UK: a qualitative study.

BACKGROUND: To manage increasing demand for emergency and unscheduled care NHS England policy has promoted services in which patients presenting to Emergency Departments (EDs) with non-urgent problems are directed to general practitioners (GPs) and other primary care clinicians working within or alongside emergency departments. However, the ways that hospitals have implemented primary care services in EDs are varied. The aim of this study was to describe ED clinical leads' experiences of implementing and delivering 'primary care services' and 'emergency medicine services' where GPs were integrated into the ED team. METHODS: We conducted interviews with ED clinical leads in England (n = 19) and Wales (n = 2). We used framework analysis to analyse interview transcripts and explore differences across 'primary care services', 'emergency medicine services' and emergency departments without primary care services. RESULTS: In EDs with separate primary care services, success was reported when having a distinct workforce of primary care clinicians, who improved waiting times and flow by seeing primary care-type patients in a timely way, using fewer investigations, and enabling ED doctors to focus on more acutely unwell patients. Some challenges were: trying to align their service with the policy guidance, inconsistent demand for primary care, accessible community primary care services, difficulties in recruiting GPs, lack of funding, difficulties in agreeing governance protocols and establishing effective streaming pathways. Where GPs were integrated into an ED workforce success was reported as managing the demand for both emergency and primary care and reducing admissions. CONCLUSIONS: Introducing a policy advocating a preferred model of service to address primary care demand was not useful for all emergency departments. To support successful and sustainable primary care services in or alongside EDs, policy makers and commissioners should consider varied ways that GPs can be employed to manage variation in local demand and also local contextual factors such as the ability to recruit and retain GPs, sustainable funding, clear governance frameworks, training, support and guidance for all staff. Whether or not streaming to a separate primary care service is useful also depended on the level of primary care demand.

Assessing guideline adherence in the management of type 1 diabetes mellitus in Australian children: a population-based sample survey.

INTRODUCTION: To estimate adherence to clinical practice guidelines in selected settings at a population level for Australian children with type 1 diabetes mellitus. RESEARCH DESIGN AND METHODS: Medical records of children with type 1 diabetes mellitus aged 0-15 years in 2012-2013 were targeted for sampling across inpatient, emergency department and community visits with specialist pediatricians in regional and metropolitan areas and tertiary pediatric hospitals in three states where approximately 60% of Australian children reside. Clinical recommendations extracted from two clinical practice guidelines were used to audit adherence. Results were aggregated across types of care (diagnosis, routine care, emergency care). RESULTS: Surveyors conducted 6346 indicator assessments from an audit of 539 healthcare visits by 251 children. Average adherence across all indicators was estimated at 79.9% (95% CI 69.5 to 88.0). Children with type 1 diabetes mellitus have higher rates of behavioral and psychological disorders, but only a third of children (37.9%; 95% CI 11.7 to 70.7) with suboptimal glycemic control (eg, hemoglobin A1c >10% or 86 mmol/mol) were screened for psychological disorders using a validated tool; this was the only indicator with <50% estimated adherence. Adherence by care type was: 86.1% for diagnosis (95% CI 76.7 to 92.7); 78.8% for routine care (95% CI 65.4 to 88.9) and 83.9% for emergency care (95% CI 78.4 to 88.5). CONCLUSIONS: Most indicators for care of children with type 1 diabetes mellitus were adhered to. However, there remains room to improve adherence to guidelines for optimization of practice consistency and minimization of future disease burden.

Using the WHO International Classification of patient safety framework to identify incident characteristics and contributing factors for medical or surgical complication deaths.

This study aimed to operationalise and use the World Health Organisation's International Classification for Patient Safety (ICPS) to identify incident characteristics and contributing factors of deaths involving complications of medical or surgical care in Australia. A sample of 500 coronial findings related to patient deaths following complications of surgical or medical care in Australia were reviewed using a modified-ICPS (mICPS). Over two-thirds (69.0%) of incidents occurred during treatment and 27.4% occurred in the operating theatre. Clinical process and procedures (55.9%), medication/IV fluids (11.2%) and healthcare-associated infection/complications (10.4%) were the most common incident types. Coroners made recommendations in 44.0% of deaths and organisations undertook preventive actions in 40.0% of deaths. This study demonstrated that the ICPS was able to be modified for practical use as a human factors taxonomy to identify sequences of incident types and contributing factors for patient deaths. Further testing of the mICPS is warranted.

Deepening our Understanding of Quality in Australia (DUQuA): An overview of a nation-wide, multi-level analysis of relationships between quality management systems and patient factors in 32 hospitals.

OBJECTIVE: The Deepening our Understanding of Quality in Australia (DUQuA) project is a multisite, multi-level, cross-sectional study of 32 of the largest hospitals in Australia. This overview examines relationships between (i) organization-level quality management systems and department-level quality management strategies and (ii) patient-level measures (clinical treatment processes, patient-reported perceptions of care and clinical outcomes) within Australian hospitals. DESIGN: We examined hospital quality improvement structures, processes and outcomes, collecting data at organization, department and patient levels for acute myocardial infarction (AMI), hip fracture and stroke. Data sources included surveys of quality managers, clinicians and patients, hospital visits, medical record reviews and national databases. Outcomes data and patient admissions data were analysed. Relationships between measures were evaluated using multi-level models. We based the methods on the Deepening our Understanding of Quality Improvement in Europe (DUQuE) framework, extending that work in parts and customizing the design to Australian circumstances. SETTING, PARTICIPANTS AND OUTCOME MEASURES: The 32 hospitals, containing 119 participating departments, provided wide representation across metropolitan, inner and outer regional Australia. We obtained 31 quality management, 1334 clinician and 857 patient questionnaires, and conducted 2401 medical record reviews and 151 external assessments. External data via a secondary source comprised 14 460 index patient admissions across 14 031 individual patients. Associations between hospital, Emergency Department (ED) and department-level systems and strategies and five patient-level outcomes were assessed: 19 of 165 associations (11.5%) were statistically significant, 12 of 79 positive associations (15.2%) and 7 of 85 negative associations (8.2%). RESULTS: We did not find clear relationships between hospital-level quality management systems, ED or department quality strategies and patient-level outcomes. ED-level clinical reviews were related to adherence to clinical practice guidelines for AMI, hip fracture and stroke, but in different directions. The results, when considered alongside the DUQuE results, are suggestive that front line interventions may be more influential than department-level interventions when shaping quality of care and that multi-pronged strategies are needed. Benchmark reports were sent to each participating hospital, stimulating targeted quality improvement activities. CONCLUSIONS: We found no compelling relationships between the way care is organized and the quality of care across three targeted patient-level outcome conditions. The study was cross-sectional, and thus we recommend that the relationships studied should be assessed for changes across time. Tracking care longitudinally so that quality improvement activities are monitored and fed back to participants is an important initiative that should be given priority as health systems strive to develop their capacity for quality improvement over time.

Appropriate management of acute gastroenteritis in Australian children: A population-based study.

OBJECTIVES: To determine the proportion of care provided to children with acute gastroenteritis (AGE) in Australia consistent with clinical practice guidelines. METHODS: Indicators were developed from national and international clinical practice guideline (CPG) recommendations and validated by an expert panel. Medical records from children ≤15 years presenting with AGE in three healthcare settings-Emergency Department (ED), hospital admissions and General Practitioner (GP) consultations-from randomly selected health districts across three Australian States were reviewed. Records were audited against 35 indicators by trained paediatric nurses, to determine adherence to CPGs during diagnosis, treatment, and ongoing management. RESULTS: A total of 14,434 indicator assessments were performed from 854 healthcare visits for AGE by 669 children, across 75 GPs, 34 EDs and 26 hospital inpatient services. Documented adherence to guidelines across all healthcare settings was 45.5% for indicators relating to diagnosis (95% CI: 40.7-50.4), 96.1% for treatment (95% CI: 94.8-97.1) and 57.6% for ongoing management (95% CI: 51.3-63.7). Adherence varied by healthcare setting, with adherence in GPs (54.6%; 95% CI: 51.1-58.1) lower than for either ED settings (84.7%; 95% CI: 82.4-86.9) or for inpatients (84.3%; 95% CI: 80.0-87.9); p<0.0001 for both differences. The difference between settings was driven by differences in the diagnosis and ongoing management phases of care. CONCLUSIONS: Adherence to clinical guidelines for children presenting to healthcare providers with AGE varies according to phase of care and healthcare setting. Although appropriate diagnostic assessment and ongoing management phase procedures are not well documented in medical records (particularly in the GP setting), in the treatment phase children are treated in accordance with guidelines over 90% of the time.

The impact of general practitioners working in or alongside emergency departments: a rapid realist review.

OBJECTIVES: Worldwide, emergency healthcare systems are under intense pressure from ever-increasing demand and evidence is urgently needed to understand how this can be safely managed. An estimated 10%-43% of emergency department patients could be treated by primary care services. In England, this has led to a policy proposal and £100 million of funding (US$130 million), for emergency departments to stream appropriate patients to a co-located primary care facility so they are 'free to care for the sickest patients'. However, the research evidence to support this initiative is weak. DESIGN: Rapid realist literature review. SETTING: Emergency departments. INCLUSION CRITERIA: Articles describing general practitioners working in or alongside emergency departments. AIM: To develop context-specific theories that explain how and why general practitioners working in or alongside emergency departments affect: patient flow; patient experience; patient safety and the wider healthcare system. RESULTS: Ninety-six articles contributed data to theory development sourced from earlier systematic reviews, updated database searches (Medline, Embase, CINAHL, Cochrane DSR & CRCT, DARE, HTA Database, BSC, PsycINFO and SCOPUS) and citation tracking. We developed theories to explain: how staff interpret the streaming system; different roles general practitioners adopt in the emergency department setting (traditional, extended, gatekeeper or emergency clinician) and how these factors influence patient (experience and safety) and organisational (demand and cost-effectiveness) outcomes. CONCLUSIONS: Multiple factors influence the effectiveness of emergency department streaming to general practitioners; caution is needed in embedding the policy until further research and evaluation are available. Service models that encourage the traditional general practitioner approach may have shorter process times for non-urgent patients; however, there is little evidence that this frees up emergency department staff to care for the sickest patients. Distinct primary care services offering increased patient choice may result in provider-induced demand. Economic evaluation and safety requires further research. PROSPERO REGISTRATION NUMBER: CRD42017069741.

Linking clinical quality indicators to research evidence - a case study in asthma management for children.

BACKGROUND: Clinical quality indicators are used to monitor the performance of healthcare services and should wherever possible be based on research evidence. Little is known however about the extent to which indicators in common use are based on research. The objective of this study is to measure the extent to which clinical quality indicators used in asthma management in children with outcome measurements can be linked to results in randomised controlled clinical trial (RCT) reports. This work is part of a broader research program to trial methods that improve the efficiency and accuracy of indicator development. METHODS: National-level indicators for asthma management in children were extracted from the National Quality Measures Clearinghouse database and the National Institute for Health and Care Excellence quality standards by two independent appraisers. Outcome measures were extracted from all published English language RCT reports for asthma management in children below the age of 12 published between 2005 and 2014. The two sets were then linked by manually mapping both to a common set of Unified Medical Language System (UMLS) concepts. RESULTS: The analysis identified 39 indicators and 562 full text RCTs dealing with asthma management in children. About 95% (37/39) of the indicators could be linked to RCT outcome measures. CONCLUSIONS: It is possible to identify relevant RCT reports for the majority of indicators used to assess the quality of asthma management in childhood. The methods reported here could be automated to more generally support assessment of candidate indicators against the research evidence.

Sources of unsafe primary care for older adults: a mixed-methods analysis of patient safety incident reports.

Background: older adults are frequent users of primary healthcare services, but are at increased risk of healthcare-related harm in this setting. Objectives: to describe the factors associated with actual or potential harm to patients aged 65 years and older, treated in primary care, to identify action to produce safer care. Design and Setting: a cross-sectional mixed-methods analysis of a national (England and Wales) database of patient safety incident reports from 2005 to 2013. Subjects: 1,591 primary care patient safety incident reports regarding patients aged 65 years and older. Methods: we developed a classification system for the analysis of patient safety incident reports to describe: the incident and preceding chain of incidents; other contributory factors; and patient harm outcome. We combined findings from exploratory descriptive and thematic analyses to identify key sources of unsafe care. Results: the main sources of unsafe care in our weighted sample were due to: medication-related incidents e.g. prescribing, dispensing and administering (n = 486, 31%; 15% serious patient harm); communication-related incidents e.g. incomplete or non-transfer of information across care boundaries (n = 390, 25%; 12% serious patient harm); and clinical decision-making incidents which led to the most serious patient harm outcomes (n = 203, 13%; 41% serious patient harm). Conclusion: priority areas for further research to determine the burden and preventability of unsafe primary care for older adults, include: the timely electronic tools for prescribing, dispensing and administering medication in the community; electronic transfer of information between healthcare settings; and, better clinical decision-making support and guidance.

Health system frameworks and performance indicators in eight countries: A comparative international analysis.

OBJECTIVES: Performance indicators are a popular mechanism for measuring the quality of healthcare to facilitate both quality improvement and systems management. Few studies make comparative assessments of different countries' performance indicator frameworks. This study identifies and compares frameworks and performance indicators used in selected Organisation for Economic Co-operation and Development health systems to measure and report on the performance of healthcare organisations and local health systems. Countries involved are Australia, Canada, Denmark, England, the Netherlands, New Zealand, Scotland and the United States. METHODS: Identification of comparable international indicators and analyses of their characteristics and of their broader national frameworks and contexts were undertaken. Two dimensions of indicators - that they are nationally consistent (used across the country rather than just regionally) and locally relevant (measured and reported publicly at a local level, for example, a health service) - were deemed important. RESULTS: The most commonly used domains in performance frameworks were safety, effectiveness and access. The search found 401 indicators that fulfilled the 'nationally consistent and locally relevant' criteria. Of these, 45 indicators are reported in more than one country. Cardiovascular, surgery and mental health were the most frequently reported disease groups. CONCLUSION: These comparative data inform researchers and policymakers internationally when designing health performance frameworks and indicator sets.