Tools developed and disseminated by guideline producers to promote the uptake of their guidelines.

BACKGROUND: The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs. OBJECTIVES: To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective. SEARCH METHODS: We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites. SELECTION CRITERIA: We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines. MAIN RESULTS: We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service. AUTHORS' CONCLUSIONS: Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.

Tailored interventions to address determinants of practice.

BACKGROUND: Tailored intervention strategies are frequently recommended among approaches to the implementation of improvement in health professional performance. Attempts to change the behaviour of health professionals may be impeded by a variety of different barriers, obstacles, or factors (which we collectively refer to as determinants of practice). Change may be more likely if implementation strategies are specifically chosen to address these determinants. OBJECTIVES: To determine whether tailored intervention strategies are effective in improving professional practice and healthcare outcomes. We compared interventions tailored to address the identified determinants of practice with either no intervention or interventions not tailored to the determinants. SEARCH METHODS: We conducted searches of The Cochrane Library, MEDLINE, EMBASE, PubMed, CINAHL, and the British Nursing Index to May 2014. We conducted a final search in December 2014 (in MEDLINE only) for more recently published trials. We conducted searches of the metaRegister of Controlled Trials (mRCT) in March 2013. We also handsearched two journals. SELECTION CRITERIA: Cluster-randomised controlled trials (RCTs) of interventions tailored to address prospectively identified determinants of practice, which reported objectively measured professional practice or healthcare outcomes, and where at least one group received an intervention designed to address prospectively identified determinants of practice. DATA COLLECTION AND ANALYSIS: Two review authors independently assessed quality and extracted data. We undertook qualitative and quantitative analyses, the quantitative analysis including two elements: we carried out 1) meta-regression analyses to compare interventions tailored to address identified determinants with either no interventions or an intervention(s) not tailored to the determinants, and 2) heterogeneity analyses to investigate sources of differences in the effectiveness of interventions. These included the effects of: risk of bias, use of a theory when developing the intervention, whether adjustment was made for local factors, and number of domains addressed with the determinants identified. MAIN RESULTS: We added nine studies to this review to bring the total number of included studies to 32 comparing an intervention tailored to address identified determinants of practice to no intervention or an intervention(s) not tailored to the determinants. The outcome was implementation of recommended practice, e.g. clinical practice guideline recommendations. Fifteen studies provided enough data to be included in the quantitative analysis. The pooled odds ratio was 1.56 (95% confidence interval (CI) 1.27 to 1.93, P value < 0.001). The 17 studies not included in the meta-analysis had findings showing variable effectiveness consistent with the findings of the meta-regression. AUTHORS' CONCLUSIONS: Despite the increase in the number of new studies identified, our overall finding is similar to that of the previous review. Tailored implementation can be effective, but the effect is variable and tends to be small to moderate. The number of studies remains small and more research is needed, including trials comparing tailored interventions to no or other interventions, but also studies to develop and investigate the components of tailoring (identification of the most important determinants, selecting interventions to address the determinants). Currently available studies have used different methods to identify determinants of practice and different approaches to selecting interventions to address the determinants. It is not yet clear how best to tailor interventions and therefore not clear what the effect of an optimally tailored intervention would be.

Reflective and automatic processes in health care professional behaviour: a dual process model tested across multiple behaviours.

BACKGROUND: Clinicians' behaviours require deliberate decision-making in complex contexts and may involve both impulsive (automatic) and reflective (motivational and volitional) processes. PURPOSE: The purpose of this study was to test a dual process model applied to clinician behaviours in their management of type 2 diabetes. METHODS: The design used six nested prospective correlational studies. Questionnaires were sent to general practitioners and nurses in 99 UK primary care practices, measuring reflective (intention, action planning and coping planning) and impulsive (automaticity) predictors for six guideline-recommended behaviours: blood pressure prescribing (N = 335), prescribing for glycemic control (N = 288), providing diabetes-related education (N = 346), providing weight advice (N = 417), providing self-management advice (N = 332) and examining the feet (N = 218). RESULTS: Respondent retention was high. A dual process model was supported for prescribing behaviours, weight advice, and examining the feet. A sequential reflective process was supported for blood pressure prescribing, self-management and weight advice, and diabetes-related education. CONCLUSIONS: Reflective and impulsive processes predict behaviour. Quality improvement interventions should consider both reflective and impulsive approaches to behaviour change.

Survey of consent practices in cluster randomized trials: improvements are needed in ethical conduct and reporting.

BACKGROUND: Informed consent procedures in cluster randomized trials (CRTs) are considerably more complicated than in individually randomized trials. In a CRT, the units of randomization, intervention, and observation may differ in a single trial; there can be multiple levels of participants (individual and cluster level); consent may be required separately for intervention and data collection; and there may be practical constraints to seeking informed consent, for example, due to cluster-level interventions or the sheer size of clusters. PURPOSE: We aimed to document consent practices at individual and cluster levels, assess the adequacy of reporting consent in trial publications, and assess associations with two trial characteristics that may influence consent requirements in CRTs: presence or absence of study interventions and presence or absence of data collection procedures at individual and cluster levels. METHODS: We reviewed a random sample of 300 CRTs published during 2000-2008. We sent survey questionnaires to 285 unique authors of these trials to gather detailed information about consent procedures used in each trial. RESULTS: In all, 182 authors (64%) responded. Overall, 93% (95% confidence interval (CI): 88.8%-96.6%) indicated that participant consent had been sought for some aspects of the study. Consent was less frequently sought for a study intervention (70% of respondents) than for data collection (88%). More than half of the respondents (52%) indicated that consent had been sought at both cluster and individual levels. There was strong evidence for under-reporting of consent in trial publications: only 63% of all trial publications reported that informed consent had been sought for some aspect of the study. The odds ratios (ORs) summarizing the association of the two trial characteristics with cluster-level participant consent were weak (OR = 1.17, p = 0.70 for presence of cluster-level study intervention and OR = 1.54, p = 0.29 for data collection); on the other hand, the ORs summarizing the associations with individual-level consent were strong (OR = 6.2, p < 0.0001 for presence of individual-level intervention and OR = 14.7, p < 0.0001 for data collection). LIMITATIONS: In all, 36% of authors did not respond to the survey; to the extent that consent practices in their trials were different than in respondents' trials, our results may be biased. CONCLUSIONS: There is a need for improvements in research practices in CRTs as well as their reporting. There may be a lack of clarity about consent requirements at the cluster level in particular. With the publication of the Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials, researchers and research ethics committees now have access to comprehensive ethics guidelines specific to CRTs.

General practitioners' psychosocial resources, distress, and sickness absence: a study comparing the UK and Finland.

BACKGROUND: Many countries, including the UK and Finland, face difficulties in recruiting GPs and one reason for these difficulties may be due to negative psychosocial work environments. OBJECTIVE: To compare psychosocial resources (job control and participative safety), distress and sickness absences between GPs from the UK and those from Finland. We also examined differences in how psychosocial resources are associated with distress and sickness absence and how distress is associated with sickness absence for both countries. METHODS: Two independent cross-sectional surveys conducted in general practice in the UK and Finland. Analyses of covariance were used for continuous outcome variables and logistic regression for dichotomized variable (sickness absence) adjusted for gender, qualification year and response format. RESULTS: UK GPs reported more opportunities to control their work and had higher levels of participative safety but were more distressed than Finnish GPs. Finnish GPs were 2.3 (95% confidence interval = 1.8-3.1) times more likely to report sickness absence spells than UK GPs. Among Finnish GPs, job control opportunities and high participative safety were associated with lower levels of distress, but not among UK GPs. Among UK GPs, higher distress was associated with 2.1 (95% confidence interval = 1.3-3.6) times higher likelihood of sickness absence spells, but among Finnish GPs there were no such association. CONCLUSION: In Finland, primary health care organizations should try to improve participative safety and increase control opportunities of physicians to decrease GP distress, whereas in the UK, other work or private life factors may be more important.

Theory-based predictors of multiple clinician behaviors in the management of diabetes.

UNLABELLED: Behavioral theory is often tested on one behavior in isolation from other behaviors and theories. We aimed to test the predictive validity of constructs from motivation and action theories of behavior across six diabetes-related clinician behaviors, within the same sample of primary care clinicians. Physicians and nurses (n = 427 from 99 practices in the United Kingdom) completed questionnaires at baseline and 12 months. PRIMARY OUTCOMES: six self-reported clinician behaviors related to advising, prescribing and examining measured at 12 months; secondary outcomes: baseline intention and patient-scenario-based simulated behavior. Across six behaviors, each theory accounted for a medium amount of variance for 12-month behavior (median R adj (2)  = 0.15), large and medium amount of variance for two intention measures (median R adj (2)  = 0.66; 0.34), and small amount of variance for simulated behavior (median R adj (2)  = 0.05). Intention/proximal goals, self-efficacy, and habit predicted all behaviors. Constructs from social cognitive theory (self-efficacy), learning theory (habit) and action and coping planning consistently predicted multiple clinician behaviors and should be targeted by quality improvement interventions.

The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions.

BACKGROUND: CONSORT guidelines call for precise reporting of behavior change interventions: we need rigorous methods of characterizing active content of interventions with precision and specificity. OBJECTIVES: The objective of this study is to develop an extensive, consensually agreed hierarchically structured taxonomy of techniques [behavior change techniques (BCTs)] used in behavior change interventions. METHODS: In a Delphi-type exercise, 14 experts rated labels and definitions of 124 BCTs from six published classification systems. Another 18 experts grouped BCTs according to similarity of active ingredients in an open-sort task. Inter-rater agreement amongst six researchers coding 85 intervention descriptions by BCTs was assessed. RESULTS: This resulted in 93 BCTs clustered into 16 groups. Of the 26 BCTs occurring at least five times, 23 had adjusted kappas of 0.60 or above. CONCLUSIONS: "BCT taxonomy v1," an extensive taxonomy of 93 consensually agreed, distinct BCTs, offers a step change as a method for specifying interventions, but we anticipate further development and evaluation based on international, interdisciplinary consensus.

Challenges in the research ethics review of cluster randomized trials: international survey of investigators.

BACKGROUND: Cluster randomized trials (CRTs) complicate the interpretation of standard research ethics guidelines for several reasons. For one, the units of allocation, intervention, and observation often may differ within a single trial. In the absence of tailored and internationally accepted ethics guidelines for CRTs, researchers and research ethics committees have no common standard by which to judge ethically appropriate practices in CRTs. Moreover, lack of familiarity with and consideration of the unique features of the CRT design by research ethics committees may cause difficulties in the research ethics review process, and amplify problems such as variability in the requirements and decisions reached by different research ethics committees. PURPOSE: We aimed to characterize research ethics review of CRTs, examine investigator experiences with the ethics review process, and assess the need for ethics guidelines for CRTs. METHODS: An electronic search strategy implemented in MEDLINE was used to identify and randomly sample 300 CRTs published in English language journals from 2000 to 2008. A web-based survey with closed- and open-ended questions was administered to corresponding authors in a series of six contacts. RESULTS: The survey response rate was 64%. Among 182 of 285 eligible respondents, 91% indicated that they had sought research ethics approval for the identified CRT, although only 70% respondents reported research ethics approval in the published article. Nearly one-third (31%) indicated that they have had to meet with ethics committees to explain aspects of their trials, nearly half (46%) experienced variability in the ethics review process in multijurisdictional trials, and 38% experienced negative impacts of the ethics review process on their trials, including delays in trial initiation (28%), increased costs (10%), compromised ability to recruit participants (16%), and compromised methodological quality (9%). Most respondents (74%; 95% confidence interval (CI): 67%-80%) agreed or strongly agreed that there is a need to develop ethics guidelines for CRTs, and (70%; 95% CI: 63%-77%) that ethics committees could be better informed about distinct ethical issues surrounding CRTs. LIMITATIONS: Thirty-six percent of authors did not respond to the survey. Due to the absence of comparable results from a representative sample of authors of individually randomized trials, it is unclear to what extent the reported challenges result from the CRT design. CONCLUSIONS: CRT investigators are experiencing challenges in the research ethics review of their trials, including excessive delays, variability in process and outcome, and imposed requirements that can have negative consequences for study conduct. Investigators identified a clear need for ethics guidelines for CRTs and education of research ethics committees about distinct ethical issues in CRTs.

Is organizational justice associated with clinical performance in the care for patients with diabetes in primary care? Evidence from the improving Quality of care in Diabetes study.

BACKGROUND: Type 2 diabetes is an increasingly prevalent illness, and there is considerable variation in the quality of care provided to patients with diabetes in primary care. OBJECTIVES: The aim of this study was to explore whether organizational justice and organizational citizenship behaviour are associated with the behaviours of clinical staff when providing care for patients with diabetes. METHODS: The data were from an ongoing prospective multicenter study, the 'improving Quality of care in Diabetes' (iQuaD) study. Participants (N = 467) were clinical staff in 99 primary care practices in the UK. The outcome measures were six self-reported clinical behaviours: prescribing for glycaemic control, prescribing for blood pressure control, foot examination, giving advice about weight management, providing general education about diabetes and giving advice about self-management. Organizational justice perceptions were collected using a self-administered questionnaire. The associations between organizational justice and behavioural outcomes were tested using linear multilevel regression modelling. RESULTS: Higher scores on the procedural component of organizational justice were associated with more frequent weight management advice, self-management advice and provision of general education for patients with diabetes. The associations between justice and clinical behaviours were not explained by individual or practice characteristics, but evidence was found for the partial mediating role of organizational citizenship behaviour. CONCLUSIONS: Quality improvement efforts aimed at increasing advice and education provision in diabetes management in primary care could target also perceptions of procedural justice.

Reporting of patient consent in healthcare cluster randomised trials is associated with the type of study interventions and publication characteristics.

OBJECTIVE: Cluster randomised trial (CRT) investigators face challenges in seeking informed consent from individual patients (cluster members). This study examined associations between reporting of patient consent in healthcare CRTs and characteristics of these trials. STUDY DESIGN: Consent practices and study characteristics were abstracted from a random sample of 160 CRTs performed in primary or hospital care settings that were published from 2000 to 2008. Multivariable logistic regression was used to examine associations between reporting of patient consent and methodological characteristics, as well as publication features such as date and journal of publication. RESULTS: 82 (53.8%) of 160 studies reported obtaining informed consent from individual patients. Reporting of patient consent was independently and positively associated with: smaller cluster size, the evaluation of experimental interventions targeted at patients, data collection from individual patients, publication later than 2004 and publication in higher-impact journals. CONCLUSIONS: Reporting of consent practices in published CRTs should be improved. Consent practices in published CRTs appear to be related to the type of interventions under study, as well as journal impact and trends in research ethics practices. These findings will inform best practices in trial conduct and ethics review, remediation of errors in consent practices and ethics review and the development of regulatory guidance for CRTs.

The impact of the UK 'Act FAST' stroke awareness campaign: content analysis of patients, witness and primary care clinicians' perceptions.

BACKGROUND: The English mass media campaign 'Act FAST' aimed to raise stroke awareness and the need to call emergency services at the onset of suspected stroke. We examined the perceived impact and views of the campaign in target populations to identify potential ways to optimise mass-media interventions for stroke. METHODS: Analysis of semi-structured interviews conducted as part of two qualitative studies, which examined factors influencing patient/witness response to acute stroke symptoms (n = 19 stroke patients, n = 26 stroke witnesses) and perceptions about raising stroke awareness in primary care (n = 30 clinicians). Both studies included questions about the 'Act FAST' campaign. Interviews were content analysed to determine campaign awareness, perceived impact on decisions and response to stroke, and views of the campaign. RESULTS: Most participants were aware of the Act FAST campaign. Some patients and witnesses reported that the campaign impacted upon their stroke recognition and response, but the majority reported no impact. Clinicians often perceived campaign success in raising stroke awareness, but few thought it would change response behaviours. Some patients and witnesses, and most primary care clinicians expressed positive views towards the campaign. Some more critical participant comments included perceptions of dramatic, irrelevant, and potentially confusing content, such as a prominent 'fire in the brain' analogy. CONCLUSIONS: Act FAST has had some perceived impact on stroke recognition and response in some stroke patients and witnesses, but the majority reported no campaign impact. Primary care clinicians were positive about the campaign, and believed it had impacted on stroke awareness and recognition but doubted impact on response behaviour. Potential avenues for optimising and complementing mass media campaigns such as 'Act FAST' were identified.

Interventions to increase clinical incident reporting in health care.

BACKGROUND: Reporting of adverse clinical events is thought to be an effective method of improving the safety of healthcare. Underreporting of these adverse events is often said to occur with consequence of missing of opportunities to learn from these incidents. A clinical incident can be defined as any occurrence which is not consistent with the routine care of the patient or the routine operation of the institution. OBJECTIVES: To assess the effects of interventions designed to increase clinical incident reporting in healthcare settings. SEARCH METHODS: We searched the the following databases: Cochrane Effective Practice and Organisation of Care Group Specialised Register, the Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE (OVID), EMBASE (OVID), CINAHL (EBSCO), Social Science Citation Index and Science Citation Index (Web of Knowledge), Healthstar (OVID), INSPEC, DHSS-DATA, SIGLE, ISI Conference Proceedings, Web of Science Conference Proceedings Citation Index (Science), Database of Abstracts of Reviews of Effectiveness (DARE). SELECTION CRITERIA: Randomised controlled trials (RCT), controlled before-after studies (CBA) and interrupted time series (ITS) of interventions designed to increase clinical incident reporting in healthcare. DATA COLLECTION AND ANALYSIS: At least two review authors assessed the eligibility of potentially relevant studies, extracted the data and assessed the quality of included studies. MAIN RESULTS: Four studies (one CBA and three ITS studies) met our inclusion criteria and were included in the review. The CBA study showed a significant improvement in incident reporting rates after the introduction of the new reporting system. Just one of the ITS studies showed a statistically significant improved effectiveness of the new reporting system from nine months. The other two studies reported no statistically significant improvements. AUTHORS' CONCLUSIONS: Because of the limitations of the studies it is not possible to draw conclusions for clinical practice. Anyone introducing a system into practice should give careful consideration to conducting an evaluation using a robust design.

Do incentives, reminders or reduced burden improve healthcare professional response rates in postal questionnaires? two randomised controlled trials.

BACKGROUND: Healthcare professional response rates to postal questionnaires are declining and this may threaten the validity and generalisability of their findings. Methods to improve response rates do incur costs (resources) and increase the cost of research projects. The aim of these randomised controlled trials (RCTs) was to assess whether 1) incentives, 2) type of reminder and/or 3) reduced response burden improve response rates; and to assess the cost implications of such additional effective interventions. METHODS: Two RCTs were conducted. In RCT A general dental practitioners (dentists) in Scotland were randomised to receive either an incentive; an abridged questionnaire or a full length questionnaire. In RCT B non-responders to a postal questionnaire sent to general medical practitioners (GPs) in the UK were firstly randomised to receive a second full length questionnaire as a reminder or a postcard reminder. Continued non-responders from RCT B were then randomised within their first randomisation to receive a third full length or an abridged questionnaire reminder. The cost-effectiveness of interventions that effectively increased response rates was assessed as a secondary outcome. RESULTS: There was no evidence that an incentive (52% versus 43%, Risk Difference (RD) -8.8 (95%CI -22.5, 4.8); or abridged questionnaire (46% versus 43%, RD -2.9 (95%CI -16.5, 10.7); statistically significantly improved dentist response rates compared to a full length questionnaire in RCT A. In RCT B there was no evidence that a full questionnaire reminder statistically significantly improved response rates compared to a postcard reminder (10.4% versus 7.3%, RD 3 (95%CI -0.1, 6.8). At a second reminder stage, GPs sent the abridged questionnaire responded more often (14.8% versus 7.2%, RD -7.7 (95%CI -12.8, -2.6). GPs who received a postcard reminder followed by an abridged questionnaire were most likely to respond (19.8% versus 6.3%, RD 8.1%, and 9.1% for full/postcard/full, three full or full/full/abridged questionnaire respectively). An abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy for increasing the response rate (£15.99 per response). CONCLUSIONS: When expecting or facing a low response rate to postal questionnaires, researchers should carefully identify the most efficient way to boost their response rate. In these studies, an abridged questionnaire containing fewer questions following a postcard reminder was the only cost-effective strategy. An increase in response rates may be explained by a combination of the number and type of contacts. Increasing the sampling frame may be more cost-effective than interventions to prompt non-responders. However, this may not strengthen the validity and generalisability of the survey findings and affect the representativeness of the sample.

Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes.

BACKGROUND: Inspection systems are used in health care to promote quality improvements, i.e. to achieve changes in organisational structures or processes, healthcare provider behaviour and patient outcomes. These systems are based on the assumption that externally promoted adherence to evidence-based standards (through inspection/assessment) will result in higher quality of health care. However, the benefits of external inspection in terms of organisational, provider and patient level outcomes are not clear. OBJECTIVES: To evaluate the effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour and patient outcomes. SEARCH METHODS: We searched the following electronic databases for studies: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, CINAHL, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effectiveness, Scopus, HMIC, Index to Theses and Intute from their inception dates up to May 2011. There was no language restriction and studies were included regardless of publication status. We searched the reference lists of included studies and contacted authors of relevant papers, accreditation bodies and the International Organization for Standardisation (ISO), regarding any further published or unpublished work. SELECTION CRITERIA: We included randomised controlled trials (RCTs), controlled clinical trials (CCTs), interrupted time-series (ITSs) and controlled before and after studies (CBAs) evaluating the effect of external inspection against external standards on healthcare organisation change, healthcare professional behaviour or patient outcomes in hospitals, primary healthcare organisations and other community-based healthcare organisations. DATA COLLECTION AND ANALYSIS: Two review authors independently applied eligibility criteria, extracted data and assessed the risk of bias of each included study. Since meta-analysis was not possible, we produced a narrative results summary. MAIN RESULTS: We identified one cluster-RCT involving 20 South African public hospitals (Salmon 2003) and one ITS involving all acute trusts in England (OPM 2009) for inclusion in this review.Salmon and colleagues (Salmon 2003) showed mixed effects of a hospital accreditation system on the compliance with COHSASA (the Council for Health Services Accreditation for South Africa) accreditation standards and eight indicators of hospital quality. Significantly improved total mean compliance score with COHSASA accreditation standards was found for 21/28 service elements: mean intervention effect (95% confidence interval (CI)) was 30% (23% to 57%) (P < 0.001). The score increased from 48% to 78% in intervention hospitals, while remaining the same in control hospitals (43%). A sub-analysis of 424 a priori identified critical criteria (19 service elements) showed significantly improved compliance with the critical standards (P < 0.001). The score increased from 41% (21% to 46%) to 75% (55% to 96%) in intervention hospitals, but was unchanged in control hospitals (37%). Only one of the nine intervention hospitals gained full accreditation status at the end of the study period, with two others reached pre-accreditation status.The median intervention effect (range) for the indicators of hospital quality of care was 2.4 (-1.9 to +11.8) and only one of the eight indicators: 'nurses perception of clinical quality, participation and teamwork' was significantly improved (mean intervention effect 5.7, P = 0.03).Re-analysis of the MRSA (methicillin-resistant Staphylococcus aureus) data showed statistically non-significant effects of the Healthcare Commissions Infection Inspection programme. AUTHORS' CONCLUSIONS: We only identified two studies for inclusion in this review, which highlights the paucity of high-quality controlled evaluations of the effectiveness of external inspection systems. No firm conclusions could therefore be drawn about the effectiveness of external inspection on compliance with standards.

The effectiveness of strategies to change organisational culture to improve healthcare performance.

BACKGROUND: Organisational culture is an anthropological metaphor used to inform research and consultancy and to explain organisational environments. Great emphasis has been placed during the last years on the need to change organisational culture in order to pursue effective improvement of healthcare performance. However, the precise nature of organisational culture in healthcare policy often remains underspecified and the desirability and feasibility of strategies to be adopted has been called into question. OBJECTIVES: To determine the effectiveness of strategies to change organisational culture in order to improve healthcare performance.To examine the effectiveness of these strategies according to different patterns of organisational culture. SEARCH STRATEGY: We searched the following electronic databases for primary studies: The Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, CINAHL, Sociological Abstracts, Web of Knowledge, PsycINFO, Business and Management, EThOS, Index to Theses, Intute, HMIC, SIGLE, and Scopus until October 2009. The Database of Abstracts of Reviews of Effectiveness (DARE) was searched for related reviews. We also searched the reference lists of all papers and relevant reviews identified, and we contacted experts in the field for advice on further potential studies. SELECTION CRITERIA: We considered randomised controlled trials (RCTs) or well designed quasi-experimental studies, controlled clinical trials (CCTs), controlled before and after studies (CBAs) and interrupted time series analyses (ITS) meeting the quality criteria used by the Cochrane Effective Practice and Organisation of Care Group (EPOC). Studies should be set in any type of healthcare organisation in which strategies to change organisational culture in order to improve healthcare performance were applied. Our main outcomes were objective measures of professional performance and patient outcome. DATA COLLECTION AND ANALYSIS: At least two review authors independently applied the criteria for inclusion and exclusion criteria to scan titles and abstracts and then to screen the full reports of selected citations. At each stage results were compared and discrepancies solved through discussion. MAIN RESULTS: The search strategy yielded 4239 records. After the full text assessment, no studies met the quality criteria used by the EPOC Group and evaluated the effectiveness of strategies to change organisational culture to improve healthcare performance. AUTHORS' CONCLUSIONS: It is not possible to draw any conclusions about the effectiveness of strategies to change organisational culture because we found no studies that fulfilled the methodological criteria for this review. Research efforts should focus on strengthening the evidence about the effectiveness of methods to change organisational culture to improve health care performance.

An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes.

BACKGROUND: There is considerable interest in the effectiveness of financial incentives in the delivery of health care. Incentives may be used in an attempt to increase the use of evidence-based treatments among healthcare professionals or to stimulate health professionals to change their clinical behaviour with respect to preventive, diagnostic and treatment decisions, or both. Financial incentives are an extrinsic source of motivation and exist when an individual can expect a monetary transfer which is made conditional on acting in a particular way. Since there are numerous reviews performed within the healthcare area describing the effects of various types of financial incentives, it is important to summarise the effectiveness of these in an overview to discern which are most effective in changing health professionals' behaviour and patient outcomes. OBJECTIVES: To conduct an overview of systematic reviews that evaluates the impact of financial incentives on healthcare professional behaviour and patient outcomes. METHODS: We searched the Cochrane Database of Systematic Reviews (CDSR) (The Cochrane Library); Database of Abstracts of Reviews of Effectiveness (DARE); TRIP; MEDLINE; EMBASE; Science Citation Index; Social Science Citation Index; NHS EED; HEED; EconLit; and Program in Policy Decision-Making (PPd) (from their inception dates up to January 2010). We searched the reference lists of all included reviews and carried out a citation search of those papers which cited studies included in the review. We included both Cochrane and non-Cochrane reviews of randomised controlled trials (RCTs), controlled clinical trials (CCTs), interrupted time series (ITSs) and controlled before and after studies (CBAs) that evaluated the effects of financial incentives on professional practice and patient outcomes, and that reported numerical results of the included individual studies. Two review authors independently extracted data and assessed the methodological quality of each review according to the AMSTAR criteria. We included systematic reviews of studies evaluating the effectiveness of any type of financial incentive. We grouped financial incentives into five groups: payment for working for a specified time period; payment for each service, episode or visit; payment for providing care for a patient or specific population; payment for providing a pre-specified level or providing a change in activity or quality of care; and mixed or other systems. We summarised data using vote counting. MAIN RESULTS: We identified four reviews reporting on 32 studies. Two reviews scored 7 on the AMSTAR criteria (moderate, score 5 to 7, quality) and two scored 9 (high, score 8 to 11, quality). The reported quality of the included studies was, by a variety of methods, low to moderate. Payment for working for a specified time period was generally ineffective, improving 3/11 outcomes from one study reported in one review. Payment for each service, episode or visit was generally effective, improving 7/10 outcomes from five studies reported in three reviews; payment for providing care for a patient or specific population was generally effective, improving 48/69 outcomes from 13 studies reported in two reviews; payment for providing a pre-specified level or providing a change in activity or quality of care was generally effective, improving 17/20 reported outcomes from 10 studies reported in two reviews; and mixed and other systems were of mixed effectiveness, improving 20/31 reported outcomes from seven studies reported in three reviews. When looking at the effect of financial incentives overall across categories of outcomes, they were of mixed effectiveness on consultation or visit rates (improving 10/17 outcomes from three studies in two reviews); generally effective in improving processes of care (improving 41/57 outcomes from 19 studies in three reviews); generally effective in improving referrals and admissions (improving 11/16 outcomes from 11 studies in four reviews); generally ineffective in improving compliance with guidelines outcomes (improving 5/17 outcomes from five studies in two reviews); and generally effective in improving prescribing costs outcomes (improving 28/34 outcomes from 10 studies in one review). AUTHORS' CONCLUSIONS: Financial incentives may be effective in changing healthcare professional practice. The evidence has serious methodological limitations and is also very limited in its completeness and generalisability. We found no evidence from reviews that examined the effect of financial incentives on patient outcomes.

Local opinion leaders: effects on professional practice and health care outcomes.

BACKGROUND: Clinical practice is not always evidence-based and, therefore, may not optimise patient outcomes. Opinion leaders disseminating and implementing 'best evidence' is one method that holds promise as a strategy to bridge evidence-practice gaps. OBJECTIVES: To assess the effectiveness of the use of local opinion leaders in improving professional practice and patient outcomes. SEARCH STRATEGY: We searched Cochrane EPOC Group Trials Register, the Cochrane Central Register of Controlled Trials, MEDLINE, EMBASE, HMIC, Science Citation Index, Social Science Citation Index, ISI Conference Proceedings and World Cat Dissertations up to 5 May 2009. In addition, we searched reference lists of included articles. SELECTION CRITERIA: Studies eligible for inclusion were randomised controlled trials investigating the effectiveness of using opinion leaders to disseminate evidence-based practice and reporting objective measures of professional performance and/or health outcomes. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data from each study and assessed its risk of bias. For each trial, we calculated the median risk difference (RD) for compliance with desired practice, adjusting for baseline where data were available. We reported the median adjusted RD for each of the main comparisons. MAIN RESULTS: We included 18 studies involving more than 296 hospitals and 318 PCPs. Fifteen studies (18 comparisons) contributed to the calculations of the median adjusted RD for the main comparisons. The effects of interventions varied across the 63 outcomes from 15% decrease in compliance to 72% increase in compliance with desired practice. The median adjusted RD for the main comparisons were: i) Opinion leaders compared to no intervention, +0.09; ii) Opinion leaders alone compared to a single intervention, +0.14; iii) Opinion leaders with one or more additional intervention(s) compared to the one or more additional intervention(s), +0.10; iv) Opinion leaders as part of multiple interventions compared to no intervention, +0.10. Overall, across all 18 studies the median adjusted RD was +0.12 representing a 12% absolute increase in compliance in the intervention group. AUTHORS' CONCLUSIONS: Opinion leaders alone or in combination with other interventions may successfully promote evidence-based practice, but effectiveness varies both within and between studies. These results are based on heterogeneous studies differing in terms of type of intervention, setting, and outcomes measured. In most of the studies the role of the opinion leader was not clearly described, and it is therefore not possible to say what the best way is to optimise the effectiveness of opinion leaders.

Public release of performance data in changing the behaviour of healthcare consumers, professionals or organisations.

BACKGROUND: It is becoming increasingly common to release information about the performance of hospitals, health professionals or providers, and healthcare organisations into the public domain. However, we do not know how this information is used and to what extent such reporting leads to quality improvement by changing the behaviour of healthcare consumers, providers and purchasers, or to what extent the performance of professionals and providers can be affected. OBJECTIVES: To determine the effectiveness of the public release of performance data in changing the behaviour of healthcare consumers, professionals and organisations. SEARCH METHODS: We searched the Cochrane Central Register of Controlled Trials (CENTRAL), Cochrane Effective Practice and Organisation of Care (EPOC) Trials Register, MEDLINE Ovid (from 1966), EMBASE Ovid (from 1979), CINAHL, PsycINFO Ovid (from 1806) and DARE up to 2011. SELECTION CRITERIA: We searched for randomised or quasi-randomised trials, interrupted time series and controlled before-after studies of the effects of publicly releasing data regarding any aspect of the performance of healthcare organisations or individuals. The papers had to report at least one main outcome related to selecting or changing care. Other outcome measures were awareness, attitude, views and knowledge of performance data and costs. DATA COLLECTION AND ANALYSIS: Two review authors independently screened studies for eligibility and extracted data. For each study, we extracted data about the target groups (healthcare consumers, healthcare providers and healthcare purchasers), performance data, main outcomes (choice of healthcare provider and improvement by means of changes in care) and other outcomes (awareness, attitude, views, knowledge of performance data and costs). MAIN RESULTS: We included four studies containing more than 35,000 consumers, and 1560 hospitals. Three studies were conducted in the USA and examined consumer behaviour after the public release of performance data. Two studies found no effect of Consumer Assessment of Healthcare Providers and Systems information on health plan choice in a Medicaid population. One interrupted time series study found a small positive effect of the publishing of data on patient volumes for coronary bypass surgery and low-complication outliers for lumbar discectomy, but these effects did not persist longer than two months after each public release. No effects on patient volumes for acute myocardial infarction were found.One cluster-randomised controlled trial, conducted in Canada, studied improvement changes in care after the public release of performance data for patients with acute myocardial infarction and congestive heart failure. No effects for the composite process-of-care indicators for either condition were found, but there were some improvements in the individual process-of-care indicators. There was an effect on the mortality rates for acute myocardial infarction. More quality improvement activities were initiated in response to the publicly-released report cards. No secondary outcomes were reported. AUTHORS' CONCLUSIONS: The small body of evidence available provides no consistent evidence that the public release of performance data changes consumer behaviour or improves care. Evidence that the public release of performance data may have an impact on the behaviour of healthcare professionals or organisations is lacking.

Capability and dependency in the Newcastle 85+ cohort study. Projections of future care needs.

BACKGROUND: Little is known of the capabilities of the oldest old, the fastest growing age group in the population. We aimed to estimate capability and dependency in a cohort of 85 year olds and to project future demand for care. METHODS: Structured interviews at age 85 with 841 people born in 1921 and living in Newcastle and North Tyneside, UK who were permanently registered with participating general practices. Measures of capability included were self-reported activities of daily living (ADL), timed up and go test (TUG), standardised mini-mental state examination (SMMSE), and assessment of urinary continence in order to classify interval-need dependency. To project future demand for care the proportion needing 24-hour care was applied to the 2008 England and Wales population projections of those aged 80 years and over by gender. RESULTS: Of participants, 62% (522/841) were women, 77% (651/841) lived in standard housing, 13% (106/841) in sheltered housing and 10% (84/841) in a care home. Overall, 20% (165/841) reported no difficulty with any of the ADLs. Men were more capable in performing ADLs and more independent than women. TUG validated self-reported ADLs. When classified by 'interval of need' 41% (332/810) were independent, 39% (317/810) required help less often than daily, 12% (94/810) required help at regular times of the day and 8% (67/810) required 24-hour care. Of care-home residents, 94% (77/82) required daily help or 24-hour care. Future need for 24-hour care for people aged 80 years or over in England and Wales is projected to increase by 82% from 2010 to 2030 with a demand for 630,000 care-home places by 2030. CONCLUSIONS: This analysis highlights the diversity of capability and levels of dependency in this cohort. A remarkably high proportion remain independent, particularly men. However a significant proportion of this population require 24-hour care at home or in care homes. Projections for the next 20 years suggest substantial increases in the number requiring 24-hour care due to population ageing and a proportionate increase in demand for care-home places unless innovative health and social care interventions are found.

Effect of point-of-care computer reminders on physician behaviour: a systematic review.

BACKGROUND: The opportunity to improve care using computer reminders is one of the main incentives for implementing sophisticated clinical information systems. We conducted a systematic review to quantify the expected magnitude of improvements in processes of care from computer reminders delivered to clinicians during their routine activities. METHODS: We searched the MEDLINE, Embase and CINAHL databases (to July 2008) and scanned the bibliographies of retrieved articles. We included studies in our review if they used a randomized or quasi-randomized design to evaluate improvements in processes or outcomes of care from computer reminders delivered to physicians during routine electronic ordering or charting activities. RESULTS: Among the 28 trials (reporting 32 comparisons) included in our study, we found that computer reminders improved adherence to processes of care by a median of 4.2% (interquartile range [IQR] 0.8%-18.8%). Using the best outcome from each study, we found that the median improvement was 5.6% (IQR 2.0%-19.2%). A minority of studies reported larger effects; however, no study characteristic or reminder feature significantly predicted the magnitude of effect except in one institution, where a well-developed, "homegrown" clinical information system achieved larger improvements than in all other studies (median 16.8% [IQR 8.7%-26.0%] v. 3.0% [IQR 0.5%-11.5%]; p = 0.04). A trend toward larger improvements was seen for reminders that required users to enter a response (median 12.9% [IQR 2.7%-22.8%] v. 2.7% [IQR 0.6%-5.6%]; p = 0.09). INTERPRETATION: Computer reminders produced much smaller improvements than those generally expected from the implementation of computerized order entry and electronic medical record systems. Further research is required to identify features of reminder systems consistently associated with clinically worthwhile improvements.