Development and validation of an index to assess hospital quality management systems.

OBJECTIVE: The aim of this study was to develop and validate an index to assess the implementation of quality management systems (QMSs) in European countries. DESIGN: Questionnaire development was facilitated through expert opinion, literature review and earlier empirical research. A cross-sectional online survey utilizing the questionnaire was undertaken between May 2011 and February 2012. We used psychometric methods to explore the factor structure, reliability and validity of the instrument. SETTING AND PARTICIPANTS: As part of the Deepening our Understanding of Quality improvement in Europe (DUQuE) project, we invited a random sample of 188 hospitals in 7 countries. The quality managers of these hospitals were the main respondents. MAIN OUTCOME MEASURE: The extent of implementation of QMSs. RESULTS: Factor analysis yielded nine scales, which were combined to build the Quality Management Systems Index. Cronbach's reliability coefficients were satisfactory (ranging from 0.72 to 0.82) for eight scales and low for one scale (0.48). Corrected item-total correlations provided adequate evidence of factor homogeneity. Inter-scale correlations showed that every factor was related, but also distinct, and added to the index. Construct validity testing showed that the index was related to recent measures of quality. Participating hospitals attained a mean value of 19.7 (standard deviation of 4.7) on the index that theoretically ranged from 0 to 27. CONCLUSION: Assessing QMSs across Europe has the potential to help policy-makers and other stakeholders to compare hospitals and focus on the most important areas for improvement.

The associations between organizational culture, organizational structure and quality management in European hospitals.

OBJECTIVE: To better understand associations between organizational culture (OC), organizational management structure (OS) and quality management in hospitals. DESIGN: A multi-method, multi-level, cross-sectional observational study. SETTING AND PARTICIPANTS: As part of the DUQuE project (Deepening our Understanding of Quality improvement in Europe), a random sample of 188 hospitals in 7 countries (France, Poland, Turkey, Portugal, Spain, Germany and Czech Republic) participated in a comprehensive questionnaire survey and a one-day on-site surveyor audit. Respondents for this study (n = 158) included professional quality managers and hospital trustees. MAIN OUTCOME MEASURES: Extent of implementation of quality management systems, extent of compliance with existing management procedures and implementation of clinical quality activities. RESULTS: Among participating hospitals, 33% had a clan culture as their dominant culture type, 26% an open and developmental culture type, 16% a hierarchical culture type and 25% a rational culture type. The culture type had no statistically significant association with the outcome measures. Some structural characteristics were associated with the development of quality management systems. CONCLUSION: The type of OC was not associated with the development of quality management in hospitals. Other factors (not culture type) are associated with the development of quality management. An OS that uses fewer protocols is associated with a less developed quality management system, whereas an OS which supports innovation in care is associated with a more developed quality management system.

The use of on-site visits to assess compliance and implementation of quality management at hospital level.

OBJECTIVE: Stakeholders of hospitals often lack standardized tools to assess compliance with quality management strategies and the implementation of clinical quality activities in hospitals. Such assessment tools, if easy to use, could be helpful to hospitals, health-care purchasers and health-care inspectorates. The aim of our study was to determine the psychometric properties of two newly developed tools for measuring compliance with process-oriented quality management strategies and the extent of implementation of clinical quality strategies at the hospital level. DESIGN: We developed and tested two measurement instruments that could be used during on-site visits by trained external surveyors to calculate a Quality Management Compliance Index (QMCI) and a Clinical Quality Implementation Index (CQII). We used psychometric methods and the cross-sectional data to explore the factor structure, reliability and validity of each of these instruments. SETTING AND PARTICIPANTS: The sample consisted of 74 acute care hospitals selected at random from each of 7 European countries. MAIN OUTCOME MEASURES: The psychometric properties of the two indices (QMCI and CQII). RESULTS: Overall, the indices demonstrated favourable psychometric performance based on factor analysis, item correlations, internal consistency and hypothesis testing. Cronbach's alpha was acceptable for the scales of the QMCI (α: 0.74-0.78) and the CQII (α: 0.82-0.93). Inter-scale correlations revealed that the scales were positively correlated, but distinct. All scales added sufficient new information to each main index to be retained. CONCLUSION: This study has produced two reliable instruments that can be used during on-site visits to assess compliance with quality management strategies and implementation of quality management activities by hospitals in Europe and perhaps other jurisdictions.

Is having quality as an item on the executive board agenda associated with the implementation of quality management systems in European hospitals: a quantitative analysis.

OBJECTIVE: To assess whether there is a relationship between having quality as an item on the board's agenda, perceived external pressure (PEP) and the implementation of quality management in European hospitals. DESIGN: A quantitative, mixed method, cross-sectional study in seven European countries in 2011 surveying CEOs and quality managers and data from onsite audits. PARTICIPANTS: One hundred and fifty-five CEOs and 155 quality managers. SETTING: One hundred and fifty-five randomly selected acute care hospitals in seven European countries (Czech Republic, France, Germany, Poland, Portugal, Spain and Turkey). Main outcome measure(s) Three constructs reflecting quality management based on questionnaire and audit data: (i) Quality Management System Index, (ii) Quality Management Compliance Index and (iii) Clinical Quality Implementation Index. The main predictor was whether quality performance was on the executive board's agenda. RESULTS: Discussing quality performance at executive board meetings more often was associated with a higher quality management system score (regression coefficient b = 2.53; SE = 1.16; P = 0.030). We found a trend in the associations of discussing quality performance with quality compliance and clinical quality implementation. PEP did not modify these relationships. CONCLUSIONS: Having quality as an item on the executive board's agenda allows them to review and discuss quality performance more often in order to improve their hospital's quality management. Generally, and as this study found, having quality on the executive board's agenda matters.