Determinants of continuance intention in a post-adoption satisfaction evaluation of a clinical information system.

PURPOSE: The evaluation of end-user satisfaction is an essential part of any clinical information system (CIS) project. The purpose of this study is to evaluate the determinants of CIS continuance intention in a late post-adoption phase at the Georges Pompidou University Hospital (HEGP) in Paris. METHODS: We designed an electronic survey instrument based on an IT post-adoption model (ITPAM) developed from three previous models, i.e., the Delone and McLean Information Success Model, the Davis TAM model and the Bhattacherjee information system continuance intention model. RESULTS: 419 questionnaires were collected from CIS users directly involved in patient care. The perceived CIS quality, usefulness and user satisfaction are significantly lower for medical professions than other professional groups. Continuance intention is very high within all professional subgroups. In a multiple regression analysis, the global satisfaction (R(2) = .780) was positively and significantly correlated with CIS quality, confirmation of expectations and perceived CIS usefulness. The continuance intention (R(2) = .392) was positively and significantly correlated with perceived CIS usefulness, confirmation of expectations and global satisfaction. CONCLUSION: In a late post-adoption CIS deployment phase, continuance intention does not significantly depend on individual end user characteristics but is significantly associated with the perceived CIS usefulness, confirmation of expectations and global satisfaction.

Clinical information system post-adoption evaluation at the georges pompidou university hospital.

The evaluation of a clinical information system (CIS) at different stages of deployment and routine use is a key factor to improve acceptability and use by health professionals. This paper examines on an expectation-confirmation model (ITPAM) the relationships between the determinants of success of a CIS in a cross-sectional survey performed at the Georges Pompidou University Hospital (HEGP). Results for the groups of physicians and nurses that replied to the survey (n=312) suggest that health professional satisfaction (overall R(2)=0.60) is determined by the quality of user support (r=.21, p=<0001), ease of use (r=.19, p=<0001), confirmation of expectations (r=.15, p=.0037), usefulness (r=.12, p=.0068), and compatibility (r=.10, p=.0206). The best predictor of physician satisfaction (R(2)=0.71) was compatibility (r=.21, p=.0072) whereas for nurses (R(2)=0.52) it was user support (r=.22, p=<0001) and ease of use (r=.22, p=.0001). Confirmation of expectations had an impact on post-adoption expectation and user's satisfaction, and confirms its importance for CIS evaluation studies.

Electronic implementation of guidelines in the EsPeR system: a knowledge specification method.

Despite initiatives to standardize methods for the development of clinical guidelines, several barriers hinder their integration in daily clinical practice: failure to fulfil quality criteria, poor effectiveness of their dissemination. Computerization of guidelines can favor their dissemination. The initial step of computerization is the knowledge specification from the text of the guideline. We describe the method of knowledge specification, which is used in EsPeR (Personalized Estimate of Risks), a web-based decision support system in preventive medicine, which allows, for a given person, to estimate risks and access recommendations, based on clinical profile. This method is based on a structured and systematic analysis of text allowing detailed specification of a decision tree. We use decision tables to validate the decision algorithm and decision trees to specify this algorithm, along with elementary messages of recommendation. Editing tools are used to facilitate the process of validation and the workflow between expert physicians and computer scientists. Applied to eleven different guidelines, the method allows a quick and valid computerization and integration in the EsPeR system. The method used for computerization could help to define a framework usable at the initial step of guideline development in order to produce guidelines ready for electronic implementation.

Computerization of guidelines: a knowledge specification method to convert text to detailed decision tree for electronic implementation.

The initial step for the computerization of guidelines is the knowledge specification from the prose text of guidelines. We describe a method of knowledge specification based on a structured and systematic analysis of text allowing detailed specification of a decision tree. We use decision tables to validate the decision algorithm and decision trees to specify and represent this algorithm, along with elementary messages of recommendation. Edition tools are also necessary to facilitate the process of validation and workflow between expert physicians who will validate the specified knowledge and computer scientist who will encode the specified knowledge in a guide-line model. Applied to eleven different guidelines issued by an official agency, the method allows a quick and valid computerization and integration in a larger decision support system called EsPeR (Personalized Estimate of Risks). The quality of the text guidelines is however still to be developed further. The method used for computerization could help to define a framework usable at the initial step of guideline development in order to produce guidelines ready for electronic implementation.

Combining risks estimations and clinical practice guidelines in a computer decision aid: a pilot study of the EsPeR system.

Many preventable diseases such as ischemic heart diseases or breast cancer are still not adequately managed in the population. Computerized decision support systems are one of the solutions for improving the quality of prevention strategies. We designed a system called EsPeR (Personalised Estimate of Risks) combining calculation of several risks and computerisation of guidelines (cardio-vascular prevention, screening for breast cancer, colorectal cancer, uterine cervix cancer, and prostate cancer, diagnosis of depression and suicide risk). We present a qualitative evaluation of its ergonomics, its understanding and acceptance by a group of general practitioners. We organised 4 focus groups comprising 6-11 general practitioners. Physicians worked on several structured clinical scenario with help of EsPeR, and 3 senior investigators leaded structured discussion sessions. Initial sessions identified several ergonomics flaws that were easily corrected. Both clinical scenari and discussion sessions identified several problems of insufficient comprehension (expression of risks, definition of familial history of disease), lack of knowledge, and acceptance of recommendation by both the physician. Educational and organisational components (i.e. time constraints) as well as acceptance of evidence-based decision-making should be taken into account before launching computerised decision support system, or testing them in randomised trials.

A computer decision aid for medical prevention: a pilot qualitative study of the Personalized Estimate of Risks (EsPeR) system.

BACKGROUND: Many preventable diseases such as ischemic heart diseases and breast cancer prevail at a large scale in the general population. Computerized decision support systems are one of the solutions for improving the quality of prevention strategies. METHODS: The system called EsPeR (Personalized Estimate of Risks) combines calculation of several risks with computerisation of guidelines (cardiovascular prevention, screening for breast cancer, colorectal cancer, uterine cervix cancer, and prostate cancer, diagnosis of depression and suicide risk). We present a qualitative evaluation of its ergonomics, as well as it's understanding and acceptance by a group of general practitioners. We organised four focus groups each including 6-11 general practitioners. Physicians worked on several structured clinical scenarios with the help of EsPeR, and three senior investigators leaded structured discussion sessions. RESULTS: The initial sessions identified several ergonomic flaws of the system that were easily corrected. Both clinical scenarios and discussion sessions identified several problems related to the insufficient comprehension (expression of risks, definition of familial history of disease), and difficulty for the physicians to accept some of the recommendations. CONCLUSION: Educational, socio-professional and organisational components (i.e. time constraints for training and use of the EsPeR system during consultation) as well as acceptance of evidence-based decision-making should be taken into account before launching computerised decision support systems, or their application in randomised trials.