Evaluation of a hospital picture archiving and communication system.

OBJECTIVES: To establish the net costs to the hospital and the broad range of benefits associated with a hospital-wide picture archiving and communication system (PACS) that comprised digital acquisition, storage and transmission of radiological images via a hospital-wide network to 150 workstations. METHODS: 'Before and after' comparisons and time series analyses at Hammersmith Hospital (London, UK), and comparison with five other British hospitals where PACS was not being installed. The cost analysis considered implementation costs and changes in key elements of hospital running costs, including the impact of changes in the length of inpatient stays. A range of benefit measures were investigated, including image availability, avoidance of repeat imaging, avoidance of exposure to radiation, patient turn-round speed, time from examination to image availability in intensive care, avoidance of diagnostic 'errors' by casualty doctors, the additional diagnostic value of PACS-based images and clinician satisfaction. RESULTS: The annual equivalent capital cost of the PACS was 1.7 million Pounds (annual equivalent replacement cost: 0.8 million Pound). Overall, the PACS substantially increased running costs. No convincing evidence of a PACS-induced change in length of inpatient stay was found. PACS was associated with some improvements in the performance of the radiology department: improved image availability (97.7% versus 86.9%), lower repeat imaging rate (7.3% versus 9.9%) and 20% lower total radiation doses for examinations of the lateral lumbar spine. No improvements were identified in the quality of the radiology reporting service. Benefits outside radiology included shorter time from examination to image availability for routine uses in intensive care (19 versus 37 minutes), and a lower rate of diagnostic 'errors' in casualty (0.65% versus 1.51%). High levels of satisfaction with PACS were found amongst both providers and clinical users. CONCLUSIONS: PACS was almost universally preferred by users and brought many operational and clinical benefits. However, these advantages came at a significant capital and net running cost.

Examining the influence of picture archiving communication systems and other factors upon the length of stay for patients with total hip and total knee replacements.

OBJECTIVES: To examine the influence of a picture archiving and communication system (PACS) on the length of stay (LOS) for patients receiving total hip replacement (THR) or total knee replacement (TKR) procedures. METHODS: A before-and-after design was used. Data were collected on all THR and TKR procedures at Hammersmith Hospital from 1993-96. A regression approach was used to examine the influence of PACS on LOS. Factors such as patient age, sex, and physician were controlled for. RESULTS: Type of admission and discharge, month of procedure, complications, and number of procedures all significantly influenced LOS for patients undergoing THR. For patients receiving TKR, age, sex, admission, prosthetic complications, number of procedures, and PACS significantly influenced LOS. CONCLUSIONS: While this study shows an apparent reduction of 25% in the average LOS for TKR patients at the time PACS was introduced, this is unlikely to be a true PACS effect and no similar reduction in LOS was shown for THR patients.

Radiology report times: impact of picture archiving and communication systems.

OBJECTIVE: We investigated the impact on radiologist reporting time of the change from conventional film to hard-copy computerized radiography and of the subsequent move to soft-copy images on picture archiving and communication system (PACS) workstations. MATERIALS AND METHODS: A controlled before and after research design was undertaken. Data were collected on four occasions: two relating to conventional film, one relating to hard-copy computerized radiography, and one relating to soft-copy PACS images. Data collection was by direct observation of radiology reporting sessions by independent health service researchers. Data were collected on report times, details of images viewed, characteristics of the radiologist, and details of interruptions. To control for potential biases in the before and after comparisons, ordinary least squares multiple regression analysis was used. The principal comparison was between reports with PACS and reports with computerized radiography hard-copy because no change was noted in the organization of the reporting process between these two data collection rounds other than the introduction of the PACS. RESULTS: Data were collected on a total of 5568 report observations. Report time in the PACS data collection period was not significantly different (p = .32) than that in the computerized radiography hard-copy period. Reporting with the PACS was associated with significantly more (p < .01) historical images (i.e., images of the same patient obtained in previous examinations) being viewed. CONCLUSION: Report time was not lengthened by the introduction of the PACS. The finding that more historical images were viewed when the PACS was in use indicates that the PACS brought about a positive change in reporting practice.

Evaluation of diffuse technologies: the case of digital imaging networks.

There have been significant developments in recent years in the methodologies and methods for the evaluation of a wide range of health technologies. There remain, though, many technologies which are difficult to evaluate. Often the difficulty stems from the complexity of the technologies themselves, which are in effect hybrids, comprising combinations of several distinct elements. In this paper these are termed 'diffuse' technologies, because the different elements exert different costs and effects, often across several different services. Computer networks are one, increasingly important, example of such technologies in health care. While it is possible to evaluate individual elements of such technologies, it is not clear how to evaluate the technology as a whole, where the whole may be greater (or less) than the sum of the parts. The paper outlines a seven-stage framework for the evaluation of diffuse technologies. The general principles of evaluation are illustrated using the example of picture archiving and communication systems (PACS), which are computer systems designed to capture, store and distribute electronic radiological images within a hospital.

Explaining variation in radiologists' reporting times.

This paper describes an investigation into the reasons for variation in the time taken by senior radiologists to complete radiological reports. An observational study of the reporting process at one UK hospital was undertaken for a 25 day period. An independent health service researcher observed the radiology reporting process and collected data on a variety of factors including the time taken to produce the report, the number and nature of all images viewed, the experience of the radiologist, and the number of disturbances that occurred. The nature of the variation in reporting time was explored using both simple comparative statistics and more sophisticated multiple regression techniques. Data were collected on 2345 report observations and the median report time was 117 s. This research provides the first empirical evidence for systematic variation in reporting time. The results confirm the importance of certain factors that were expected to explain report time variation. For example, the results indicate that report time tended to be significantly shorter in reporting sessions that were busy, and significantly longer when the radiologist was disturbed during the reporting process or was training juniors during a reporting session. More surprising were the results indicating that there was no significant difference in report time for reports categorized as urgent or "hot" and those categorized as less urgent or "cold", and that report time appeared to vary systematically depending on the day of the week and on the time of day.

Issues in the evaluation of picture archiving and communication systems.

Picture archiving and communication systems (PACS) are an example of the application of computer technology in the medical field. PACS automates image handling in a hospital and has the potential to transform the way radiology is currently performed. This paper focuses on the evaluation of the PACS technology, and considers the claims that have been made for PACS, how these claims might be turned into questions to be addressed by evaluation and the appropriate methods for the evaluation of PACS. A distinction is drawn between evaluation questions for which the hospital is the appropriate focus and those for which the patient is the appropriate focus. The preferred research design is different for hospital focused PACS evaluation and patient-focused evaluation of small scale PACS systems. A contemporaneous experimental comparison within hospitals is the preferred design for the patient-focused evaluation of small scale PACS systems. The patient-focused evaluation of large scale systems and the hospital-focused evaluation of all PACS systems could feasibly be conducted as contemporaneous experimental comparisons between hospitals but the large research costs implied by such a design almost certainly mean that non-contemporaneous, non-experimental comparisons within hospitals are more realistic. The current situation for the PACS technology is that it has potential, but as yet unproven, benefits and a large capital cost. Thus, the primary purpose of funding additional PACS implementations must be to add to the currently small body of evaluation evidence.

Information strategy in the NHS: issues and challenges.

There has been considerable discussion of the nature and scope of information that purchasers and providers must acquire and use in the post-review NHS. Somewhat surprisingly, this has not been complemented by discussion of the potential for computer systems to support information management. This in spite of the publication of the NHS Information Management and Technology Strategy, which seems set to shape the way in which purchasers and providers manage data into the next century, and expenditure on computer systems which will be in the order of hundreds of millions of pounds over the next few years. Discusses some of the key challenges involved in implementing an IT infrastructure across the NHS, and identifies five issues which will substantially determine the success of the strategy.