A paediatric telecardiology service for district hospitals in south-east England: an observational study.

OBJECTIVES: To compare caseloads of new patients assessed by paediatric cardiologists face-to-face or during teleconferences, and assess NHS costs for the alternative referral arrangements. DESIGN: Prospective cohort study over 15 months. SETTING: Four district hospitals in south-east England and a London paediatric cardiology centre. PATIENTS: Babies and children. INTERVENTION: A telecardiology service introduced alongside outreach clinics. MEASUREMENTS: Clinical outcomes and mean NHS costs per patient. RESULTS: 266 new patients were studied: 75 had teleconsultations (19 of 42 newborns and 56 of 224 infants and children). Teleconsultation patients generally were younger (49% being under 1 year compared with 32% seen personally (p = 0.025)) and their symptoms were not as severe. A cardiac intervention was undertaken immediately or planned for five telemedicine patients (7%) and 30 conventional patients (16%). However, similar proportions of patients were discharged after being assessed (32% telemedicine and 39% conventional). During scheduled teleconferences the mean duration of time per patient in sessions involving real-time echocardiography was 14.4 min, and 8.5 min in sessions where pre-recorded videos were transmitted. Mean cost comparisons for telemedicine and face-to-face patients over 14-day and 6-month follow-up showed the telecardiology service to be cost-neutral for the three hospitals with infrequently-held outreach clinics (1519 UK pounds vs 1724 UK pounds respectively after 14 days). CONCLUSION: Paediatric cardiology centres with small cadres of specialists are under pressure to cope with ever-expanding caseloads of new patients with suspected anomalies. Innovative use of telecardiology alongside conventional outreach services should suitably, and economically, enhance access to these specialists.

The cost-effectiveness of magnetic resonance imaging for investigation of the knee joint.

OBJECTIVES: This study considered the role of magnetic resonance imaging (MRI) in the diagnosis of knee injuries in a district general hospital (DGH) setting. The principal objective was to identify whether the use of MRI had a major impact on the clinical management of patients presenting with chronic knee problems, in whom surgery was being considered, whether it reduced overall costs and whether it improved patient outcome. In addition, the research: (1) explored the 'diagnostic accuracy' of initial clinical investigation of the knee by an orthopaedic trainee, consultant knee specialist and consultant radiologist; (2) considered the variability and diagnostic accuracy of interpretations of knee MRI investigations between radiologists; (3) measured the strength of preference for the potential diagnostic/therapeutic impact of knee MRI (i.e. the avoidance of surgery). METHODS - RANDOMISED CONTROLLED TRIAL: The research was based on a single-centre randomised controlled trial conducted at Kent and Canterbury Hospital. Patients attending with knee problems in whom surgery was being considered were recruited from routine orthopaedic clinics. Most patients had been referred by their general practitioner. Patients were randomised to either investigation using an MRI scan (MRI trial arm) or investigation using arthroscopy (no-MRI trial arm). The study investigated the benefits of knee MRI at two levels: diagnostic/therapeutic impact (i.e. avoidance of surgery) and patient outcome (using the Short Form with 36 items and EQ-5D quality-of-life measurement instruments). Quality of life was assessed at baseline and at 6 and 12 months. Costs were assessed from the perspectives of the NHS and patients. All analyses were by intention to treat. METHODS - SUBSTUDIES (INVESTIGATION OF DIAGNOSTIC ACCURACY): For the investigation of diagnostic accuracy of initial clinical investigation, the sample comprised 114 patients recruited in a separate study conducted at St Thomas' Hospital. The sample was drawn from patients presenting at the Accident and Emergency Department with an acute knee injury. All study patients received an MRI scan, but initial diagnosis was made without access to the scan or the radiologist's report. After 12 months, all clinical notes and MRI scans of study patients were reviewed and a final 'reference standard' diagnosis for each patient was reached. Comparison was made between the diagnosis recorded by each clinician (i.e. orthopaedic trainee, knee specialist and consultant radiologist) and the reference diagnosis. METHODS - SUBSTUDIES (INVESTIGATION OF THE GENERALISABILITY OF RESULTS): For this substudy, the MRI images from 80 patients (recruited at St Thomas' Hospital) were interpreted independently by seven consultant radiologists at DGHs and the St Thomas' Hospital MRI radiologist. For each area of the knee, the level of agreement (measured using weighted kappa) between the responses of the eight radiologists and the reference standard diagnosis was assessed. METHODS - SUBSTUDIES (INVESTIGATION OF PREFERENCES): The investigation of potential patient preferences for the diagnostic/therapeutic impact of MRI was explored using a discrete choice conjoint measurement research design. Choices involved selecting between two alternative scenarios described using four attributes, and data were collected from 585 undergraduate sports science students and analysed using a random-effects probit model. RESULTS - RANDOMISED CONTROLLED TRIAL: The trial recruited 118 patients (59 randomly allocated to each arm). The two groups were similar in important respects at baseline. The central finding was of no statistically significant differences between groups in all measures of health outcome, although a trend in favour of the no-MRI group was observed. However, the use of MRI was found to be associated with a positive diagnostic/therapeutic impact: a significantly smaller proportion of patients in the MRI group underwent surgery (MRI = 0.41, no-MRI = 0.71; p = 0.001). There was a similar mean overall NHS cost for both groups. RESULTS - SUBSTUDIES (INVESTIGATION OF DIAGNOSTIC ACCURACY): The exploration of diagnostic accuracy found that, when compared to orthopaedic trainees (44% correct diagnoses) or to radiologists reporting an MRI scan (68% correct diagnoses), the accuracy rate was higher for knee specialists (72% correct diagnoses). RESULTS - SUBSTUDIES (INVESTIGATION OF THE GENERALISABILITY OF RESULTS): This generalisability study indicated that, in general terms, radiologists in DGHs provide accurate interpretations of knee MRI images that are similar to a radiologist at a specialist centre. The one area of the knee for which this did not hold was the lateral collateral ligament. RESULTS - SUBSTUDIES (INVESTIGATION OF PREFERENCES): The central finding for this substudy was that, on average and within the range specified, choices in this group of potential patients were not significantly influenced by variation in the chance of avoiding surgery. CONCLUSIONS - IMPLICATIONS FOR HEALTHCARE: The evidence presented in this report supports the conclusions that the use of MRI in patients presenting at DGHs with chronic knee problems in whom arthroscopy was being considered did not increase NHS costs overall, was not associated with significantly worse outcomes and avoided surgery in a significant proportion of patients. CONCLUSIONS - RECOMMENDATIONS FOR FURTHER RESEARCH (IN PRIORITY ORDER): (1) The trial data demonstrated that the use of MRI in patients with chronic knee problems reduced the need for surgery. However, the link between diagnostic processes and changes in health outcome is indirect and the finding of no-MRI-related effect on health outcome may, therefore, be a consequence of the limited power of the trial. Further research to confirm (or contradict) these findings would be valuable. (2) The investigation of diagnostic accuracy involved comparison with a reference diagnosis established by a panel of two clinical members of the research team. It would be interesting to explore the extent to which the results would differ using an external panel. (3) The result from the preference study, indicating that the potential diagnostic/therapeutic impact of knee MRI was not highly valued, is a surprising finding that would be important to explore in general public or patient populations. (4) The focus for the trial-based aspects of this research was the DGH and patients presenting with chronic knee problems who were being considered for surgery. Care should be taken in generalising from these results to other patient groups (e.g. acute knee injuries) or to other settings (e.g. specialist centres). Further clinical trials would be required in order to answer such questions.

Comparison of doses for bedside examinations of the chest with conventional screen-film and computed radiography: results of a randomized controlled trial.

PURPOSE: To compare the radiation doses received by patients during bedside chest radiography when a computed radiography system was used and when a 400-speed screen-film system was used. MATERIALS AND METHODS: A randomized controlled trial was performed whereby all patients who were admitted to an intensive care unit were randomly assigned at admission to have all radiographic chest images obtained with either computed or conventional screen-film radiography. Doses were measured for 1 year, during which 269 patients underwent imaging. For these patients, surface entry doses were measured by means of individual thermoluminescent dosimeters placed on the skin at the center of the radiation beam. In addition, data were collected relating to the patient and examination characteristics, as well as to repeat examinations. Effective doses were calculated. RESULTS: The patients in the two arms of the study were well matched. The surface entry doses were higher in the computed radiography group (median, 0.21 mGy for computed radiography and 0.16 mGy for conventional radiography), and the effective doses were also higher (median, 0.036 mSv for computed radiography and 0.027 mSv for conventional radiography). Fewer examinations were repeated when computed radiography was used. CONCLUSION: When computed radiography was used, patient doses increased. The speed of this computed radiography system, which uses phosphor plate imaging, equates approximately to a 300-speed screen-film system.

A comparison of the time required by radiologists for the preparation of clinico-radiological meetings when film and PACS are used.

The hypothesis was that when a hospital-wide Picture Archive and Communications System (PACS) is used, preparation for clinico-radiological meetings is faster, and more images are available, than when a conventional film system is used. This paper reports a study which compared the preparation time by radiologists when film was used with the time for the same activity when a hospital-wide PACS was used at Hammersmith Hospital for the preparation of the respirator medicine and hepato-biliary meeting. It was found that when PACS was used the time per patient to prepare for the respiratory medicine session was reduced by 11.1 min and that similarly, 16 min per patient was saved in the preparation of the hepato-biliary sessions. The number of images which were unavailable for the session was reduced when PACS was in operation, but this reduction was not shown to be statistically significant. The introduction of PACS at Hammersmith Hospital has significantly reduced the time spent by radiologists in preparing for the two clinico-radiological sessions studied and, if this is extended to the other numerous sessions held each week, contributes to a considerable saving of staff time within the radiology department.

The effect of a picture archiving and communications system (PACS) on diagnostic performance in the accident and emergency department.

OBJECTIVE: A study has been conducted to identify the benefits to the accident and emergency (A&E) department of a hospital wide Picture Archiving and Communications System (PACS). METHODS: The study was conducted in two parts: firstly while the hospital was using conventional radiographic films, and secondly when the PACS was in operation. For each part of the study, the diagnoses of radiographic images made by A&E clinicians were compared with those made by radiologists. This resulted in the estimation of the incidence of false negative findings by the A&E staff. The management of patients with such findings was studied to identify those for whom a change of treatment was required. Such data for the two periods, when film and when PACS was used, were compared. RESULTS: It was found that the overall rate of misdiagnoses across all A&E patients who had radiography was low in both periods and there was a significant reduction when PACS was used (1.5% for film and 0.7% for PACS, 95% CI for difference between proportions: -0.014 to -0.0034), but the rate of serious misdiagnoses involving patient recall did not change significantly (95% CI for difference between proportions: -0.0059 to +0.0001). CONCLUSIONS: When PACS was used the diagnostic performance by A&E staff improved by reducing false negative interpretations but the rate of serious misdiagnosis did not change.

The impact of a picture archiving and communication system (PACS) upon an intensive care unit.

OBJECTIVE: The aim of the study was to assess the effect of the introduction of PACS (Picture Archiving and Communication System) upon image availability in an Intensive Care Unit (ICU) and the consequent impact upon the behaviour of the ICU physicians, in terms of the initiation of image-based clinical actions. DESIGN: A before and after study was used to compare the speed of image availability prior to, and following, the implementation of a hospital-wide PACS. SETTING: The research was part of an economic evaluation of PACS at Hammersmith Hospital, West London. PATIENTS AND PARTICIPANTS: All ICU patients who were X-rayed during two pre-PACS and one post-PACS data collection periods were included within the study. MEASUREMENTS: The times of: the X-ray request; acquisition; availability on ICU; and of any image-based clinical action taken by the ICU physician were recorded by radiographers and ICU physicians. RESULTS: PACS significantly reduced the time between request and image availability on ICU for routine X-rays but did not have any measurable impact upon the time clinical actions were initiated by ICU physicians. The data on non-routine images were statistically inconclusive. CONCLUSIONS: This study shows that PACS significantly improves the speed of delivery of routine images to the ICU, but it appears that the instigation of image-based clinical actions is determined by other organisational factors in ICU, such as ward rounds, rather than the availability of the image for viewing. Further work is required on non-routine X-rays to clarify the impact of PACS on physician behaviour in clinically urgent situations.

The effect of a picture archiving and communication system (PACS) on patient radiation doses for examination of the lateral lumbar spine.

This study was conducted to determine whether the doses for the radiographic examination of the lateral lumbar spine changed as a result of the introduction of a hospital-wide picture archiving and communication system (PACS). Doses were measured by thermoluminescent dosimeters (TLD) and dose-area product (DAP) meter readings for 100 patient examinations using a 300-speed conventional film/screen system and for 96 patient examinations when PACS was fully operational. Radiographic technique, exposure factors and patient characteristics were noted and effective doses were calculated, and a comparison was made of all variables. No significant differences between conventional and PACS working were found in surface entry and effective doses for single views of the lateral lumbar spine, but there was a 20% reduction in DAP readings with PACS. However, when summed doses for all images, including rejects, required to demonstrate the lateral lumbar spine for each patient were compared, PACS was found to be associated with significantly lower surface entry (TLD) dose, DAP reading and effective dose (28%, 36% and 16%, respectively) than conventional film. For single images of L1-5, when PACS was in use, there was a significant reduction in the DAP readings and increases in the area of the film/plate irradiated, the focus-to-skin distance and the focus-to-film distance. In addition, significantly fewer lumbosacral junction views were undertaken when PACS was in use. Since many confounding factors may have influenced the results over the period of dose measurement, regression models were used to determine the significance of PACS. These models showed that the use of PACS was not significant in causing any differences in the dose for single images as compared with when film was used, but was significant in the resulting total dose reductions for the examinations.

The benefits of hospital-wide picture archiving and communication systems: a survey of clinical users of radiology services.

This paper describes one element of a broad evaluation of a hospital-wide picture archiving and communication system (PACS): an assessment of the views of users of the radiology service, their major causes of dissatisfaction with the service, the incidence of image unavailability, and the consequences of images being unavailable. The principal research design was a "before and after" comparison at Hammersmith Hospital, as the hospital site introducing PACS. Several other hospitals were included in this survey, for comparison. Questionnaires were distributed several times before PACS was operational at Hammersmith, and on one occasion after. The overall response rate was 54%. The main pre-PACS radiology-related problem areas were: the non-availability of images, the non-availability of written reports when clinically required, and the time devoted by junior staff to image searching. PACS greatly reduced the perceived problem of image non-availability. But Hammersmith's problems with the availability of radiological reports still remained when PACS was operational. The time junior doctors spent in image-searching was dramatically reduced by the introduction of PACS.

Evaluation of a hospital picture archiving and communication system.

OBJECTIVES: To establish the net costs to the hospital and the broad range of benefits associated with a hospital-wide picture archiving and communication system (PACS) that comprised digital acquisition, storage and transmission of radiological images via a hospital-wide network to 150 workstations. METHODS: 'Before and after' comparisons and time series analyses at Hammersmith Hospital (London, UK), and comparison with five other British hospitals where PACS was not being installed. The cost analysis considered implementation costs and changes in key elements of hospital running costs, including the impact of changes in the length of inpatient stays. A range of benefit measures were investigated, including image availability, avoidance of repeat imaging, avoidance of exposure to radiation, patient turn-round speed, time from examination to image availability in intensive care, avoidance of diagnostic 'errors' by casualty doctors, the additional diagnostic value of PACS-based images and clinician satisfaction. RESULTS: The annual equivalent capital cost of the PACS was 1.7 million Pounds (annual equivalent replacement cost: 0.8 million Pound). Overall, the PACS substantially increased running costs. No convincing evidence of a PACS-induced change in length of inpatient stay was found. PACS was associated with some improvements in the performance of the radiology department: improved image availability (97.7% versus 86.9%), lower repeat imaging rate (7.3% versus 9.9%) and 20% lower total radiation doses for examinations of the lateral lumbar spine. No improvements were identified in the quality of the radiology reporting service. Benefits outside radiology included shorter time from examination to image availability for routine uses in intensive care (19 versus 37 minutes), and a lower rate of diagnostic 'errors' in casualty (0.65% versus 1.51%). High levels of satisfaction with PACS were found amongst both providers and clinical users. CONCLUSIONS: PACS was almost universally preferred by users and brought many operational and clinical benefits. However, these advantages came at a significant capital and net running cost.

A comparison of image reject rates when using film, hard copy computed radiography and soft copy images on picture archiving and communication systems (PACS) workstations.

A comparison has been made of the reject rates of plain images for three separate periods when film, computed radiography (CR) and PACS systems were in operation throughout the Hammersmith Hospital, London. There was a statistically significant reduction in the overall percentage reject rate across all examinations from 9.9% to 8.1% when the hospital changed from using a conventional film based system to a CR system. There was a further reduction in the reject rate to 7.3% when the hospital moved to a hospital-wide PACS system, but this change was not statistically significant. Using estimations of the total number of images used, the percentage reject rates were 6.6% for film, 5.5% for CR and 5.5% for PACS. Thus, if the radiation dose for each image is unchanged, and the same types of images are used for the examination of each body area, a move from conventional film imaging to phosphor plate imaging provides the potential to reduce the patient population dose.

Comparison of film, hard copy computed radiography (CR) and soft copy picture archiving and communication (PACS) systems using a contrast detail test object.

This paper describes two experiments where a widely available test object (FAXIL TO20) was used to compare film, hard copy computed radiography (CR) and soft copy picture archiving and communication systems (PACS) images. Baseline images were produced with a fixed mAs. All images were scored by four experienced medical physicists. Contrast detail curves for the three types of images were almost identical. A second series of images was produced with the mAs varying from 1 mAs to 250 mAs. The contrast detail curves were plotted for each mAs value and the wider exposure latitude of CR compared with film was demonstrated. Use of PACS provided no further increase in exposure latitude. The density of the film images increased with mAs but the density of the CR hard copy images remained constant. It is of concern that the wider latitude of the CR images extends to exposures that are much higher than those used for film with no noticeable change in CR image density but with better images at higher exposures, because the potential exists for patient doses to increase. Hard copy CR images provide information about the exposure index which relates to the input dose to the plate and hence approximately to the dose to the patient. However, since such information is currently not available on default soft copy images, the authors suggest that all manufacturers of PACS should provide an indication of dose as a mandatory default setting.

Radiology report times: impact of picture archiving and communication systems.

OBJECTIVE: We investigated the impact on radiologist reporting time of the change from conventional film to hard-copy computerized radiography and of the subsequent move to soft-copy images on picture archiving and communication system (PACS) workstations. MATERIALS AND METHODS: A controlled before and after research design was undertaken. Data were collected on four occasions: two relating to conventional film, one relating to hard-copy computerized radiography, and one relating to soft-copy PACS images. Data collection was by direct observation of radiology reporting sessions by independent health service researchers. Data were collected on report times, details of images viewed, characteristics of the radiologist, and details of interruptions. To control for potential biases in the before and after comparisons, ordinary least squares multiple regression analysis was used. The principal comparison was between reports with PACS and reports with computerized radiography hard-copy because no change was noted in the organization of the reporting process between these two data collection rounds other than the introduction of the PACS. RESULTS: Data were collected on a total of 5568 report observations. Report time in the PACS data collection period was not significantly different (p = .32) than that in the computerized radiography hard-copy period. Reporting with the PACS was associated with significantly more (p < .01) historical images (i.e., images of the same patient obtained in previous examinations) being viewed. CONCLUSION: Report time was not lengthened by the introduction of the PACS. The finding that more historical images were viewed when the PACS was in use indicates that the PACS brought about a positive change in reporting practice.

The effect of PACS on the visualization of the lateral cervical spine and the management of patients presenting with trauma.

In patients presenting with trauma, early diagnosis of neck injuries is likely to affect long-term outcome. This paper reports a study that compared lateral images of the cervical spine produced by a Picture Archiving and Communication System (PACS) with the same images produced using computed radiography (CR). The study was undertaken at the Hammersmith Hospital, London. Data were collected on 100 patients who presented with trauma. Both soft copy (PACS) and hard copy (CR) images of the cervical spine were produced for each patient from the same radiographic exposure. The images were viewed by five clinical members of the Accident and Emergency Department. Data were collected on the level of the cervical spine that could be viewed, the clinical management following the viewing of the image and the use of PACS 'tools'. Overall no statistically significant differences between modalities were found in the level of visualization. Within viewer differences were found for three viewers: one indicating better visualization with PACS and two indicating better visualization with CR. The results relating to patient management indicate greater clinician confidence following the viewing of PACS images for two viewers. The use of PACS 'tools' improved visualization of the cervical spine for one viewer.

Evaluation of diffuse technologies: the case of digital imaging networks.

There have been significant developments in recent years in the methodologies and methods for the evaluation of a wide range of health technologies. There remain, though, many technologies which are difficult to evaluate. Often the difficulty stems from the complexity of the technologies themselves, which are in effect hybrids, comprising combinations of several distinct elements. In this paper these are termed 'diffuse' technologies, because the different elements exert different costs and effects, often across several different services. Computer networks are one, increasingly important, example of such technologies in health care. While it is possible to evaluate individual elements of such technologies, it is not clear how to evaluate the technology as a whole, where the whole may be greater (or less) than the sum of the parts. The paper outlines a seven-stage framework for the evaluation of diffuse technologies. The general principles of evaluation are illustrated using the example of picture archiving and communication systems (PACS), which are computer systems designed to capture, store and distribute electronic radiological images within a hospital.

Explaining variation in radiologists' reporting times.

This paper describes an investigation into the reasons for variation in the time taken by senior radiologists to complete radiological reports. An observational study of the reporting process at one UK hospital was undertaken for a 25 day period. An independent health service researcher observed the radiology reporting process and collected data on a variety of factors including the time taken to produce the report, the number and nature of all images viewed, the experience of the radiologist, and the number of disturbances that occurred. The nature of the variation in reporting time was explored using both simple comparative statistics and more sophisticated multiple regression techniques. Data were collected on 2345 report observations and the median report time was 117 s. This research provides the first empirical evidence for systematic variation in reporting time. The results confirm the importance of certain factors that were expected to explain report time variation. For example, the results indicate that report time tended to be significantly shorter in reporting sessions that were busy, and significantly longer when the radiologist was disturbed during the reporting process or was training juniors during a reporting session. More surprising were the results indicating that there was no significant difference in report time for reports categorized as urgent or "hot" and those categorized as less urgent or "cold", and that report time appeared to vary systematically depending on the day of the week and on the time of day.

Issues in the evaluation of picture archiving and communication systems.

Picture archiving and communication systems (PACS) are an example of the application of computer technology in the medical field. PACS automates image handling in a hospital and has the potential to transform the way radiology is currently performed. This paper focuses on the evaluation of the PACS technology, and considers the claims that have been made for PACS, how these claims might be turned into questions to be addressed by evaluation and the appropriate methods for the evaluation of PACS. A distinction is drawn between evaluation questions for which the hospital is the appropriate focus and those for which the patient is the appropriate focus. The preferred research design is different for hospital focused PACS evaluation and patient-focused evaluation of small scale PACS systems. A contemporaneous experimental comparison within hospitals is the preferred design for the patient-focused evaluation of small scale PACS systems. The patient-focused evaluation of large scale systems and the hospital-focused evaluation of all PACS systems could feasibly be conducted as contemporaneous experimental comparisons between hospitals but the large research costs implied by such a design almost certainly mean that non-contemporaneous, non-experimental comparisons within hospitals are more realistic. The current situation for the PACS technology is that it has potential, but as yet unproven, benefits and a large capital cost. Thus, the primary purpose of funding additional PACS implementations must be to add to the currently small body of evaluation evidence.

Reducing radiation doses to the breast, thyroid and gonads during diagnostic radiography.

The skin entry and exit doses on patients undergoing routine radiographic examinations of areas in which the breast, thyroid and gonads are included in the primary beam were measured using thermoluminescent dosimeters. To obtain further information about patient doses, measurements were also made on a phantom at similar skin positions and at the positions of these organs. Comparisons of the doses to these radiosensitive organs were made for the antero-posterior and postero-anterior projections. In cases where it was found that the doses were reduced by the use of non-conventional relationship between the relative positions of the patient and the film, suggestions are made for the adaptations which would have to be made to X-ray equipment to enable these projections to be taken routinely. Other techniques, such as air gap techniques and thyroid shielding, whereby patient doses can be reduced during routine radiography are also examined. Finally the implications of these results for radiation protection of patients are considered.