The effect of PACS on the time required for technologists to produce radiographic images in the emergency department radiology suite.

The purpose of this study was to evaluate the effect of a switch to a filmless image management system on the time required for technologists to produce radiographic images in the emergency department (ED) after controlling for exam difficulty and a variable workload. Time and motion data were collected on patients who had radiographic images taken while being treated in the emergency department over the 3 1/2-year period from April 1997 to November 2000. Event times and demographic data were obtained from the radiology information system, from the hospital information system, from emergency department records, or by observation by research coordinators. Multiple least squares regression analysis identified several independent predictors of the time required for technologists to produce radiographic images. These variables included the level of technologist experience, the number of trauma-alert patient arrivals, and whether a filmless image management system was used (all P <.05). Our regression model explained 22% of the variability in technologist time (R2 Adjusted, 0.22; F = 24.01; P <.0001). The regression model predicted a time saving of 2 to 3 minutes per patient in the elapsed time from notification of a needed examination until image availability because of the implementation of PACS, a delay of 4 to 6 minutes per patient who were imaged by technologists who spent less than 10% of their work assignments within the ED, and a delay of 18 to 27 minutes in radiology workflow because of the arrival of a trauma alert patient. A filmless system decreased the amount of time required to produce radiographs. The arrival of a trauma alert patient delayed radiology workflow in the ED. Inexperienced technologists require 4 to 6 minutes of additional time per patient to complete the same amount of work accomplished by an experienced technologist.

Prolonged general anesthesia in MR studies of rats.

RATIONALE AND OBJECTIVES: Magnetic resonance (MR) imaging of laboratory animals may require general anesthesia to minimize body movements over many hours. The anesthetization technique should allow physiologic parameters to remain as close to normal as possible, permit fast recovery, allow safe, repeated use, and avoid attachment of ferrous metal components to the animal. The purpose of this study was to evaluate an anesthetization technique that was developed to meet each of these qualifications. MATERIALS AND METHODS: In 15 rats (280-483-g body weight), general anesthesia was induced (with intramuscular ketamine hydrochloride, xylazine hydrochloride, acepromazine maleate, and atropine), a tail vein catheter was inserted, and preimaging surgical procedures were performed. A face mask was applied, the animal was positioned in a dorsal recumbent position on an acrylic board, and an isothermal heating pad was placed on the ventral aspect of the abdominal wall. The rat, on the board, was then inserted into a trough that contained a custom-built, linearly polarized birdcage head coil and placed in the bore of a 4.7-T horizontal-bore magnet. The face mask was connected to a non-rebreathing gaseous anesthetic system, and anesthesia was maintained with 1.5-2.0 L/min oxygen and 0.25%-1.50% isoflurane. Oxygen saturation, heart rate, and rectal temperature were continuously monitored. RESULTS: The duration of intramuscular anesthesia was 110 minutes +/- 12, and the duration of gaseous anesthesia was 106 minutes +/- 43. The monitoring equipment permitted display of vital signs. CONCLUSION: The method appeared safe, was easy to perform, maintained a stable physiologic state for the parameters monitored, and could be used for repeated anesthesia in the same animal.

From being a radiologist to watching a radiologist: impact of filmless operation on the training of radiology residents.

RATIONALE AND OBJECTIVES: The authors performed this study to investigate the impact of changing from a film-based image interpretation system to one using digital image workstations on the training of radiology residents in the interpretation of radiographs. MATERIALS AND METHODS: Data were collected during a period when a conventional system of image interpretation with hard-copy images and multiviewers was used and during a period when digital image workstations were used. During each period, it was noted whether the first interpretation of the radiographs was performed by a radiology resident, by an attending radiologist, or as a group effort including both an attending radiologist and a radiology resident(s). In addition, it was noted whether a radiology resident or an attending radiologist dictated the report. RESULTS: The proportion of images first interpreted by the radiology resident alone decreased from 38% (53 of 139) when using the conventional system to 17% (34 of 199) after the switch to interpreting images on the workstations (P = .001). During the film-based period, radiology residents dictated 45% of reports (141 of 312), but during the workstation period, radiology residents dictated only 4% of reports (24 of 667; P = .001). CONCLUSION: The authors observed a decrease in autonomous participation by radiology residents in image interpretation and dictation of reports and an increase in "group reading" after the switch from a film-based system to a workstation system.

An analysis of perceptual errors in reading mammograms using quasi-local spatial frequency spectra.

In this pilot study the authors examined areas on a mammogram that attracted the visual attention of experienced mammographers and mammography fellows, as well as areas that were reported to contain a malignant lesion, and, based on their spatial frequency spectrum, they characterized these areas by the type of decision outcome that they yielded: true-positives (TP), false-positives (FP), true-negatives (TN), and false-negatives (FN). Five 2-view (craniocaudal and medial-lateral oblique) mammogram cases were examined by 8 experienced observers, and the eye position of the observers was tracked. The observers were asked to report the location and nature of any malignant lesions present in the case. The authors analyzed each area in which either the observer made a decision or in which the observer had prolonged (>1,000 ms) visual dwell using wavelet packets, and characterized these areas in terms of the energy contents of each spatial frequency band. It was shown that each decision outcome is characterized by a specific profile in the spatial frequency domain, and that these profiles are significantly different from one another. As a consequence of these differences, the profiles can be used to determine which type of decision a given observer will make when examining the area. Computer-assisted perception correctly predicted up to 64% of the TPs made by the observers, 77% of the FPs, and 70% of the TNs.

Blinded review of retrospectively visible unreported breast cancers: an eye-position analysis.

PURPOSE: To determine whether unreported retrospectively identified cancers on mammograms receive prolonged visual attention and can be reliably detected in a blinded review. MATERIALS AND METHODS: Four experienced mammographers performed a blinded review of a test set of 20 retrospective cases where the cancer was not detected until the next mammographic evaluation, 10 prospective cases where the cancer was initially detected, and 10 cancer-free cases. Two views were digitized and displayed on a workstation. The experiment consisted of an initial impression, during which eye position was monitored, and a final impression, during which viewers zoomed on regions of interest and localized suspicious lesions. Eye-position data were analyzed to determine whether retrospectively visible cancers attracted attention to the same degree as prospectively visible cancers. The initial impression used 1,000 msec as the eye-fixation dwell criterion for detecting a lesion. RESULTS: Initially, 70% of retrospective cancers and 50% of prospective cancers did not attract prolonged visual attention. In prospective cases, detailed examination significantly improved the mean receiver operating characteristic area, from.73 to.88 (P <.01), but in retrospective cases, the mean receiver operating characteristic area barely increased, from.60 to.68, due to a high true-positive-to-false-positive ratio. CONCLUSION: At blinded review, detection of retrospectively visible cancers was significantly inferior to that of prospective cancers. It cannot be assumed that retrospectively identified cancers are intrinsically detectable, because they do not draw prolonged visual attention during visual search for breast cancers.

Reliability of soft-copy versus hard-copy interpretation of emergency department radiographs: a prototype study.

OBJECTIVE: The purpose of this study was to compare the diagnostic reliability of hard-copy and soft-copy interpretation of radiographs obtained in the emergency department using a methodology for evaluating imaging systems when independent proof of the diagnosis is not available. MATERIALS AND METHODS: We collected radiographs from a stratified sample of 100 patients seen in the emergency department. The images were obtained using computed radiography, and the digital images were printed on film and stored for display on a workstation. A group of seven experienced radiologists reported the cases using both film and the workstation display. The results were analyzed using mixture distribution analysis (MDA). RESULTS: The reliability expressed as the percentage of agreement of a typical observer relative to the majority was computed from the MDA. The result was 90% for both hard copy and soft copy with bootstrap confidence intervals of 86-94%. CONCLUSION: We conclude that, in the emergency department, soft-copy interpretation is as reliable as hard-copy interpretation. The strength of this conclusion depends on the validity of the MDA approach as well as the extent to which the observer sample and case sample are representative of the emergency department.

Radiology workflow and patient volume: effect of picture archiving and communication systems on technologists and radiologists.

This study was performed to evaluate the changes in workflow and efficiency in various clinical settings in the radiology department after the introduction of a picture archiving and communication system (PACS). Time and motion data were collected when conventional image management was used, and again after the introduction of a PACS. Changes in the elapsed time from examination request until the image dispatch to the radiologist, and from dispatch until report dictation, were evaluated. The relationship between patient volume and throughput was evaluated. The time from examination request until dispatch was significantly longer after the introduction of PACS for examinations taken on patients from the emergency department (ED) (pre-PACS, 20 minutes; post-PACS, 25 minutes; P < .0001), and for examinations taken on patients in the medical intensive care unit (MICU) (pre-PACS, 34 minutes; post-PACS, 42 minutes; P < .0001). The interval from image dispatch until report dictation shortened significantly after the introduction of PACS in the ED (pre-PACS, 38 minutes; post-PACS, 23 minutes; P < .0001) and in the outpatient department (OPD) (pre-PACS, 38 minutes; post-PACS, 20 minutes; P < .0001). Simple least squares regression showed a significant relationship between daily patient volume and the daily median time until report dictation (F = 43.42, P < .001). PACS slowed technologists by prolonging the quality-control procedure. Radiologist workflow was shortened or not affected. Efficiency is dependent on patient volume, and workflow improvements are due to a shift from batch to on-line reading that is enabled by the ability of PACS to route enough examinations to keep radiologists fully occupied.

A picture archival and communication system shortens delays in obtaining radiographic information in a medical intensive care unit.

OBJECTIVE: To assess whether variables such as unit occupancy and aggregate severity of illness that reflect increased work demands on physicians in medical intensive care units (MICU) are associated with increased delays in their obtaining information about nonroutine chest radiographic examinations. To determine whether the presence of a picture archiving and communication system (PACS) workstation in the MICU shortens those delays. DESIGN: A prospective cohort study stratified for presence or absence of PACS. SETTING: MICU of a university hospital. PATIENTS: A total of 118 patients admitted to the MICU who had nonroutine bedside chest radiographs. MEASUREMENTS AND MAIN RESULTS: Multivariate analyses were conducted to determine how unit occupancy, patient acuity, the time of day the examination was taken, and the presence of a PACS workstation influenced the time from radiographic examination completion to the time when MICU physicians first obtained image information. In a multivariate analysis, patient acuity, unit occupancy, the aggregate level of severity of illness in the study cohort, whether the examination was taken at night or day, and the presence of a PACS workstation were significant predictors of the elapsed time from examination completion until review by MICU physicians. Without the PACS workstation, higher occupancy, higher aggregate severity of illness, and examinations taken during the day were associated with longer delays. Overall, the multivariate analysis showed a 24-min decrease in the elapsed time to obtain information during periods with the PACS workstation compared with periods without the workstation (p = .03). CONCLUSIONS: A PACS workstation significantly decreased the delays in obtaining image information that occurred with high unit occupancy and high aggregate severity of illness and may improve unit efficiency under conditions of high physician workload.

How experience and training influence mammography expertise.

RATIONALE AND OBJECTIVES: The authors evaluated the influence of perceptual and cognitive skills in mammography detection and interpretation by testing three groups representing different levels of mammography expertise in terms of experience, training, and talent with a mammography screening-diagnostic task. MATERIALS AND METHODS: One hundred fifty mammograms, composed of unilateral cranial-caudal and mediolateral oblique views, were displayed in pairs on a digital workstation to 19 radiology residents, three experienced mammographers, and nine mammography technologists. One-third of the mammograms showed malignant lesions; two-thirds were malignancy-free. Observers interacted with the display to indicate whether each image contained no malignant lesions or suspicious lesions indicating malignancy. Decision time was measured as the lesions were localized, classified, and rated for decision confidence. RESULTS: Compared with performance of experts, alternative free response operating characteristic performance for residents was significantly lower and equivalent to that of technologists. Analysis of overall performance showed that, as level of expertise decreased, false-positive results exerted a greater effect on overall decision accuracy over the time course of image perception. This defines the decision speed-accuracy relationship that characterizes mammography expertise. CONCLUSION: Differences in resident performance resulted primarily from lack of perceptual-learning experience during mammography training, which limited object recognition skills and made it difficult to determine differences between malignant lesions, benign lesions, and normal image perturbations. A proposed solution is systematic mentor-guided training that links image perception to feedback about the reasons underlying decision making.

A perceptually tempered display for digital mammograms.

The cathode ray tube of a workstation for use with digital mammograms was calibrated with a photometer to produce an input-output characteristic curve similar to the perceptually linear curve defined by a current display standard. Then, a test pattern consisting of bars of increasing intensity containing disks of decreasing contrast was used by an observer to estimate the minimal detectable contrast (MDC) at different levels of display luminance. The MDC was modeled by a parabola. The shape of the parabola was determined by the observer's perceptual responses, and the range was determined by the maximum and minimum pixel values of the breast parenchyma. As each mammogram was displayed, the contour of the breast was automatically found and pixels within the breast image were sampled to determine the pixel values that were used to compute the maximum and minimum pixel values. The parabola was integrated to determine the look-up table for the initial MDC-tempered display of the mammogram. Preliminary observer performance tests showed no significant differences in the accuracy and speed of three radiologists who read a set of mammograms when the MDC-tempered display was compared with the perceptually linear display.

Incremental cost of department-wide implementation of a picture archiving and communication system and computed radiography.

PURPOSE: To determine the incremental cash flows associated with department-wide implementation of a picture archiving and communication system (PACS) and computed radiography (CR) at a large academic medical center. MATERIALS AND METHODS: The authors determined all capital and operational costs associated with PACS implementation during an 8-year time horizon. Economic effects were identified, adjusted for time value, and used to calculate net present values (NPVs) for each section of the department of radiology and for the department as a whole. RESULTS: The chest-bone section used the most resources. Changes in cost assumptions for the chest-bone section had a dominant effect on the department-wide NPV. The base-case NPV (i.e., that determined by using the initial assumptions) was negative, indicating that additional net costs are incurred by the radiology department from PACS implementation. PACS and CR provide cost savings only when a 12-year hardware life span is assumed, when CR equipment is removed from the analysis, or when digitized long-term archives are compressed at a rate of 10:1. CONCLUSION: Full PACS-CR implementation would not provide cost savings for a large, subspecialized department. However, institutions that are committed to CR implementation (for whom CR implementation would represent a sunk cost) or institutions that are able to archive images by using image compression will experience cost savings from PACS.

Accuracy of bedside chest hard-copy screen-film versus hard- and soft-copy computed radiographs in a medical intensive care unit: receiver operating characteristic analysis.

PURPOSE: To compare the clinical diagnostic accuracy of hard-copy readings of screen-film bedside chest radiographs and both hard- and soft-copy readings of bedside chest computed radiographs obtained in a medical intensive care unit. MATERIALS AND METHODS: Two samples of 95 cases were assembled from chest images obtained in 541 patients with either screen-film radiography or computed radiography. The cases were stratified according to the clinical problem for which the examination was ordered; the corresponding diagnosis was verified by a panel of two or three radiologists. Four radiologists blindly read the hard-copy images obtained with screen-film or computed radiography. Six months later, the radiologists read the computed radiographs by using an 8-bit, 1,684 x 2,048-pixel display. The data were analyzed by using multireader-multicase receiver operating characteristic (ROC) analysis of variance. RESULTS: No statistically significant differences in the area under the ROC curve were found between any of the methods. CONCLUSION: The results provide some justification for using bedside chest computed radiography and for reading soft-copy images from a high-quality display.

Routine portable chest radiographs in the medical intensive care unit: effects and costs.

OBJECTIVE: To determine the effects and net costs of routine chest radiographs in a medical intensive care unit (ICU). DESIGN: A prospective, cohort study. A survey of experts in critical care and pulmonary diseases was undertaken to assess the effect of routine radiographs on patient management. SETTING: Medical ICU of a university hospital. PATIENTS: Eighty randomly selected patients admitted to a medical ICU. Two hundred fourteen experts were surveyed; 118 (55%)/214 responded. MEASUREMENTS AND MAIN RESULTS: Daily interviews with medical ICU clinicians were conducted to assess the radiographic findings in the routine radiographs and actions taken based on these findings. Experts evaluated the findings, their importance, the actions taken, and the probability of complications if the actions had not been taken at that time. Experts also predicted increases in length of stay associated with these complications. Presence of radiographic findings, changes in management because of the findings, net costs of routine chest radiographs, cost per finding that prompted an action, and expected changes in length of stay resulting from the actions were also assessed. Seventy-two (33%) of 221 routine radiographs (95% confidence interval: 25% to 39%) had findings, of which 44 (61%) were judged important, and 18 (8%, 95% confidence interval: 5% to 12%) prompted actions. Experts predicted that each action averted, on average, 2.1 +/- 1.7 days (SD) in the medical ICU. Mean savings per routine radiograph was $98. Net savings from routine chest radiographs remained after sensitivity analysis for expected change in length of stay, percentage of patients with routine radiographs, and percentage of routine radiographs that produce changes in management. CONCLUSION: The policy of obtaining routine chest radiographs in the medical ICU is effective and results in net savings.

Magnetic resonance imaging observations of blood-brain-barrier permeability in an animal model of brain injury.

RATIONALE AND OBJECTIVES: Knowledge of the in vivo relaxivity of paramagnetic contrast agents is important in the accurate measurement of the permeability of the blood-brain barrier (BBB). This study was aimed at developing an animal model for the magnetic resonance (MR) imaging investigation of injuries to the BBB. METHODS: MR imaging (1.9 T) was performed in 18 rats with acute, stable injuries to the brain caused by freezing. After injection of gadodiamide (0.05-0.20 mmol/kg), estimates were made of BBB permeability, leakage space, and relaxivity (also measured in saline). RESULTS: The BBB was always disrupted at the injured site (permeability = 0.038 min-1 +/- 0.0006). The central area of necrosis and the periphery of edema showed substantial differences in leakage space and relaxivity. The relaxivity of gadodiamide was much greater at the injured site than in saline. CONCLUSION: The in vivo relaxivity at a site of pathologic change in the brain may be substantially greater than that measured in aquo.

Mixture distribution and receiver operating characteristic analysis of bedside chest imaging with screen-film and computed radiography.

RATIONALE AND OBJECTIVES: The authors demonstrated the use of mixture distribution analysis as an alternative to receiver operating characteristic (ROC) analysis in a clinical study, where independent verification of the imaging diagnosis is not always feasible. METHODS: ROC and mixture distribution analyses were applied to the blind readings of four radiologists on a stratified, random sample of 95 screen-film radiographs and 95 computed radiographs of the chest obtained from a medical intensive care unit. The imaging diagnosis established by an expert panel was used as the truth for the ROC analysis, and agreement of ratings was used for the mixture distribution analysis. RESULTS: Both methods yielded similar values for the proportion of correct diagnoses. CONCLUSION: Mixture distribution analysis may be useful for comparing imaging techniques in situations where the true imaging diagnosis cannot be established with a method independent of that being evaluated.

Nature of expertise in searching mammograms for breast masses.

RATIONALE AND OBJECTIVES: The authors investigated how training and experience affect the performance of observers searching mammograms for breast masses. METHODS: Eye positions of mammographers, mammography technologists, mammography residents, and laypersons were compared to scan paths generated by a simulated scanner as each searched nine two-view digital mammogram pairs for breast masses. RESULTS: Analysis of time-to-hit data revealed that mammographers and mammography technologists with the most extensive training and experience had the fastest search times in the detection and confirmation of a breast mass on two views. Scanning patterns of less-experienced mammography residents were less efficient due to wider dispersion of visual attention between potential breast masses and perturbations in breast parenchyma. Because laypersons lacked both training and experience in mammography, bright blobs in the breast image were considered to be intuitively valid target candidates and these features distracted the search by capturing visual attention. CONCLUSION: Experience reading normal and abnormal mammograms plays a critical role in training radiologists. Experience combined with training provides the basis for generating efficient visual search strategies and developing distinctive conceptual criteria for perceptual differentiation and interpretation of true breast masses from image artifacts and structured noise that mimics breast abnormalities.

Observer performance in the localization of tubes and catheters on digital chest images: the role of expertise and image enhancement.

RATIONALE AND OBJECTIVES: To determine whether observer performance in the localization of tubes and catheters on computed radiography (CR) chest images can be improved by using an automatic image-processing algorithm. METHODS: Comparisons were made of CR hard-copy, CR soft-copy, and CR enhanced soft-copy images obtained with an image-processing algorithm. The enhanced images used gray-level optimization and nonlinear unsharp masking to emphasize the edges of the devices. Chest radiologists (n = 4), general radiologists (n = 4), and interns (n = 6) read 45 images that contained endotracheal tubes, pulmonary artery catheters, and central venous catheters. RESULTS: Chest radiologists had the smallest mean interobserver localization variability (4 mm), followed by general radiologists (6 mm) and interns (8 mm). Localization variability was greatest for hard-copy images and least for enhanced soft-copy images. CONCLUSION: Use of an automatic imaging-processing algorithm reduced localization variability and enabled the medical interns to perform at approximately the same level as the chest radiologists.