Expert interpretation compensates for reduced image quality of camera-digitized images referred to radiologists.

We compared the accuracy of five veterinary radiologists when reading 20 radiographic cases on both analog film and in camera-digitized format. In addition, we compared the ability of five veterinary radiologists vs. 10 private practice veterinarians to interpret the analog images. Interpretation accuracy was compared using receiver operating characteristic curve analysis. Veterinary radiologists' accuracy did not significantly differ between analog vs. camera-digitized images (P = 0.13) although sensitivity was higher for analog images. Radiologists' interpretation of both digital and analog images was significantly better compared with the private veterinarians (P < 0.05).

Using gaze-tracking data and mixture distribution analysis to support a holistic model for the detection of cancers on mammograms.

RATIONALE AND OBJECTIVES: Use data collected independently at three institutions to compare time to first fixate the true lesion in searching for cancers on mammograms. Examine the fit of the results to a holistic model of visual perception. MATERIALS AND METHODS: The time required to first fixate a cancer on a mammogram was extracted from 400 eye-tracking records collected independently from three institutions. The time was used as an indicator of the initial perception of cancer. The distribution of first fixation times was partitioned into two normally distributed components using mixture distribution analysis. The true-positive fraction of each component was calculated. RESULTS: About 57% of the cancers had a 95% chance of being fixated in the first second of viewing. The remainder took longer (range, 1.0 to 15.2 seconds). The true-positive fraction was larger for the lesions hit immediately for most of the readers (TPF = 0.63 vs. 0.52, F = 5.88, P = .02) in 68% (13/19) of the readers. CONCLUSIONS: The initial detection occurs before visual scanning and, therefore, must be the result of a parallel "global" analysis of the image resulting in an initial holistic, gestalt-like perception. The development of expertise in medical image analysis may consist of a shift in the recognition mechanism from scan-look-detect to look-detect-scan.

Visual interest in pictorial art during an aesthetic experience.

Two experiments were performed during which adults untrained in the visual arts were shown digital versions of eight paintings by renowned artists. In Experiment 1 participants' written reactions following a single 100 ms glance at each work were found to overwhelmingly reflect an initial holistic impression (i.e. gist) of the structural arrangement and semantic meaning of the paintings. In the second experiment participants' eye movements and verbal reactions were recorded as they evaluated each reproduction for pleasingness. Analyses reveal the relationships between the content and structural organization of the art stimuli and the way viewers select, process and think about information contained in paintings across the time course of an aesthetic experience. The results are interpreted in terms of an information-processing stage model of visual aesthetics according to which perceptual-cognitive processing of an art stimulus begins with the rapid generation of a gist reaction followed by scrutiny of pictorial features directed in a top-down fashion by cognitively-based evaluative processes.

Holistic component of image perception in mammogram interpretation: gaze-tracking study.

PURPOSE: To test the hypothesis that rapid and accurate performance of the proficient observer in mammogram interpretation involves a shift in the mechanism of image perception from a relatively slow search-to-find mode to a relatively fast holistic mode. MATERIALS AND METHODS: This HIPAA-compliant study had institutional review board approval, and participant informed consent was obtained; patient informed consent was not required. The eye positions of three full-time mammographers, one attending radiologist, two mammography fellows, and three radiology residents were recorded during the interpretation of 20 normal and 20 subtly abnormal mammograms. The search time required to first locate a cancer, as well as the initial eye scan path, was determined and compared with diagnostic performance as measured with receiver operating characteristic (ROC) analysis. RESULTS: The median time for all observers to fixate a cancer, regardless of the decision outcome, was 1.13 seconds, with a range of 0.68 second to 3.06 seconds. Even though most of the lesions were fixated, recognition of them as cancerous ranged from 85% (17 of 20) to 10% (two of 20), with corresponding areas under the ROC curve of 0.87-0.40. The ROC index of detectability, d(a), was linearly related to the time to first fixate a cancer with a correlation (r(2)) of 0.81. CONCLUSION: The rapid initial fixation of a true abnormality is evidence for a global perceptual process capable of analyzing the visual input of the entire retinal image and pinpointing the spatial location of an abnormality. It appears to be more highly developed in the most proficient observers, replacing the less efficient initial search-to-find strategies.

The perception of breast cancers--a spatial frequency analysis of what differentiates missed from reported cancers.

The primary detector of breast cancer is the human eye. Radiologists read mammograms by mapping exogenous and endogenous factors, which are based on the image and observer, respectively, into observer-based decisions. These decisions rely on an internal schema that contains a representation of possible malignant and benign findings. Thus, to understand the hits and misses made by the radiologists, it is important to model the interactions between the measurable image-based elements contained in the mammogram and the decisions made. The image-based elements can be of two types, i.e., areas that attracted the visual attention of the radiologist, but did not yield a report, and areas where the radiologist indicated the presence of an abnormal finding. In this way, overt and covert decisions are made when reading a mammogram. In order to model this decision-making process, we use a system that is based upon the processing done by the human visual system, which decomposes the areas under scrutiny in elements of different sizes and orientations. In our system, this decomposition is done using wavelet packets (WPs). Nonlinear features are then extracted from the WP coefficients, and an artificial neural network is trained to recognize the patterns of decisions made by each radiologist. Afterwards, the system is used to predict how the radiologist will respond to visually selected areas in new mammogram cases.

The perception of breast cancer: what differentiates missed from reported cancers in mammography?

RATIONALE AND OBJECTIVES: Mammographers map endogenous and exogenous factors into decisions whether to report the presence of a malignant finding in a mammogram case. Thus, to understand how image-based elements are translated into observer-based decisions, the authors used spatial frequency analysis to model the areas on mammograms that attracted visual attention, in addition to the areas localized as abnormal. MATERIALS AND METHODS: Four mammographers read 40 two-view mammogram cases, of which 30 contained at least one malignant lesion visible on one or two views. Their eye positions were recorded during visual search. Once the mammographer felt confident enough to provide an initial impression of the case ("normal" or "abnormal"), the eye position monitoring was turned off and the mammographer indicated, with a mouse-controlled cursor, the location and nature of any malignant findings. Regions that elicited an overt or a covert response by the mammographers were extracted for processing by means of wavelet packets and artificial neural networks. RESULTS: Different decision outcomes yielded different energy representations, in the spatial frequency domain. These energy representations were used by an artificial neural network to predict decision outcome in areas of interest, derived from eye position analysis, on mammograms from new cases. Individual trends were observed for each mammographer. CONCLUSION: Spatial frequency representation of regions that attracted a given mammographer's visual attention may be useful for characterizing how that mammographer will respond to the visually selected areas.

Time course of perception and decision making during mammographic interpretation.

OBJECTIVE: This article describes the time course of lesion detection on digital mammograms using data about both eye position and decision time to compare performance between experienced mammographers and trainees. Research indicates that a longer decision time works against performance in the interpretation of chest radiographs because the likelihood of error is increased, particularly for trainees. Is this relation between decision time and performance also true for interpreting mammograms? Is there an optimal decision time-performance trade-off for detecting breast lesions? MATERIALS AND METHODS: Six radiology trainees (experience, 302-976 cases) and three mammographers (experience, 3000-5000 cases per year) reviewed 40 test cases. Each test case was represented by two mammograms that showed different views of the same breast. Twenty breasts contained suspicious lesions, and 20 were lesion-free. An interactive computer display system with an eye-head tracker measured the timing of decisions, where visual attention was directed, and how much time was spent fixating on a region of interest for each decision. Eye position was monitored during an initial-decision phase, and decision times were measured throughout a final-decision phase during which suspicious lesions recognized initially were interpreted and localized. Performance was analyzed using localization receiver operating characteristic curves. RESULTS: The time course of interpreting mammograms is similar to that for interpreting chest radiographs. Mammographers detected 71% of the true lesions within 25 sec, and trainees detected 46% within 40 sec. Both a fixation dwell time of 1000 msec and a high level of confidence in the decision were associated with the detection of true lesions for the mammographers but not for the trainees. CONCLUSION: Mammographers detected most breast lesions by global recognition within 25 sec, but trainees took more time. Prolonging one's search beyond the global recognition phase yielded few new lesions and increased the risk of error.