Extended query refinement for medical image retrieval.

The impact of image pattern recognition on accessing large databases of medical images has recently been explored, and content-based image retrieval (CBIR) in medical applications (IRMA) is researched. At the present, however, the impact of image retrieval on diagnosis is limited, and practical applications are scarce. One reason is the lack of suitable mechanisms for query refinement, in particular, the ability to (1) restore previous session states, (2) combine individual queries by Boolean operators, and (3) provide continuous-valued query refinement. This paper presents a powerful user interface for CBIR that provides all three mechanisms for extended query refinement. The various mechanisms of man-machine interaction during a retrieval session are grouped into four classes: (1) output modules, (2) parameter modules, (3) transaction modules, and (4) process modules, all of which are controlled by a detailed query logging. The query logging is linked to a relational database. Nested loops for interaction provide a maximum of flexibility within a minimum of complexity, as the entire data flow is still controlled within a single Web page. Our approach is implemented to support various modalities, orientations, and body regions using global features that model gray scale, texture, structure, and global shape characteristics. The resulting extended query refinement has a significant impact for medical CBIR applications.

Informatics in radiology (infoRAD): new tools for computer assistance in thoracic CT part 2. Therapy monitoring of pulmonary metastases.

Owing to the rapid development of scanner technology, thoracic computed tomography (CT) offers new possibilities but also faces enormous challenges with respect to the quality of computer-assisted diagnosis and therapy planning. In the framework of the Virtual Institute for Computer Assistance in Clinical Radiology cooperative research project, a software application was developed to assist the radiologist in the analysis of thoracic CT data for the purpose of evaluating the response to tumor therapy. The application provides follow-up support for monitoring of tumor therapy by means of volumetric quantification of tumors and temporal registration. In addition, anatomically adequate three-dimensional visualization techniques for convenient examination of large data sets are included. With close cooperation between computer scientists and radiologists, the application was tested and optimized to achieve a high degree of usability. Several clinical studies were carried out, the results of which indicated that the application improves therapy monitoring with respect to accuracy and time required.

Automatic categorization of medical images for content-based retrieval and data mining.

Categorization of medical images means selecting the appropriate class for a given image out of a set of pre-defined categories. This is an important step for data mining and content-based image retrieval (CBIR). So far, published approaches are capable to distinguish up to 10 categories. In this paper, we evaluate automatic categorization into more than 80 categories describing the imaging modality and direction as well as the body part and biological system examined. Based on 6231 reference images from hospital routine, 85.5% correctness is obtained combining global texture features with scaled images. With a frequency of 97.7%, the correct class is within the best ten matches, which is sufficient for medical CBIR applications.

IRMA--content-based image retrieval in medical applications.

The impact of content-based access to medical images is frequently reported but existing systems are designed for only a particular modality or context of diagnosis. Contrarily, our concept of image retrieval in medical applications (IRMA) aims at a general structure for semantic content analysis that is suitable for numerous applications in case-based reasoning or evidence-based medicine. Within IRMA, stepwise processing results in six layers of information modeling (raw data layer, registered data layer, feature layer, scheme layer, object layer, knowledge layer) incorporating medical expert knowledge. At the scheme layer, medical images are represented by a hierarchical structure of ellipses (blobs) describing image regions. Hence, image retrieval transforms to graph matching. The multilayer processing is implemented using a distributed system designed with only three core elements. The central database holds program sources, process-ing schemes, images, features, and blob trees; the scheduler balances distributed computing by addressing daemons running on all connected workstations; and the web server provides graphical user interfaces for data entry and retrieval..

Determining the view of chest radiographs.

Automatic identification of frontal (posteroanterior/anteroposterior) vs. lateral chest radiographs is an important preprocessing step in computer-assisted diagnosis, content-based image retrieval, as well as picture archiving and communication systems. Here, a new approach is presented. After the radiographs are reduced substantially in size, several distance measures are applied for nearest-neighbor classification. Leaving-one-out experiments were performed based on 1,867 radiographs from clinical routine. For comparison to existing approaches, subsets of 430 and 5 training images are also considered. The overall best correctness of 99.7% is obtained for feature images of 32 x 32 pixels, the tangent distance, and a 5-nearest-neighbor classification scheme. Applying the normalized cross correlation function, correctness yields still 99.6% and 99.3% for feature images of 32 x 32 and 8 x 8 pixel, respectively. Remaining errors are caused by image altering pathologies, metal artifacts, or other interferences with routine conditions. The proposed algorithm outperforms existing but sophisticated approaches and is easily implemented at the same time.