Ranked centroid projection: a data visualization approach with self-organizing maps.

The self-organizing map (SOM) is an efficient tool for visualizing high-dimensional data. In this paper, the clustering and visualization capabilities of the SOM, especially in the analysis of textual data, i.e., document collections, are reviewed and further developed. A novel clustering and visualization approach based on the SOM is proposed for the task of text mining. The proposed approach first transforms the document space into a multidimensional vector space by means of document encoding. Afterwards, a growing hierarchical SOM (GHSOM) is trained and used as a baseline structure to automatically produce maps with various levels of detail. Following the GHSOM training, the new projection method, namely the ranked centroid projection (RCP), is applied to project the input vectors to a hierarchy of 2-D output maps. The RCP is used as a data analysis tool as well as a direct interface to the data. In a set of simulations, the proposed approach is applied to an illustrative data set and two real-world scientific document collections to demonstrate its applicability.

A sorting system for hierarchical grading of diabetic fundus images: a preliminary study.

Diabetic retinopathy is a leading cause of blindness in developed countries. Diabetic patients can prevent severe visual loss by attending regular eye examinations and receiving timely treatments. In the United States, standard protocols have been developed and refined for years to provide better screening and evaluation procedures of the fundus images. Due to the emerging number of diabetic retinopathy cases, accurate and efficient evaluations of the fundus images have become a serious burden for the ophthalmologists or care providers. While diabetic retinopathy remains too complicated to call for an automatic diagnosis system, an efficient tool to facilitate the grading process with a limited number of personnel is in great demand. The current study is to develop a sorting system with a user-friendly interface, based upon the standardized early treatment diabetic retinopathy study (ETDRS) protocol, to assist the professional graders. The raw fundus images will be screened and assigned to different graders according to their skill levels and experiences. The developed hierarchical sorting process will greatly support the graders and enhance their efficiency and throughput. The proposed hybrid intelligent system with multilevel knowledge representation is used to construct this sorting system. A preliminary case study is conducted using only the features of the spot lesion group coupled with the ETDRS standard to demonstrate its feasibility and performance. The results obtained from the case study show a promising future.

Constructing a fuzzy rule-based system using the ILFN network and Genetic Algorithm.

In this paper, a method for automatic construction of a fuzzy rule-based system from numerical data using the Incremental Learning Fuzzy Neural (ILFN) network and the Genetic Algorithm is presented. The ILFN network was developed for pattern classification applications. The ILFN network, which employed fuzzy sets and neural network theory, equips with a fast, one-pass, on-line, and incremental learning algorithm. After trained, the ILFN network stored numerical knowledge in hidden units, which can then be directly interpreted into if then rule bases. However, the rules extracted from the ILFN network are not in an optimized fuzzy linguistic form. In this paper, a knowledge base for fuzzy expert system is extracted from the hidden units of the ILFN classifier. A genetic algorithm is then invoked, in an iterative manner, to reduce number of rules and select only discriminate features from input patterns needed to provide a fuzzy rule-based system. Three computer simulations using a simulated 2-D 3-class data, the well-known Fisher's Iris data set, and the Wisconsin breast cancer data set were performed. The fuzzy rule-based system derived from the proposed method achieved 100% and 97.33% correct classification on the 75 patterns for training set and 75 patterns for test set, respectively. For the Wisconsin breast cancer data set, using 400 patterns for training and 299 patterns for testing, the derived fuzzy rule-based system achieved 99.5% and 98.33% correct classification on the training set and the test set, respectively.

Winner take all experts network for sensor validation.

The validation of sensor measurements has become an integral part of the operation and control of modern industrial equipment. The sensor under harsh environment must be shown to consistently provide the correct measurements. Analysis of the validation hardware or software should trigger an alarm when the sensor signals deviate appreciably from the correct values. Neural network based models can be used to on-line estimate critical sensor values when neighboring sensor measurements are used as inputs. The underlying assumption is that the neighboring sensors share an analytical relationship. The discrepancy between the measured and predicted sensor values may then be used as an indicator for sensor health. The proposed Winner Take All Experts (WTAE) network based on a 'divide and conquer' strategy significantly reduces the computational time required to train the neural network. It employs a growing fuzzy clustering algorithm to divide a complicated problem into a series of simpler sub-problems and assigns an expert to each of them locally. After the sensor approximation, the outputs from the estimator and the real sensor readings are compared both in the time domain and the frequency domain. Three fault indicators are used to provide analytical redundancy to detect the sensor failure. In the decision stage, the intersection of three fuzzy sets accomplishes a decision level fusion, which indicates the confidence level of the sensor health. Two data sets, the Spectra Quest Machinery Fault Simulator data set and the Westland vibration data set, were used in simulations to demonstrate the performance of the proposed WTAE network. The simulation results show the proposed WTAE is competitive with or even superior to the existing approaches.

An effective neuro-fuzzy paradigm for machinery condition health monitoring.

An innovative neuro-fuzzy network appropriate for fault detection and classification in a machinery condition health monitoring environment is proposed. The network, called an incremental learning fuzzy neural (ILFN) network, uses localized neurons to represent the distributions of the input space and is trained using a one-pass, on-line, and incremental learning algorithm that is fast and can operate in real time. The ILFN network employs a hybrid supervised and unsupervised learning scheme to generate its prototypes. The network is a self-organized structure with the ability to adaptively learn new classes of failure modes and update its parameters continuously while monitoring a system. To demonstrate the feasibility and effectiveness of the proposed network, numerical simulations have been performed using some well-known benchmark data sets, such as the Fisher's Iris data and the Deterding vowel data set. Comparison studies with other well-known classifiers were performed and the ILFN network was found competitive with or even superior to many existing classifiers. The ILFN network was applied on the vibration data known as Westland data set collected from a U.S. Navy CH-46E helicopter test stand, in order to assess its efficiency in machinery condition health monitoring. Using a simple fast Fourier transform (FFT) technique for feature extraction, the ILFN network has shown promising results. With various torque levels for training the network, 100% correct classification was achieved for the same torque Levels of the test data.

Pattern classification by a neurofuzzy network: application to vibration monitoring.

An innovative neurofuzzy network is proposed herein for pattern classification applications, specifically for vibration monitoring. A fuzzy set interpretation is incorporated into the network design to handle imprecise information. A neural network architecture is used to automatically deduce fuzzy if-then rules based on a hybrid supervised learning scheme. The neurofuzzy classifier proposed is equipped with a one-pass, on-line, and incremental learning algorithm. This network can be considered a self-organized classifier with the ability to adaptively learn new information without forgetting old knowledge. The classification performance of the proposed neurofuzzy network is validated on the Fisher's Iris data, which is a well-known benchmark data set. For the generalization capability, the neurofuzzy network can achieve 97.33% correct classification. In addition, to demonstrate the efficiency and effectiveness of the proposed neurofuzzy paradigm, numerical simulations have been performed using the Westland data set. The Westland data set consists of vibration data collected from a US Navy CH-46E helicopter test stand. Using a simple fast Fourier transform technique for feature extraction, the proposed neurofuzzy network has shown promising results. Using various torque levels for training and testing, the network achieved 100% correct classification.

Eigenstructure bidirectional associative memory: an effective synthesis procedure.

We propose a computationally efficient synthesis procedure for a class of bidirectional associative memories. Networks are described by a system of first-order ordinary difference equations which are defined on a closed hypercube of the state-space with solutions extended to the corner of the hypercube. The proposed algorithm possesses several advantages since it is possible: 1) to exert control over the number of spurious states; 2) to estimate the basins of attraction of the stable memories; and 3) under certain constraints, to effectively store a number of desired stable memories which by far exceed the order of the network. The applicability of the present results is demonstrated by means of a specific application in reconfigurable control of flexible structures.