Self-incremental learning vector quantization with human cognitive biases.

Human beings have adaptively rational cognitive biases for efficiently acquiring concepts from small-sized datasets. With such inductive biases, humans can generalize concepts by learning a small number of samples. By incorporating human cognitive biases into learning vector quantization (LVQ), a prototype-based online machine learning method, we developed self-incremental LVQ (SILVQ) methods that can be easily interpreted. We first describe a method to automatically adjust the learning rate that incorporates human cognitive biases. Second, SILVQ, which self-increases the prototypes based on the method for automatically adjusting the learning rate, is described. The performance levels of the proposed methods are evaluated in experiments employing four real and two artificial datasets. Compared with the original learning vector quantization algorithms, our methods not only effectively remove the need for parameter tuning, but also achieve higher accuracy from learning small numbers of instances. In the cases of larger numbers of instances, SILVQ can still achieve an accuracy that is equal to or better than those of existing representative LVQ algorithms. Furthermore, SILVQ can learn linearly inseparable conceptual structures with the required and sufficient number of prototypes without overfitting.

Development of an automatic turntable-type multiple T-maze device and observation of pill bug behavior.

In recent years, various animal observation instruments have been developed to support long-term measurement and analysis of animal behaviors. This study proposes an automatic observation instrument that specializes for turning behaviors of pill bugs and aims to obtain new knowledge in the field of ethology. Pill bugs strongly tend to turn in the opposite direction of a preceding turn. This alternation of turning is called turn alternation reaction. However, a repetition of turns in the same direction is called turn repetition reaction and has been considered a malfunction of turn alternation. In this research, the authors developed an automatic turntable-type multiple T-maze device and observed the turning behavior of 34 pill bugs for 6 h to investigate whether turn repetition is a malfunction. As a result, most of the pill bug movements were categorized into three groups: sub-diffusion, Brownian motion, and Lévy walk. This result suggests that pill bugs do not continue turn alternation mechanically but elicit turn repetition moderately, which results in various movement patterns. In organisms with relatively simple nervous systems such as pill bugs, stereotypical behaviors such as turn alternation have been considered mechanical reactions and variant behaviors such as turn repetition have been considered malfunctions. However, our results suggest that a moderate generation of turn repetition is involved in the generation of various movement patterns. This study is expected to provide a new perspective on the conventional view of the behaviors of simple organisms.

A new method of Bayesian causal inference in non-stationary environments.

Bayesian inference is the process of narrowing down the hypotheses (causes) to the one that best explains the observational data (effects). To accurately estimate a cause, a considerable amount of data is required to be observed for as long as possible. However, the object of inference is not always constant. In this case, a method such as exponential moving average (EMA) with a discounting rate is used to improve the ability to respond to a sudden change; it is also necessary to increase the discounting rate. That is, a trade-off is established in which the followability is improved by increasing the discounting rate, but the accuracy is reduced. Here, we propose an extended Bayesian inference (EBI), wherein human-like causal inference is incorporated. We show that both the learning and forgetting effects are introduced into Bayesian inference by incorporating the causal inference. We evaluate the estimation performance of the EBI through the learning task of a dynamically changing Gaussian mixture model. In the evaluation, the EBI performance is compared with those of the EMA and a sequential discounting expectation-maximization algorithm. The EBI was shown to modify the trade-off observed in the EMA.

Extended Bayesian inference incorporating symmetry bias.

We start by proposing a causal induction model that incorporates symmetry bias. This model has two parameters that control the strength of symmetry bias and includes conditional probability and conventional models of causal induction as special cases. We calculated the determination coefficients between assessments by participants in eight types of causal induction experiments and the estimated values using the proposed model. The mean coefficient of determination was 0.93. Thus, it can reproduce causal induction of human judgment with high accuracy. We further propose a human-like Bayesian inference method to replace the conditional probability in Bayesian inference with the aforementioned causal induction model. In this method, two components coexist: the component of Bayesian inference, which updates the degree of confidence for each hypothesis, and the component of inverse Bayesian inference that modifies the model of each hypothesis. In other words, this method allows not only inference but also simultaneous learning. Our study demonstrates that the method addresses unsteady situations where the target of inference occasionally changes not only by making inferences based on knowledge (model) and observation data, but also by modifying the model itself.