Controlling human causal inference through in silico task design.

Learning causal relationships is crucial for survival. The human brain's functional flexibility allows for effective causal inference, underlying various learning processes. While past studies focused on environmental factors influencing causal inference, a fundamental question remains: can these factors be manipulated for strategic causal inference control? This paper presents a task control framework for orchestrating causal learning task design. It utilizes a two-player game setting where a neural network learns to manipulate task variables by interacting with a human causal inference model. Training the task controller to generate experimental designs, we confirm its ability to accommodate complexities of environmental causal structure. Experiments involving 126 human subjects successfully validate the impact of task control on performance and learning efficiency. Additionally, we find that task control policy reflects the intrinsic nature of human causal inference: one-shot learning. This framework holds promising potential for applications paving the way for targeted behavioral outcomes in humans.

Preeminently Robust Neural PPG Denoiser.

Photoplethysmography (PPG) is a simple and cost-efficient technique that effectively measures cardiovascular response by detecting blood volume changes in a noninvasive manner. A practical challenge in the use of PPGs in real-world applications is noise reduction. PPG signals are likely to be compromised by various types of noise, such as scattering or motion artifacts, and removing such compounding noises using a monotonous method is not easy. To this end, this paper proposes a neural PPG denoiser that can robustly remove multiple types of noise from a PPG signal. By casting the noise reduction problem into a signal restoration approach, we aim to achieve a solid performance in the reduction of different noise types using a single neural denoiser built upon transformer-based deep generative models. Using this proposed method, we conducted the experiments on the noise reduction of a PPG signal synthetically contaminated with five types of noise. Following this, we performed a comparative study using six different noise reduction algorithms, each of which is known to be the best model for each noise. Evaluation results of the peak signal-to-noise ratio (PSNR) show that the neural PPG denoiser is superior in three out of five noise types to the performance of conventional noise reduction algorithms. The salt-and-pepper noise type showed the best performance, with the PSNR of the neural PPG denoiser being 36.6080, and the PSNRs of the other methods were 19.8160 and 32.8234. The Poisson noise type performed the worst, showing a PSNR of 33.0090; the PSNRs of other methods were 35.1822 and 33.4795, respectively. Thereafter, an experiment to recover a signal synthesized with two or more of the five noise types was conducted. When the number of mixed noises was two, three, four, and five, the PSNRs were 29.2759, 27.8759, 26.5608, and 25.9402, respectively. Finally, an experiment to recover motion artifacts was also conducted. The synthesized motion artifact signal was created by synthesizing only a certain ratio of the total signal length. As a result of the motion artifact signal restoration, the PSNRs were 25.2872, 22.8240, 21.2901, and 19.9577 at 30%, 50%, 70%, and 90% motion artifact ratios, respectively. In the three experiments conducted, the neural PPG denoiser showed that various types of noise were effectively removed. This proposal contributes to the universal denoising of continuous PPG signals and can be further expanded to denoise continuous signals in the general domain.

Importance of prefrontal meta control in human-like reinforcement learning.

Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models.

Toward high-performance, memory-efficient, and fast reinforcement learning-Lessons from decision neuroscience.

Recent insights from decision neuroscience raise hope for the development of intelligent brain-inspired solutions to robot learning in real dynamic environments full of noise and unpredictability.