Task-driven neural network models predict neural dynamics of proprioception.

Proprioception tells the brain the state of the body based on distributed sensory neurons. Yet, the principles that govern proprioceptive processing are poorly understood. Here, we employ a task-driven modeling approach to investigate the neural code of proprioceptive neurons in cuneate nucleus (CN) and somatosensory cortex area 2 (S1). We simulated muscle spindle signals through musculoskeletal modeling and generated a large-scale movement repertoire to train neural networks based on 16 hypotheses, each representing different computational goals. We found that the emerging, task-optimized internal representations generalize from synthetic data to predict neural dynamics in CN and S1 of primates. Computational tasks that aim to predict the limb position and velocity were the best at predicting the neural activity in both areas. Since task optimization develops representations that better predict neural activity during active than passive movements, we postulate that neural activity in the CN and S1 is top-down modulated during goal-directed movements.

Toward a modeling, optimization, and predictive control framework for fed-batch metabolic cybergenetics.

Biotechnology offers many opportunities for the sustainable manufacturing of valuable products. The toolbox to optimize bioprocesses includes extracellular process elements such as the bioreactor design and mode of operation, medium formulation, culture conditions, feeding rates, and so on. However, these elements are frequently insufficient for achieving optimal process performance or precise product composition. One can use metabolic and genetic engineering methods for optimization at the intracellular level. Nevertheless, those are often of static nature, failing when applied to dynamic processes or if disturbances occur. Furthermore, many bioprocesses are optimized empirically and implemented with little-to-no feedback control to counteract disturbances. The concept of cybergenetics has opened new possibilities to optimize bioprocesses by enabling online modulation of the gene expression of metabolism-relevant proteins via external inputs (e.g., light intensity in optogenetics). Here, we fuse cybergenetics with model-based optimization and predictive control for optimizing dynamic bioprocesses. To do so, we propose to use dynamic constraint-based models that integrate the dynamics of metabolic reactions, resource allocation, and inducible gene expression. We formulate a model-based optimal control problem to find the optimal process inputs. Furthermore, we propose using model predictive control to address uncertainties via online feedback. We focus on fed-batch processes, where the substrate feeding rate is an additional optimization variable. As a simulation example, we show the optogenetic control of the ATPase enzyme complex for dynamic modulation of enforced ATP wasting to adjust product yield and productivity.

Layout of Detection Array Based on Multi-Strategy Fusion Improved Adaptive Mayfly Algorithm in Bearing-Only Sensor Network.

The various applications of bearing-only sensor networks for detection and localization are becoming increasingly widespread and important. The array layout of the bearing-only sensor network seriously impacts the detection performance. This paper proposes a multi-strategy fusion improved adaptive mayfly algorithm (MIAMA) in a bearing-only sensor network to perform layout planning on the geometric configuration of the optimal detection. Firstly, the system model of a bearing-only sensor network was constructed, and the observability of the system was analyzed based on the Cramer-Rao Lower Bound and Fisher Information Matrix. Then, in view of the limitations of the traditional mayfly algorithm, which has a single initial population and no adaptability and poor global search capabilities, multi-strategy fusion improvements were carried out by introducing Tent chaos mapping, the adaptive inertia weight factor, and Random Opposition-based Learning. Finally, three simulation experiments were conducted. Through comparison with the Particle Swarm Optimization (PSO) algorithm, Mayfly Algorithm (MA), and Genetic Algorithm (GA), the effectiveness and superiority of the proposed MIAMA were validated.

Noise-Adaptive State Estimators with Change-Point Detection.

Aiming at tracking sharply maneuvering targets, this paper develops novel variational adaptive state estimators for joint target state and process noise parameter estimation for a class of linear state-space models with abruptly changing parameters. By combining variational inference with change-point detection in an online Bayesian fashion, two adaptive estimators-a change-point-based adaptive Kalman filter (CPAKF) and a change-point-based adaptive Kalman smoother (CPAKS)-are proposed in a recursive detection and estimation process. In each iteration, the run-length probability of the current maneuver mode is first calculated, and then the joint posterior of the target state and process noise parameter conditioned on the run length is approximated by variational inference. Compared with existing variational noise-adaptive Kalman filters, the proposed methods are robust to initial iterative value settings, improving their capability of tracking sharply maneuvering targets. Meanwhile, the change-point detection divides the non-stationary time sequence into several stationary segments, allowing for an adaptive sliding length in the CPAKS method. The tracking performance of the proposed methods is investigated using both synthetic and real-world datasets of maneuvering targets.

Adhesion Coefficient Identification of Wheeled Mobile Robot under Unstructured Pavement.

Because of its uneven and large slope, unstructured pavement presents a great challenge to obtaining the adhesion coefficient of pavement. An estimation method of the peak adhesion coefficient of unstructured pavement on the basis of the extended Kalman filter is proposed in this paper. The identification accuracy of road adhesion coefficients under unstructured pavement is improved by introducing the equivalent suspension model to optimize the calculation of vertical wheel load and modifying vehicle acceleration combined with vehicle posture data. Finally, the multi-condition simulation experiments with Carsim are conducted, the estimation accuracy of the adhesion coefficient is at least improved by 3.6%, and then the precision and effectiveness of the designed algorithm in the article are verified.

A Recursive Non-Uniform Sampling Estimator for Asynchronous Nonlinear Systems.

In this paper, we consider the problem of asynchronous estimation in the presence of packet losses for the randomly sampling nonlinear system. Packet losses occur at the control input and at the measurement side. Firstly, the synchronization of the asynchronous sampling system is realized by weighting the state of the adjacent state update points. Secondly, the projection theorem is used to estimate the system state at the sampling time. Due to modeling errors and unmodeled dynamics, obtaining an accurate dynamic model is challenging. Therefore, observation inference based on interpolation techniques is proposed to solve the asynchronous estimation problem. Furthermore, the algorithm is extended to multi-sensor systems to obtain a distributed fusion estimator. Finally, simulation experiments are conducted to validate the effectiveness of the algorithm.

Consensus-Based Information Filtering in Distributed LiDAR Sensor Network for Tracking Mobile Robots.

A distributed state observer is designed for state estimation and tracking of mobile robots amidst dynamic environments and occlusions within distributed LiDAR sensor networks. The proposed novel framework enhances three-dimensional bounding box detection and tracking utilizing a consensus-based information filter and a region of interest for state estimation of mobile robots. The framework enables the identification of the input to the dynamic process using remote sensing, enhancing the state prediction accuracy for low-visibility and occlusion scenarios in dynamic scenes. Experimental evaluations in indoor settings confirm the effectiveness of the framework in terms of accuracy and computational efficiency. These results highlight the benefit of integrating stationary LiDAR sensors' state estimates into a switching consensus information filter to enhance the reliability of tracking and to reduce estimation error in the sense of mean square and covariance.

Improving SLAM Techniques with Integrated Multi-Sensor Fusion for 3D Reconstruction.

Simultaneous Localization and Mapping (SLAM) poses distinct challenges, especially in settings with variable elements, which demand the integration of multiple sensors to ensure robustness. This study addresses these issues by integrating advanced technologies like LiDAR-inertial odometry (LIO), visual-inertial odometry (VIO), and sophisticated Inertial Measurement Unit (IMU) preintegration methods. These integrations enhance the robustness and reliability of the SLAM process for precise mapping of complex environments. Additionally, incorporating an object-detection network aids in identifying and excluding transient objects such as pedestrians and vehicles, essential for maintaining the integrity and accuracy of environmental mapping. The object-detection network features a lightweight design and swift performance, enabling real-time analysis without significant resource utilization. Our approach focuses on harmoniously blending these techniques to yield superior mapping outcomes in complex scenarios. The effectiveness of our proposed methods is substantiated through experimental evaluation, demonstrating their capability to produce more reliable and precise maps in environments with variable elements. The results indicate improvements in autonomous navigation and mapping, providing a practical solution for SLAM in challenging and dynamic settings.

Event-Triggered State Filter Estimation for Nonlinear Systems with Packet Dropout and Correlated Noise.

This paper begins by exploring the challenge of event-triggered state estimations in nonlinear systems, grappling with packet dropout and correlated noise. A communication mechanism is introduced that determines whether to transmit measurement values based on whether event-triggered conditions are violated, thereby minimizing redundant communication data. In designing the filter, noise decorrelation is initially conducted, followed by the integration of the event-triggered mechanism and the unreliable network transmission system for state estimator development. Subsequently, by combining the three-degree spherical-radial cubature rule, the numerical implementation steps of the proposed state estimation framework are outlined. The performance estimation analysis highlights that by adjusting the event-triggered threshold appropriately, the estimation performance and transmission rate can be effectively balanced. It is established that when there is a lower bound on the packet dropout rate, the covariance matrix of the state estimation error remains bounded, and the stochastic stability of the state estimation error is also confirmed. Ultimately, the algorithm and conclusions that are proposed in this paper are validated through a simulation example of a target tracking system.

Comparison of KF-Based Vehicle Sideslip Estimation Logics with Increasing Complexity for a Passenger Car.

Nowadays, control is pervasive in vehicles, and a full and accurate knowledge of vehicle states is crucial to guarantee safety levels and support the development of Advanced Driver-Assistance Systems (ADASs). In this scenario, real-time monitoring of the vehicle sideslip angle becomes fundamental, and various virtual sensing techniques based on both vehicle dynamics models and data-driven methods are widely presented in the literature. Given the need for on-board embedded device solutions in autonomous vehicles, it is mandatory to find the correct balance between estimation accuracy and the computational burden required. This work mainly presents different physical KF-based methodologies and proposes both mathematical and graphical analysis to explore the effectiveness of these solutions, all employing equal tire and vehicle simplified models. For this purpose, results are compared with accurate sensor acquisition provided by the on-track campaign on passenger vehicles; moreover, to truthfully represent the possibility of using such virtual sensing techniques in real-world scenarios, the vehicle is also equipped with low-end sensors that provide information to all the employed observers.

An Adaptive Unscented Kalman Filter for the Estimation of the Vehicle Velocity Components, Slip Angles, and Slip Ratios in Extreme Driving Manoeuvres.

This paper presents a novel unscented Kalman filter (UKF) implementation with adaptive covariance matrices (ACMs), to accurately estimate the longitudinal and lateral components of vehicle velocity, and thus the sideslip angle, tire slip angles, and tire slip ratios, also in extreme driving conditions, including tyre-road friction variations. The adaptation strategies are implemented on both the process noise and measurement noise covariances. The resulting UKF ACM is compared against a well-tuned baseline UKF with fixed covariances. Experimental test results in high tyre-road friction conditions show the good performance of both filters, with only a very marginal benefit of the ACM version. However, the simulated extreme tests in variable and low-friction conditions highlight the superior performance and robustness provided by the adaptation mechanism.

Review of Integrated Chassis Control Techniques for Automated Ground Vehicles.

Integrated chassis control systems represent a significant advancement in the dynamics of ground vehicles, aimed at enhancing overall performance, comfort, handling, and stability. As vehicles transition from internal combustion to electric platforms, integrated chassis control systems have evolved to meet the demands of electrification and automation. This paper analyses the overall control structure of automated vehicles with integrated chassis control systems. Integration of longitudinal, lateral, and vertical systems presents complexities due to the overlapping control regions of various subsystems. The presented methodology includes a comprehensive examination of state-of-the-art technologies, focusing on algorithms to manage control actions and prevent interference between subsystems. The results underscore the importance of control allocation to exploit the additional degrees of freedom offered by over-actuated systems. This paper systematically overviews the various control methods applied in integrated chassis control and path tracking. This includes a detailed examination of perception and decision-making, parameter estimation techniques, reference generation strategies, and the hierarchy of controllers, encompassing high-level, middle-level, and low-level control components. By offering this systematic overview, this paper aims to facilitate a deeper understanding of the diverse control methods employed in automated driving with integrated chassis control, providing insights into their applications, strengths, and limitations.

Distributed Cubature Information Filtering Method for State Estimation in Bearing-Only Sensor Network.

The problem of state estimation based on bearing-only sensors is increasingly important while existing research on distributed filtering solutions is rather limited. Therefore, this paper proposed the novel distributed cubature information filtering (DCIF) method for addressing the state estimation challenge in bearing-only sensor networks. Firstly, the system model of the bearing-only sensor network was constructed, and the observability of the system was analyzed. The sensor nodes are paired to measure relative angle information. Subsequently, the coordinated consistency theory is employed to achieve a unified state estimation of the maneuvering target. The DCIF method enhances the observability of the system, addressing the issues of large accuracy errors and divergence in traditional nonlinear filtering algorithms. Building upon the theoretical proof of consistency convergence in DCIF, four simulation experiments were conducted for comparison. These experiments validate the effectiveness and superiority of the DCIF method in bearing-only sensor networks.

Late integration of vision and proprioception during perturbed reaches.

The motor system corrects rapidly, but selectively, for perturbations to ongoing reaching movements, depending on the constraints of the task. To account for such sophistication, it has been postulated that corrections are based on an estimated limb state that integrates all sensory changes caused by the perturbation, taking into account their processing delays. Here, we asked if information from different sensory modalities is integrated immediately or processed separately in the early phase of a response. We perturbed the estimated state of the limb with both unimodal and bimodal visual and proprioceptive perturbations without changing the actual limb state. For visual perturbations, a cursor representing the hand was shifted to the left or the right relative to the true hand location. For proprioceptive perturbations, the biceps or triceps muscles were vibrated, which induced illusory limb-state changes to the right or the left. In the bimodal condition, the perturbations to vision and proprioception were either congruent or incongruent in their directions. Response latencies show that it takes ∼100 ms longer to respond to unimodal visual perturbations than to unimodal proprioceptive perturbations. Responses to bimodal perturbations show that it takes an additional ∼100 ms beyond the response to unimodal visual perturbations for intermodal consistency to impact the response. These results suggest that visual and proprioceptive signals are initially processed separately for state estimation and only combined at the level of the limb's motor output, instead of being immediately integrated into a single state estimate of the limb.NEW & NOTEWORTHY Both visual and proprioceptive signals provide information about arm state during reaching. By perturbing the perceived, but not the actual, position of the hand in both modalities using visual disturbances and muscle vibration, we examined multimodal integration and state estimation during reaching. Our results suggest that the early reach corrections are based on separate state estimates from the two sensory modalities and only later are based on a combined state estimate.

Congruent visual cues speed dynamic motor adaptation.

Motor adaptation to novel dynamics occurs rapidly using sensed errors to update the current motor memory. This adaption is strongly driven by proprioceptive and visual signals that indicate errors in the motor memory. Here, we extend this previous work by investigating whether the presence of additional visual cues could increase the rate of motor adaptation, specifically when the visual motion cue is congruent with the dynamics. Six groups of participants performed reaching movements while grasping the handle of a robotic manipulandum. A visual cue (small red circle) was connected to the cursor (representing the hand position) via a thin red bar. After a baseline, a unidirectional (3 groups) or bidirectional (3 groups) velocity-dependent force field was applied during the reach. For each group, the movement of the red object relative to the cursor was either congruent with the force field dynamics, incongruent with the force field dynamics, or constant (fixed distance from the cursor). Participants adapted more to the unidirectional force fields than to the bidirectional force field groups. However, across both force fields, groups in which the visual cues matched the type of force field (congruent visual cue) exhibited higher final adaptation level at the end of learning than the control or incongruent conditions. In all groups, we observed that an additional congruent cue assisted the formation of the motor memory of the external dynamics. We then demonstrate that a state estimation-based model that integrates proprioceptive and visual information can successfully replicate the experimental data.NEW & NOTEWORTHY We demonstrate that adaptation to novel dynamics is stronger when additional online visual cues that are congruent with the dynamics are presented during adaptation, compared with either a constant or incongruent visual cue. This effect was found regardless of whether a bidirectional or unidirectional velocity-dependent force field was presented to the participants. We propose that this effect might arise through the inclusion of this additional visual cue information within the state estimation process.

Nonlinear state estimation as tool for online monitoring and adaptive feed in high throughput cultivations.

Robotic facilities that can perform advanced cultivations (e.g., fed-batch or continuous) in high throughput have drastically increased the speed and reliability of the bioprocess development pipeline. Still, developing reliable analytical technologies, that can cope with the throughput of the cultivation system, has proven to be very challenging. On the one hand, the analytical accuracy suffers from the low sampling volumes, and on the other hand, the number of samples that must be treated rapidly is very large. These issues have been a major limitation for the implementation of feedback control methods in miniaturized bioreactor systems, where observations of the process states are typically obtained after the experiment has finished. In this work, we implement a Sigma-Point Kalman Filter in a high throughput platform with 24 parallel experiments at the mL-scale to demonstrate its viability and added value in high throughput experiments. The filter exploits the information generated by the ammonia-based pH control to enable the continuous estimation of the biomass concentration, a critical state to monitor the specific rates of production and consumption in the process. The objective in the selected case study is to ensure that the selected specific substrate consumption rate is tightly controlled throughout the complete Escherichia coli cultivations for recombinant production of an antibody fragment.

Validating models of sensory conflict and perception for motion sickness prediction.

The human motion perception system has long been linked to motion sickness through state estimation conflict terms. However, to date, the extent to which available perception models are able to predict motion sickness, or which of the employed perceptual mechanisms are of most relevance to sickness prediction, has not been studied. In this study, the subjective vertical model, the multi-sensory observer model and the probabilistic particle filter model were all validated for their ability to predict motion perception and sickness, across a large set of motion paradigms of varying complexity from literature. It was found that even though the models provided a good match for the perception paradigms studied, they could not be made to capture the full range of motion sickness observations. The resolution of the gravito-inertial ambiguity has been identified to require further attention, as key model parameters selected to match perception data did not optimally match motion sickness data. Two additional mechanisms that may enable better future predictive models of sickness have, however, been identified. Firstly, active estimation of the magnitude of gravity appears to be instrumental for predicting motion sickness induced by vertical accelerations. Secondly, the model analysis showed that the influence of the semicircular canals on the somatogravic effect may explain the differences in the dynamics observed for motion sickness induced by vertical and horizontal plane accelerations.

Efficient Sensor Node Selection for Observability Gramian Optimization.

Optimization approaches that determine sensitive sensor nodes in a large-scale, linear time-invariant, and discrete-time dynamical system are examined under the assumption of independent and identically distributed measurement noise. This study offers two novel selection algorithms, namely an approximate convex relaxation method with the Newton method and a gradient greedy method, and confirms the performance of the selection methods, including a convex relaxation method with semidefinite programming (SDP) and a pure greedy optimization method proposed in the previous studies. The matrix determinant of the observability Gramian was employed for the evaluations of the sensor subsets, while its gradient and Hessian were derived for the proposed methods. In the demonstration using numerical and real-world examples, the proposed approximate greedy method showed superiority in the run time when the sensor numbers were roughly the same as the dimensions of the latent system. The relaxation method with SDP is confirmed to be the most reasonable approach for a system with randomly generated matrices of higher dimensions. However, the degradation of the optimization results was also confirmed in the case of real-world datasets, while the pure greedy selection obtained the most stable optimization results.

Event-Triggered Kalman Filter and Its Performance Analysis.

In estimation of linear systems, an efficient event-triggered Kalman filter algorithm is proposed. Based on the hypothesis test of Gaussian distribution, the significance of the event-triggered threshold is given. Based on the threshold, the actual trigger frequency of the estimated system can be accurately set. Combining the threshold and the proposed event-triggered mechanism, an event-triggered Kalman filter is proposed and the approximate estimation accuracy can also be calculated. Whether it is a steady system or a time-varying system, the proposed algorithm can reasonably set the threshold according to the required accuracy in advance. The proposed event-triggered estimator not only effectively reduces the communication cost, but also has high accuracy. Finally, simulation examples verify the correctness and effectiveness of the proposed algorithm.

Global Visual-Inertial Localization for Autonomous Vehicles with Pre-Built Map.

Accurate, robust and drift-free global pose estimation is a fundamental problem for autonomous vehicles. In this work, we propose a global drift-free map-based localization method for estimating the global poses of autonomous vehicles that integrates visual-inertial odometry and global localization with respect to a pre-built map. In contrast to previous work on visual-inertial localization, the global pre-built map provides global information to eliminate drift and assists in obtaining the global pose. Additionally, in order to ensure the local odometry frame and the global map frame can be aligned accurately, we augment the transformation between these two frames into the state vector and use a global pose-graph optimization for online estimation. Extensive evaluations on public datasets and real-world experiments demonstrate the effectiveness of the proposed method. The proposed method can provide accurate global pose-estimation results in different scenarios. The experimental results are compared against the mainstream map-based localization method, revealing that the proposed approach is more accurate and consistent than other methods.