DeFINE: Delayed feedback-based immersive navigation environment for studying goal-directed human navigation.

With the advent of consumer-grade products for presenting an immersive virtual environment (VE), there is a growing interest in utilizing VEs for testing human navigation behavior. However, preparing a VE still requires a high level of technical expertise in computer graphics and virtual reality, posing a significant hurdle to embracing the emerging technology. To address this issue, this paper presents Delayed Feedback-based Immersive Navigation Environment (DeFINE), a framework that allows for easy creation and administration of navigation tasks within customizable VEs via intuitive graphical user interfaces and simple settings files. Importantly, DeFINE has a built-in capability to provide performance feedback to participants during an experiment, a feature that is critically missing in other similar frameworks. To show the usability of DeFINE from both experimentalists' and participants' perspectives, a demonstration was made in which participants navigated to a hidden goal location with feedback that differentially weighted speed and accuracy of their responses. In addition, the participants evaluated DeFINE in terms of its ease of use, required workload, and proneness to induce cybersickness. The demonstration exemplified typical experimental manipulations DeFINE accommodates and what types of data it can collect for characterizing participants' task performance. With its out-of-the-box functionality and potential customizability due to open-source licensing, DeFINE makes VEs more accessible to many researchers.

A Hidden Semi-Markov Model based approach for rehabilitation exercise assessment.

In this paper, a Hidden Semi-Markov Model (HSMM) based approach is proposed to evaluate and monitor body motion during a rehabilitation training program. The approach extracts clinically relevant motion features from skeleton joint trajectories, acquired by the RGB-D camera, and provides a score for the subject's performance. The approach combines different aspects of rule and template based methods. The features have been defined by clinicians as exercise descriptors and are then assessed by a HSMM, trained upon an exemplar motion sequence. The reliability of the proposed approach is studied by evaluating its correlation with both a clinical assessment and a Dynamic Time Warping (DTW) algorithm, while healthy and neurological disabled people performed physical exercises. With respect to the discrimination between healthy and pathological conditions, the HSMM based method correlates better with the physician's score than DTW. The study supports the use of HSMMs to assess motor performance providing a quantitative feedback to physiotherapist and patients. This result is particularly appropriate and useful for a remote assessment in the home.

Multimodal Representation Learning for Place Recognition Using Deep Hebbian Predictive Coding.

Recognising familiar places is a competence required in many engineering applications that interact with the real world such as robot navigation. Combining information from different sensory sources promotes robustness and accuracy of place recognition. However, mismatch in data registration, dimensionality, and timing between modalities remain challenging problems in multisensory place recognition. Spurious data generated by sensor drop-out in multisensory environments is particularly problematic and often resolved through adhoc and brittle solutions. An effective approach to these problems is demonstrated by animals as they gracefully move through the world. Therefore, we take a neuro-ethological approach by adopting self-supervised representation learning based on a neuroscientific model of visual cortex known as predictive coding. We demonstrate how this parsimonious network algorithm which is trained using a local learning rule can be extended to combine visual and tactile sensory cues from a biomimetic robot as it naturally explores a visually aliased environment. The place recognition performance obtained using joint latent representations generated by the network is significantly better than contemporary representation learning techniques. Further, we see evidence of improved robustness at place recognition in face of unimodal sensor drop-out. The proposed multimodal deep predictive coding algorithm presented is also linearly extensible to accommodate more than two sensory modalities, thereby providing an intriguing example of the value of neuro-biologically plausible representation learning for multimodal navigation.

Impacts of robot implementation on care personnel and clients in elderly-care institutions.

BACKGROUND: Digital technologies, including robots, are being increasingly used in elderly care. Their impact on users carries implications for successfully integrating technological innovations into care. This study aims to identify the impacts of care-robot implementation on elderly-care service stakeholders. METHODS: Impacts of care-robot implementation on users - care personnel and elderly clients - are identified from the data collected during a 10-week field study of the implementation process of the care robot 'Zora' in municipal elderly care services in Finland. The data were obtained from semi-participatory observation (27 sessions) of the robot engaging in rehabilitation efforts in two care homes and a geriatric rehabilitation hospital, and focus-group interviews conducted with 40 care workers and clients. RESULTS: Robot use in elderly care is associated with multiple types of impacts with positive, negative, and neutral dimensions. These include impacts on interaction and activity for clients, and impacts on the work atmosphere, meaningfulness of work content, and professional development for care personnel. Impacts on personnel were related to the need for orientation, problems of time usage, and overall attitudes toward novelty and renewing of care service. The robot's presence stimulated the clients into exercising and interacting. The care workers perceived the clients' well-being both as a motivation to learn how to use robots as well as a justification for negative views. CONCLUSIONS: Care-robots like Zora have the potential for multi-faceted rehabilitative functions and can become part of care service with careful systemic planning with a specific focus on orientation. Many of the identified impacts were related to how the robot fits into the service processes. Distinguishing between positive, negative, or neutral dimensions of different impacts is important.

Invariance properties of gabor filter-based features--overview and applications.

For almost three decades the use of features based on Gabor filters has been promoted for their useful properties in image processing. The most important properties are related to invariance to illumination, rotation, scale, and translation. These properties are based on the fact that they are all parameters of Gabor filters themselves. This is especially useful in feature extraction, where Gabor filters have succeeded in many applications, from texture analysis to iris and face recognition. This study provides an overview of Gabor filters in image processing, a short literature survey of the most significant results, and establishes invariance properties and restrictions to the use of Gabor filters in feature extraction. Results are demonstrated by application examples.

Optimal reconstruction of approximate planar surfaces using photometric stereo.

Photometric stereo can be used to obtain a fast and noncontact surface reconstruction of Lambertian surfaces. Despite several published works concerning the uncertainties and optimal light configurations of photometric stereo, no solutions for optimal surface reconstruction from noisy real images have been proposed. In this paper, optimal surface reconstruction methods for approximate planar textured surfaces using photometric stereo are derived, given that the statistics of imaging errors are measurable. Simulated and real surfaces are experimentally studied, and the results validate that the proposed approaches improve the surface reconstruction especially for the high-frequency height variations.