Map Learning with a 3D Printed Interactive Small-Scale Model: Improvement of Space and Text Memorization in Visually Impaired Students.

Special education teachers for visually impaired students rely on tools such as raised-line maps (RLMs) to teach spatial knowledge. These tools do not fully and adequately meet the needs of the teachers because they are long to produce, expensive, and not versatile enough to provide rapid updating of the content. For instance, the same RLM can barely be used during different lessons. In addition, those maps do not provide any interactivity, which reduces students' autonomy. With the emergence of 3D printing and low-cost microcontrollers, it is now easy to design affordable interactive small-scale models (SSMs) which are adapted to the needs of special education teachers. However, no study has previously been conducted to evaluate non-visual learning using interactive SSMs. In collaboration with a specialized teacher, we designed a SSM and a RLM representing the evolution of the geography and history of a fictitious kingdom. The two conditions were compared in a study with 24 visually impaired students regarding the memorization of the spatial layout and historical contents. The study showed that the interactive SSM improved both space and text memorization as compared to the RLM with braille legend. In conclusion, we argue that affordable home-made interactive small scale models can improve learning for visually impaired students. Interestingly, they are adaptable to any teaching situation including students with specific needs.

Simplification of Visual Rendering in Simulated Prosthetic Vision Facilitates Navigation.

Visual neuroprostheses are still limited and simulated prosthetic vision (SPV) is used to evaluate potential and forthcoming functionality of these implants. SPV has been used to evaluate the minimum requirement on visual neuroprosthetic characteristics to restore various functions such as reading, objects and face recognition, object grasping, etc. Some of these studies focused on obstacle avoidance but only a few investigated orientation or navigation abilities with prosthetic vision. The resolution of current arrays of electrodes is not sufficient to allow navigation tasks without additional processing of the visual input. In this study, we simulated a low resolution array (15 × 18 electrodes, similar to a forthcoming generation of arrays) and evaluated the navigation abilities restored when visual information was processed with various computer vision algorithms to enhance the visual rendering. Three main visual rendering strategies were compared to a control rendering in a wayfinding task within an unknown environment. The control rendering corresponded to a resizing of the original image onto the electrode array size, according to the average brightness of the pixels. In the first rendering strategy, vision distance was limited to 3, 6, or 9 m, respectively. In the second strategy, the rendering was not based on the brightness of the image pixels, but on the distance between the user and the elements in the field of view. In the last rendering strategy, only the edges of the environments were displayed, similar to a wireframe rendering. All the tested renderings, except the 3 m limitation of the viewing distance, improved navigation performance and decreased cognitive load. Interestingly, the distance-based and wireframe renderings also improved the cognitive mapping of the unknown environment. These results show that low resolution implants are usable for wayfinding if specific computer vision algorithms are used to select and display appropriate information regarding the environment.

Simulated Prosthetic Vision: The Benefits of Computer-Based Object Recognition and Localization.

Clinical trials with blind patients implanted with a visual neuroprosthesis showed that even the simplest tasks were difficult to perform with the limited vision restored with current implants. Simulated prosthetic vision (SPV) is a powerful tool to investigate the putative functions of the upcoming generations of visual neuroprostheses. Recent studies based on SPV showed that several generations of implants will be required before usable vision is restored. However, none of these studies relied on advanced image processing. High-level image processing could significantly reduce the amount of information required to perform visual tasks and help restore visuomotor behaviors, even with current low-resolution implants. In this study, we simulated a prosthetic vision device based on object localization in the scene. We evaluated the usability of this device for object recognition, localization, and reaching. We showed that a very low number of electrodes (e.g., nine) are sufficient to restore visually guided reaching movements with fair timing (10 s) and high accuracy. In addition, performance, both in terms of accuracy and speed, was comparable with 9 and 100 electrodes. Extraction of high level information (object recognition and localization) from video images could drastically enhance the usability of current visual neuroprosthesis. We suggest that this method-that is, localization of targets of interest in the scene-may restore various visuomotor behaviors. This method could prove functional on current low-resolution implants. The main limitation resides in the reliability of the vision algorithms, which are improving rapidly.

Simulated prosthetic vision: improving text accessibility with retinal prostheses.

Image processing can improve significantly the every-day life of blind people wearing current and upcoming retinal prostheses relying on an external camera. We propose to use a real-time text localization algorithm to improve text accessibility. An augmented text-specific rendering based on automatic text localization has been developed. It has been evaluated in comparison to the classical rendering through a Simulated Prosthetic Vision (SPV) experiment with 16 subjects. Subjects were able to detect text in natural scenes much faster and further with the augmented rendering compared to the control rendering. Our results show that current and next generation of low resolution retinal prostheses may benefit from real-time text detection algorithms.

Wayfinding with simulated prosthetic vision: performance comparison with regular and structure-enhanced renderings.

In this study, we used a simulation of upcoming low-resolution visual neuroprostheses to evaluate the benefit of embedded computer vision techniques in a wayfinding task. We showed that augmenting the classical phosphene rendering with the basic structure of the environment - displaying the ground plane with a different level of brightness - increased both wayfinding performance and cognitive mapping. In spite of the low resolution of current and upcoming visual implants, the improvement of these cognitive functions may already be possible with embedded artificial vision algorithms.

Cortical regions involved in the observation of bimanual actions.

Although we are beginning to understand how observed actions performed by conspecifics with a single hand are processed and how bimanual actions are controlled by the motor system, we know very little about the processing of observed bimanual actions. We used fMRI to compare the observation of bimanual manipulative actions with their unimanual components, relative to visual control conditions equalized for visual motion. Bimanual action observation did not activate any region specialized for processing visual signals related to this more elaborated action. On the contrary, observation of bimanual and unimanual actions activated similar occipito-temporal, parietal and premotor networks. However, whole-brain as well as region of interest (ROI) analyses revealed that this network functions differently under bimanual and unimanual conditions. Indeed, in bimanual conditions, activity in the network was overall more bilateral, especially in parietal cortex. In addition, ROI analyses indicated bilateral parietal activation patterns across hand conditions distinctly different from those at other levels of the action-observation network. These activation patterns suggest that while occipito-temporal and premotor levels are involved with processing the kinematics of the observed actions, the parietal cortex is more involved in the processing of static, postural aspects of the observed action. This study adds bimanual cooperation to the growing list of distinctions between parietal and premotor cortex regarding factors affecting visual processing of observed actions.

Active versus passive training of a complex bimanual task: is prescriptive proprioceptive information sufficient for inducing motor learning?

Perceptual processes play an important role in motor learning. While it is evident that visual information greatly contributes to learning new movements, much less is known about provision of prescriptive proprioceptive information. Here, we investigated whether passive (proprioceptively-based) movement training was comparable to active training for learning a new bimanual task. Three groups practiced a bimanual coordination pattern with a 1:2 frequency ratio and a 90° phase offset between both wrists with Lissajous feedback over the course of four days: 1) passive training; 2) active training; 3) no training (control). Retention findings revealed that passive as compared to active training resulted in equally successful acquisition of the frequency ratio but active training was more effective for acquisition of the new relative phasing between the limbs in the presence of augmented visual feedback. However, when this feedback was removed, performance of the new relative phase deteriorated in both groups whereas the frequency ratio was better preserved. The superiority of active over passive training in the presence of augmented feedback is hypothesized to result from active involvement in processes of error detection/correction and planning.

Spotting animals in natural scenes: efficiency of humans and monkeys at very low contrasts.

The ability of monkeys to categorize objects in visual stimuli such as natural scenes might rely on sets of low-level visual cues without any underlying conceptual abilities. Using a go/no-go rapid animal/non-animal categorization task with briefly flashed achromatic natural scenes, we show that both human and monkey performance is very robust to large variations of stimulus luminance and contrast. When mean luminance was increased or decreased by 25-50%, accuracy and speed impairments were small. The largest impairment was found at the highest luminance value with monkeys being mainly impaired in accuracy (drop of 6% correct vs. <1.5% in humans), whereas humans were mainly impaired in reaction time (20 ms increase in median reaction time vs. 4 ms in monkeys). Contrast reductions induced a large deterioration of image definition, but performance was again remarkably robust. Subjects scored well above chance level, even when the contrast was only 12% of the original photographs ( approximately 81% correct in monkeys; approximately 79% correct in humans). Accuracy decreased with contrast reduction but only reached chance level -in both species- for the most extreme condition, when only 3% of the original contrast remained. A progressive reaction time increase was observed that reached 72 ms in monkeys and 66 ms in humans. These results demonstrate the remarkable robustness of the primate visual system in processing objects in natural scenes with large random variations in luminance and contrast. They illustrate the similarity with which performance is impaired in monkeys and humans with such stimulus manipulations. They finally show that in an animal categorization task, the performance of both monkeys and humans is largely independent of cues relying on global luminance or the fine definition of stimuli.

The time-course of visual categorizations: you spot the animal faster than the bird.

BACKGROUND: Since the pioneering study by Rosch and colleagues in the 70s, it is commonly agreed that basic level perceptual categories (dog, chair...) are accessed faster than superordinate ones (animal, furniture...). Nevertheless, the speed at which objects presented in natural images can be processed in a rapid go/no-go visual superordinate categorization task has challenged this "basic level advantage". PRINCIPAL FINDINGS: Using the same task, we compared human processing speed when categorizing natural scenes as containing either an animal (superordinate level), or a specific animal (bird or dog, basic level). Human subjects require an additional 40-65 ms to decide whether an animal is a bird or a dog and most errors are induced by non-target animals. Indeed, processing time is tightly linked with the type of non-targets objects. Without any exemplar of the same superordinate category to ignore, the basic level category is accessed as fast as the superordinate category, whereas the presence of animal non-targets induces both an increase in reaction time and a decrease in accuracy. CONCLUSIONS AND SIGNIFICANCE: These results support the parallel distributed processing theory (PDP) and might reconciliate controversial studies recently published. The visual system can quickly access a coarse/abstract visual representation that allows fast decision for superordinate categorization of objects but additional time-consuming visual analysis would be necessary for a decision at the basic level based on more detailed representations.

Corticospinal facilitation following prolonged proprioceptive stimulation by means of passive wrist movement.

The purpose of this study was to evaluate the delayed effects of repetitive sensory stimulation with passive wrist movement on corticospinal excitability of the forearm and hand musculature. Motor evoked potential responses to single and double pulse transcranial magnetic stimulation were recorded from the flexor carpi radialis, extensor carpi radialis, and the first dorsal interosseous muscles of the right limb. Data were collected before and after a 1 hour session of passive wrist movement (intervention group, n = 11) or after a same period of rest (control group, n = 9). Motor evoked potential size and area were analyzed to evaluate corticospinal excitability and short interval intracortical inhibition and facilitation. Training with passive movement resulted in a prolonged increase in corticospinal excitability in the flexor carpi radialis and extensor carpi radialis (until at least 1 hour postintervention), but did not evoke significant changes in the levels of short interval intracortical inhibition and facilitation. No such effects were noted in the control group or first dorsal interosseous muscle. Prolonged proprioceptive stimulation with passive wrist movement induces a delayed increase in corticospinal excitability of the forearm muscles. Accordingly, this intervention may promote motor cortical reorganization in the targeted muscles. Results show induced effects from passive movement training that may prove useful for neurorehabilitation therapies.

Limits of event-related potential differences in tracking object processing speed.

We report results from two experiments in which subjects had to categorize briefly presented upright or inverted natural scenes. In the first experiment, subjects decided whether images contained animals or human faces presented at different scales. Behavioral results showed virtually identical processing speed between the two categories and very limited effects of inversion. One type of event-related potential (ERP) comparison, potentially capturing low-level physical differences, showed large effects with onsets at about 150 msec in the animal task. However, in the human face task, those differences started as early as 100 msec. In the second experiment, subjects responded to close-up views of animal faces or human faces in an attempt to limit physical differences between image sets. This manipulation almost completely eliminated small differences before 100 msec in both tasks. But again, despite very similar behavioral performances and short reaction times in both tasks, human faces were associated with earlier ERP differences compared with animal faces. Finally, in both experiments, as an alternative way to determine processing speed, we compared the ERP with the same images when seen as targets and nontargets in different tasks. Surprisingly, all task-dependent ERP differences had relatively long latencies. We conclude that task-dependent ERP differences fail to capture object processing speed, at least for some categories like faces. We discuss models of object processing that might explain our results, as well as alternative approaches.

Rapid categorization of achromatic natural scenes: how robust at very low contrasts?

The human visual system is remarkably good at categorizing objects even in challenging visual conditions. Here we specifically assessed the robustness of the visual system in the face of large contrast variations in a high-level categorization task using natural images. Human subjects performed a go/no-go animal/nonanimal categorization task with briefly flashed grey level images. Performance was analysed for a large range of contrast conditions randomly presented to the subjects and varying from normal to 3% of initial contrast. Accuracy was very robust and subjects were performing well above chance level (approximately 70% correct) with only 10-12% of initial contrast. Accuracy decreased with contrast reduction but reached chance level only in the most extreme condition (3% of initial contrast). Conversely, the maximal increase in mean reaction time was approximately 60 ms (at 8% of initial contrast); it then remained stable with further contrast reductions. Associated ERPs recorded on correct target and distractor trials showed a clear differential effect whose amplitude and peak latency were correlated respectively with task accuracy and mean reaction times. These data show the strong robustness of the visual system in object categorization at very low contrast. They suggest that magnocellular information could play a role in ventral stream visual functions such as object recognition. Performance may rely on early object representations which lack the details provided subsequently by the parvocellular system but contain enough information to reach decision in the categorization task.

The time course of visual processing: backward masking and natural scene categorisation.

Human observers are very good at deciding whether briefly flashed novel images contain an animal and previous work has shown that the underlying visual processing can be performed in under 150 ms. Here we used a masking paradigm to determine how information accumulates over time during such high-level categorisation tasks. As the delay between test image and mask is increased, both behavioural accuracy and differential ERP amplitude rapidly increase to reach asymptotic levels around 40-60 ms. Such results imply that processing at each stage in the visual system is remarkably rapid, with information accumulating almost continuously following the onset of activation.

Rapid categorization of natural scenes in monkeys: target predictability and processing speed.

Three monkeys performed a categorization task and a recognition task with briefly flashed natural images, using in alternation either a large variety of familiar target images (animal or food) or a single (totally predictable) target. The processing time was 20 ms shorter in the recognition task in which false alarms showed that monkeys relied on low-level cues (color, form, orientation, etc.). The 20-ms additional delay necessary in monkeys to perform the categorization task is compared with the 40-ms delay previously found for humans performing similar tasks. With such short additional processing time, it is argued that neither monkeys nor humans have time to develop a fully integrated object representation in the categorization task and must rely on coarse intermediate representations.

Spatiotemporal analyses of the N170 for human faces, animal faces and objects in natural scenes.

We assessed the specificity to human faces of the N170 ERP component in the context of natural scenes. Subjects categorized photographs containing human faces, animal faces and various objects. Spatiotemporal topography analyses were performed on the individual ERP data. ERPs elicited by animal faces were similar to human faces ERPs but with a delayed face activity. In the N170 time window, ERPs to human and animal faces had a different topography compared with object ERPs. Such data suggest that N170 generators might process various stimuli with a coarse facial organization and show the care that must be taken in comparing scalp signal to faces and other objects as they are probably generated, at least partially, by different cortical sources.

Animal and human faces in natural scenes: How specific to human faces is the N170 ERP component?

The N170 is an event-related potential component reported to be very sensitive to human face stimuli. This study investigated the specificity of the N170, as well as its sensitivity to inversion and task status when subjects had to categorize either human or animal faces in the context of upright and inverted natural scenes. A conspicuous N170 was recorded for both face categories. Pictures of animal faces were associated with a N170 of similar amplitude compared to pictures of human faces, but with delayed peak latency. Picture inversion enhanced N170 amplitude for human faces and delayed its peak for both human and animal faces. Finally, whether processed as targets or non-targets, depending on the task, both human and animal face N170 were identical. Thus, human faces in natural scenes elicit a clear but non-specific N170 that is not modulated by task status. What appears to be specific to human faces is the strength of the inversion effect.

Interaction of top-down and bottom-up processing in the fast visual analysis of natural scenes.

The influence of task requirements on the fast visual processing of natural scenes was studied in 14 human subjects performing in alternation an "animal" categorization task and a single-photograph recognition task. Target photographs were randomly mixed with non-target images and flashed for only 20 ms. Subjects had to respond to targets within 1 s. Processing time for image-recognition was 30-40 ms shorter than for the categorization task, both for the fastest behavioral responses and for the latency at which event related potentials evoked by target and non-target stimuli started to diverge. The faster processing in image-recognition is shown to be due to the use of low-level cues, but source analysis produced evidence that, regardless of the task, the dipoles accounting for the differential activity had the same localization and orientation in the occipito-temporal cortex. We suggest that both tasks involve the same visual pathway and the same decisional brain area but because of the total predictability of the target in the image recognition task, the first wave of bottom-up feed-forward information is speeded up by top-down influences that might originate in the prefrontal cortex and preset lower levels of the visual pathway to the known target features.

Is it an animal? Is it a human face? Fast processing in upright and inverted natural scenes.

Object categorization can be extremely fast. But among all objects, human faces might hold a special status that could depend on a specialized module. Visual processing could thus be faster for faces than for any other kind of object. Moreover, because face processing might rely on facial configuration, it could be more disrupted by stimulus inversion. Here we report two experiments that compared the rapid categorization of human faces and animals or animal faces in the context of upright and inverted natural scenes. In Experiment 1, the natural scenes contained human faces and animals in a full range of scales from close-up to far views. In Experiment 2, targets were restricted to close-ups of human faces and animal faces. Both experiments revealed the remarkable object processing efficiency of our visual system and further showed (1) virtually no advantage for faces over animals; (2) very little performance impairment with inversion; and (3) greater sensitivity of faces to inversion. These results are interpreted within the framework of a unique system for object processing in the ventral pathway. In this system, evidence would accumulate very quickly and efficiently to categorize visual objects, without involving a face module or a mental rotation mechanism. It is further suggested that rapid object categorization in natural scenes might not rely on high-level features but rather on features of intermediate complexity.